JP2021153284A - Transmission system, transmission terminal, and program - Google Patents

Abstract

To reduce discomfort on the quality of communication.SOLUTION: A transmission system is for a plurality of transmission terminals to perform communication via a network, and has: a transmission and reception unit that holds information on communication used for the communication; a video encoding unit that holds information on the quality of video data, voice data, or content data used for the communication; and an analysis unit that, when data transmission corresponding to the communication is cut off, analyzes the necessity of an improvement plan based on the information held by the transmission and reception unit or the information held by the video encoding unit.SELECTED DRAWING: Figure 6

Description

The present invention relates to transmission systems, transmission terminals and programs.

A conference system for conducting a remote conference with a remote location via a communication network such as the Internet is known. By the way, since the network environment is not always stable and may become unstable, communication may be interrupted or communication may be disconnected (interrupted) due to network factors. If communication is disconnected, there is no guarantee that the instability of the network environment will be resolved immediately, so if communication is resumed in the same way as before the disconnection, the disconnection may occur again due to network factors. Therefore, it is desirable that the user restarts communication by setting an appropriate communication quality, communication method, etc. before restarting.

Therefore, there is known a technique that facilitates reconnection by setting an appropriate network band when communication is interrupted (for example, Patent Document 1).

However, in the above-mentioned prior art, congestion is likely to occur when a communication means such as a wireless environment in which the network bandwidth is likely to fluctuate is used, or when the network bandwidth is narrowed such as in a TCP (Transmission Control Protocol) environment. In an environment that uses a communication method that easily affects the network bandwidth due to congestion, it is difficult to predict and estimate the network bandwidth, and even if you intend to set the network bandwidth appropriately, a situation may occur where the bandwidth value falls below that bandwidth value. There is sex. Further, in the above-mentioned conventional technique, since the user is reconnected without knowing the change of the network bandwidth setting, the quality of communication may be deteriorated unintentionally by the user when the network bandwidth is lowered.

Therefore, in the above-mentioned conventional technology, when communication is interrupted, even if an appropriate network bandwidth is set and reconnection is performed, the network bandwidth cannot be predicted or estimated again in an environment of communication means or communication method. There is a problem that disconnection may occur, and further, communication quality may be deteriorated unintentionally by the user, which may lead to discomfort to the communication itself.

The present invention has been made in view of the above, and an object of the present invention is to provide a transmission system, a transmission terminal, and a program that reduce discomfort regarding the quality of communication.

In order to solve the above-mentioned problems and achieve the object, the present invention is a transmission system for a plurality of transmission terminals to communicate via a network, and holds information on communication used for the communication. A transmission / reception unit, a video coding unit that holds information on the quality of video data, audio data, or content data used for the communication, an operation input reception unit that receives input according to a predetermined operation from a user, and the above. Based on the display control unit that controls the display of information to the user and the information held by the transmission / reception unit and the video coding unit when the data transmission corresponding to the communication is disconnected, the need for an improvement plan is determined. It is characterized by having an analysis unit for analysis.

According to the present invention, there is an effect that discomfort regarding the quality of communication can be reduced.

FIG. 1 is a diagram showing a configuration example of a transmission system according to the first embodiment. FIG. 2 is a diagram showing a hardware configuration example of the transmission terminal according to the first embodiment. FIG. 3 is a hardware configuration diagram of the transmission management system according to the first embodiment. FIG. 4 is a conceptual diagram showing an outline of communication in the transmission system according to the first embodiment. FIG. 5 is a block diagram showing an example of a functional configuration of the transmission terminal according to the first embodiment. FIG. 6 is a functional configuration diagram of the conference analysis unit 25 according to the first embodiment. FIG. 7 is a sequence diagram showing a process from the time when the data transfer is disconnected until the improvement plan for the disconnection is created. FIG. 8 is a diagram showing an example of communication information according to the first embodiment. FIG. 9 is a diagram showing an example of conference quality information according to the first embodiment. FIG. 10 is a flowchart showing the flow of analysis processing according to the first embodiment. FIG. 11 is a flowchart showing the flow of the improvement plan creation process according to the first embodiment. FIG. 12 is a sequence diagram showing a process from the creation of the improvement plan to the implementation of the improvement plan. FIG. 13 is a diagram showing an example of a list of improvement plans according to the first embodiment. FIG. 14 is a flowchart schematically showing the flow of the improvement plan creation process according to the second embodiment. FIG. 15 is a sequence diagram showing a process from the implementation of the improvement plan to the notification of the improvement after the creation of the improvement plan. FIG. 16 is a diagram showing a display example of the contents of the implemented improvement measures. FIG. 17 is a sequence diagram showing a process of returning to the setting before the improvement after the implementation of the improvement plan. FIG. 18 is a diagram showing an example of notification as to whether or not to return to the setting before improvement.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.

(First Embodiment)
<System configuration>
FIG. 1 is a diagram showing a configuration example of a transmission system according to the first embodiment. The transmission system includes a data providing system that transmits content data from one transmission terminal to the other transmission terminal in one direction via a transmission management system, and information, emotions, etc. between a plurality of transmission terminals via a transmission management system. Includes a communication system that communicates with each other. This communication system is a system for mutually transmitting information, emotions, etc. between a plurality of communication terminals (corresponding to "transmission terminal") via a communication management system (corresponding to "transmission management system"). Examples of this communication system include a video conference system, a video telephone system, a voice conference system, a voice telephone system, a screen sharing system, and the like.

In the present embodiment, a video conference system as an example of a communication system, a video conference management system as an example of a communication management system, and a video conference terminal as an example of a communication terminal are assumed, and then a transmission system, a transmission management system, and a transmission management system. A transmission terminal will be described. That is, the transmission terminal and transmission management system of the present invention are applied not only to a video conference system but also to a communication system or a transmission system.

The transmission system 1 shown in FIG. 1 includes a plurality of transmission terminals (10aa, 10ab, ..., 10dc), displays (120aa, 120ab, ..., 120dc) for each transmission terminal (10aa, 10ab, ..., 10dc), and a plurality of transmission terminals. It is constructed by a relay device (30a, 30b, 30c, 30d), a transmission management system 50, a program providing system 90, a maintenance system 100, and the like.

In the present embodiment, the "transmission terminal 10" is used when indicating an arbitrary transmission terminal among the transmission terminals (10aa, 10ab, ..., 10dc). Further, when indicating an arbitrary display among the displays (120aa, 120ab, ..., 120dc), "display 120" is used, and when indicating an arbitrary relay device among the relay devices (30a, 30b, 30c, 30d). Uses the "relay device 30".

Further, the configuration in which the transmission terminal 10 shown in FIG. 1 has the display 120 is merely an example.

The relay device 30 relays video data, audio data, and the like between a plurality of transmission terminals 10. The transmission management system 50 centrally manages login authentication from the transmission terminal 10, management of the communication status of other transmission terminals 10, management of the destination list, and the like, and the communication status of the relay device 30.

The plurality of routers (70a, 70b, 70c, 70d, 70ab, 70cd) select the optimum route of the content data. In the present embodiment, "router 70" is used when indicating an arbitrary router among routers (70a, 70b, 70c, 70d, 70ab, 70cd).

The program providing system 90 includes an HD (Hard Disk) described later in which a program for a transmission terminal for realizing various functions or various means is stored in the transmission terminal 10, and the transmission terminal 10 is used for the transmission terminal. Program can be sent. Further, the HD of the program providing system 90 also stores a relay device program for realizing various functions or various means in the relay device 30, and the relay device program can be transmitted to the relay device 30. .. Further, the HD of the program providing system 90 also stores a transmission management program for realizing various functions or various means in the transmission management system 50, and transmits the transmission management program to the transmission management system 50. Can be done.

The maintenance system 100 is a computer for maintaining, managing, or maintaining at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, and the program providing system 90. For example, when the maintenance system 100 is installed in Japan and the transmission terminal 10, the relay device 30, the transmission management system 50 or the program providing system 90 is installed overseas, the maintenance system 100 is remotely installed via the communication network 2. In addition, maintenance such as maintenance, management, and maintenance of at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, and the program providing system 90 is performed. Further, the maintenance system 100 has a model number, a serial number, a sales destination, and a maintenance inspection in at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, and the program providing system 90, without going through the communication network 2. , Or perform maintenance such as failure history management.

By the way, the transmission terminal (10aa, 10ab, 10ac, ...), The relay device 30a, and the router 70a are communicably connected by LAN2a. The transmission terminals (10ba, 10bb, 10bc, ...), The relay device 30b, and the router 70b are communicably connected by LAN2b. Further, LAN2a and LAN2b are communicably connected by a dedicated line 2ab including a router 70ab, and are constructed in a predetermined area A. For example, region A is Japan, LAN2a is built in a business office in Tokyo, and LAN2b is built in a business office in Osaka.

On the other hand, the transmission terminal (10ca, 10cc, 10cc, ...), The relay device 30c, and the router 70c are communicably connected by LAN2c. The transmission terminal 10d (a, 10db, 10dc, ...), The relay device 30d, and the router 70d are communicably connected by LAN2d. Further, LAN2c and LAN2d are communicably connected by a dedicated line 2cd including a router 70cd, and are constructed in a predetermined area B. For example, Region B is the United States, LAN2c is built within a New York office, and LAN2d is Washington D.C. C. It is built in the office of. Area A and area B are connected to each other from routers (70ab, 70cd) so as to be able to communicate with each other via the Internet 2i.

Further, the transmission management system 50 and the program providing system 90 are communicably connected to the transmission terminal 10 and the relay device 30 via the Internet 2i. The transmission management system 50 and the program providing system 90 may be installed in the area A or the area B, or may be installed in an area other than these.

In the present embodiment, the communication network 2 of the present embodiment is constructed by the LAN 2a, LAN 2b, the leased line 2ab, the Internet 2i, the leased line 2cd, the LAN 2c, and the LAN 2d. The communication network 2 may have a place where communication is performed not only by wire but also by wireless communication such as wireless LAN and short-range wireless communication.

Further, in FIG. 1, four sets of numbers shown under each transmission terminal 10, each relay device 30, transmission management system 50, router 70, and program providing system 90 are IPs (Internet) in general IPv4. Protocol) The address is shown briefly. For example, the IP address of the transmission terminal 10aa is "1.2.1.3". Further, IPv6 may be used instead of IPv4, but for the sake of brevity, the description will be made using IPv4.

In addition, each transmission terminal 10 not only communicates between a plurality of business establishments and between different rooms in the same business establishment, but also makes a call in the same room and communicates outdoors and indoors or outdoors and outdoors. May be used in. When each transmission terminal 10 is used outdoors, communication is performed by a mobile communication network or the like.

<Hardware configuration of transmission terminal>
FIG. 2 is a diagram showing a hardware configuration example of the transmission terminal 10 according to the first embodiment. The transmission terminal 10 is an example of a terminal device according to the present invention. As shown in FIG. 2, the transmission terminal 10 has a general computer configuration, for example, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, and a RAM (Random Access Memory). ) 103, flash memory 104, SSD (Solid State Drive) 105, media drive 107, operation button 108, power switch 109, network I / F111, camera 112, image pickup element I / F113, microphone 114, speaker 115, audio input / output. I / F116, display I / F117, external device connection I / F118, and bus lines 110 such as an address bus and a data bus for electrically connecting each of the above components as shown in FIG. I have.

The hardware configuration of the transmission terminal 10 shown in FIG. 2 is merely an example. For example, the transmission terminal 10 does not necessarily have a built-in microphone 114, speaker 115, camera 112, etc., and the microphone, speaker, camera, etc. may be externally attached. Further, the transmission terminal 10 may have a built-in display 120.

The CPU 101 is an arithmetic unit that realizes each function of the transmission terminal 10 by reading a program or data from the ROM 102 or the like and executing processing. The ROM 102 is a non-volatile memory for storing a program or the like of the transmission terminal 10, and is composed of, for example, a flash ROM or the like. The RAM 103 is a volatile memory used as a work area of the CPU 101. The flash memory 104 is a non-volatile memory that stores various data such as video data and audio data. The SSD 105 controls reading or writing of various data to the flash memory 104 according to the control of the CPU 101.

The media drive 107 controls reading or writing (storage) of data to a recording medium 106 such as a memory card. The operation button 108 is an input unit for performing various operations of the transmission terminal 10, and may be an input means other than the button, for example, a touch panel or the like. The power switch 109 is a switch for switching the power on / off of the transmission terminal 10. The network I / F111 is an interface such as a wired / wireless LAN that transmits / receives data using a network.

The camera 112 is a device that images a subject under the control of the CPU 101, and includes a lens and a solid-state image sensor that converts light into electric charges to digitize an image (video) of the subject. As the solid-state image sensor, CMOS (Complementary Metal Oxide Semiconductor), CCD (Charge Coupled Device), or the like is used. The image sensor I / F 113 is an interface that captures an image signal output from the image pickup camera 112 as predetermined image data. The microphone 114 inputs audio and converts it into an audio signal. The speaker 115 converts the input voice signal into voice. The audio input / output I / F captures the audio signal input from the microphone 114 as predetermined audio data according to the control of the CPU 101. Further, the output audio data is converted into an audio signal that can be reproduced by the speaker 115.

The display I / F 117 is an interface that outputs various images such as a communication destination image, a menu screen, and a setting screen to the display 120. The display 120 is a display unit composed of a liquid crystal display or an organic EL that displays an image of a subject, an operation icon, or the like. Further, the display 120 is connected to the display I / F 117 by the cable 120c. The cable 120c may be a cable for analog RGB (VGA) signals or a cable for component video. Alternatively, it may be a cable for HDMI (registered trademark) (High-Definition Multimedia Interface) or DVI (Digital Video Interactive) signal.

The external device connection I / F 118 is an interface for transmitting and receiving various data to and from an external device, and includes, for example, USB (Universal Serial Bus) and the like. External devices such as an external camera, an external microphone, and an external speaker can be electrically connected to the external device connection I / F 118 by a USB cable or the like. When an external camera is connected, the external camera is driven in preference to the built-in camera 112 according to the control of the CPU 101. Similarly, when an external microphone is connected or an external speaker is connected, the external microphone and the external speaker are given priority over the built-in microphone 114 and the built-in speaker 115 according to the control of the CPU 101. The external speaker is driven.

The recording medium 106 has a structure that allows it to be attached to and detached from the transmission terminal 10. Further, the flash memory 104 is not limited to the flash memory as long as it is a non-volatile memory that reads or writes data under the control of the CPU 101, and may be an EEPROM (Electrically Erasable and Programmable ROM) or the like.

Further, the program for the transmission terminal may be a file in an installable format or an executable format, and may be recorded and distributed on a computer-readable recording medium such as the recording medium 106.

<Hardware configuration of transmission management system>
FIG. 3 is a hardware configuration diagram of the transmission management system according to the first embodiment. The transmission management system 50 has a general computer (server) configuration, for example, CPU201, ROM202, RAM203, HD204, HDD (Hard Disk Drive) 205, media drive 207, display 208, network I / F209. , Keyboard 211, mouse 212, optical drive 214, bus line 210 and the like.

The CPU 201 is an arithmetic unit that realizes each function of the transmission management system 50 by reading a program or data from the ROM 202, HD 204, or the like and executing processing. The ROM 202 is a non-volatile memory for storing a program or the like of the external input device 40, and is composed of, for example, a flash ROM or the like. The RAM 203 is a volatile memory used as a work area of the CPU 201.

The HD204 stores various software, data, image data, audio data, and the like required for various processes executed by the CPU 201. The HDD 205 controls reading or writing of various data to the HD 204 according to the control of the CPU 201. The media drive 207 controls reading or writing of data to the media 206, which is a recording medium such as a memory card. The display 208 displays various information such as a cursor, a menu, a window, characters, an image, and a video. The display 208 may be provided outside the external input device.

The network I / F 209 is an interface for transmitting and receiving data via a network, and includes, for example, a wired LA and / or a wireless LAN. The keyboard 211 inputs keys such as characters. The mouse 212 is a means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like, and may be another pointing device such as a touch panel or a touch pad, for example. The optical drive 214 controls reading or writing of data to, for example, an optical disc 213 such as a CD (Compact Disc), a DVD, or a Blu-ray.

The external device I / F 215 is an interface for inputting / outputting various data to / from an external device, and includes, for example, a USB interface and the like. The bus line 210 transmits an address bus, a data bus, various control signals, and the like.

A program of the transmission management system 50 for controlling the external input device 40 is recorded in the ROM 202 and / or the HD 204. The program for an external input device may be a file in an installable format or an executable format, and may be recorded and distributed on a computer-readable recording medium such as media 206 or optical disk 213.

<Hardware configuration of other devices>
Since the relay device 30 has the same hardware configuration as the transmission management system 50 of FIG. 3, the description thereof will be omitted. However, the relay device program for controlling the relay device 30 is recorded in the HD 204 and / or the ROM 202. In this case as well, the relay device program may be a file in an installable format or an executable format, and may be recorded and distributed on a computer-readable recording medium such as the media 206 or the optical disk 213.

Further, since the program providing system 9 and the maintenance system 100 also have the same hardware configuration as the transmission management system 50 of FIG. 3, the description thereof will be omitted. However, in the HD204 and / or the ROM 202, a program providing program for controlling the program providing system 90 or a maintenance program for controlling the maintenance system 100 is recorded. Also in this case, the program providing program, the maintenance program, etc. are files in an installable format or an executable format, and are recorded and distributed on a computer-readable recording medium such as the media 206 or the optical disk 213. You can do it.

<Outline of communication>
FIG. 4 is a conceptual diagram showing an outline of communication in the transmission system 1 according to the first embodiment. In the transmission system 1 according to the first embodiment, content data is transmitted / received between a plurality of transmission terminals 10 via a relay device 30. At this time, as shown in FIG. 4, a management information session Sei for transmitting and receiving various management information is established between the plurality of transmission terminals 10 via the transmission management system 50. Further, a data session Sed for transmitting and receiving content data is established between the plurality of transmission terminals 10 via the relay device 30. Here, in particular, the video data transmitted / received in the data session Sed is scalable encoded data, for example, high-quality video encoded data, medium-quality video encoded data, and low-quality video. The coded data of is transmitted and received on different channels.

As a standard coding format for scalablely encoding video data, H.I. The 264 / SVC (H.264 / AVC Annex G) coding format is known. H. In the 264 / SVC coding format, the video data is converted into hierarchical data, encoded as a set of a plurality of video data having different qualities, and the coded data corresponding to the video data of each quality is output on a plurality of channels. You can send and receive. In this embodiment, this H. It is assumed that the coded data obtained by encoding the video data using the 264 / SVC coding format is transmitted and received between the plurality of transmission terminals 10.

[Embodiment]
<Functional configuration>
Next, the functional configuration of the transmission terminal 10 according to the first embodiment will be described. FIG. 5 is a block diagram showing an example of the functional configuration of the transmission terminal 10 according to the first embodiment. As shown in FIG. 5, the transmission terminal 10 includes a transmission / reception unit 12, an operation input reception unit 13, a login request unit 14, an imaging unit 15, a voice input unit 16, a voice output unit 17, a storage / reading processing unit 18, and volatile nature. It includes a storage unit 19, a non-volatile storage unit 20, a display control unit 21, a video compounding unit 22, a video coding unit 23, a band control unit 24, and a conference analysis unit 25.

The transmission / reception unit 12 transmits / receives various data (or information) to / from another transmission terminal 10, a relay device 30, a transmission management system 50, etc. via the communication network 2. The transmission / reception unit 12 is realized by, for example, a program running on the CPU 101 shown in FIG. 2 and a network I / F 111 shown in FIG. As an example, the transmission / reception unit 12 enables the exchange of session information and conference video (image / audio / conference material, etc.) data. In addition, the transmission / reception unit 12 holds information (communication information) related to communication used for communication.

The operation input receiving unit 13 is realized by the command from the CPU 101 shown in FIG. 2 and the operation button 108 and the power switch 109 shown in FIG. 2, and receives various inputs by the user. For example, when the user turns on the power switch 109 shown in FIG. 2, the operation input receiving unit 13 accepts the power on and turns on the power.

The login request unit 14 is realized by a command from the CPU 101 shown in FIG. 2, and when the power is turned on, the transmission / reception unit 12 requests the transmission management system 50 to log in via the communication network 2. The login request information indicating that effect and the current IP address of the requesting terminal are automatically transmitted. Further, when the user turns off the power switch 109 from the on state, the operation input receiving unit 13 completely turns off the power after the transmission / reception unit 12 transmits the state information indicating that the power is turned off to the transmission management system 50. To. As a result, on the transmission management system 50 side, it is possible to grasp that the transmission terminal 10 has been turned from power on to power off.

The image pickup unit 15 is realized by the command from the CPU 101 shown in FIG. 2 and the camera 112 and the image pickup element I / F 113 shown in FIG. Converts to predetermined image data with / F and outputs.

The voice input unit 16 is realized by the instruction from the CPU 101 shown in FIG. 2 and the voice input / output I / F 116 shown in FIG. 2, and the voice signal of the user or the like acquired by the microphone 114 is voiced. The input / output I / F 116 converts the audio data into predetermined audio data. The audio output unit 17 is realized by the command from the CPU 101 shown in FIG. 2 and the audio input / output I / F116 shown in FIG. 2, and the output audio data is converted into an audio signal by the audio input / output I / F116. The converted audio signal is output from the speaker 115 as audio.

The storage / reading processing unit 18 is realized by a command from the CPU 101 shown in FIG. 2 and an SSD 105 or the like shown in FIG. Alternatively, the storage / reading processing unit 18 is realized by an instruction from the CPU 101. The storage / reading processing unit 18 performs a process of storing and reading various data in the volatile storage unit 19 and the non-volatile storage unit 20. The volatile storage unit 19 is realized by, for example, the RAM 102 shown in FIG. For example, the volatile storage unit 19 can hold information only when the power is turned on. The non-volatile storage unit 20 is realized by, for example, the flash memory 104 shown in FIG. For example, the non-volatile storage unit 20 can hold information even when the power is turned off.

The display control unit 21 is realized by the command from the CPU 101 shown in FIG. 2 and the display I / F 117 shown in FIG. Further, the display control unit 21 can transmit the destination list information received from the transmission management system 50 to the display 120 to display the destination list on the display 120. Further, the display control unit 21 can output an image using an image output device connected to the transmission terminal 10. Further, for example, when the reconnection operation due to the disconnection of the data transmission is accepted, the display control unit 21 displays the improvement plan generated by the conference analysis unit 25. For example, the display control unit 21 displays an improvement plan according to the control by the conference analysis unit 25.

The video compounding unit 22 decodes the coded data transmitted from the other transmission terminal 10 via the relay device 30, and outputs the video data, audio data, and content data before coding. The video compounding unit 22 is realized, for example, by the CPU 101 shown in FIG. 2 executing a coding / decoding program (video / audio codec) included in the above-mentioned program for a transmission terminal. For example, the video compounding unit 22 can combine received video data, audio data, and content data.

The video coding unit 23 encodes the video data output from the imaging unit 15 and the audio data output from the audio output unit 17 to generate the encoded data. The video coding unit 23, in particular, regarding the coding of video data, H.A. Video data is scalablely encoded according to the 264 / SVC coding format. The video coding unit 23 is realized, for example, by the CPU 101 shown in FIG. 2 executing a coding / decoding program (video / audio codec) included in the above-mentioned program for a transmission terminal. For example, the video coding unit 23 can encode the video data, the audio data, and the content data to be transmitted. In addition, the video coding unit 23 holds information on the quality of video data, audio data, and content data used for communication.

The band control unit 24 controls the network for transmitting and receiving video data, audio data, and content data. The band control unit 24 is realized, for example, by the CPU 101 shown in FIG. 2 executing the program for the transmission terminal described above.

The conference analysis unit 25 is held by the information or video coding unit 23 held by the transmission / reception unit 12 when the data transmission (session) corresponding to communication such as a remote conference (for example, a video conference or a voice conference) is disconnected. Based on the information, analyze the need for improvement plans.

Further, when the conference analysis unit 25 determines that an improvement plan is necessary by the analysis, whether or not the information held by the transmission / reception unit 12 or the information held by the video coding unit 23 satisfies the predetermined condition information. Generate an improvement plan based on the information. Further, the conference analysis unit 25 sets the display control unit 21 so that the generated improvement plan is presented (displayed) to the user when the reconnection operation due to the disconnection of the data transmission is received from the user. Control. Further, the conference analysis unit 25 controls so that when the presented improvement plan is selected by the user, the selected improvement plan is implemented. For example, the conference analysis unit 25 controls the transmission / reception unit 12 and the video coding unit 23.

FIG. 6 is a functional configuration diagram of the conference analysis unit 25 according to the first embodiment. The conference analysis unit 25 includes a communication information acquisition unit 25a, a conference quality information acquisition unit 25b, an analysis unit 25c, a reception unit 25d, and an output unit 25e.

The communication information acquisition unit 25a acquires information related to communication used for communication (meeting) from the transmission / reception unit 12.

The conference quality information acquisition unit 25b acquires information on the quality of video data, audio data, or content data used for communication (conference) from the video coding unit 23.

When the data transmission corresponding to the communication (meeting) is disconnected (interrupted) and the communication is disconnected (interrupted), the analysis unit 25c is based on the information acquired by the conference quality information acquisition unit 25b. Analyze the need for improvements to this disconnected communication. Further, when the analysis unit 25c determines that an improvement plan is necessary by the analysis, the analysis unit 25c generates an improvement plan based on the information acquired by the conference quality information acquisition unit 25b.

The reception unit 25d receives notifications and inputs addressed to the conference analysis unit 25. For example, when the user selects the presented improvement plan, the reception unit 25d accepts the input of the selected improvement plan (selection result).

The output unit 25e controls the display control unit 21 so that the improvement plan generated by the analysis unit 25c is displayed. For example, the output unit 25e outputs the improvement plan to the display control unit 21 so that the improvement plan generated by the analysis unit 25c is displayed. Further, the output unit 25e controls the transmission / reception unit 12 and the video coding unit 23 so that the improvement plan selected by the user is implemented.

Next, with reference to FIG. 7, in the transmission system 1 according to the first embodiment, the process from the disconnection of the data transfer corresponding to the communication to the creation of the improvement plan for the disconnection will be described. FIG. 7 is a sequence diagram showing a process from the time when the data transfer is disconnected until the improvement plan for the disconnection is created. In FIG. 7, it is assumed that the communication is a conference (for example, communication in a video conference). Therefore, in the example of FIG. 7, the disconnection of the data transfer means the disconnection of the conference, and the disconnected conference is paraphrased as the disconnection conference.

Further, in the example of FIG. 7, data transfer between the transmission terminal aa and the transmission terminal db is illustrated. That is, in the example of FIG. 7, a conference (hereinafter referred to as “conference MT1”) is held between the transmission terminal aa and the transmission terminal db. Further, the user U1 shown in FIG. 7 is the owner of the transmission terminal aa.

In such a state, the transmission / reception unit 12 of the transmission terminal aa determines whether or not the data transmission has been disconnected (step S701). For example, when the transmission / reception unit 12 can detect that the data transmission has been disconnected, it determines that the data transmission has been disconnected and notifies the conference analysis unit 25 that the data transmission has been disconnected.

In such a case, the reception unit 25d of the conference analysis unit 25 receives the disconnection notification from the transmission / reception unit 12 (step S702).

Further, when the disconnection notification is received by the reception unit 25d, the communication information acquisition unit 25a acquires information (communication information) related to the communication used in the conference MT1 from the transmission / reception unit 12 (step S703).

Here, the communication information according to the first embodiment will be described with reference to FIG. FIG. 8 is a diagram showing an example of communication information according to the first embodiment. As shown in FIG. 8, the communication information held by the transmission / reception unit 12 includes information indicating each item such as "communication means", "communication method", "proxy", "communication availability", and "reason for disconnection". Is done.

The "communication means" is information indicating means used for communication for data transmission, and examples of the communication means include "wired communication" and "wireless communication". In the example of FIG. 8, the communication means "wireless" is shown. Such an example shows that in the conference MT1, data transmission is performed by the communication means “wireless communication”. The "communication method" is information indicating a protocol used for communication for data transmission, and examples of the communication method include "UDP" and "TCP". In the example of FIG. 8, the communication method "TCP" is shown. Such an example shows that data transmission is performed by the communication method "UDP" in the conference MT1.

The "proxy" is information indicating whether or not a proxy is used. In the example of FIG. 8, the proxy "none" is shown. Such an example shows an example in which data transmission is performed in the state of no proxy in the conference MT1.

"Communication capability" is information indicating whether or not communication for data transmission is possible, and for example, such information includes "link up" and "link down". In the example of FIG. 8, the communication ability "possible" is shown. Such an example shows an example in which communication for data transmission is "possible" in the conference MT1.

The "reason for disconnection" is information indicating the reason why the data transmission is disconnected, and examples of the reason include "disconnection due to poor communication with the transmission management system 50 or the relay device 30" and "disconnection due to user operation". Be done. In the example of FIG. 8, the reason for disconnection "connection lost with the relay device" is shown. Such an example shows that the reason why the data transmission is disconnected in the conference MT1 is "connection lost with the relay device".

Returning to the description of FIG. When the disconnection notification is received by the reception unit 25d, the conference quality information acquisition unit 25b encodes information (conference quality information) regarding the quality of the video data, audio data, or content data used in the conference MT1. Obtained from unit 23 (step S704).

Here, the conference quality information according to the first embodiment will be described with reference to FIG. FIG. 9 is a diagram showing an example of conference quality information according to the first embodiment. In the example of FIG. 9, the conference quality information includes information indicating the quality of the "video" data used in the conference, information indicating the quality of the "audio" data used in the conference, and information used in the conference. Information indicating the quality of "content data" is included.

Further, as the information indicating the quality, for example, items such as "resolution", "frame rate", "sampling frequency", and "bandwidth used" can be mentioned. "Resolution" indicates the resolution of the data transmitted at the conference. "Frame rate" indicates the frame rate of the data transmitted at the conference. “Sampling frequency” indicates the sampling frequency of the data transmitted at the conference. "Used band" indicates the band used for data transmission.

Then, in the example of FIG. 9, "1920 × 1080" is associated with the combination of "video" and "resolution". Such an example shows an example in which the resolution of the “video data” transmitted in the conference MT1 is “1920 × 1080”. Further, in the example of FIG. 9, "30 fps" is associated with the combination of "video" and "frame rate". Such an example shows an example in which the frame rate of the "video data" transmitted in the conference MT1 is "30 fps". Further, in the example of FIG. 9, "4000 Kbps" is associated with the combination of "video" and "used band". Such an example shows an example in which the band used for data transmission in the conference MT1 is "4000 Kbps".

Further, in the example of FIG. 9, "32 KHz" is associated with the combination of "voice" and "sampling frequency". Such an example shows an example in which the sampling frequency of the “voice data” transmitted in the conference MT1 is “32 KHz”. Further, in the example of FIG. 9, "72 Kbps" is associated with the combination of "voice" and "used band". Such an example shows an example in which the band used for data transmission in the conference MT1 is "72 Kbps".

Further, in the example of FIG. 9, "1920 × 1080" is associated with the combination of "content data" and "resolution". Such an example shows an example in which the resolution of the “content data” transmitted in the conference MT1 is “1920 × 1080”. Further, in the example of FIG. 9, "10 fps" is associated with the combination of "content data" and "frame rate". Such an example shows an example in which the frame rate of the "content data" transmitted in the conference MT1 is "10 fps". Further, in the example of FIG. 9, "2000 Kbps" is associated with the combination of "content data" and "bandwidth used". Such an example shows an example in which the band used for data transmission in the conference MT1 is "2000 Kbps".

Returning to the description of FIG. The analysis unit 25c is the communication information (communication information held by the transmission / reception unit 12) acquired by the communication information acquisition unit 25a in step S703, or the conference quality information acquired by the conference quality information acquisition unit 25b in step S704. Based on (conference quality information held by the video coding unit 23), the disconnection conference MT1 is analyzed (step S705). For example, the analysis unit 25c analyzes the necessity of improvement measures for the conference MT1 based on the communication information or the conference quality information. More specifically, the analysis unit 25c analyzes the need for improvement measures for recovering the disconnection of the data communication corresponding to the conference MT1 based on the communication information or the conference quality information.

Here, with reference to FIG. 10, the necessity of improvement measures will be described in the analysis process. FIG. 10 is a flowchart showing the flow of analysis processing according to the first embodiment. Further, FIG. 10 illustrates the analysis process in step S705 in more detail.

First, the analysis unit 25c determines whether or not the reason for disconnecting the conference MT1 is "disconnection by user operation" based on the "disconnection reason" included in the acquired communication information (step S1001). Then, when the analysis unit 25c determines that the reason for disconnecting the conference MT1 is "disconnection by user operation" (step S1001; Yes), the analysis unit 25c proposes an improvement plan based on the disconnection reason "disconnection by user operation". The necessity is analyzed (step S1003).

Here, "disconnection by user operation" means intentional disconnection by user (user U1 in the example of FIG. 7) operation, and such disconnection is, for example, disconnection due to some problem in the communication environment. No. Therefore, when the analysis unit 25c determines that the reason for disconnecting the conference MT1 is "disconnection by user operation", the analysis unit 25c obtains an analysis result that "it is not necessary to create an improvement plan".

On the other hand, when the analysis unit 25c determines that the reason why the conference MT1 is disconnected is not "disconnection by user operation" (step S1001; No), it is based on the "disconnection reason" included in the acquired communication information. , It is determined whether or not the reason why the conference MT1 is disconnected is "disconnection due to the disconnection of the conference partner" (step S1002).

Then, when the analysis unit 25c determines that the reason why the conference MT1 is disconnected is "disconnection due to disconnection by the conference partner" (step S1002; Yes), the reason for disconnection "due to the disconnection by the conference partner". Based on "disconnection", the necessity of the improvement plan is analyzed (step S1003).

Here, "disconnection due to disconnection by the conference partner" means intentional disconnection by the partner user (user b of the transmission terminal db in the example of FIG. 7), and such disconnection means, for example, in a communication environment. It is not a disconnection due to some problem. Therefore, even when the analysis unit 25c determines that the reason why the conference MT1 is disconnected is "disconnection due to disconnection by the conference partner", the analysis unit 25c obtains the analysis result that "it is not necessary to create an improvement plan".

On the other hand, when the analysis unit 25c determines that the reason for disconnecting the conference MT1 is not "disconnection due to disconnection by the conference partner" (step S1002; No), the disconnection reason "user operation of the user participating in the conference". The necessity of the improvement plan is analyzed based on "disconnection without dependence" (step S1003). For example, "disconnection without user operation of a user participating in a conference" is likely to be disconnection due to some problem in the communication environment. And since such a disconnection is not an intentional disconnection and the reason for the actual disconnection is not clear, it can be said that it is necessary to try measures to reconnect. For this reason, when the analysis unit 25c determines that the reason for disconnecting the conference MT1 is not "disconnection due to disconnection by the conference partner", the analysis result states that "it is necessary to create an improvement plan". To get.

Returning to the description of FIG. The analysis unit 25c creates an improvement measure for the conference MT1 based on the analysis result obtained by the analysis process in step S705 (step S706). Specifically, when the analysis unit 25c obtains the analysis result that "it is necessary to create an improvement plan" by the analysis process in step S705, the analysis unit 25c performs an improvement plan creation process for creating an improvement measure for the conference MT1. conduct.

Here, the improvement measure creation process will be described with reference to FIG. FIG. 11 is a flowchart showing the flow of the improvement plan creation process according to the first embodiment. Further, FIG. 11 illustrates in more detail the process of creating the improvement plan in step S706.

First, the analysis unit 25c determines whether or not communication for data transmission is possible based on the information indicated by "communication capability" included in the communication information (step S1101).

When the analysis unit 25c determines that communication for data transmission is possible (step S1101; Yes), communication for data transmission is performed based on the information indicated by the "communication means" included in the communication information. It is determined whether or not the communication means used in the above is wired (step S1103). When making such a determination, the analysis unit 25c has an internal determination criterion of "wired> wireless".

On the other hand, when the analysis unit 25c determines that communication for data transmission is not possible (step S1101; No), the analysis unit 25c makes an improvement plan (referred to as “improvement plan A1”) regarding confirmation of communication capability as an improvement plan. It is added to the list (referred to as "improvement plan list LT") (step S1102), and the process proceeds to step S1103.

Further, when the analysis unit 25c determines that the communication means used for the communication for data transmission is wired (step S1103; Yes), the information indicated by the "communication method" included in the communication information is used. Based on this, it is determined whether or not the communication method used for communication for data transmission is UDP (step S1105). When making such a determination, the analysis unit 25c has an internal determination criterion of "UDP> TCP".

On the other hand, when the analysis unit 25c determines that the communication means used for the communication for data transmission is not wired (step S1103; No), the analysis unit 25c calls it an improvement plan (“improvement plan A2”) regarding the change of the communication means. ) Is added to the improvement plan list LT (step S1104), and the process proceeds to step S1105.

Further, when the analysis unit 25c determines that the communication method used for the communication for data transmission is UDP (step S1105; Yes), the analysis unit 25c is based on the "used band" included in the conference quality information. , It is determined whether or not the information regarding the used band (for example, the total of the used band) is within a predetermined threshold value (for example, "2000 Kbps") (step S1107). When making such a determination, the analysis unit 25c has a threshold value of "2000 Kbps" inside.

On the other hand, when the analysis unit 25c determines that the communication method used for communication for data transmission is not UDP (step S1105; No), it is referred to as an improvement plan (“improvement plan A3”) regarding the change of the communication method. ) Is added to the improvement plan list LT (step S1106), and the process proceeds to step S1107.

Further, when the analysis unit 25c determines that the information regarding the used band (for example, the total of the used band) is within a predetermined threshold value (for example, "2000 Kbps") (step S1107; Yes), it has been added so far. A final improvement plan is created based on the improvement plan (step S1109).

On the other hand, when the analysis unit 25c determines that the information regarding the used bandwidth (for example, the total of the used bandwidth) is not within a predetermined threshold value (for example, "2000 Kbps") (step S1107; No), the analysis unit 25c relates to the change of the conference quality. An improvement plan (referred to as “improvement plan A4”) is added to the improvement plan list LT (step S1108), and the process proceeds to step S1109.

The analysis unit 25c can extract an improvement plan according to the determination result in each of the above steps from the candidates for the improvement plan, and add the extracted improvement plan to the improvement plan list LT.

Here, an example of step S1109 will be described. The analysis unit 25c assigns a priority to each of the improvement plans added so far, and controls the improvement plan list LT so that the improvement plan is displayed according to the given priority. For example, the analysis unit 25c assigns a priority to each of the improvement proposals added so far according to the order of addition to the improvement proposal list LT. For example, the analysis unit 25c assigns a higher priority to the improvement proposals that are added to the improvement proposal list LT in the earliest order. Then, the analysis unit 25c generates, for example, an improvement proposal list LT in which improvement proposals are listed from the top in descending order of priority. Alternatively, the analysis unit 25c may generate a list of improvement proposals in which only a predetermined number of improvement proposals having a high priority are displayed. Further, for example, when the analysis unit 25c generates an improvement plan list LT in which improvement plans are listed from the top in descending order of priority, each improvement plan is displayed in a list so that the priority can be visually recognized. Such an improvement plan LT may be generated. The priority here indicates the high priority to be executed.

The improvement proposal displayed in the improvement proposal list LT is controlled so as to be selectable by the user. For example, the improvement plan displayed in the improvement plan list LT is controlled so that the improvement plan to be implemented can be selected by using the check box.

Next, with reference to FIG. 12, in the transmission system 1 according to the first embodiment, the process from the creation of the improvement plan to the implementation of the improvement plan will be described. FIG. 12 is a sequence diagram showing a process from the creation of the improvement plan to the implementation of the improvement plan. The process shown in FIG. 12 is a process performed by the transmission terminal aa following step S706 in FIG. 7.

For example, the operation input receiving unit 13 of the transmission terminal aa determines whether or not the input of the reconnection operation is received from the user U1 (step S1201). For example, when the operation input reception unit 13 receives the input of the reconnection operation from the user U1, the operation input reception unit 13 notifies the conference analysis unit 25 that the reconnection operation has been performed.

In such a case, the reception unit 25d of the conference analysis unit 25 receives the reconnection notification from the operation input reception unit 13, and the output unit 25e receives the reconnection notification, and the analysis unit 25c in step S706. The display control unit 21 is controlled to display the improvement plan (improvement plan list LT) generated by (step S1202). For example, the output unit 25e outputs the improvement plan for displaying the improvement plan generated by the analysis unit 25c to the display control unit 21.

Then, the display control unit 21 displays the improvement plan (improvement plan list LT) output by the output unit 25e on the display 120 (step S1203). That is, the display control unit 21 presents the improvement plan (improvement plan list LT) output by the output unit 25e to the user U1 via the display 120.

Here, the improvement proposal list LT according to the first embodiment will be described with reference to FIG. FIG. 13 is a diagram showing an example of the improvement plan list LT according to the first embodiment. For example, the improvement proposal list LT is displayed in any of the embodiments of FIGS. 13 (a) to 13 (c).

FIG. 13A shows how the added improvement plans are listed from the top according to the priority. As described above, the analysis unit 25c assigns a higher priority to the improvement proposals added to the improvement proposal list LT in the order of earlier addition, and the improvement proposal list is displayed in a list from the top in the order of the given priority. LT may be generated. Therefore, FIG. 13A corresponds to this example. Following the example of FIG. 11, for example, the analysis unit 25c has a priority of "1" for the improvement plan A1, a priority of "2" for the improvement plan A2, and a priority of "3" for the improvement plan A3. , It is assumed that the priority "4" is given to the improvement plan A4. In such a case, as shown in FIG. 13A, the analysis unit 25c generates an improvement proposal list LT in which the improvement proposals A1 to A4 are listed from above, and displays the improvement proposal list LT.

Further, FIG. 13B shows a state in which only a predetermined number of improvement proposals having a higher priority among the added improvement proposals are displayed. In FIG. 13B, as a simple example, only the improvement proposal having the highest priority among the added improvement proposals is displayed. As described above, the analysis unit 25c may generate a list of improvement proposals in which only a predetermined number of improvement proposals having a high priority are displayed. Therefore, FIG. 13B corresponds to this example. Following the example of FIG. 11, for example, the analysis unit 25c has a priority of "1" for the improvement plan A1, a priority of "2" for the improvement plan A2, and a priority of "3" for the improvement plan A3. , It is assumed that the priority "4" is given to the improvement plan A4. In such a case, as shown in FIG. 13B, the analysis unit 25c generates an improvement plan list LT in which only the improvement plan A1 is displayed and displays it.

Further, FIG. 13C shows how each improvement plan is displayed in a list so that the priority order can be visually recognized. As described above, the analysis unit 25c may generate an improvement plan list LT in which each improvement plan is displayed in a list so that the priority order can be visually recognized. Therefore, FIG. 13 (c) corresponds to this example. Following the example of FIG. 11, for example, the analysis unit 25c has a priority of "1" for the improvement plan A1, a priority of "2" for the improvement plan A2, and a priority of "3" for the improvement plan A3. , It is assumed that the priority "4" is given to the improvement plan A4.

In such a case, the analysis unit 25c unifies the character color of the text "high recommendation level" and the character color of the text "to the network ..." indicating the content of the improvement plan A1 with the character color R. By displaying it, it is possible to visually recognize that the improvement plan A1 has the highest priority. In addition, the analysis unit 25c displays the character color of the text "Medium recommendation" and the character color of the text "For wired connection ..." indicating the content of the improvement plan A2 in a unified state with the character color Y. By doing so, it is possible to visually recognize that the priority of the improvement plan A2 is medium.

Further, the analysis unit 25c displays the character color of the text "Medium recommendation" and the character color of the text "From TCP method ..." indicating the content of the improvement plan A3 in a unified state with the character color Y. By doing so, it is possible to visually recognize that the priority of the improvement plan A3 is medium. Further, the analysis unit 25c displays the character color of the text "low recommendation level" and the character color of the text "communication ..." indicating the content of the improvement plan A4 in a unified state with the character color G. This makes it possible to visually recognize that the priority of the improvement plan A4 is medium.

Returning to the description of FIG. The operation input receiving unit 13 determines whether or not the input of the selection operation for selecting one of the improvement plans is received from the user U1 in the state where the improvement plan is displayed as shown in FIG. (Step S1204). For example, when the operation input receiving unit 13 receives the input of the selection operation from the user U1, the operation input receiving unit 13 transmits the selection result (information indicating the selected improvement plan among the improvement plans) corresponding to the selection operation to the conference analysis unit 25. Notice.

In such a case, the reception unit 25d of the conference analysis unit 25 receives the selection result (information indicating the selected improvement plan among the improvement plans) from the operation input reception unit 13, and the output unit 25e receives the selected improvement plan. The transmission / reception unit 12 and the video coding unit 23 are controlled so that For example, the output unit 25e outputs information indicating the improvement plan for implementing the selected improvement plan to the transmission / reception unit 12 and the video coding unit 23.

Further, in response to such control, for example, the transmission / reception unit 12 changes the communication setting, and the video coding unit 23 changes the conference quality (step S1206).

For example, it is assumed that the user U1 selects the improvement plan A2 from the improvement plans A1 to A4 while the improvement plan list LT is displayed in the aspect of FIG. 13A. Specifically, it is assumed that the user U1 selects the improvement plan A2 of "switching to a wired connection" by checking and inputting the check box associated with "switching to a wired connection". In such a case, the transmission / reception unit 12 implements the improvement plan A2 of "switching to a wired connection" according to the control from the output unit 25e. That is, the transmission / reception unit 12 changes the communication setting.

Further, for example, it is assumed that the user U1 selects the improvement plan A4 from the improvement plans A1 to A4 while the improvement plan list LT is displayed in the aspect of FIG. 13A. Specifically, the improvement plan A4 that the user U1 "deletes the amount of data used for communication" by checking and inputting the check box associated with "delete the amount of data used for communication". Is selected. In such a case, the video coding unit 23 implements the improvement plan A4 of "deletes the amount of data used for communication" in response to the control from the output unit 25e. That is, the video coding unit 23 changes the conference quality.

<Summary>
According to the transmission system 1 (transmission terminal 10) according to the first embodiment, when the data transmission corresponding to the communication is disconnected, the information or the video coding unit 23 held by the transmission / reception unit 12 holds the information. Analyze the need for improvement proposals based on the information provided. Then, when it is determined that an improvement plan is necessary, the transmission system 1 is based on whether or not the information held by the transmission / reception unit 12 or the information held by the video coding unit 23 satisfies predetermined condition information. And generate (create) an improvement plan.

Further, the transmission system 1 controls so that the generated improvement plan is presented to the user when the reconnection operation due to the disconnection of the data transmission is accepted from the user. Further, the transmission system 1 controls so that when the presented improvement plan is selected by the user, the selected improvement plan is implemented.

For this reason, the transmission system 1 according to the first embodiment prevents disconnection from occurring again even in an environment of a communication means or a communication method in which it is difficult to predict or estimate the network bandwidth, and when the user himself / herself reconnects. It is possible to select the improvement method of. As a result, the transmission system 1 can reduce the discomfort regarding the quality of communication.

(Second Embodiment)
Next, the second embodiment will be described.

In the first embodiment, the flow was "creation of improvement plan"-> "presentation of improvement plan to user"-> "user selects improvement plan"-> "implementation of improvement plan". In the second embodiment, "improvement plan creation"-> "automatic improvement plan implementation"-> "presentation of action items to the user"-> (at the end of the meeting) "return to the setting before the improvement plan implementation"-> (return) Case) The difference from the first embodiment is that the flow is "return the setting to before improvement". Hereinafter, in the description of the second embodiment, the description of the same part as that of the first embodiment will be omitted, and the parts different from the first embodiment will be described.

Here, FIG. 14 is a flowchart schematically showing the flow of the improvement plan creation process according to the second embodiment. FIG. 14 describes in more detail the improvement plan creation process in step S706 shown in FIG. 7 of the first embodiment. Generally, the analysis unit 25c of the conference analysis unit 25 creates an improvement plan to be implemented from the communication information and the conference quality information.

The analysis unit 25c of the conference analysis unit 25 starts creating an improvement plan (step S1401).

First, the analysis unit 25c of the conference analysis unit 25 confirms the communication capability based on the communication information (step S1402). When communication is "impossible" (No in step S1402), the analysis unit 25c of the conference analysis unit 25 needs to be in a communicable state first, so that an improvement in communication capability is added (step S1403). , Step S1404. The actual improvement will be considered in combination with the confirmation result of the communication means described later.

On the other hand, when the communication is "possible" (Yes in step S1402), the analysis unit 25c of the conference analysis unit 25 implements the improvement from the confirmation items after step S1404.

Next, the analysis unit 25c of the conference analysis unit 25 confirms whether or not to use another communication means based on the communication information (step S1404). For example, when the current communication means is "wired" from the communication information, the analysis unit 25c of the conference analysis unit 25 confirms whether wireless communication can be used as another communication means. The analysis unit 25c of the conference analysis unit 25 determines whether to use another communication means based on the presence / absence of the SSID for wireless connection, the presence / absence of the set value of the security information, the ability to acquire the IP address, and the like.

When the analysis unit 25c of the conference analysis unit 25 is “possible” to use another communication means (Yes in step S1404), the analysis unit 25c adds a change in the communication means to the improvement plan (step S1405), and proceeds to step S1406.

On the other hand, when the analysis unit 25c of the conference analysis unit 25 is “impossible” to use another communication means (No in step S1404), the analysis unit 25c proceeds to step S1406 as it is.

The analysis unit 25c of the conference analysis unit 25 is in the case of "impossible" in the above-mentioned confirmation of communication capability (No in step S1402) and in the case of "other means cannot be used" in the confirmation of the communication means (No). In step S1404 No), regardless of the confirmation result after that, the "automatic improvement plan implementation" in the flow of the present embodiment cannot be performed. Therefore, the improvement plan is not automatically implemented, and the improvement plan is presented to the user.

Example 1: In the case of "impossible" in the confirmation of communication capability by wire (No in step S1402) and "No other means available" in the confirmation of the communication means (No in step S1404), the conference The analysis unit 25c of the analysis unit 25 makes the following presentations.
・ Present "I want you to check the connection of the wired LAN cable of the terminal".
・ Present that "I want the terminal to change the settings so that it can be connected wirelessly."

Example 2: When the confirmation of communication capability by wireless is "impossible" (No in step S1402) and when the confirmation of communication means is "unusable by other means" (No in step S1404), the conference is held. The analysis unit 25c of the analysis unit 25 makes the following presentations.
・ Present "I want you to try connecting a wired LAN cable to the terminal".
・ Present that "I want you to change the access point for wireless connection and try it."

Next, the analysis unit 25c of the conference analysis unit 25 confirms the communication method of the communication information and confirms whether or not another communication method is used (step S1406). For example, when the analysis unit 25c of the conference analysis unit 25 is currently communicating with UDP, the port to be used by TCP is open, or conversely, when communicating with TCP, the port to be used by UDP is open. Judge from whether it is open or not.

When the analysis unit 25c of the conference analysis unit 25 is “possible” to use another communication method (Yes in step S1406), the analysis unit 25c adds a change in the communication method to the improvement plan (step S1407), and proceeds to step S1408.

On the other hand, when the analysis unit 25c of the conference analysis unit 25 is “impossible” to use another communication method (No in step S1406), the analysis unit 25c proceeds to step S1408 as it is.

Next, the analysis unit 25c of the conference analysis unit 25 confirms the conference quality based on the conference quality information, and confirms whether the conference quality can be lowered (step S1408). For example, with respect to the setting of the band used for the conference video, if the available band is low, there is a high possibility that the conference will be disconnected. Therefore, the analysis unit 25c of the conference analysis unit 25 sets the conference quality below the available band. Judge whether it can be lowered.

Basically, the analysis unit 25c of the conference analysis unit 25 confirms the conference quality in the following form.
1. 1. Bandwidth used> Bandwidth used-Basically, "conference quality can be degraded".
-However, as shown below, if the current conference quality is sufficiently degraded, "the conference quality cannot be degraded".
-When the resolution is reduced to the extent that the visibility as an image is reduced, such as 320 x 180.
-When the frame rate is low enough to be unrecognizable as an image, such as 5 fps.
2. When the used band ≤ the used band ・ Basically, "conference quality cannot be degraded".

When the analysis unit 25c of the conference analysis unit 25 “can deteriorate the conference quality” (Yes in step S1408), the analysis unit 25c adds a change in the conference quality to the improvement plan (step S1409), and proceeds to step S1410.

On the other hand, the analysis unit 25c of the conference analysis unit 25 proceeds to step S1410 as it is in the case of "the conference quality cannot be deteriorated" (No in step S1408).

Finally, the analysis unit 25c of the conference analysis unit 25 creates a final improvement plan (step S1410).

The analysis unit 25c of the conference analysis unit 25 follows a predetermined policy / policy when finally creating an improvement plan in the processing flow as shown in FIG. For example, when improvement plans for "communication means", "communication method", and "meeting quality" are added, the analysis unit 25c of the conference analysis unit 25 creates an improvement plan as shown below.
1. 1. Implement all possible improvements to increase the chances of a successful reconnection.
-Create as an improvement plan to improve "communication means", "communication method", and "meeting quality".
2. In order to keep the number of changes to a minimum, implement the one with the highest priority according to a predetermined priority (when the priority is "improvement of communication means">"improvement of communication method">"improvement of meeting quality").
-Create as an improvement plan to implement only the improvement of "communication means", which has the highest priority.

When the analysis unit 25c of the conference analysis unit 25 creates an improvement plan as described above, the improvement is carried out according to the improvement plan.

Next, in the transmission system 1, after the above-mentioned improvement plan is created, the process from the implementation of the improvement plan to the notification of the improvement will be described. Here, FIG. 15 is a sequence diagram showing a process from the implementation of the improvement plan to the notification of the improvement after the creation of the improvement plan.

As shown in FIG. 15, after creating the improvement measure shown in FIG. 7 (step S706), the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa creates an improvement plan (step S707).

Next, the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa stores the communication information and the conference quality information before improvement in the volatile storage unit 19 (step S708).

Next, the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa implements the improvement measures based on the created improvement plan (step S709). More specifically, the conference analysis unit 25 of the transmission terminal 10aa changes the communication setting of the transmission / reception unit 12 of the transmission terminal 10aa based on the created improvement plan. Further, the conference analysis unit 25 of the transmission terminal 10aa changes the conference quality of the video coding unit 23 of the transmission terminal 10aa based on the created improvement plan.

After that, the transmission / reception unit 12 of the transmission terminal 10aa starts the conference (step S710).

Next, the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa presents the content of the implemented improvement measures (step S711). More specifically, the conference analysis unit 25 of the transmission terminal 10aa causes the display control unit 21 of the transmission terminal 10aa to notify (display) the content of the implemented improvement measures to the user.

Here, FIG. 16 is a diagram showing a display example of the contents of the implemented improvement measures. As shown in FIG. 16, the display control unit 21 creates an improvement plan list LT showing the contents implemented as the improvement plan, and displays it on the display 120 by superimposing it on the conference image after the conference is started. The display control unit 21 may always display the improvement plan list LT indicating the contents implemented as the improvement plan during the meeting, or may delete the improvement plan list LT after a few seconds.

Next, in the transmission system 1, after the above-mentioned improvement plan is implemented, the user is notified at the end of the meeting whether or not to return to the setting before the improvement, and a process for returning to the setting before the improvement will be described. Here, FIG. 17 is a sequence diagram showing a process of returning to the setting before the improvement after the implementation of the improvement plan.

As shown in FIG. 17, when the transmission / reception unit 12 of the transmission terminal 10aa receives the signal for ending the conference described with reference to FIG. 15 from the transmission management system 50, the transmission / reception unit 12 ends the conference (step S712).

Next, the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa presents a notification as to whether or not to return to the setting before the improvement (step S713). More specifically, the conference analysis unit 25 of the transmission terminal 10aa causes the display control unit 21 of the transmission terminal 10aa to notify (display) on the display 120 whether or not to return to the setting before the improvement. In response to the displayed notification, the user inputs whether or not to return to the setting before the improvement plan.

Here, FIG. 18 is a diagram showing an example of notification as to whether or not to return to the setting before improvement. In the notification example shown in FIG. 18, the display control unit 21 displays the improvement plan LT indicating the changed improvement plan on the display 120, and presses the buttons B1 and B2 whether to return to the setting before reconnection (before improvement). The user is made to select by selection.

The reception unit 25d of the conference analysis unit 25 of the transmission terminal 10aa accepts the input selection via the operation input reception unit 13 (step S714).

When returning to the setting before the improvement, the analysis unit 25c of the conference analysis unit 25 of the transmission terminal 10aa changes the setting based on the communication information before the improvement and the conference quality information stored in the volatile storage unit 19 (step S715). ). More specifically, the conference analysis unit 25 of the transmission terminal 10aa changes the communication setting of the transmission / reception unit 12 of the transmission terminal 10aa based on the setting before the improvement. Further, the conference analysis unit 25 of the transmission terminal 10aa changes the conference quality of the video coding unit 23 of the transmission terminal 10aa based on the settings before the improvement.

As described above, according to the present embodiment, the transmission system 1 according to the second embodiment prevents disconnection from occurring again even in an environment of a communication means or a communication method in which it is difficult to predict or estimate the network bandwidth, and the user. You can allow yourself to choose how to improve when reconnecting. As a result, the transmission system 1 can reduce the discomfort regarding the quality of communication.

Although each embodiment of the present invention has been described above, each of the above embodiments is presented as an example and is not intended to limit the scope of the invention. The new embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the gist of the invention. Each of the above embodiments and modifications thereof is included in the scope and gist of the invention, and is also included in the scope of the invention described in the claims and the equivalent scope thereof.

1 Transmission system 10 Transmission terminal 12 Transmission / reception unit 13 Operation input reception unit 14 Login request unit 15 Imaging unit 16 Audio input unit 17 Audio output unit 18 Storage / reading processing unit 19 Volatile storage unit 20 Non-volatile storage unit 21 Display control unit 22 Video compounding unit 23 Video coding unit 24 Band control unit 25 Conference analysis unit 25a Communication information acquisition unit 25b Conference quality information acquisition unit 25c Analysis unit 25d Reception unit 25e Output unit 30 Relay device 50 Transmission management system

Japanese Patent No. 6515436

Claims (8)

A transmission system for multiple transmission terminals to communicate via a network.
A transmitter / receiver that holds information about the communication used for the communication,
A video coding unit that holds information on the quality of video data, audio data, or content data used in the communication, and
An analysis unit that analyzes the need for improvement proposals based on the information held by the transmission / reception unit or the information held by the video coding unit when the data transmission corresponding to the communication is disconnected.
A transmission system characterized by having. When the analysis unit determines that the improvement plan is necessary, whether or not the information held by the transmission / reception unit or the information held by the video coding unit satisfies predetermined condition information. To generate the above improvement plan based on
The transmission system according to claim 1. When the reconnection operation due to the disconnection of the data transmission is received from the user, the analysis unit controls so that the generated improvement plan is presented to the user.
The transmission system according to claim 2. When the presented improvement plan is selected by the user, the analysis unit controls so that the selected improvement plan is implemented.
The transmission system according to claim 3. The analysis unit
The information before improvement held by the transmission / reception unit or the information held by the video coding unit is stored in the storage unit.
When it is determined by the analysis that the improvement plan is necessary, the information held by the transmission / reception unit or the information held by the video coding unit satisfies the predetermined condition information. Generate an improvement plan and
Implement the created improvement plan and
Present the details of the improvement measures implemented,
The transmission system according to claim 1. The analysis unit
Present a notification as to whether or not to return to the setting before improvement,
When it is selected to return to the setting before the improvement, the setting is returned to the setting before the improvement based on the information held by the transmitting / receiving unit or the information held by the video coding unit stored in the storage unit.
The transmission system according to claim 5. The transmission terminal in a transmission system for a plurality of transmission terminals to communicate via a network.
A transmitter / receiver that holds information about the communication used for the communication,
A video coding unit that holds information on the quality of video data, audio data, or content data used in the communication, and
An analysis unit that analyzes the need for improvement proposals based on the information held by the transmission / reception unit or the information held by the video coding unit when the data transmission corresponding to the communication is disconnected.
A transmission terminal characterized by having. The transmission terminal in a transmission system for a plurality of transmission terminals to communicate via a network,
A transmitter / receiver that holds information about the communication used for the communication,
A video coding unit that holds information on the quality of video data, audio data, or content data used in the communication, and
To function as an analysis unit that analyzes the need for improvement proposals based on the information held by the transmission / reception unit or the information held by the video coding unit when the data transmission corresponding to the communication is disconnected. program.

Images