WO2017056315A1

WO2017056315A1 - Communication-quality measurement method and system and communication terminal device

Info

Publication number: WO2017056315A1
Application number: PCT/JP2015/078048
Authority: WO
Inventors: 亮張; 藤井　輝也
Original assignee: ソフトバンク株式会社
Priority date: 2015-10-02
Filing date: 2015-10-02
Publication date: 2017-04-06

Abstract

Provided are a communication-quality measurement method and system and a communication terminal device that are capable of measuring, with high accuracy, the connection rate of voice communication lines in a mobile communication network without an operation being performed by a user to make a call or receive a call for voice communication. A plurality of SMS messages are transmitted via the mobile communication network to one or a plurality of communication terminal devices at a predetermined transmission set time. For each of the plurality of SMS messages, it is determined whether the communication terminal devices have received the SMS message within a predetermined initial-transmission determination time set with respect to the transmission set time. The ratio of the number of SMS messages received within the initial-transmission determination time to the total number of the plurality of SMS messages is calculated as the connection rate of the voice communication lines.

Description

Communication quality measurement method and system, and communication terminal device

The present invention relates to a method and system for measuring the quality of communication via a mobile communication network, and a communication terminal device used for measuring the communication quality.

Conventionally, voice communication is performed between a server such as a voice response device and a communication terminal device such as a mobile phone via a mobile communication network at a predetermined measurement time, which is transmitted and received via a voice communication line. A method of measuring communication quality such as voice communication quality (see, for example, Patent Document 1, Non-Patent Document 1, and Non-Patent Document 2) is known.

Japanese Unexamined Patent Publication No. 2015-0505561

For communication via the mobile communication network, there is a demand for measuring the connection rate of a voice communication line with high accuracy without requiring the user to make or receive voice communication.

The communication quality measurement method according to an aspect of the present invention includes transmitting an SMS message to each of one or a plurality of communication terminal devices via a mobile communication network at a predetermined transmission set time, For each of the plurality of SMS messages, determining whether or not the communication terminal apparatus has received the SMS message within a predetermined initial transmission determination time set based on the transmission setting time; and the plurality of SMS messages Calculating a ratio of the number of SMS messages received within the initial transmission determination time as a connection rate of the voice communication line.
A communication quality measurement method according to another aspect of the present invention includes receiving a plurality of SMS messages transmitted at a predetermined transmission set time preset from one or a plurality of communication terminal devices via a mobile communication network. For each of the plurality of SMS messages, it is determined whether or not the SMS message has been received within a predetermined initial transmission determination time set based on the transmission setting time, and the total number of the plurality of SMS messages Calculating a ratio of the number of SMS messages received within the initial transmission determination time as a connection rate of the voice communication line.
A communication quality measurement method according to still another aspect of the present invention receives a plurality of SMS messages transmitted at a predetermined transmission set time preset from one or a plurality of communication terminal devices via a mobile communication network. And, when receiving the SMS message, returning a receipt confirmation response to the SMS message, and for each of the plurality of SMS messages, within a predetermined initial transmission judgment time set based on the transmission set time Determining whether or not the communication terminal apparatus has received the reception confirmation response, and the number of SMS messages for which the reception confirmation response has been received within the initial transmission determination time with respect to the total number of the plurality of SMS messages. Calculating a ratio as a connection rate of the voice communication line.
In each of the methods, the plurality of SMS messages are transmitted and received between the communication terminal device and the server via the mobile communication network, and the connection ratio of the voice communication line including the setting information of the transmission setting time is measured. You may further include delivering a schedule to the said server and the said communication terminal device.

A communication quality measurement system according to an aspect of the present invention includes: a unit configured to transmit a plurality of SMS messages via a mobile communication network at a predetermined transmission setting time set in advance to one or a plurality of communication terminal devices; For each of the plurality of SMS messages, means for determining whether or not the communication terminal apparatus has received the SMS message within a predetermined initial transmission determination time set based on the transmission setting time; and the plurality of SMS messages Means for calculating, as a connection rate of the voice communication line, a ratio of the number of SMS messages received within the initial transmission determination time to the total number of messages.
A communication quality measurement system according to another aspect of the present invention comprises: means for receiving a plurality of SMS messages transmitted at a predetermined transmission set time preset from one or a plurality of communication terminal devices via a mobile communication network; , For each of the plurality of SMS messages, a means for determining whether or not the SMS message has been received within a predetermined initial transmission determination time set based on the transmission set time, and a total number of the plurality of SMS messages Means for calculating a ratio of the number of SMS messages received within the initial transmission judgment time as a connection rate of the voice communication line.
In addition, a communication quality measurement system according to still another aspect of the present invention includes a plurality of SMS messages transmitted at a predetermined transmission set time preset from each of one or a plurality of communication terminal devices via a mobile communication network. A means for receiving, a means for sending back a receipt confirmation response to the SMS message when the SMS message is received, and a predetermined initial transmission determination time set based on the set transmission time for each of the plurality of SMS messages. Means for determining whether or not the communication terminal apparatus has received the reception confirmation response, and the number of SMS messages for which the reception confirmation response has been received within the initial transmission determination time with respect to the total number of the plurality of SMS messages. Means for calculating a ratio of the above as a connection rate of the voice communication line.
In each of the systems, the plurality of SMS messages are transmitted and received between the communication terminal device and the server via the mobile communication network, and the connection rate of the voice communication line including the setting information of the transmission setting time is measured. You may further provide the means to deliver a schedule to the said server and the said communication terminal device.

A communication terminal device according to an aspect of the present invention is configured based on a means for receiving an SMS message transmitted from a server via a mobile communication network at a preset predetermined transmission set time, and the transmission set time as a reference. Means for transmitting communication log information capable of determining whether or not the SMS message has been received within a predetermined initial transmission determination time to the server.
A communication terminal device according to another aspect of the present invention includes means for transmitting an SMS message to a server via a mobile communication network at a predetermined transmission set time set in advance for measuring a connection rate of a voice communication line. Prepare.
A communication terminal device according to another aspect of the present invention receives means for transmitting an SMS message to a server via a mobile communication network at a predetermined transmission set time, and a reception confirmation response to the SMS message. Means for transmitting to the server communication log information capable of determining whether or not the communication terminal apparatus has received the reception confirmation response within a predetermined initial transmission determination time set on the basis of the transmission set time. .
Each of the communication terminal devices may further comprise means for receiving from the server a measurement schedule of a voice communication line connection rate including the setting information of the transmission setting time.

According to the present invention, the connection rate of the voice communication line of the mobile communication network can be accurately measured without accompanying the user's operation of making or receiving voice communication.

Explanatory drawing which shows an example of a principal part structure of the whole communication system provided with the communication quality measurement system which concerns on embodiment of this invention. The sequence diagram which shows an example of the communication quality measurement which measures the connection rate of the voice communication line of a mobile communication network by the SMS communication of a downlink direction transmitted from a SMS communication server toward a communication terminal device in the communication system which concerns on this embodiment. The flowchart which shows an example of the process in the communication terminal device in the communication quality measurement of FIG. The sequence diagram which shows an example of the communication quality measurement which measures the connection rate of the voice communication line of a mobile communication network by the SMS communication of the uplink direction transmitted to a SMS communication server from a communication terminal device in the communication system which concerns on this embodiment. Sequence showing another example of the communication quality measurement for measuring the connection rate of the voice communication line of the mobile communication network by the SMS communication in the uplink direction transmitted from the communication terminal device to the SMS communication server in the communication system according to the present embodiment. Figure. The flowchart which shows an example of the process in the communication terminal device in the communication quality measurement of FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is an explanatory diagram showing an example of a main configuration of the entire communication system including the communication quality measurement system according to the embodiment of the present invention. In FIG. 1, the communication system of this embodiment includes a communication terminal device 100 that can be used by a user, and SMS (short message service) in which retransmission control is performed via the mobile communication network (mobile phone network) 200 by the communication terminal device 100. And a communication quality measurement system 400 that performs processing for measuring the connection rate of the voice communication line of the mobile communication network 200 using transmission / reception of the above message (hereinafter referred to as “SMS message”). Here, the SMS is a service that can transmit a relatively short message (for example, a 70-byte message) having a size limit to the terminal identification information (for example, a telephone number) of the communication terminal apparatus 100. In the following description, communication in which an SMS message is transmitted and received is referred to as “SMS communication”.

The communication quality measurement system 400 may be configured by a single server or network device, or may be configured by combining a plurality of servers or network devices.

In addition to the base station 210, the mobile communication network 200 includes a circuit switching network having a HLR (subscriber information database), a RAN (wireless network) control device, a GMSC (relay switch), a VMSC (subscriber switch), and the like. A packet switching network having a (relay packet switch), an SGSN (subscriber packet switch), or the like is included. The cell of the mobile communication network 200 is any one of various cells such as a macro cell, a micro cell, a femto cell, and a pico cell having different sizes.

The communication quality measurement system 400 illustrated in FIG. 1 includes an SMS communication server 410 and a distribution / analysis server 420 as network side communication devices. The SMS communication server 410 can perform SMS communication with the communication terminal device 100 and record a predetermined network side communication log when performing communication quality measurement for measuring the connection rate of the voice communication line. (Network device). The distribution / analysis server 420 manages and distributes the measurement schedule of the connection rate of the voice communication line, analyzes the communication log information received from the communication terminal device 100 and the SMS communication server, and calculates various communication quality index values. It is a network side communication device (network device) that can be used.

The communication terminal apparatus 100 performs SMS communication and voice communication with the SMS communication server 410 of the communication quality measurement system 400, other communication terminal apparatuses, and the like via the circuit switching network of the mobile communication network 200 including the base station 210. be able to.

The communication terminal apparatus 100 uses the mobile communication network 200 to measure terminal-side measurement data (hereinafter referred to as “terminal-side measurement data”) including communication log information used for communication quality measurement for measuring the connection rate of a voice communication line. ) Can be transmitted to the distribution / analysis server 420, or the measurement schedule can be distributed from the distribution / analysis server 420. The measurement schedule includes, for example, measurement condition information and measurement content information. The measurement conditions include, for example, a measurement start set time for starting a series of measurements including one or more transmissions for measuring communication quality, the number of transmissions per transmission, a transmission interval, and the like. The measurement content includes information for designating the type of index value of the communication quality to be measured (for example, the connection rate of the voice communication line).

Further, the communication terminal device 100 accesses the Internet 500 via the mobile communication network 200 including the base station 210 or a wireless LAN access point device 510 such as WiFi (Wireless Fidelity), and transmits communication log information to the distribution / analysis server 420. It is referred to as “terminal-side measurement data including the above”. ) Or the distribution of the measurement schedule from the distribution / analysis server 420.

The communication terminal device 100 is, for example, a mobile communication terminal such as a mobile phone, a smartphone, or a PHS that can perform voice communication, or a tablet PC, and performs SMS communication, voice communication, mail transmission / reception with a communication destination via the mobile communication network 200. Notification delivery service communication, data communication, etc. can be performed.

For example, when the communication terminal device 100 is located in a cell as a wireless communication area of the mobile communication network 200, the mobile terminal, mobile phone, PHS, or the like that is located in a cell of another mobile communication network Mail communication by voice communication and packet communication can be performed between communication terminal devices such as communication terminals and tablet PCs.

The communication terminal device 100 communicates via a short message center (hereinafter referred to as “SMSC”) 220 as an SMS relay device of the mobile communication network 200 when located in a cell of the mobile communication network 200. SMS communication can be performed between the SMS communication server 410 of the quality measurement system 400 and other communication terminal devices. The SMSC 220 is a server for providing a short message service (SMS), receives an SMS message having a size limit from a communication device on the transmission side based on a telephone number as terminal identification information of the communication terminal device 100, Transfer to the receiving communication device. The SMSC 220 can also send SMS messages to a plurality of communication devices all at once in a broadcast format.

The communication terminal device 100 includes, for example, a radio signal processing unit composed of an antenna, a transmission amplifier, a reception amplifier, a communication chip set, a baseband signal processing unit, an application execution management unit, a voice input device composed of a small microphone, a speaker, a receiver And an audio output device including a vibration generator, a display unit such as an LCD as a display means, a main control device, and the like. Moreover, the communication terminal device 100 includes a GPS receiving unit that acquires information on its current position using GPS (Global Positioning System) as current position acquisition means. Further, the communication terminal apparatus 100 may include an imaging unit made up of a camera device such as a CCD or CMOS, and an attitude detection unit made up of a gyro sensor, an acceleration sensor, a magnetic sensor, or the like.

The main control device is composed of a microprocessor such as an MPU (Micro Processing Unit) or a memory such as RAM or ROM, and controls each unit based on a predetermined control program incorporated in advance. For example, the main control device can perform processing and control of SMS communication with the SMS communication server 410 via the SMSC 220 of the mobile communication network 200 by executing a predetermined control program.

Further, the communication terminal device 100 can execute various application programs in the native environment of the main control device, and can execute various application programs in a virtual environment constructed by the application execution management unit. Here, “application” (hereinafter abbreviated as “application” where appropriate) includes communication quality measurement processing, telephone, recording, browser, camera, search, mail, information distribution, calendar, clock, music playback, map This means software that can be applied to various uses such as display, data folder, message communication such as SMS and push notification, and video playback, and is also called “application software”. An “application” is a collection of files of an execution program developed in various languages, files of setting information and images used or referred to when the program is executed, and the like.

The application execution management unit manages, for example, program modules and libraries used for application execution. In addition, the application execution management unit executes one or more of a plurality of types of applications such as an Android (registered trademark) application, an iOS (registered trademark) application, a Windows (registered trademark) application, and a Java (registered trademark) application. A framework for execution (for example, Android framework, iOS framework, etc.), and a virtual execution environment (virtual machine) such as Dalvik (registered trademark) VM or Java VM is constructed. In addition, the application execution management unit is configured to have a multitask function capable of executing a plurality of applications in parallel.

The distribution / analysis server 420 performs management processing such as new registration, correction, and deletion of a measurement schedule for measuring communication quality such as a voice communication line connection rate by SMS communication with retransmission control. The measurement schedule specifies, for example, the measurement start setting time for starting communication quality measurement, information on measurement conditions such as the number of transmissions per transmission and the transmission interval, and the type of index value of the communication quality to be measured. Includes information on measurement contents.

The distribution / analysis server 420 also functions as a means for distributing a measurement schedule of a voice communication line connection rate by SMS communication with retransmission control to the communication terminal apparatus 100 that can communicate via the mobile communication network 200. The distribution / analysis server 420 also functions as means for distributing a measurement schedule of the voice communication line connection rate by SMS communication with retransmission control to the SMS communication server 410.

For example, the distribution / analysis server 420 starts communication quality measurement measurement to the communication terminal device 100 and the SMS communication server 410 via the mobile communication network 200 or other dedicated line at a predetermined timing or arbitrary timing set in advance. A measurement schedule including measurement conditions such as set time can be distributed. Here, in the case where downlink SMS communication is used for the measurement of the connection rate of the voice communication line, the SMS communication server 410 transmits the mobile communication network at a predetermined transmission set time that satisfies the measurement conditions received from the distribution / analysis server 420. An SMS message for measuring communication quality is transmitted to the communication terminal apparatus 100 via 200, and an SMS-ACK that is a reception confirmation response to the SMS message is received from the communication terminal apparatus 100. When uplink SMS communication is used for measuring the connection rate of the voice communication line, the communication terminal device 100 is set to the mobile communication network 200 at a predetermined transmission set time that satisfies the measurement conditions received from the distribution / analysis server 420. The SMS message for measuring the communication quality is transmitted to the SMS communication server 410 via SMS, and the SMS-ACK that is the reception confirmation response to the SMS message is received from the SMS communication server 410.

The measurement conditions include a measurement start setting time for starting communication quality measurement, a measurement area for specifying a location where the communication terminal device is located when performing communication quality measurement, and a communication terminal device for performing communication quality measurement. Other conditions such as a moving speed at the time of specifying the moving speed may be used. In addition to the above measurement conditions, measurement content that specifies the type of communication quality index value to be measured may be distributed. Here, the communication quality index value is, for example, a value indicating the SMS initial transmission success rate in SMS communication that can be substituted as the connection rate of the voice communication line in the mobile communication network. The SMS initial transmission success rate is, for example, the SMS received within the standby time T1 as the predetermined initial transmission determination time at the transmission destination with respect to the total number of the plurality of SMS messages transmitted from the communication terminal device 100 or the SMS communication server 410. The ratio of the number of messages. Further, when the SMS-ACK that is the SMS message reception confirmation response is determined, the SMS initial transmission success rate is determined by a transmission source with respect to the total number of a plurality of SMS messages transmitted from the communication terminal device 100 or the SMS communication server 410. This is the ratio of the number of SMS messages for which SMS-ACK was received within the standby time T1 as the initial transmission determination time.

The measurement schedule such as the above measurement conditions and measurement contents may be set based on various information. For example, the communication history of the communication terminal device 100, the model of the communication terminal device 100, the location of the communication terminal device 100 (GPS position, area, cell in area, etc.), time zone (weekdays / holidays, day of the week, early morning / daytime / night ), The moving speed of the communication terminal device (for example, low speed while moving on foot, high speed moving on a car or train), communication carrier information of the mobile communication network 200 and communication quality information (for example, communication terminal device 100) , The measurement conditions of the measurement schedule may be set based on at least one of the received SINR). In addition, it is configured to have an automatic learning function that sequentially learns and updates the measurement conditions set in this way, and the measurement conditions used in the most recent measurement are given priority as the measurement conditions in the next communication quality measurement. You may make it deliver to.

Communication terminal device 100 can determine whether or not an SMS message from SMS communication server 410 transmitted at a predetermined transmission set time has been received within a waiting time T1 as a predetermined initial transmission determination time. It also functions as means for transmitting log information to the distribution / analysis server 420. Note that the communication log information that can be determined may be communication log information including a result of determining whether or not the communication terminal apparatus 100 has received an SMS message within a predetermined standby time T1.

The SMS communication server 410 is configured to be able to perform SMS communication with the communication terminal apparatus 100 via the circuit switching network of the mobile communication network 200 and the SMSC 220. Further, the SMS communication server 410 is configured to be able to communicate with the distribution / analysis server 420 via the mobile communication network 200 or another dedicated line.

The SMS communication server 410 functions as an SMS transmission control unit that starts SMS communication with the communication terminal apparatus 100 via the circuit switching network of the mobile communication network 200 and the SMSC 220 at a predetermined measurement start transmission setting time that satisfies the measurement conditions. To do. For example, when the SMS communication server 410 reaches a preset measurement start set time, the SMS communication server 410 has a predetermined number of times (the number of transmissions) N at a predetermined time interval (transmission interval) ΔT from the measurement start set time. The SMS message for communication quality evaluation is repeatedly transmitted.

Further, for example, the SMS communication server 410 may control to hold a measurement time list in which a plurality of measurement start setting time candidates are set in advance and select any measurement start setting time from the measurement time list. . Here, when one transmission per measurement is performed, an SMS message for communication quality evaluation is transmitted to the communication terminal apparatus 100 at the timing when the selected measurement start setting time is reached. Further, when the number of transmissions per measurement is plural, for example, the transmission setting time of each transmission is set based on the selected measurement start setting time, the transmission interval ΔT, and the number of transmissions N, and the measurement start setting time The communication quality evaluation SMS message is repeatedly transmitted to the communication terminal apparatus 100 a predetermined number of times (number of transmissions) N at a predetermined time interval (transmission interval) ΔT.

Further, for example, the SMS communication server 410 maintains a transmission time list in which a plurality of transmission setting time candidates are set in advance for each measurement, and controls to select an arbitrary transmission setting time from the transmission time list. Good. In this case, an SMS message for communication quality evaluation is transmitted to the communication terminal device 100 at the timing when the selected transmission set time is reached.

The distribution / analysis server 420 is configured to be able to communicate with the communication terminal apparatus 100 via the packet switching network of the mobile communication network 200 or via the packet switching network and the Internet 500. Further, the distribution / analysis server 420 is configured to be able to communicate with the SMS communication server 410 via the mobile communication network 200 or other dedicated line.

The standby time T1 used for the above determination is set based on the transmission setting time of communication quality. For example, the start timing of T1 is set to coincide with the transmission setting time of communication quality. When the start of measurement of communication quality is delayed from the transmission set time, the start timing of T1 may be set delayed from the transmission set time by the delay time. The length of the standby time T1 is set to be shorter than the retransmission timeout of the first retransmission in the retransmission control of the SMS communication to be measured, for example. The length of the standby time T1 may be set by adding a margin considering the transmission delay time between the server and the communication terminal device.

Also, the communication terminal device 100, the SMS communication server 410, and the communication quality measurement server 420 are in time synchronization with each other. For example, each of the communication terminal device 100, the SMS communication server 410, and the communication quality measurement server 420 can perform time synchronization processing by communicating with the mobile communication network 200 or an NTP (Network Time Protocol) server 530 connected to the Internet. it can. The time synchronization processing in each device or server may be performed by receiving a GPS signal or may be performed by another method.

The distribution / analysis server 420 can perform various processes related to measurement of communication quality in communication via the mobile communication network 200.
For example, the distribution / analysis server 420 includes terminal-side measurement data including terminal status log information and terminal location base station quality information at a predetermined timing that satisfies the above measurement conditions recorded in the communication terminal device 100, and communication at a predetermined timing. It functions as a means for acquiring at least one of measurement data on the network side corresponding to (hereinafter referred to as “network-side measurement data”).
In addition, the distribution / analysis server 420 uses the communication quality index value (connection of voice communication line) by SMS communication with retransmission control via the mobile communication network 200 based on at least one of the terminal side measurement data and the network side measurement data. It functions as a means for calculating the rate.

Each of the above-described SMS communication server 410 and distribution / analysis server 420 is configured by using hardware such as a computer device having an MPU or a memory, an external communication interface unit, and the like, and performs communication by executing a predetermined program. Various processes for quality measurement can be performed.

The distribution / analysis server 420 may be composed of a plurality of servers. For example, a distribution server that distributes information including the measurement conditions and measurement contents and an analysis server that performs various processes related to measurement of communication quality may be provided separately.

Table 1 is a list showing an example of terminal-side measurement data that can be acquired from the communication terminal device 100. Table 2 is a list showing an example of wireless communication information included in the terminal-side measurement data of Table 1. The log information in Table 1 is recorded only for a predetermined time (for example, a time within 2 minutes) specified in the above measurement schedule. Further, the wireless communication information in Table 2 is information related to a serving base station of a cell (serving cell) in which the communication terminal device 100 is located at the time of communication quality measurement, and this information also includes a predetermined time including the time of the measurement schedule described above. You may make it record only time (for example, time within 2 minutes). Note that the communication quality measurement results in Table 1 may be included in the terminal-side measurement data calculated by the communication terminal device 100 and transmitted to the distribution / analysis server 420, or distributed without the communication terminal device 100 calculating it. The analysis server 420 may calculate and save.

Table 3 is a list showing an example of server-side measurement data as network-side measurement data that can be acquired from the SMS communication server 410. The log information in Table 3 is recorded only for a predetermined time (for example, a time within 2 minutes) specified in the above measurement schedule. The SMSC response code in the log information is information indicating the SMS delivery result such as DELIVRD, EXPIRED, DELETED, UNDELIV, REJECTD, OTHER, and GWFAILED. The communication quality measurement results in Table 3 may be included in the network-side measurement data calculated by the SMS communication server 410 and transmitted to the distribution / analysis server 420, or distributed without the SMS communication server 410 calculating. The analysis server 420 may calculate and save.

Table 4 is a list showing an example of an index value of communication quality using SMS communication calculated by the distribution / analysis server 420, for example. In the present embodiment, at least one of these communication quality index values (for example, the connection rate of the voice communication line) is calculated. Note that the “total number of measurements” in Table 4 is a communication failure caused by a server such as the SMS communication server 410 or the SMSC 220 used for measuring the communication quality from the total number of measurements actually performed (for example, You may use what excluded the measurement in which the failure of a server, transmission delay, etc. occurred.

The index value of the communication quality is calculated for the SMS communication in the uplink direction transmitted from the communication terminal device 100, for example. Further, the distribution of the measurement conditions described above, the communication via the mobile communication network 200, and the acquisition of at least one of the terminal side measurement data and the network side measurement data are performed for a plurality of communication terminal devices 100, For communication via the mobile communication network 200 by the communication terminal device 100, the communication quality index value may be calculated.

Next, an example of communication quality measurement in the communication system according to the present embodiment will be described.
FIG. 2 shows a communication quality measurement for measuring the connection rate of the voice communication line of the mobile communication network by the SMS communication in the downlink direction transmitted from the SMS communication server 410 to the communication terminal apparatus 100 in the communication system according to the present embodiment. It is a sequence diagram which shows an example. FIG. 3 is a flowchart showing an example of processing in the communication terminal apparatus 100 in the communication quality measurement of FIG.

In this example, information including a measurement schedule that specifies measurement time information for performing communication quality measurement involving transmission of a plurality of SMS messages (hereinafter referred to as “SMS transmission”) is set as a measurement condition for communication quality measurement. This is an example of distribution. The measurement time information in this example is information such as a measurement start set time (= first SMS transmission set time), a transmission interval, and the number of transmissions.

In this example, a communication quality measurement application for performing communication quality measurement processing is installed in the communication terminal device 100 in advance. Communication terminal device 100 and SMS communication server 410 are time-synchronized with each other using an NTP server, a GPS signal, or the like. In addition, the communication terminal device 100 is always in the background operation state after the communication quality measurement application is activated in advance.

First, the distribution / analysis server 420 communicates information including a measurement schedule that specifies measurement time information for performing communication quality measurement with a plurality of predetermined SMS transmissions as a measurement condition for specifying the timing of communication quality measurement. It transmits to the terminal device 100 and the SMS communication server 410.

Based on the measurement schedule information received from the distribution / analysis server 420, the communication terminal device 100 has a predetermined communication quality at a timing approaching the designated measurement start set time (first SMS transmission set time). Start recording a communication log for measurement.

In addition, the SMS communication server 410, based on the measurement schedule received from the distribution / analysis server 420, sets a predetermined communication quality at a timing approaching a designated measurement start set time (first SMS transmission set time). Start recording a communication log for measurement. Note that the SMS communication server 410 may always execute communication quality measurement communication log recording.

At the measurement start set time (first SMS transmission set time), the SMS communication server 410 is addressed to the telephone number of the communication terminal device 100 specified as the transmission destination in the measurement schedule via the SMSC 220 of the mobile communication network 200. The process of transmitting the SMS message to is executed. When the SMSC 220 receives the SMS message from the SMS communication server 410, the SMSC 220 transmits the SMS message to the communication terminal apparatus 100. Hereinafter, the transmission of the SMS message before retransmission is referred to as initial transmission.

On the other hand, as shown in FIG. 3, communication terminal apparatus 100 starts a timer for measuring predetermined standby time T1 when the measurement start set time (first SMS transmission set time) is reached (YES in S101). (S102), and waits for reception of an SMS (initial transmission) message from the SMSC 220. Here, the communication terminal apparatus 100 determines whether the reception of the SMS (initial transmission) message is successful or not based on whether or not the SMS (initial transmission) message is received from the SMSC 220 within the standby time T1 (S103). For example, when receiving an SMS (initial transmission) message within the standby time T1 (YES in S103), the communication terminal device 100 determines that the SMS (initial transmission) message has been successfully received (S104), and receives it. An acknowledgment message (hereinafter referred to as “SMS-ACK”) is transmitted to the SMSC 220. On the other hand, when the SMS (initial transmission) message is not received within the standby time T1 as described later (NO in S103), the communication terminal device 100 determines that the reception of the SMS (initial transmission) message has failed (S105). ), SMS-ACK is not sent to the SMSC 220. The result of success or failure of receiving the SMS (initial transmission) message within the standby time T1 is included in the communication log information and transmitted from the communication terminal apparatus 100 to the distribution / analysis server 420. The communication terminal apparatus 100 repeatedly executes the process when receiving the above SMS transmission a predetermined number of times (N times) (S106, S101 to S105).

In the example of FIG. 3 described above, the communication terminal device 100 determines whether the reception of the SMS (initial transmission) message within the standby time T1 is successful and transmits it to the distribution / analysis server 420. 420 may receive the communication log information that can be determined from the communication terminal device 100, and may determine whether the reception of the SMS (initial transmission) message within the standby time T1 is successful based on the communication log information.

In FIG. 2, when the second SMS transmission set time is reached, the SMS communication server 410 sends a second SMS message to the telephone number of the communication terminal device 100 via the SMSC 220 of the mobile communication network 200 as in the first time. Execute the process to send. When the SMSC 220 receives the SMS message from the SMS communication server 410, the SMSC 220 transmits the SMS message to the communication terminal apparatus 100.

In the second SMS transmission in FIG. 2, since the communication terminal device 100 cannot receive the SMS (initial transmission) message from the SMSC 220, it is determined that the reception of the SMS (initial transmission) message has failed as described above, and the SMS− ACK has not been sent to SMSC 220. Since SMSC 220 cannot receive SMS-ACK from communication terminal apparatus 100, SMSC 220 retransmits the SMS message at a predetermined retransmission timing. When communication terminal apparatus 100 receives the SMS (retransmission) message retransmitted from SMSC 220, communication terminal apparatus 100 transmits SMS-ACK of the reception confirmation to SMSC 220.

After the above SMS transmission is repeatedly executed a predetermined number of times (N times), the communication terminal device 100 and the SMS communication server 410 respectively end the recording of the communication log. The terminal-side measurement data including the terminal-side communication log information recorded by the communication terminal device 100 and the network-side measurement data including the network-side communication log information recorded by the SMS communication server 410 are transmitted to the distribution / analysis server 420, respectively. . Note that the terminal-side measurement data and the network-side measurement data may be transmitted to the distribution / analysis server 420 after completing a predetermined number of times (N times) of SMS transmission, or distributed every time SMS transmission is completed. -You may transmit to the analysis server 420. FIG. The terminal-side measurement data and the network-side measurement data may be collectively transmitted to the distribution / analysis server 420 after a plurality of measurements are completed.

When the distribution / analysis server 420 receives the terminal-side measurement data from the communication terminal apparatus 100 and the network-side measurement data from the SMS communication server 410, the distribution / analysis server 420 executes a communication quality analysis process. In this communication quality analysis, for example, communication that performs SMS transmission from the SMS communication server 410 to the communication terminal device 100 by collating terminal-side measurement data and network-side measurement data having the same schedule ID (schedule management number). A communication quality index value is calculated. Examples of the communication quality index value calculated here include the connection rate (connection success rate) and connection failure rate of the voice communication line using the SMS communication exemplified in Table 4 above. The communication quality index value may include at least one of an out-of-service rate, an in-flight mode rate, a device failure rate, and a power-off rate.

Of the communication quality index values shown in Table 4, the connection rate of the voice communication line was received within a standby time T1 as a predetermined initial transmission determination time for the total number of SMS messages transmitted at the time of measurement. The ratio of the number of SMS messages (SMS initial transmission success rate), that is, the value obtained by dividing the number of times SMS (initial transmission) was successfully received within the standby time T1 in FIGS. 2 and 3 by the total number of measurements (N) Can be calculated and substituted. Further, as the connection failure rate of the voice communication line, the ratio of the number of SMS messages not received within the standby time T1 to the total number of SMS messages transmitted at the time of measurement (SMS initial transmission failure rate), that is, A value obtained by dividing the number of times of SMS (initial transmission) reception by the total number of measurements (N) can be calculated and used instead. Note that the “total number of measurements” in Table 4 is a communication failure caused by a server such as the SMS communication server 410 used for communication quality measurement (for example, the server's total number of measurements). A measurement excluding a measurement in which a failure, a transmission delay, or the like has occurred may be used.

As described above, according to the example of FIG. 2 and FIG. 3, the initial transmission in the SMS communication with the retransmission control in the downlink direction transmitted from the SMS communication server 410 to the communication terminal device 100 via the mobile communication network is distinguished from the retransmission. The ratio of the number of SMS messages received within the initial transmission determination time (SMS initial transmission success rate) to the total number of SMS messages transmitted from the SMS communication server 410 is calculated. The value of this ratio (SMS initial transmission success rate) corresponds to the connection rate of the voice communication line of the mobile communication network with high accuracy, unlike the normal SMS connection rate measured without distinguishing between the initial transmission and re-transmission of SMS messages. Therefore, the ratio can be used as the connection rate of the voice communication line. Thus, by calculating the value of the ratio (SMS initial transmission success rate) as the connection rate of the voice communication line, the connection rate of the voice communication line can be accurately measured. In addition, at the time of the measurement, it is not necessary for the user to operate the communication terminal device 100 to make a voice communication call or to receive a voice communication. Therefore, it is possible to accurately measure the connection rate of the voice communication line of the mobile communication network without the user's operation of making or receiving voice communication.

FIG. 4 is a sequence diagram showing an example of communication quality measurement of SMS communication in the uplink direction transmitted from the communication terminal device 100 to the SMS communication server 410 in the communication system according to the present embodiment. In the present example, the description of the same parts as those in the example of FIG. Further, the processing in the SMS communication server 410 in the communication quality measurement of FIG. 4 is the same as the processing in the communication terminal apparatus 100 shown in FIG.

In FIG. 4, when the measurement start set time (first SMS call set time) is reached, the communication terminal apparatus 100 via the SMSC 220 of the mobile communication network 200 specifies the SMS communication server 410 specified as the call destination in the measurement schedule. The process of sending the SMS message to the telephone number of is executed. When the SMSC 220 receives the SMS message from the communication terminal apparatus 100, the SMSC 220 transmits the SMS message to the SMS communication server 410.

On the other hand, the SMS communication server 410 starts a timer for measuring a predetermined standby time T1 when the measurement start set time (first SMS transmission set time) is reached, and the SMS (initial transmission) message from the SMSC 220 is sent. Wait for reception. Here, the SMS communication server 410 determines whether the reception of the SMS (initial transmission) message is successful depending on whether or not the SMS (initial transmission) message is received from the SMSC 220 within the standby time T1. For example, if the SMS communication server 410 receives an SMS (initial transmission) message within the standby time T1, it determines that the SMS (initial transmission) message has been successfully received, and sends an SMS-ACK to the SMSC 220 to confirm the reception. Send. On the other hand, as described later, when the SMS (initial transmission) message is not received within the standby time T1, the SMS communication server 410 determines that the reception of the SMS (initial transmission) message has failed and sends the SMS-ACK to the SMSC 220. Do not send. The SMS communication server 410 repeatedly executes the process when receiving the above SMS transmission a predetermined number of times (N times).

In FIG. 4, the communication terminal apparatus 100 sends a second SMS message to the telephone number of the SMS communication server 410 via the SMSC 220 of the mobile communication network 200 at the second SMS transmission set time, as in the first time. Execute the outgoing process. When the SMSC 220 receives the SMS message from the communication terminal apparatus 100, the SMSC 220 transmits the SMS message to the SMS communication server 410.

In the second SMS transmission in FIG. 4, since the SMS communication server 410 cannot receive the SMS (initial transmission) message from the SMSC 220, it is determined that reception of the SMS (initial transmission) message has failed as described above. ACK has not been sent to SMSC 220. Since the SMSC 220 cannot receive the SMS-ACK from the SMS communication server 410, it retransmits the SMS message at a predetermined retransmission timing. When the SMS communication server 410 receives the SMS (retransmission) message retransmitted from the SMSC 220, the SMS communication server 410 transmits an SMS-ACK of the reception confirmation to the SMSC 220.

After the above SMS transmission is repeatedly executed a predetermined number of times (N times), the communication terminal device 100 and the SMS communication server 410 respectively end the recording of the communication log. The terminal-side measurement data including the terminal-side communication log information recorded by the communication terminal device 100 and the network-side measurement data including the network-side communication log information recorded by the SMS communication server 410 are transmitted to the distribution / analysis server 420, respectively. .

As described above, according to the example of FIG. 4, the initial transmission in the SMS communication with the retransmission control in the uplink direction that is transmitted from the communication terminal device 100 to the SMS communication server 410 is distinguished from the retransmission, and is directed to the SMS communication server 410. A ratio (MS initial transmission connection rate) of the number of SMS messages received within the initial transmission determination time to the total number of SMS messages to be transmitted is calculated. The value of this ratio is different from the normal SMS connection rate measured without distinguishing between the initial transmission and re-transmission of the SMS message, and in order to accurately correspond to the connection rate of the voice communication line of the mobile communication network, It can be used as a communication line connection rate. Thus, by calculating the ratio value as the connection rate of the voice communication line, the connection rate of the voice communication line can be accurately measured. In addition, at the time of the measurement, it is not necessary for the user to operate the communication terminal device 100 to make a voice communication call or to receive a voice communication. Therefore, it is possible to accurately measure the connection rate of the voice communication line of the mobile communication network without the user's operation of making or receiving voice communication.

FIG. 5 is a sequence diagram showing another example of communication quality measurement of SMS communication in the uplink direction transmitted from the communication terminal device 100 to the SMS communication server 410 in the communication system according to the present embodiment. In the present example, the description of the same parts as those in the example of FIG. FIG. 6 is a flowchart showing an example of processing in the communication terminal apparatus 100 in the communication quality measurement of FIG.

In FIG. 5, when the communication terminal device 100 reaches the measurement start set time (first SMS call set time), the SMS communication server 410 specified as the call destination in the measurement schedule via the SMSC 220 of the mobile communication network 200. The process of sending the SMS message to the telephone number of is executed. When the SMSC 220 receives the SMS message from the communication terminal apparatus 100, the SMSC 220 transmits the SMS message to the SMS communication server 410.

In addition, as shown in FIG. 6, communication terminal apparatus 100 starts a timer for measuring a predetermined standby time T1 when the measurement start set time (first SMS transmission set time) is reached (YES in S201). (S202), and waits for the reception of SMS-ACK, which is a reception confirmation response to the SMS (initial transmission) message from the SMSC 220. In this case, the standby time T1 is set longer than the standby time T1 used in the examples of FIGS. 2 to 4 described above, for example, by the time required for sending and receiving SMS-ACK. Communication terminal apparatus 100 determines whether SMS-ACK has been successfully received or not depending on whether SMS-ACK has been received for the SMS (initial transmission) message from SMSC 220 within standby time T1 (S203). For example, when receiving the SMS-ACK for the SMS (initial transmission) message within the standby time T1 (YES in S203), the communication terminal apparatus 100 determines that the SMS-ACK has been successfully received (S204). On the other hand, when the SMS-ACK for the SMS (initial transmission) message is not received within the standby time T1 (NO in S203), the communication terminal apparatus 100 determines that the reception of the SMS-ACK has failed (S205). The result of the success or failure of receiving the SMS-ACK within the standby time T1 is included in the communication log information and transmitted from the communication terminal device 100 to the distribution / analysis server 420. The communication terminal apparatus 100 repeatedly executes the process when receiving the above SMS transmission a predetermined number of times (N times) (S206, S201 to S205).

In the example of FIG. 6, the communication terminal device 100 determines whether the reception of the SMS-ACK within the standby time T1 is successful and transmits it to the distribution / analysis server 420. Communication log information that can be determined from the terminal device 100 may be received, and success or failure of reception of the SMS-ACK within the standby time T1 may be determined based on the communication log information.

In FIG. 5, the communication terminal device 100 sends a second SMS message to the telephone number of the SMS communication server 410 via the SMSC 220 of the mobile communication network 200 at the second SMS transmission set time, as in the first time. Execute the outgoing process. When the SMSC 220 receives the SMS message from the communication terminal apparatus 100, the SMSC 220 transmits the SMS message to the SMS communication server 410.

In the second SMS transmission in FIG. 5, the SMS communication server 410 cannot receive the SMS (initial transmission) message from the SMSC 220 and therefore does not transmit the SMS-ACK to the SMSC 220. As a result, the communication terminal device 100 cannot receive the SMS-ACK for the SMS (initial transmission) message within the standby time T1 as described above. Accordingly, it is determined that communication terminal apparatus 100 has failed to receive SMS-ACK. Further, since SMSC 220 cannot receive SMS-ACK from SMS communication server 410, SMSC 220 retransmits the SMS message at a predetermined retransmission timing. When the SMS communication server 410 receives the SMS (retransmission) message retransmitted from the SMSC 220, the SMS communication server 410 transmits an SMS-ACK of the reception confirmation to the SMSC 220.

As described above, according to the example of FIG. 5 and FIG. 6, the initial transmission in the SMS communication with the retransmission control in the uplink direction transmitted from the communication terminal device 100 to the SMS communication server 410 is distinguished from the retransmission, and the SMS communication server 410 The ratio of the number of SMS messages received within the initial transmission determination time (MS initial transmission connection rate) to the total number of SMS messages transmitted toward is calculated. The value of this ratio is different from the normal SMS connection rate measured without distinguishing between the initial transmission and re-transmission of the SMS message, and in order to accurately correspond to the connection rate of the voice communication line of the mobile communication network, It can be used as a communication line connection rate. Thus, by calculating the ratio value as the connection rate of the voice communication line, the connection rate of the voice communication line can be accurately measured. In addition, at the time of the measurement, it is not necessary for the user to operate the communication terminal device 100 to make a voice communication call or to receive a voice communication. Therefore, it is possible to accurately measure the connection rate of the voice communication line of the mobile communication network without the user's operation of making or receiving voice communication.

Note that the processing steps and components in the communication terminal device 100, the SMS communication server 410, the distribution / analysis server 420, and the like described in this specification can be implemented by various means in addition to the above-described means. For example, these processing steps and components may be implemented in hardware, firmware, software, or a combination thereof.

For hardware implementation, a processing unit used to realize the above steps and components in an entity (for example, various wireless communication devices, NodeBs, servers, gateways, exchanges, computers, hard disk drive devices, or optical disk drive devices) Such means include one or more application specific IC (ASIC), digital signal processor (DSP), digital signal processor (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), processor, controller, microcontroller, microprocessor, electronic device, other electronic unit, computer, or combination thereof designed to perform the functions described herein It may be implemented in.

Also, for firmware and / or software implementation, means such as processing units used to implement the above components may be programs (eg, procedures, functions, modules, instructions) that perform the functions described herein. , Etc.). In general, any computer / processor readable medium that specifically embodies firmware and / or software code is means such as a processing unit used to implement the steps and components described herein. May be used to implement For example, the firmware and / or software code may be stored in a memory, for example, in a control device, and executed by a computer or processor. The memory may be implemented inside the computer or processor, or may be implemented outside the processor. The firmware and / or software code may be, for example, random access memory (RAM), read only memory (ROM), nonvolatile random access memory (NVRAM), programmable read only memory (PROM), electrically erasable PROM (EEPROM) ), FLASH memory, floppy disk, compact disk (CD), digital versatile disk (DVD), magnetic or optical data storage, etc. Good. The code may be executed by one or more computers or processors, and may cause the computers or processors to execute the functional aspects described herein.

Also, descriptions of the embodiments disclosed herein are provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to the present disclosure will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. The present disclosure is therefore not limited to the examples and designs described herein, but should be accorded the widest scope consistent with the principles and novel features disclosed herein.

100 communication terminal device 200 mobile communication network 210 base station 220 short message service center (SMSC)
400 Communication Quality Measurement System 410 SMS Communication Server 420 Distribution / Analysis Server 500 Internet 510 Access Point Device 530 NTP Server

Claims

A method for measuring communication quality,
Transmitting a plurality of SMS messages via a mobile communication network at a predetermined transmission setting time set in advance to one or a plurality of communication terminal devices;
For each of the plurality of SMS messages, determining whether or not the communication terminal apparatus has received the SMS message within a predetermined initial transmission determination time set based on the transmission setting time;
Calculating a ratio of the number of SMS messages received within the initial transmission determination time to the total number of the plurality of SMS messages as a connection rate of the voice communication line.
A method for measuring communication quality,
Receiving a plurality of SMS messages transmitted from one or a plurality of communication terminal devices via a mobile communication network at a predetermined transmission set time;
For each of the plurality of SMS messages, it is determined whether or not the SMS message has been received within a predetermined initial transmission determination time set based on the transmission set time, and the initial value for the total number of the plurality of SMS messages Calculating a ratio of the number of SMS messages received within the transmission judgment time as a connection rate of the voice communication line.
A method for measuring communication quality,
Receiving a plurality of SMS messages transmitted from one or a plurality of communication terminal devices via a mobile communication network at a predetermined transmission set time;
When receiving the SMS message, returning a receipt confirmation response to the SMS message;
For each of the plurality of SMS messages, determining whether or not the communication terminal apparatus has received the reception confirmation response within a predetermined initial transmission determination time set based on the transmission setting time;
Calculating a ratio of the number of SMS messages in which the reception confirmation response is received within the initial transmission determination time with respect to the total number of the plurality of SMS messages as a connection rate of the voice communication line.
The method of claim 1, 2 or 3,
Each of the plurality of SMS messages is transmitted and received between the communication terminal device and the server via the mobile communication network,
A method further comprising: distributing a measurement schedule of the connection rate of the voice communication line including setting information of the transmission setting time to the server and the communication terminal device.
A communication quality measurement system,
Means for transmitting a plurality of SMS messages via a mobile communication network at a predetermined transmission set time to one or a plurality of communication terminal devices;
For each of the plurality of SMS messages, means for determining whether or not the communication terminal apparatus has received the SMS message within a predetermined initial transmission determination time set based on the transmission setting time;
Means for calculating, as a connection rate of the voice communication line, a ratio of the number of SMS messages received within the initial transmission determination time to the total number of the plurality of SMS messages.
A communication quality measurement system,
Means for receiving a plurality of SMS messages transmitted at a predetermined transmission set time preset from one or a plurality of communication terminal devices via a mobile communication network;
For each of the plurality of SMS messages, means for determining whether or not the SMS message has been received within a predetermined initial transmission determination time set based on the transmission setting time;
Means for calculating, as a connection rate of the voice communication line, a ratio of the number of SMS messages received within the initial transmission determination time to the total number of the plurality of SMS messages.
A communication quality measurement system,
Means for receiving a plurality of SMS messages transmitted at a predetermined transmission set time preset from each of one or a plurality of communication terminal devices via a mobile communication network;
Means for returning a receipt confirmation response to the SMS message when the SMS message is received;
For each of the plurality of SMS messages, means for determining whether or not the communication terminal apparatus has received the reception confirmation response within a predetermined initial transmission determination time set based on the transmission setting time;
Means for calculating, as a connection rate of the voice communication line, a ratio of the number of SMS messages for which the reception confirmation response is received within the initial transmission determination time to the total number of the plurality of SMS messages.
The system of claim 5, 6 or 7,
Each of the plurality of SMS messages is transmitted and received between the communication terminal device and the server via the mobile communication network,
A system further comprising means for distributing a measurement schedule of a connection rate of the voice communication line including setting information of the transmission setting time to the server and the communication terminal device.
A communication terminal device,
Means for receiving an SMS message transmitted from a server via a mobile communication network at a predetermined transmission set time set in advance;
A communication terminal device comprising: means for transmitting communication log information capable of determining whether or not the SMS message has been received within a predetermined initial transmission determination time set based on the transmission setting time to an analysis server.
A communication terminal device,
Means for transmitting an SMS message to an SMS communication server via a mobile communication network at a predetermined transmission setting time set in advance for measuring a connection rate of a voice communication line.
A communication terminal device,
Means for transmitting an SMS message to a server via a mobile communication network at a predetermined transmission set time set in advance;
Means for receiving an acknowledgment to the SMS message;
Means for transmitting to the server communication log information capable of determining whether or not the communication terminal apparatus has received the reception confirmation response within a predetermined initial transmission determination time set based on the transmission setting time. Communication terminal device.
The communication terminal device according to claim 9, 10 or 11,
A communication terminal apparatus further comprising means for receiving a connection schedule measurement schedule of a voice communication line including setting information of the transmission setting time from a server.