WO2023209802A1 - User sensory quality estimation device, user sensory quality estimation method, and program - Google Patents

User sensory quality estimation device, user sensory quality estimation method, and program Download PDF

Info

Publication number
WO2023209802A1
WO2023209802A1 PCT/JP2022/018874 JP2022018874W WO2023209802A1 WO 2023209802 A1 WO2023209802 A1 WO 2023209802A1 JP 2022018874 W JP2022018874 W JP 2022018874W WO 2023209802 A1 WO2023209802 A1 WO 2023209802A1
Authority
WO
WIPO (PCT)
Prior art keywords
user experience
quality
estimated value
experience quality
communication service
Prior art date
Application number
PCT/JP2022/018874
Other languages
French (fr)
Japanese (ja)
Inventor
勇一朗 浦田
則次 恵木
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Priority to PCT/JP2022/018874 priority Critical patent/WO2023209802A1/en
Publication of WO2023209802A1 publication Critical patent/WO2023209802A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters

Definitions

  • the present disclosure relates to a technology for estimating future user experience quality.
  • Non-Patent Document 1 when the target service is a video distribution service, ITU-T Recommendation P.1203 is standardized (Non-Patent Document 1). Regarding web browsing, the Web-Browsing QoE Estimation Model (Non-Patent Document 2) has been proposed.
  • existing user experience quality estimation technology is based on data evaluated within the same target communication service, and the output values of user experience quality estimation technology targeting different communication services can be directly compared. I can't.
  • the technology in Non-Patent Document 1 outputs the user experience quality of video distribution in the range of 1 (very poor) to 5 (very good), whereas the technology in Non-Patent Document 2 It describes a technique for outputting the user experience quality on a scale of 1 to 5.
  • the present invention has been made in view of the above-mentioned circumstances, and its purpose is to estimate user-experienced quality as the same scale that allows quality comparisons between multiple communication services without conducting subjective quality evaluation experiments. do.
  • the invention according to claim 1 provides a user experience quality estimation device that estimates user experience quality based on quality parameters that can be obtained while using a communication service in an environment where a plurality of communication services are used.
  • a first user experience quality estimator that outputs an estimated value of a first user experience quality by inputting a first quality parameter related to a first communication service;
  • a first occurrence probability distribution based on the estimated value of the first quality of user experience managed by a first quality control unit that records the estimated value of the first quality of user experience while using the communication service.
  • a user experience quality estimating device comprising: a correction unit that outputs an estimated value of the first user experience quality after correction by performing correction based on a probability distribution. It is.
  • FIG. 1 is an overall configuration diagram of a communication system according to an embodiment.
  • FIG. 1 is an electrical hardware configuration diagram of a user experience quality estimation device according to the present embodiment.
  • FIG. 2 is an electrical hardware configuration diagram of a communication terminal according to the present embodiment.
  • FIG. 1 is a functional configuration diagram of a user experience quality estimation device according to an embodiment.
  • FIG. 6 is an image diagram of correction of the estimated value of the quality of user experience according to the embodiment.
  • 3 is a flowchart illustrating processing of a user experience quality estimation method according to an embodiment.
  • FIG. 1 is an overall configuration diagram of a communication system according to an embodiment.
  • the communication system 10 of this embodiment is constructed by a user experience quality estimation device 30, a content distribution device 50, and a user terminal 70.
  • the user terminal 70 is managed and used by a user.
  • the user experience quality estimation device 30, the content distribution device 50, and the user terminal 70 can communicate via a communication network 100 such as the Internet.
  • the communication network 100 includes a predetermined network such as an ISP (Internet Service Provider) network managed (provided) by a network operator. This predetermined network is a best effort network for video distribution, web browsing, voice calls, etc.
  • the connection form of the communication network 100 may be either wireless or wired.
  • the user experience quality estimation device 30 is configured by one or more computers. When the user experience quality estimating device 30 is constituted by a plurality of computers, it may be referred to as a "user experience quality estimation device” or a "user experience quality estimation system.”
  • the user experience quality estimation device 30 generates an occurrence probability distribution of the estimated value of the user experience quality calculated by the quality estimation technology (see Non-Patent Documents 1 and 2) based on each quality parameter of a plurality of communication services, and By correcting the estimated value of the user experience quality output using quality estimation technology based on the occurrence probability distribution of each service, it is possible to estimate the user experience quality as the same scale that allows quality comparisons between multiple communication services. can.
  • the quality parameter is information measured by a predetermined application (communication quality measurement application described below) installed on the user terminal 70.
  • quality parameters include video bit rate, resolution, frame rate, audio bit rate, information regarding playback stop (number of times the video stops during video playback), and the like.
  • the content distribution device 50 is configured by one or more computers.
  • the content distribution device 50 is composed of a plurality of computers, it may be referred to as a “content distribution device” or a “content distribution system.”
  • the content distribution device 50 is a server owned by a content provider, and distributes content data in an information communication service to the user terminal 70 via the communication network 100.
  • the user terminal 70 is a computer, and in FIG. 1, a notebook computer is shown as an example.
  • a user operates a user terminal 70.
  • a communication quality measurement application is installed on the user terminal 70 to measure the playback quality of the content being played on the user terminal 70 and output quality parameters, and the user terminal 70 periodically measures the quality parameters. It is transmitted to the user experience quality estimation device 30.
  • a router or server on a predetermined network such as an ISP (Internet Service Provider) network managed by a network operator (telecommunications carrier) monitors the traffic status, etc.
  • the quality parameters may be sent to the user experience quality estimation device 30 directly.
  • the communication service provider's server or the like may monitor the traffic status, etc., and the communication service provider's server or the like may periodically transmit quality parameters to the user experience quality estimation device 30.
  • FIG. 2 is an electrical hardware configuration diagram of the user experience quality estimation device.
  • the user experience quality estimation device 30 is a computer that includes a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, and an SSD (Solid State Drive). ) 304, an external device connection I/F (Interface) 305, a network I/F 306, a media I/F 309, and a bus line 310.
  • a CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • SSD Solid State Drive
  • the CPU 301 controls the overall operation of the user experience quality estimation device 30.
  • the ROM 302 stores programs used to drive the CPU 301, such as IPL (Initial Program Loader).
  • RAM 303 is used as a work area for CPU 301.
  • the SSD 304 reads or writes various data under the control of the CPU 301.
  • an HDD Hard Disk Drive
  • SDD Serial Digital
  • the external device connection I/F 305 is an interface for connecting various external devices.
  • External devices in this case include a display, speaker, keyboard, mouse, USB (Universal Serial Bus) memory, printer, and the like.
  • the network I/F 306 is an interface for data communication via the communication network 100.
  • the media I/F 309 controls reading or writing (storage) of data to a recording medium 309m such as a flash memory.
  • the recording media 309m also include DVDs (Digital Versatile Discs), Blu-ray Discs (registered trademark), and the like.
  • the bus line 310 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 301 shown in FIG. 2.
  • the content distribution device 50 has the same configuration as the user experience quality estimation device 30, a description of the electrical hardware configuration of the content distribution device 50 will be omitted.
  • FIG. 3 is an electrical hardware configuration diagram of the communication terminal.
  • the user terminal 70 as a computer includes a CPU 501, ROM 502, RAM 503, SSD 504, external device connection I/F (Interface) 505, network I/F 506, display 507, pointing device 508, and media. It includes an I/F 509 and a bus line 510.
  • I/F Interface
  • the CPU 501 controls the operation of the user terminal 70 as a whole.
  • the ROM 502 stores programs used to drive the CPU 501 such as IPL.
  • RAM 503 is used as a work area for CPU 501.
  • the SSD 504 reads or writes various data under the control of the CPU 501. Note that an HDD (Hard Disk Drive) may be used instead of the SSD 504.
  • HDD Hard Disk Drive
  • the external device connection I/F 505 is an interface for connecting various external devices.
  • External devices in this case include a display, speaker, keyboard, mouse, USB memory, printer, and the like.
  • the network I/F 506 is an interface for data communication via the communication network 100.
  • the display 507 is a type of display means such as liquid crystal or organic EL (Electro Luminescence) that displays various images.
  • the pointing device 508 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. Note that when the user uses a keyboard, the function of the pointing device 508 may be turned off.
  • the media I/F 509 controls reading or writing (storage) of data to a recording medium 509m such as a flash memory.
  • the recording media 509m also include DVDs, Blu-ray Discs (registered trademark), and the like.
  • the bus line 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501 shown in FIG. 4.
  • FIG. 4 is a functional configuration diagram of the user experience quality estimation device according to the embodiment.
  • the user experience quality estimation device 30 targets N ( ⁇ 2) types of communication services. Further, the user experience quality estimation device 30 starts operation by inputting the quality parameters of the communication service Z (Z is an integer from 1 to N) for which the user experience quality is to be estimated, and calculates the corrected user experience quality of the communication service Z. Output the estimated value of .
  • the user experience quality estimation device 30 includes an acquisition section 31, a plurality of user experience quality estimation sections 32 1 to 32 N , a plurality of distribution generation sections 33 1 to 33 N , a correction section 36, and an output section. It has 39. Each of these units is a function realized by instructions from the CPU 301 in FIG. 2 based on a program. Further, in the RAM 303 or the SSD 304, quality control DBs (Data Bases) 40 1 to 40 N are constructed, which can be recorded or read by each of the plurality of user experience quality estimation units 32 1 to 32 N.
  • Data Bases Data Bases
  • the user experience quality estimation units 32 1 to 32 N will be collectively referred to as the “user experience quality estimation unit 32”.
  • the distribution generating units 33 1 to 33 N are collectively referred to as “distribution generating unit 33”.
  • the quality control DBs 40 1 to 40 N are collectively referred to as "quality control DB 40".
  • the quality control DBs 40 1 to 40 N record the user experience quality Q before correction for the target period (certain period).
  • the estimated value of the user experience quality calculated by the user experience quality estimation technology applied by the user experience quality estimation unit 32 from the quality parameters acquired in the target period, and the acquisition date and time (time and time) of the quality parameter.
  • the data recorded in the quality control DB 40 includes data for a specific period, such as from one year ago to the present.
  • the acquisition unit 31 acquires user experience quality information that can be acquired while using each communication service from the user terminal 70 (communication quality measurement application). Note that the acquisition section may also be referred to as an "input section.”
  • the user experience quality estimation unit 32 receives the quality parameters acquired by the acquisition unit 31 as input, calculates an estimated value of the user experience quality before correction, and outputs it to the distribution generation unit 33 and the correction unit 36.
  • the user experience quality estimating unit 32 can apply the user experience quality estimation technology of existing communication services, and the target communication services include, for example, video distribution service, VR video distribution service, voice call service, Web browsing, Web Examples include conference systems and online games.
  • the user experience quality estimating unit 321 uses the technology of Non-Patent Document 1 (ITU-T Recommendation P.1203) to output an estimated value of the user experience quality when the communication service is a video distribution service.
  • the user experience quality estimation unit 321 inputs the video bit rate, resolution, frame rate, audio bit rate, information regarding playback stop, etc. as quality parameters, and calculates the estimated value of the user experience quality for video viewing. Output from 1 to 5 (larger number indicates better quality).
  • the user experience quality estimating unit 322 uses the technique of Non-Patent Document 2 to output an estimated value of the user experience quality when the communication service is a Web browsing service.
  • the user experience quality estimating unit 322 inputs information regarding the waiting time until display as a quality parameter, and outputs the user experience quality for web browsing from 1 to 5 (a larger number indicates better quality). do.
  • the distribution generation unit 33 In response to the generation request from the correction unit 36, the distribution generation unit 33 generates an occurrence probability distribution based on the estimated value of the user experience quality recorded in the quality management DB 40, and outputs it to the correction unit 36. For example, by recording a large number of estimated values of user experience quality in the quality management DB 40, the distribution generation unit 33 can generate a percentile (for example, 50%) of a specific user experience quality estimate (for example, "3"). It is possible to generate an occurrence probability distribution that can be derived.
  • a percentile for example, 50%
  • a specific user experience quality estimate for example, "3"
  • the correction unit 36 uses the estimated value of the predetermined user experience quality related to the predetermined communication service Z output by the predetermined user experience quality estimation unit 32 and the plurality of communication services (predetermined communication).
  • the estimated value of the predetermined quality of user experience is corrected based on a plurality of occurrence probability distributions related to (including service Z), and the corrected estimated value of the quality of user experience is output.
  • the correction unit 36 calculates an occurrence probability distribution G by superimposing each occurrence probability distribution. Then, the correction unit 36 calculates the percentile P of the predetermined user experience quality estimate Q before correction in the predetermined occurrence probability distribution F, and sets the same percentile P in the occurrence probability distribution G as the post-correction percentile P'. In this way, an estimated value Q' of the corrected predetermined user experience quality is calculated.
  • FIG. 5 is an image diagram of correction of the estimated value of the quality of user experience according to the embodiment.
  • the cumulative distribution of each communication service can be obtained by numerically integrating the respective occurrence probability distributions.
  • the correction unit 36 adjusts the user experience quality before correction output by the predetermined user experience quality estimation unit 32 based on the quality parameters of the predetermined communication service Z input to the user experience quality estimation device 30.
  • the percentile P in FIG. 5, the Y coordinate of the point on the broken line
  • the correction unit 36 calculates the value Q' of the percentile P in the superimposed occurrence probability distribution function G(x) (in FIG. 5, the X coordinate of the point on the solid line) on the same scale considering multiple communication services. is output as an estimated value of the user experience quality after correction.
  • the correction unit 36 performs correction focusing on the correspondence between the user experience quality and the occurrence probability distribution. That is, the correction unit 36 refers to the percentile in the occurrence probability distribution of each communication service (for example, poor quality experienced by only about 2%, median value, etc.) and the occurrence probability distribution obtained by superimposing the occurrence probability distribution of each communication service. By doing so, it becomes possible to correct the estimated value of the user experience quality on the same scale that can be compared between a plurality of different communication services.
  • the output unit 39 acquires the estimated value of the corrected user experience quality corrected by the correction unit 36, and outputs information including this estimated value from the user experience quality estimation device 30. Examples of output include displaying on a display connected to external device connection I/F 305 in FIG. 2, and transmitting to an external device via network I/F 306.
  • FIG. 6 is a flowchart showing the processing of the user experience quality estimation method according to the embodiment.
  • the acquisition unit 31 acquires the quality parameters of each communication service from the user terminal 70.
  • the user experience quality estimation unit 32 estimates the estimated value Q of the user experience quality of each communication service based on each quality parameter.
  • Each distribution generation unit 33 records the estimated value Q of each user experience quality before correction, and in response to the generation request from the correction unit 36, each distribution generation unit 33 records the estimated value Q of each user experience quality before correction, and in response to the generation request from the correction unit 36, the distribution generation unit 33 records the estimated value Q of each user experience quality before correction, and in response to the generation request from the correction unit 36, Each occurrence probability distribution is generated based on the estimated value of the perceived quality and output to the correction unit 36. Note that each distribution generation unit 33 does not necessarily need to generate each occurrence probability distribution based on the estimated value of the user experience quality recorded in each quality control DB 40 in the same past fixed period.
  • the distribution generation unit 33 1 generates an occurrence probability distribution based on the estimated value of the user experience quality recorded in the quality control DB 40 1 in the past first period, and generates the occurrence probability distribution in the quality control DB 40 2 in the past second period.
  • An occurrence probability distribution may be generated based on the recorded estimated quality of user experience.
  • the past first period and the past second period are the same period, different periods, or periods that partially overlap.
  • the correction unit 36 calculates an occurrence probability distribution G by superimposing each occurrence probability distribution.
  • the correction unit 36 calculates the percentile P of the estimated value Q of the predetermined user experience quality before correction in the predetermined occurrence probability distribution F for the predetermined communication service Z among the respective communication services, and By setting the same percentile P as the corrected percentile P', an estimated value Q' of the corrected predetermined user experience quality is calculated.
  • the output unit 39 outputs information regarding the estimated value Q' of the corrected user experience quality related to the predetermined service Z.
  • the user experience quality estimating device 30 of the present embodiment calculates the frequency of occurrence of the user experience quality estimate for each communication service based on the occurrence probability distribution of the user experience quality estimate for a plurality of communication services. By making corrections that take this into account, it is possible to estimate the quality of user experience as the same measure that allows quality comparisons between a plurality of communication services, without conducting experiments on subjective quality evaluation.
  • the user experience quality estimation device 30 can be realized by a computer and a program, but this program can also be recorded on a (non-temporary) recording medium or provided via a communication network 100 such as the Internet. be.
  • a notebook computer is shown as an example of the user terminal 70, but the invention is not limited to this.
  • it may be a desktop computer, a tablet terminal, a smartphone, a smart watch, a head-mounted display, a car navigation device, a refrigerator, a microwave oven, or the like.
  • Each of the CPUs 301, 501, and 701 may be not only a single CPU but also a plurality of CPUs.
  • the quality control DB 40 is an example of a quality control department.
  • the quality control department may record data in a state other than a database format.
  • Communication system 30
  • User experience quality estimation device 50
  • Content distribution device 70
  • User terminal 31
  • Acquisition unit (input unit) 32
  • User experience quality estimator 32 1 to 32
  • N user experience quality estimator (an example of a first user experience quality estimator, an example of a second user experience quality estimator)
  • Distribution generation unit 33 1 to 33 N distribution generation unit (an example of a first distribution generation unit, an example of a second distribution generation unit)
  • Correction section 39
  • Output section 40
  • Quality control DB an example of a quality control section
  • Quality control DB an example of the first quality control department, an example of the second quality control department

Abstract

The present disclosure is for a user sensory quality estimation device that estimates a user sensory quality on the basis of a quality parameter which can be acquired during use of a communication service, in an environment in which a plurality of communication services are used. The sensory quality estimation device includes: a first (second) user sensory quality estimation unit that receives input of a first (second) quality parameter pertaining to a first (second) communication service, and outputs a first (second) user sensory quality estimated value; a first (second) distribution generation unit that generates a first (second) occurrence probability distribution on the basis of the first (second) user sensory quality estimated value being managed by a first (second) quality management unit which recorded the first (second) user sensory quality estimated values during use of the first (second) communication service during a first (second) period in the past; and a correction unit that corrects, on the basis of the first and second occurrence probability distributions, the first user sensory quality estimated value output by the first user sensory quality estimation unit, thereby outputting the first user sensory quality estimated value that has been corrected.

Description

ユーザ体感品質推定装置、ユーザ体感品質推定方法及びプログラムUser experience quality estimation device, user experience quality estimation method and program
　本開示内容は、将来のユーザ体感品質を推定する技術に関する。 The present disclosure relates to a technology for estimating future user experience quality.
　近年、情報通信技術の発展により、ユーザがスマートフォン、タブレット端末、ＰＣ等を用いて様々な通信サービスを利用しており、トラヒックが急増している。ベストエフォート型ネットワークを介したサービス提供ではサービス品質が時間帯等によって大きく変化する。また、通信サービスの品質の低下は、ユーザの不満を招き、サービス解約等につながるため、ネットワーク事業者（通信事業者）や通信サービス提供者にとって、通信サービスの利用中のユーザ体感品質を把握することは重要である。そのため、映像配信、Webブラウジング、音声通話等に対する通信サービスの品質監視を目的とするユーザ体感品質（QoE: Quality of Experience）の推定技術が確立されてきた。例えば、対象サービスが映像配信サービスの場合には、ITU-T 勧告P.1203が標準化されている（非特許文献１）。Webブラウジングについては、Web-Browsing QoE Estimation Model（非特許文献２）が提案されている．
　また、既存のユーザ体感品質推定技術は、対象とする同じ通信サービスの中で評価されたデータに基づいており、異なる各通信サービスを対象としたユーザ体感品質推定技術の出力値を直接的に比較することはできない。例えば、非特許文献１の技術は、映像配信のユーザ体感品質を１（非常に悪い）～５（非常に良い）の範囲で出力するのに対して、非特許文献２の技術は、Webブラウジングのユーザ体感品質を１～５で出力する技術について記載されている。ここで、両技術を用いて品質監視をしていて、映像配信のユーザA，Bのユーザ体感品質がそれぞれ3.0, 4.0と推定され、WebブラウジングのユーザCのユーザ体感品質が3.5と推定されたとする。このとき、同一の通信サービスを対象とした出力値を比較しているユーザAとユーザBについてはユーザAがより低いユーザ体感品質であるといえる。しかし、異なる通信サービスの出力値は直接的に比較できないため、ユーザCがユーザA, Bに比べユーザ体感品質が低いのか高いのかを判断することはできない。 In recent years, with the development of information and communication technology, users are using various communication services using smartphones, tablet terminals, PCs, etc., and traffic is rapidly increasing. When providing services via a best-effort network, service quality varies greatly depending on the time of day and other factors. In addition, since a decline in the quality of communication services will lead to user dissatisfaction and lead to service cancellation, it is important for network carriers (telecommunications carriers) and communication service providers to understand the quality of user experience while using communication services. That is important. Therefore, technology for estimating user quality of experience (QoE) has been established for the purpose of monitoring the quality of communication services such as video distribution, web browsing, and voice calls. For example, when the target service is a video distribution service, ITU-T Recommendation P.1203 is standardized (Non-Patent Document 1). Regarding web browsing, the Web-Browsing QoE Estimation Model (Non-Patent Document 2) has been proposed.
In addition, existing user experience quality estimation technology is based on data evaluated within the same target communication service, and the output values of user experience quality estimation technology targeting different communication services can be directly compared. I can't. For example, the technology in Non-Patent Document 1 outputs the user experience quality of video distribution in the range of 1 (very poor) to 5 (very good), whereas the technology in Non-Patent Document 2 It describes a technique for outputting the user experience quality on a scale of 1 to 5. Here, suppose that both technologies are used to monitor the quality, and the user experience quality for video distribution users A and B is estimated to be 3.0 and 4.0, respectively, and the user experience quality for web browsing user C is estimated to be 3.5. do. At this time, with respect to users A and B whose output values are compared for the same communication service, it can be said that user A has a lower user experience quality. However, since the output values of different communication services cannot be directly compared, it is not possible to determine whether user C has a lower or higher user experience quality than users A and B.
　ところが、ネットワーク事業者や通信サービス提供者は、通信サービスの監視によりユーザの体感品質がより低くなっているサービスを検知するために、サービス横断的にサービス利用時のユーザ体感品質を把握する必要がある。そのためには、それぞれの通信サービスに対するユーザ体感品質の推定値を同一尺度で比較可能とするユーザ体感品質推定技術が求められている。また、通信サービス間での品質比較を可能とする同一尺度での出力を参照することで、通信サービスを横断的に限られたリソースの中でユーザ体感品質を最適化するようなリソースの割り当て等の制御技術に活用することができる。 However, network operators and communication service providers need to understand the quality of user experience when using services across services in order to monitor communication services and detect services where the user's quality of experience is lower. be. To this end, there is a need for a quality of user experience estimating technique that allows the estimated values of the quality of user experience for each communication service to be compared on the same scale. In addition, by referring to the output on the same scale that enables quality comparison between communication services, it is possible to allocate resources that optimize the user experience quality within limited resources across communication services. It can be used for control technology.
　但し、上述したように、既存のユーザ体感品質推定技術を併用するだけでは、異なる通信サービス間でのユーザ体感品質を同一尺度で比較することはできない。同一尺度で比較可能とするためには、例えば、複数の通信サービスの評価が混在するような主観品質評価実験を実施し、得られた評価結果を同一尺度上の結果とする補正を行う必要がある。 However, as described above, it is not possible to compare the user experience quality between different communication services on the same scale simply by using existing user experience quality estimation techniques together. In order to be able to compare on the same scale, it is necessary, for example, to conduct a subjective quality evaluation experiment in which evaluations of multiple communication services are mixed, and to correct the obtained evaluation results so that they are on the same scale. be.
　しかしながら、主観品質評価実験の実施には専門的な知識が必要であり、評価者を集めるコストがかかる。従って、このような異なる通信サービス間の品質比較が可能な同一尺度でのユーザ体感品質を、新たに主観品質評価実験することなく推定可能な技術が求められている。 However, conducting a subjective quality evaluation experiment requires specialized knowledge, and it is costly to gather evaluators. Therefore, there is a need for a technology that can estimate the quality of user experience on the same scale that allows quality comparison between different communication services without conducting new subjective quality evaluation experiments.
　本発明は、上述の事情に鑑みてなされたもので、主観品質評価の実験をすることなく、複数の通信サービス間の品質比較が可能な同一尺度としてのユーザ体感品質を推定することを目的とする。 The present invention has been made in view of the above-mentioned circumstances, and its purpose is to estimate user-experienced quality as the same scale that allows quality comparisons between multiple communication services without conducting subjective quality evaluation experiments. do.
　上記目的を達成するため、請求項１に係る発明は、複数の通信サービスが利用される環境において、通信サービスの利用中に取得可能な品質パラメータに基づきユーザ体感品質を推定するユーザ体感品質推定装置であって、第１の通信サービスに係る第１の品質パラメータを入力として第１のユーザ体感品質の推定値を出力する第1のユーザ体感品質推定部と、過去の第１期間において前記第１の通信サービスの利用中の前記第１のユーザ体感品質の推定値を記録した第１の品質管理部で管理されている前記第１のユーザ体感品質の推定値に基づき、第１の発生確率分布を生成する第１の分布生成部と、第２の通信サービスに係る第２の品質パラメータを入力として第２のユーザ体感品質の推定値を出力する第２のユーザ体感品質推定部と、過去の第２期間において前記第２の通信サービスの利用中の前記第２のユーザ体感品質の推定値を記録した第２の品質管理部で管理されている前記第２のユーザ体感品質の推定値に基づき、第２の発生確率分布を生成する第２の分布生成部と、前記第１のユーザ体感品質推定部が出力する前記第１のユーザ体感品質の推定値を、前記第１及び第２の発生確率分布に基づいて補正を行うことで、補正後の前記第１のユーザ体感品質の推定値を出力する補正部と、を有することを特徴とするユーザ体感品質推定装置。である。 In order to achieve the above object, the invention according to claim 1 provides a user experience quality estimation device that estimates user experience quality based on quality parameters that can be obtained while using a communication service in an environment where a plurality of communication services are used. a first user experience quality estimator that outputs an estimated value of a first user experience quality by inputting a first quality parameter related to a first communication service; A first occurrence probability distribution based on the estimated value of the first quality of user experience managed by a first quality control unit that records the estimated value of the first quality of user experience while using the communication service. a first distribution generation unit that generates a distribution, a second user experience quality estimation unit that receives a second quality parameter related to a second communication service as input and outputs an estimated value of a second user experience quality; Based on the estimated value of the second quality of user experience managed by the second quality control unit that records the estimated value of the second quality of user experience while using the second communication service in the second period. , a second distribution generation unit that generates a second occurrence probability distribution, and an estimated value of the first user experience quality outputted by the first user experience quality estimation unit, A user experience quality estimating device comprising: a correction unit that outputs an estimated value of the first user experience quality after correction by performing correction based on a probability distribution. It is.
　以上説明したように本発明によれば、主観品質評価の実験をすることなく、複数の通信サービス間の品質比較が可能な同一尺度としてのユーザ体感品質を推定することができるという効果を奏する。 As explained above, according to the present invention, it is possible to estimate the user-experienced quality as the same measure that allows quality comparison between a plurality of communication services without conducting a subjective quality evaluation experiment.
実施形態に係る通信システムの全体構成図である。1 is an overall configuration diagram of a communication system according to an embodiment. 本実施形態に係るユーザ体感品質推定装置の電気的なハードウェア構成図である。FIG. 1 is an electrical hardware configuration diagram of a user experience quality estimation device according to the present embodiment. 本実施形態に係る通信端末の電気的なハードウェア構成図である。FIG. 2 is an electrical hardware configuration diagram of a communication terminal according to the present embodiment. 実施形態に係るユーザ体感品質推定装置の機能構成図である。FIG. 1 is a functional configuration diagram of a user experience quality estimation device according to an embodiment. 実施形態に係るユーザ体感品質の推定値の補正のイメージ図である。FIG. 6 is an image diagram of correction of the estimated value of the quality of user experience according to the embodiment. 実施形態に係るユーザ体感品質推定方法の処理を示すフローチャートである。3 is a flowchart illustrating processing of a user experience quality estimation method according to an embodiment.
　以下、図面を用いて本発明の実施形態を説明する。 Hereinafter, embodiments of the present invention will be described using the drawings.
　〔実施形態のシステム構成〕
　図１を用いて、実施形態の通信システムの構成の概略について説明する。図１は、実施形態に係る通信システムの全体構成図である。 [System configuration of embodiment]
The outline of the configuration of the communication system according to the embodiment will be described using FIG. 1. FIG. 1 is an overall configuration diagram of a communication system according to an embodiment.
　図１に示されているように、本実施形態の通信システム１０は、ユーザ体感品質推定装置３０、コンテンツ配信装置５０、及びユーザ端末７０によって構築されている。ユーザ端末７０は、ユーザによって管理及び使用される。ユーザ体感品質推定装置３０、コンテンツ配信装置５０、及びユーザ端末７０は、インターネット等の通信ネットワーク１００を介して通信することができる。通信ネットワーク１００には、ネットワーク事業者が管理（提供）しているISP（Internet Service Provider）ネットワーク等の所定のネットワークが含まれている。この所定のネットワークは、映像配信、Webブラウジング、音声通話等のベストエフォート型ネットワークである。通信ネットワーク１００の接続形態は、無線又は有線のいずれでも良い。なお、通信ネットワーク１００上には、コンテンツ配信装置５０は複数存在するが、図１では便宜的に１つのコンテンツ配信装置５０が示されている。同様に、ユーザ端末７０も複数存在するが、図１では便宜的に１つのユーザ端末７０が示されている。 As shown in FIG. 1, the communication system 10 of this embodiment is constructed by a user experience quality estimation device 30, a content distribution device 50, and a user terminal 70. The user terminal 70 is managed and used by a user. The user experience quality estimation device 30, the content distribution device 50, and the user terminal 70 can communicate via a communication network 100 such as the Internet. The communication network 100 includes a predetermined network such as an ISP (Internet Service Provider) network managed (provided) by a network operator. This predetermined network is a best effort network for video distribution, web browsing, voice calls, etc. The connection form of the communication network 100 may be either wireless or wired. Although there are a plurality of content distribution devices 50 on the communication network 100, one content distribution device 50 is shown in FIG. 1 for convenience. Similarly, although there are a plurality of user terminals 70, one user terminal 70 is shown in FIG. 1 for convenience.
　ユーザ体感品質推定装置３０は、単数又は複数のコンピュータによって構成されている。ユーザ体感品質推定装置３０が複数のコンピュータによって構成されている場合には、「ユーザ体感品質推定装置」と示しても良いし、「ユーザ体感品質推定システム」と示しても良い。 The user experience quality estimation device 30 is configured by one or more computers. When the user experience quality estimating device 30 is constituted by a plurality of computers, it may be referred to as a "user experience quality estimation device" or a "user experience quality estimation system."
　ユーザ体感品質推定装置３０は、複数の通信サービスの各品質パラメータに基づき品質推定技術（非特許文献１，２参照）が算出するユーザ体感品質の推定値の発生確率分布を生成し、複数の通信サービスの各発生確率分布に基づき、品質推定技術により出力するユーザ体感品質の推定値を補正することで、複数の通信サービス間の品質比較が可能な同一尺度としてのユーザ体感品質を推定することができる。 The user experience quality estimation device 30 generates an occurrence probability distribution of the estimated value of the user experience quality calculated by the quality estimation technology (see Non-Patent Documents 1 and 2) based on each quality parameter of a plurality of communication services, and By correcting the estimated value of the user experience quality output using quality estimation technology based on the occurrence probability distribution of each service, it is possible to estimate the user experience quality as the same scale that allows quality comparisons between multiple communication services. can.
　品質パラメータは、ユーザ端末７０にインストールされている所定のアプリケーション（後述の通信品質計測アプリケーション）によって計測される情報である。品質パラメータとしては、映像のビットレート、解像度、フレームレート、オーディオのビットレート、再生停止に関する情報（動画の再生中に動画が止まった回数）等が挙げられる。 The quality parameter is information measured by a predetermined application (communication quality measurement application described below) installed on the user terminal 70. Examples of quality parameters include video bit rate, resolution, frame rate, audio bit rate, information regarding playback stop (number of times the video stops during video playback), and the like.
　また、コンテンツ配信装置５０は、単数又は複数のコンピュータによって構成されている。コンテンツ配信装置５０が複数のコンピュータによって構成されている場合には、「コンテンツ配信装置」と示しても良いし、「コンテンツ配信システム」と示しても良い。 Furthermore, the content distribution device 50 is configured by one or more computers. When the content distribution device 50 is composed of a plurality of computers, it may be referred to as a "content distribution device" or a "content distribution system."
　コンテンツ配信装置５０は、コンテンツ事業者が有するサーバであり、通信ネットワーク１００を介し、ユーザ端末７０に対して、情報通信サービスにおけるコンテンツデータを配信している。 The content distribution device 50 is a server owned by a content provider, and distributes content data in an information communication service to the user terminal 70 via the communication network 100.
　ユーザ端末７０は、コンピュータであり、図１では、一例としてノート型パソコンが示されている。図１では、ユーザが、ユーザ端末７０を操作する。ユーザ端末７０には、ユーザ端末７０で再生中のコンテンツの再生品質等を計測して品質パラメータを出力するための通信品質計測アプリケーションがインストールされており、ユーザ端末７０は、品質パラメータを定期的にユーザ体感品質推定装置３０に送信する。なお、ネットワーク事業者（通信事業者）が管理しているISP（Internet Service Provider）ネットワーク等の所定のネットワーク上のルータ又はサーバ等がトラヒック状態等を監視しており、このルータ又はサーバ等が定期的にユーザ体感品質推定装置３０に品質パラメータを送信してもよい。また、通信サービス提供者のサーバ等がトラヒック状態等を監視しており、この通信サービス提供者のサーバ等が定期的にユーザ体感品質推定装置３０に品質パラメータを送信してもよい。 The user terminal 70 is a computer, and in FIG. 1, a notebook computer is shown as an example. In FIG. 1, a user operates a user terminal 70. A communication quality measurement application is installed on the user terminal 70 to measure the playback quality of the content being played on the user terminal 70 and output quality parameters, and the user terminal 70 periodically measures the quality parameters. It is transmitted to the user experience quality estimation device 30. Note that a router or server on a predetermined network such as an ISP (Internet Service Provider) network managed by a network operator (telecommunications carrier) monitors the traffic status, etc. The quality parameters may be sent to the user experience quality estimation device 30 directly. Further, the communication service provider's server or the like may monitor the traffic status, etc., and the communication service provider's server or the like may periodically transmit quality parameters to the user experience quality estimation device 30.
　〔ハードウェア構成〕
　＜ユーザ体感品質推定装置のハードウェア構成＞
　次に、図２を用いて、ユーザ体感品質推定装置３０の電気的なハードウェア構成を説明する。図２は、ユーザ体感品質推定装置の電気的なハードウェア構成図である。 [Hardware configuration]
<Hardware configuration of user experience quality estimation device>
Next, the electrical hardware configuration of the user experience quality estimation device 30 will be described using FIG. 2. FIG. 2 is an electrical hardware configuration diagram of the user experience quality estimation device.
　ユーザ体感品質推定装置３０は、コンピュータとして、図２に示されているように、ＣＰＵ(Central Processing Unit)３０１、ＲＯＭ(Read Only Memory)３０２、ＲＡＭ(Random Access Memory)３０３、ＳＳＤ(Solid State Drive)３０４、外部機器接続Ｉ／Ｆ(Interface)３０５、ネットワークＩ／Ｆ３０６、メディアＩ／Ｆ３０９、及びバスライン３１０を備えている。 As shown in FIG. 2, the user experience quality estimation device 30 is a computer that includes a CPU (Central Processing Unit) 301, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, and an SSD (Solid State Drive). ) 304, an external device connection I/F (Interface) 305, a network I/F 306, a media I/F 309, and a bus line 310.
　これらのうち、ＣＰＵ３０１は、ユーザ体感品質推定装置３０全体の動作を制御する。ＲＯＭ３０２は、ＩＰＬ(Initial Program Loader)等のＣＰＵ３０１の駆動に用いられるプログラムを記憶する。ＲＡＭ３０３は、ＣＰＵ３０１のワークエリアとして使用される。 Among these, the CPU 301 controls the overall operation of the user experience quality estimation device 30. The ROM 302 stores programs used to drive the CPU 301, such as IPL (Initial Program Loader). RAM 303 is used as a work area for CPU 301.
　ＳＳＤ３０４は、ＣＰＵ３０１の制御に従って各種データの読み出し又は書き込みを行う。なお、ＳＤＤ３０４の代わりに、ＨＤＤ(Hard Disk Drive)を用いても良い。 The SSD 304 reads or writes various data under the control of the CPU 301. Note that an HDD (Hard Disk Drive) may be used instead of the SDD 304.
　外部機器接続Ｉ／Ｆ３０５は、各種の外部機器を接続するためのインターフェースである。この場合の外部機器は、ディスプレイ、スピーカ、キーボード、マウス、ＵＳＢ(Universal Serial Bus)メモリ、及びプリンタ等である。 The external device connection I/F 305 is an interface for connecting various external devices. External devices in this case include a display, speaker, keyboard, mouse, USB (Universal Serial Bus) memory, printer, and the like.
　ネットワークＩ／Ｆ３０６は、通信ネットワーク１００を介してデータ通信をするためのインターフェースである。 The network I/F 306 is an interface for data communication via the communication network 100.
　メディアＩ／Ｆ３０９は、フラッシュメモリ等の記録メディア３０９ｍに対するデータの読み出し又は書き込み（記憶）を制御する。記録メディア３０９ｍには、ＤＶＤ(Digital Versatile Disc)やＢｌｕ-ｒａｙ Ｄｉｓｃ（登録商標）等も含まれる。 The media I/F 309 controls reading or writing (storage) of data to a recording medium 309m such as a flash memory. The recording media 309m also include DVDs (Digital Versatile Discs), Blu-ray Discs (registered trademark), and the like.
　バスライン３１０は、図２に示されているＣＰＵ３０１等の各構成要素を電気的に接続するためのアドレスバスやデータバス等である。 The bus line 310 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 301 shown in FIG. 2.
　なお、コンテンツ配信装置５０は、ユーザ体感品質推定装置３０と同様の構成を有するため、コンテンツ配信装置５０の電気的なハードウェア構成の説明は省略する。 Note that since the content distribution device 50 has the same configuration as the user experience quality estimation device 30, a description of the electrical hardware configuration of the content distribution device 50 will be omitted.
　＜通信端末のハードウェア構成＞
　次に、図３を用いて、ユーザ端末７０の電気的なハードウェア構成を説明する。図３は、通信端末の電気的なハードウェア構成図である。 <Hardware configuration of communication terminal>
Next, the electrical hardware configuration of the user terminal 70 will be described using FIG. 3. FIG. 3 is an electrical hardware configuration diagram of the communication terminal.
　ユーザ端末７０は、コンピュータとして、図３に示されているように、ＣＰＵ５０１、ＲＯＭ５０２、ＲＡＭ５０３、ＳＳＤ５０４、外部機器接続Ｉ／Ｆ(Interface)５０５、ネットワークＩ／Ｆ５０６、ディスプレイ５０７、ポインティングデバイス５０８、メディアＩ／Ｆ５０９、及びバスライン５１０を備えている。 As shown in FIG. 3, the user terminal 70 as a computer includes a CPU 501, ROM 502, RAM 503, SSD 504, external device connection I/F (Interface) 505, network I/F 506, display 507, pointing device 508, and media. It includes an I/F 509 and a bus line 510.
　これらのうち、ＣＰＵ５０１は、ユーザ端末７０全体の動作を制御する。ＲＯＭ５０２は、ＩＰＬ等のＣＰＵ５０１の駆動に用いられるプログラムを記憶する。ＲＡＭ５０３は、ＣＰＵ５０１のワークエリアとして使用される。 Among these, the CPU 501 controls the operation of the user terminal 70 as a whole. The ROM 502 stores programs used to drive the CPU 501 such as IPL. RAM 503 is used as a work area for CPU 501.
　ＳＳＤ５０４は、ＣＰＵ５０１の制御に従って各種データの読み出し又は書き込みを行う。なお、ＳＳＤ５０４の代わりに、ＨＤＤ(Hard Disk Drive)を用いてもよい。 The SSD 504 reads or writes various data under the control of the CPU 501. Note that an HDD (Hard Disk Drive) may be used instead of the SSD 504.
　外部機器接続Ｉ／Ｆ５０５は、各種の外部機器を接続するためのインターフェースである。この場合の外部機器は、ディスプレイ、スピーカ、キーボード、マウス、ＵＳＢメモリ、及びプリンタ等である。 The external device connection I/F 505 is an interface for connecting various external devices. External devices in this case include a display, speaker, keyboard, mouse, USB memory, printer, and the like.
　ネットワークＩ／Ｆ５０６は、通信ネットワーク１００を介してデータ通信をするためのインターフェースである。 The network I/F 506 is an interface for data communication via the communication network 100.
　ディスプレイ５０７は、各種画像を表示する液晶や有機ＥＬ(Electro Luminescence)などの表示手段の一種である。 The display 507 is a type of display means such as liquid crystal or organic EL (Electro Luminescence) that displays various images.
　ポインティングデバイス５０８は、各種指示の選択や実行、処理対象の選択、カーソルの移動などを行う入力手段の一種である。なお、ユーザがキーボードを使う場合は、ポインティングデバイス５０８の機能をＯＦＦにしてもよい。 The pointing device 508 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. Note that when the user uses a keyboard, the function of the pointing device 508 may be turned off.
　メディアＩ／Ｆ５０９は、フラッシュメモリ等の記録メディア５０９ｍに対するデータの読み出し又は書き込み（記憶）を制御する。記録メディア５０９ｍには、ＤＶＤやＢｌｕ-ｒａｙ Ｄｉｓｃ（登録商標）等も含まれる。 The media I/F 509 controls reading or writing (storage) of data to a recording medium 509m such as a flash memory. The recording media 509m also include DVDs, Blu-ray Discs (registered trademark), and the like.
　バスライン５１０は、図４に示されているＣＰＵ５０１等の各構成要素を電気的に接続するためのアドレスバスやデータバス等である。 The bus line 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501 shown in FIG. 4.
　〔ユーザ体感品質推定装置の機能構成〕
　続いて、図４を用いて、本実施形態に係るユーザ体感品質推定装置３０の機能構成について説明する。図４は、実施形態に係るユーザ体感品質推定装置の機能構成図である。なお、本実施形態では、ユーザ体感品質推定装置３０は、Ｎ（≧２）種の複数の通信サービスを対象としている。また、ユーザ体感品質推定装置３０は、ユーザ体感品質の推定を行う通信サービスZ（Ｚは１～Ｎの整数）の品質パラメータを入力として動作を開始し、通信サービスＺの補正後のユーザ体感品質の推定値を出力する。 [Functional configuration of user experience quality estimation device]
Next, the functional configuration of the user experience quality estimation device 30 according to this embodiment will be described using FIG. 4. FIG. 4 is a functional configuration diagram of the user experience quality estimation device according to the embodiment. In this embodiment, the user experience quality estimation device 30 targets N (≧2) types of communication services. Further, the user experience quality estimation device 30 starts operation by inputting the quality parameters of the communication service Z (Z is an integer from 1 to N) for which the user experience quality is to be estimated, and calculates the corrected user experience quality of the communication service Z. Output the estimated value of .
　図４に示すように、ユーザ体感品質推定装置３０は、取得部３１、複数のユーザ体感品質推定部３２１～３２Ｎ、複数の分布生成部３３１～３３Ｎ、補正部３６、及び出力部３９を有する。これら各部は、プログラムに基づき図２のＣＰＵ３０１による命令によって実現される機能である。また、ＲＡＭ３０３又はＳＳＤ３０４には、複数のユーザ体感品質推定部３２１～３２Ｎのそれぞれが記録又は読み出し可能な品質管理ＤＢ(Data Base：データベース)４０１～４０Ｎが構築されている。 As shown in FIG. 4, the user experience quality estimation device 30 includes an acquisition section 31, a plurality of user experience quality estimation sections 32 1 to 32 N , a plurality of distribution generation sections 33 1 to 33 N , a correction section 36, and an output section. It has 39. Each of these units is a function realized by instructions from the CPU 301 in FIG. 2 based on a program. Further, in the RAM 303 or the SSD 304, quality control DBs (Data Bases) 40 1 to 40 N are constructed, which can be recorded or read by each of the plurality of user experience quality estimation units 32 1 to 32 N.
　なお、以降、ユーザ体感品質推定部３２１～３２Ｎの総称を「ユーザ体感品質推定部３２」と示す。分布生成部３３１～３３Ｎの総称を「分布生成部３３」と示す。更に、品質管理ＤＢ４０１～４０Ｎの総称を「品質管理ＤＢ４０」と示す。 Note that hereinafter, the user experience quality estimation units 32 1 to 32 N will be collectively referred to as the “user experience quality estimation unit 32”. The distribution generating units 33 1 to 33 N are collectively referred to as “distribution generating unit 33”. Furthermore, the quality control DBs 40 1 to 40 N are collectively referred to as "quality control DB 40".
　品質管理ＤＢ４０１～４０Ｎは、対象期間（一定期間）の補正前のユーザ体感品質Qを記録している。記録方法の一例として、対象期間において取得された品質パラメータからユーザ体感品質推定部３２で適用しているユーザ体感品質推定技術により算出されるユーザ体感品質の推定値と、品質パラメータの取得日時（時刻）とを関連付けて記録することが挙げられる。なお、品質管理ＤＢ４０に記録されるデータとしては、１年前～現在などの特定の期間のデータが挙げられる。 The quality control DBs 40 1 to 40 N record the user experience quality Q before correction for the target period (certain period). As an example of a recording method, the estimated value of the user experience quality calculated by the user experience quality estimation technology applied by the user experience quality estimation unit 32 from the quality parameters acquired in the target period, and the acquisition date and time (time and time) of the quality parameter. ). Note that the data recorded in the quality control DB 40 includes data for a specific period, such as from one year ago to the present.
　取得部３１は、ユーザ端末７０（通信品質計測アプリケーション）から、各通信サービスの利用中に取得可能なユーザ体感品質の情報を取得する。なお、取得部は、「入力部」と示しても良い。 The acquisition unit 31 acquires user experience quality information that can be acquired while using each communication service from the user terminal 70 (communication quality measurement application). Note that the acquisition section may also be referred to as an "input section."
　ユーザ体感品質推定部３２は、取得部３１が取得した品質パラメータを入力として、補正前のユーザ体感品質の推定値を算出し、分布生成部３３、及び補正部３６に出力する。ユーザ体感品質推定部３２は、既存の通信サービスのユーザ体感品質推定技術を適用可能であり、対象の通信サービスとしては、例えば、映像配信サービス、VR映像配信サービス、音声通話サービス、Webブラウジング、Web会議システム、オンラインゲームなどが挙げられる。 The user experience quality estimation unit 32 receives the quality parameters acquired by the acquisition unit 31 as input, calculates an estimated value of the user experience quality before correction, and outputs it to the distribution generation unit 33 and the correction unit 36. The user experience quality estimating unit 32 can apply the user experience quality estimation technology of existing communication services, and the target communication services include, for example, video distribution service, VR video distribution service, voice call service, Web browsing, Web Examples include conference systems and online games.
　例えば、ユーザ体感品質推定部３２１は、通信サービスが映像配信サービスの場合にユーザ体感品質の推定値を出力するため、非特許文献１（ITU-T勧告P.1203）の技術を用いる。この場合、ユーザ体感品質推定部３２１は、品質パラメータとして、映像のビットレート、解像度、フレームレート、オーディオのビットレート、再生停止に関する情報等を入力し、映像視聴に対するユーザ体感品質の推定値を１～５（数値が大きい方が良い品質を表す）で出力する。 For example, the user experience quality estimating unit 321 uses the technology of Non-Patent Document 1 (ITU-T Recommendation P.1203) to output an estimated value of the user experience quality when the communication service is a video distribution service. In this case, the user experience quality estimation unit 321 inputs the video bit rate, resolution, frame rate, audio bit rate, information regarding playback stop, etc. as quality parameters, and calculates the estimated value of the user experience quality for video viewing. Output from 1 to 5 (larger number indicates better quality).
　また、例えば、ユーザ体感品質推定部３２２は、通信サービスがWebブラウジングのサービスの場合にユーザ体感品質の推定値を出力するため、非特許文献２の技術を用いる。この場合、ユーザ体感品質推定部３２２は、品質パラメータとして、表示までの待ち時間に関する情報を入力し、Webブラウジングに対するユーザ体感品質を１～５（数値が大きい方が良い品質を表す）で出力する。 Furthermore, for example, the user experience quality estimating unit 322 uses the technique of Non-Patent Document 2 to output an estimated value of the user experience quality when the communication service is a Web browsing service. In this case, the user experience quality estimating unit 322 inputs information regarding the waiting time until display as a quality parameter, and outputs the user experience quality for web browsing from 1 to 5 (a larger number indicates better quality). do.
　分布生成部３３は、補正部３６からの生成依頼に対して、品質管理ＤＢ４０に記録されるユーザ体感品質の推定値に基づいて発生確率分布を生成し、補正部３６に出力する。例えば、品質管理ＤＢ４０に、ユーザ体感品質の推定値を大量に記録しておくことで、分布生成部３３は、特定のユーザ体感品質の推定値（例えば「３」）のパーセンタイル（例えば５０％）を導出可能な発生確率分布を生成することができる。 In response to the generation request from the correction unit 36, the distribution generation unit 33 generates an occurrence probability distribution based on the estimated value of the user experience quality recorded in the quality management DB 40, and outputs it to the correction unit 36. For example, by recording a large number of estimated values of user experience quality in the quality management DB 40, the distribution generation unit 33 can generate a percentile (for example, 50%) of a specific user experience quality estimate (for example, "3"). It is possible to generate an occurrence probability distribution that can be derived.
　補正部３６は、所定のユーザ体感品質推定部３２が出力した所定の通信サービスＺに係る所定のユーザ体感品質の推定値、及び複数の分布生成部３３から取得した複数の通信サービス（所定の通信サービスＺを含む）に係る複数の発生確率分布に基づいて、所定のユーザ体感品質の推定値を補正し、補正後の所定のユーザ体感品質の推定値を出力する。本実施形態においては、補正部３６は、各発生確率分布を重ね合わせた発生確率分布Gを算出する。そして、補正部３６は、所定の発生確率分布Fにおける補正前の所定のユーザ体感品質の推定値QのパーセンタイルPを算出し、発生確率分布Gおける同じパーセンタイルPを補正後のパーセンタイルP'とすることで、補正後の所定のユーザ体感品質の推定値Q'を算出する。 The correction unit 36 uses the estimated value of the predetermined user experience quality related to the predetermined communication service Z output by the predetermined user experience quality estimation unit 32 and the plurality of communication services (predetermined communication The estimated value of the predetermined quality of user experience is corrected based on a plurality of occurrence probability distributions related to (including service Z), and the corrected estimated value of the quality of user experience is output. In this embodiment, the correction unit 36 calculates an occurrence probability distribution G by superimposing each occurrence probability distribution. Then, the correction unit 36 calculates the percentile P of the predetermined user experience quality estimate Q before correction in the predetermined occurrence probability distribution F, and sets the same percentile P in the occurrence probability distribution G as the post-correction percentile P'. In this way, an estimated value Q' of the corrected predetermined user experience quality is calculated.
　ここで、図５を用いて、補正部３６がユーザ体感品質の推定値を補正する内容を詳細に説明する。図５は、実施形態に係るユーザ体感品質の推定値の補正のイメージ図である。 Here, with reference to FIG. 5, details of how the correction unit 36 corrects the estimated value of the quality of user experience will be described in detail. FIG. 5 is an image diagram of correction of the estimated value of the quality of user experience according to the embodiment.
　図５では、一例として、N＝2、通信サービスＺがサービス１の場合を示しており、横軸はユーザ体感品質を示し、縦軸は累積確率を示す。各通信サービスの累積分布は、それぞれの発生確率分布を数値積分することで求めることができる。 FIG. 5 shows, as an example, a case where N=2 and communication service Z is service 1, where the horizontal axis shows the user experience quality and the vertical axis shows the cumulative probability. The cumulative distribution of each communication service can be obtained by numerically integrating the respective occurrence probability distributions.
　通信サービスiの補正前のユーザ体感品質の推定値xに対する過去の累積分布関数をFi(x)するとき、重ね合わせた累積分布関数G(x)は、（式１）で計算することができる。 When F i (x) is the past cumulative distribution function for the estimated value x of the user experience quality before correction for communication service i, the superimposed cumulative distribution function G(x) can be calculated using (Equation 1). can.
Figure JPOXMLDOC01-appb-M000001
 　但し、wiは
Figure JPOXMLDOC01-appb-M000001
 However, w i is
Figure JPOXMLDOC01-appb-M000002
 を満たす重み係数である。wiは、定数でもよく、最も単純にはwi = 1/Nで定めればよい。また、各通信サービスのユーザ数や利用頻度などに基づいて定めてもよい。
Figure JPOXMLDOC01-appb-M000002
 It is a weighting coefficient that satisfies the following. w i may be a constant; most simply, w i = 1/N. Alternatively, it may be determined based on the number of users of each communication service, frequency of use, etc.
　本実施形態においては、補正部３６は、ユーザ体感品質推定装置３０に入力された所定の通信サービスＺの品質パラメータに基づいて所定のユーザ体感品質推定部３２が出力した補正前のユーザ体感品質の推定値をQとしたとき、通信サービスＺに対する発生確率分布関数FZ(x)におけるユーザ体感品質の推定値QのパーセンタイルP（図５では、破線における点のＹ座標）を求める。次に、補正部３６は、重ね合わせた発生確率分布関数G(x)におけるパーセンタイルPの値Q'（図５では、実線における点のＸ座標）を、複数の通信サービスを考慮した同一尺度上の補正後のユーザ体感品質の推定値として出力する。これにより、補正部３６は、ユーザ体感品質と発生確率分布との対応に着目した補正を行う。即ち、補正部３６は、各通信サービスの発生確率分布におけるパーセンタイル（例えば2%程度しか経験しない悪い品質や中央値など）と、各通信サービスの発生確率分布を重ね合わせた発生確率分布とを参照することで、異なる複数の通信サービス間で比較可能な同一尺度上のユーザ体感品質の推定値への補正が可能となる。 In the present embodiment, the correction unit 36 adjusts the user experience quality before correction output by the predetermined user experience quality estimation unit 32 based on the quality parameters of the predetermined communication service Z input to the user experience quality estimation device 30. When the estimated value is Q, the percentile P (in FIG. 5, the Y coordinate of the point on the broken line) of the estimated value Q of the user experience quality in the occurrence probability distribution function F Z (x) for the communication service Z is determined. Next, the correction unit 36 calculates the value Q' of the percentile P in the superimposed occurrence probability distribution function G(x) (in FIG. 5, the X coordinate of the point on the solid line) on the same scale considering multiple communication services. is output as an estimated value of the user experience quality after correction. Thereby, the correction unit 36 performs correction focusing on the correspondence between the user experience quality and the occurrence probability distribution. That is, the correction unit 36 refers to the percentile in the occurrence probability distribution of each communication service (for example, poor quality experienced by only about 2%, median value, etc.) and the occurrence probability distribution obtained by superimposing the occurrence probability distribution of each communication service. By doing so, it becomes possible to correct the estimated value of the user experience quality on the same scale that can be compared between a plurality of different communication services.
　出力部３９は、補正部３６によって補正された補正後のユーザ体感品質の推定値を取得し、ユーザ体感品質推定装置３０から、この推定値を含む情報を出力する。出力する例としては、図２の外部機器接続Ｉ／Ｆ３０５に接続されたディスプレイに表示させる場合、ネットワークＩ／Ｆ３０６を介して外部装置に送信する場合等が挙げられる。 The output unit 39 acquires the estimated value of the corrected user experience quality corrected by the correction unit 36, and outputs information including this estimated value from the user experience quality estimation device 30. Examples of output include displaying on a display connected to external device connection I/F 305 in FIG. 2, and transmitting to an external device via network I/F 306.
　〔ユーザ体感品質推定装置の処理又は動作〕
　続いて、図６を用いて、ユーザ体感品質推定装置３０の処理又は動作について説明する。図６は、実施形態に係るユーザ体感品質推定方法の処理を示すフローチャートである。 [Processing or operation of user experience quality estimation device]
Next, the processing or operation of the user experience quality estimation device 30 will be described using FIG. 6. FIG. 6 is a flowchart showing the processing of the user experience quality estimation method according to the embodiment.
　Ｓ１１：取得部３１は、ユーザ端末７０から、各通信サービスの品質パラメータを取得する。 S11: The acquisition unit 31 acquires the quality parameters of each communication service from the user terminal 70.
　Ｓ１２：ユーザ体感品質推定部３２は、各品質パラメータに基づいて各通信サービスのユーザ体感品質の推定値Qを推定する。 S12: The user experience quality estimation unit 32 estimates the estimated value Q of the user experience quality of each communication service based on each quality parameter.
　Ｓ１３：各分布生成部３３は、補正前の各ユーザ体感品質の推定値Qを記録すると共に、補正部３６からの生成依頼に対して、過去の一定期間において各品質管理ＤＢ４０に記録されるユーザ体感品質の推定値に基づいて各発生確率分布を生成し、補正部３６に出力する。なお、各分布生成部３３は、必ずしも同じ過去の一定期間において各品質管理ＤＢ４０に記録されるユーザ体感品質の推定値に基づいて各発生確率分布を生成しなくてもよい。例えば、分布生成部３３１は、過去の第１期間において品質管理ＤＢ４０１に記録されるユーザ体感品質の推定値に基づいて発生確率分布を生成し、過去の第２期間において品質管理ＤＢ４０２に記録されるユーザ体感品質の推定値に基づいて発生確率分布を生成してもよい。この場合、過去の第1期及び過去の第2期は、同じ期間、異なる期間、又は一部が重複する期間である。 S13: Each distribution generation unit 33 records the estimated value Q of each user experience quality before correction, and in response to the generation request from the correction unit 36, each distribution generation unit 33 records the estimated value Q of each user experience quality before correction, and in response to the generation request from the correction unit 36, the distribution generation unit 33 records the estimated value Q of each user experience quality before correction, and in response to the generation request from the correction unit 36, Each occurrence probability distribution is generated based on the estimated value of the perceived quality and output to the correction unit 36. Note that each distribution generation unit 33 does not necessarily need to generate each occurrence probability distribution based on the estimated value of the user experience quality recorded in each quality control DB 40 in the same past fixed period. For example, the distribution generation unit 33 1 generates an occurrence probability distribution based on the estimated value of the user experience quality recorded in the quality control DB 40 1 in the past first period, and generates the occurrence probability distribution in the quality control DB 40 2 in the past second period. An occurrence probability distribution may be generated based on the recorded estimated quality of user experience. In this case, the past first period and the past second period are the same period, different periods, or periods that partially overlap.
　Ｓ１４：補正部３６は、各発生確率分布を重ね合わせた発生確率分布Gを算出する。 S14: The correction unit 36 calculates an occurrence probability distribution G by superimposing each occurrence probability distribution.
　Ｓ１５：補正部３６は、各通信サービスのうち所定の通信サービスＺに係る所定の発生確率分布Fにおける補正前の所定のユーザ体感品質の推定値QのパーセンタイルPを算出し、発生確率分布Gおける同じパーセンタイルPを補正後のパーセンタイルP'とすることで、補正後の所定のユーザ体感品質の推定値Q'を算出する。 S15: The correction unit 36 calculates the percentile P of the estimated value Q of the predetermined user experience quality before correction in the predetermined occurrence probability distribution F for the predetermined communication service Z among the respective communication services, and By setting the same percentile P as the corrected percentile P', an estimated value Q' of the corrected predetermined user experience quality is calculated.
　Ｓ１６：出力部３９は、所定のサービスＺに係る補正後のユーザ体感品質の推定値Q'に関する情報を出力する。 S16: The output unit 39 outputs information regarding the estimated value Q' of the corrected user experience quality related to the predetermined service Z.
　〔本実施形態の効果〕
　以上説明したように、本実施形態のユーザ体感品質推定装置３０は、複数の通信サービスのユーザ体感品質の推定値の発生確率分布に基づき、各通信サービスにおけるユーザ体感品質の推定値の発生頻度を加味した補正をすることで、主観品質評価の実験をすることなく、複数の通信サービス間の品質比較が可能な同一尺度としてのユーザ体感品質を推定することができる。 [Effects of this embodiment]
As described above, the user experience quality estimating device 30 of the present embodiment calculates the frequency of occurrence of the user experience quality estimate for each communication service based on the occurrence probability distribution of the user experience quality estimate for a plurality of communication services. By making corrections that take this into account, it is possible to estimate the quality of user experience as the same measure that allows quality comparisons between a plurality of communication services, without conducting experiments on subjective quality evaluation.
　〔補足〕
　以上、第１期の環境に対応した高精度なユーザ体感品質の推定値を算出することを可能にする手法について説明したが、本発明は、上記の実施形態に限定されることなく、例えば以下に示すように、種々の変更及び応用が可能である。 〔supplement〕
The above describes a method that makes it possible to calculate a highly accurate estimated value of user experience quality corresponding to the environment of the first period. However, the present invention is not limited to the above embodiments, Various modifications and applications are possible, as shown in FIG.
　（１）ユーザ体感品質推定装置３０はコンピュータとプログラムによっても実現できるが、このプログラムを（非一時的）記録媒体に記録することも、インターネット等の通信ネットワーク１００を介して提供することも可能である。 (1) The user experience quality estimation device 30 can be realized by a computer and a program, but this program can also be recorded on a (non-temporary) recording medium or provided via a communication network 100 such as the Internet. be.
　（２）上記実施形態では、ユーザ端末７０の一例としてノート型パソコンが示されているが、これに限るものではない。例えば、デスクトップパソコン、タブレット端末、スマートフォン、スマートウォッチ、ヘッドマウントディスプレイ、カーナビゲーション装置、冷蔵庫、電子レンジ等であってもよい。 (2) In the above embodiment, a notebook computer is shown as an example of the user terminal 70, but the invention is not limited to this. For example, it may be a desktop computer, a tablet terminal, a smartphone, a smart watch, a head-mounted display, a car navigation device, a refrigerator, a microwave oven, or the like.
　（３）各ＣＰＵ３０１，５０１、７０１は、単一だけでなく、複数であってもよい。 (3) Each of the CPUs 301, 501, and 701 may be not only a single CPU but also a plurality of CPUs.
　（４）品質管理ＤＢ４０は品質管理部の一例である。品質管理部は、データベース形式ではない状態でデータを記録してもよい。 (4) The quality control DB 40 is an example of a quality control department. The quality control department may record data in a state other than a database format.
１０　通信システム
３０　ユーザ体感品質推定装置
５０　コンテンツ配信装置
７０　ユーザ端末
３１　取得部（入力部）
３２　ユーザ体感品質推定部
３２１～３２Ｎ　ユーザ体感品質推定部（第１のユーザ体感品質推定部の一例、第２のユーザ体感品質推定部の一例）
３３　分布生成部
３３１～３３Ｎ　分布生成部（第１の分布生成部の一例、第２の分布生成部の一例）
３６　補正部
３９　出力部
４０　品質管理ＤＢ（品質管理部の一例）
４０１～４０Ｎ　品質管理ＤＢ（第１の品質管理部の一例、第２の品質管理部の一例） 10 Communication system 30 User experience quality estimation device 50 Content distribution device 70 User terminal 31 Acquisition unit (input unit)
32 User experience quality estimator 32 1 to 32 N user experience quality estimator (an example of a first user experience quality estimator, an example of a second user experience quality estimator)
33 Distribution generation unit 33 1 to 33 N distribution generation unit (an example of a first distribution generation unit, an example of a second distribution generation unit)
36 Correction section 39 Output section 40 Quality control DB (an example of a quality control section)
40 1 to 40 N Quality control DB (an example of the first quality control department, an example of the second quality control department)

Claims (6)

  1. 　複数の通信サービスが利用される環境において、通信サービスの利用中に取得可能な品質パラメータに基づきユーザ体感品質を推定するユーザ体感品質推定装置であって、
    　第１の通信サービスに係る第１の品質パラメータを入力として第１のユーザ体感品質の推定値を出力する第1のユーザ体感品質推定部と、
    　過去の第１期間において前記第１の通信サービスの利用中の前記第１のユーザ体感品質の推定値を記録した第１の品質管理部で管理されている前記第１のユーザ体感品質の推定値に基づき、第１の発生確率分布を生成する第１の分布生成部と、
    　第２の通信サービスに係る第２の品質パラメータを入力として第２のユーザ体感品質の推定値を出力する第２のユーザ体感品質推定部と、
    　過去の第２期間において前記第２の通信サービスの利用中の前記第２のユーザ体感品質の推定値を記録した第２の品質管理部で管理されている前記第２のユーザ体感品質の推定値に基づき、第２の発生確率分布を生成する第２の分布生成部と、
    　前記第１のユーザ体感品質推定部が出力する前記第１のユーザ体感品質の推定値を、前記第１及び第２の発生確率分布に基づいて補正を行うことで、補正後の前記第１のユーザ体感品質の推定値を出力する補正部と、
    　を有することを特徴とするユーザ体感品質推定装置。     A user experience quality estimation device that estimates user experience quality based on quality parameters that can be obtained while using a communication service in an environment where a plurality of communication services are used,
    a first user experience quality estimation unit that receives a first quality parameter related to a first communication service as input and outputs an estimated value of a first user experience quality;
    The estimated value of the first quality of user experience managed by a first quality control unit that records the estimated value of the first quality of user experience while using the first communication service in the past first period. a first distribution generation unit that generates a first occurrence probability distribution based on;
    a second user experience quality estimation unit that receives a second quality parameter related to a second communication service as input and outputs an estimated value of a second user experience quality;
    The estimated value of the second quality of user experience managed by the second quality control unit that records the estimated value of the second quality of user experience while using the second communication service in the past second period. a second distribution generation unit that generates a second occurrence probability distribution based on;
    By correcting the estimated value of the first user experience quality output by the first user experience quality estimation unit based on the first and second occurrence probability distributions, the first a correction unit that outputs an estimated value of user experience quality;
    A user experience quality estimation device comprising:
  2. 　前記第１の分布生成部は、前記過去の第１期間において前記第１の通信サービスの利用中に取得した前記第１の品質パラメータを入力として前記第１のユーザ体感品質推定部により出力された前記第１のユーザ体感品質の推定値を前記第１の品質管理部に記録することを特徴とする請求項１に記載のユーザ体感品質推定装置。 The first distribution generation unit receives as input the first quality parameter acquired while using the first communication service in the past first period, and outputs the quality parameter output by the first user experience quality estimation unit. The user experience quality estimation device according to claim 1, wherein the estimated value of the first user experience quality is recorded in the first quality control unit.
  3. 　前記補正部は、前記第１の発生確率分布と前記第２の発生確率分布とを重ね合わせた発生確率分布を算出し、当該重ね合わせた発生確率分布に基づいて前記補正を行うことを特徴とする請求項１に記載のユーザ体感品質推定装置。 The correction unit calculates an occurrence probability distribution by superimposing the first occurrence probability distribution and the second occurrence probability distribution, and performs the correction based on the superposed occurrence probability distribution. The user experience quality estimation device according to claim 1.
  4. 　前記過去の第1期及び前記過去の第2期は、同じ期間、異なる期間、又は一部が重複する期間であることを特徴とする請求項１乃至３のいずれか一項に記載のユーザ体感品質推定装置。 The user experience according to any one of claims 1 to 3, wherein the past first period and the past second period are the same period, different periods, or partially overlapping periods. Quality estimation device.
  5. 　複数の通信サービスが利用される環境において、通信サービスの利用中に取得可能な品質パラメータに基づきユーザ体感品質を推定するユーザ体感品質推定装置が実行するユーザ体感品質推定方法であって、
    　前記ユーザ体感品質推定装置は、
    　第１の通信サービスに係る第１の品質パラメータを入力として第１のユーザ体感品質の推定値を出力する第1のユーザ体感品質推定処理と、
    　過去の第１期間において前記第１の通信サービスの利用中の前記第１のユーザ体感品質の推定値を記録した第１の品質管理部で管理されている前記第１のユーザ体感品質の推定値に基づき、第１の発生確率分布を生成する第１の分布生成処理と、
    　第２の通信サービスに係る第２の品質パラメータを入力として第２のユーザ体感品質の推定値を出力する第２のユーザ体感品質推定処理と、
    　過去の第２期間において前記第２の通信サービスの利用中の前記第２のユーザ体感品質の推定値を記録した第２の品質管理部で管理されている前記第２のユーザ体感品質の推定値に基づき、第２の発生確率分布を生成する第２の分布生成処理と、
    　前記第１のユーザ体感品質推定処理によって出力された前記第１のユーザ体感品質の推定値を、前記第１及び第２の発生確率分布に基づいて補正を行うことで、補正後の前記第１のユーザ体感品質の推定値を出力する補正処理と、
    　を実行することを特徴とするユーザ体感品質推定方法。     A user experience quality estimation method executed by a user experience quality estimation device that estimates user experience quality based on quality parameters that can be obtained while using a communication service in an environment where a plurality of communication services are used, the method comprising:
    The user experience quality estimation device includes:
    a first user experience quality estimation process that receives a first quality parameter related to the first communication service as input and outputs an estimated value of the first user experience quality;
    The estimated value of the first quality of user experience managed by a first quality control unit that records the estimated value of the first quality of user experience while using the first communication service in the past first period. a first distribution generation process that generates a first occurrence probability distribution based on;
    a second user experience quality estimation process that receives a second quality parameter related to a second communication service as input and outputs an estimated value of a second user experience quality;
    The estimated value of the second quality of user experience managed by the second quality control unit that records the estimated value of the second quality of user experience while using the second communication service in the past second period. a second distribution generation process that generates a second occurrence probability distribution based on;
    By correcting the estimated value of the first user experience quality outputted by the first user experience quality estimation process based on the first and second occurrence probability distributions, the first a correction process that outputs an estimated value of the user experience quality;
    A user experience quality estimation method characterized by performing the following.
  6. 　コンピュータに、請求項５に記載のユーザ体感品質推定方法を実行させるプログラム。 A program that causes a computer to execute the user experience quality estimation method according to claim 5.
PCT/JP2022/018874 2022-04-26 2022-04-26 User sensory quality estimation device, user sensory quality estimation method, and program WO2023209802A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/018874 WO2023209802A1 (en) 2022-04-26 2022-04-26 User sensory quality estimation device, user sensory quality estimation method, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/018874 WO2023209802A1 (en) 2022-04-26 2022-04-26 User sensory quality estimation device, user sensory quality estimation method, and program

Publications (1)

Publication Number Publication Date
WO2023209802A1 true WO2023209802A1 (en) 2023-11-02

Family

ID=88518211

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/018874 WO2023209802A1 (en) 2022-04-26 2022-04-26 User sensory quality estimation device, user sensory quality estimation method, and program

Country Status (1)

Country Link
WO (1) WO2023209802A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012049598A (en) * 2010-08-24 2012-03-08 Ntt Docomo Inc Radio communication system, base station, and radio resource allocation method
JP2014165828A (en) * 2013-02-27 2014-09-08 Kddi Corp Communication terminal, quality management system, and computer program
JP2015106220A (en) * 2013-11-29 2015-06-08 Kddi株式会社 Sensory communication quality estimation device and sensory communication quality estimation program
JP2016082438A (en) * 2014-10-17 2016-05-16 日本電気株式会社 Communication control device, radio communication system, communication control method and radio base station

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012049598A (en) * 2010-08-24 2012-03-08 Ntt Docomo Inc Radio communication system, base station, and radio resource allocation method
JP2014165828A (en) * 2013-02-27 2014-09-08 Kddi Corp Communication terminal, quality management system, and computer program
JP2015106220A (en) * 2013-11-29 2015-06-08 Kddi株式会社 Sensory communication quality estimation device and sensory communication quality estimation program
JP2016082438A (en) * 2014-10-17 2016-05-16 日本電気株式会社 Communication control device, radio communication system, communication control method and radio base station

Similar Documents

Publication Publication Date Title
US10178198B2 (en) System and method for selection and switching of content sources for a streaming content session
US8751435B2 (en) System and method for determining client-based user behavioral analytics
US20170068827A1 (en) Live privacy policy method and apparatus
US9553909B2 (en) System and method for assignment and switching of content sources for a streaming content session
US9325597B1 (en) Bandwidth upgrade recommendation
WO2016109573A1 (en) Methods and apparatus to correct age misattribution in media impressions
JP2015524118A (en) Method and apparatus for sharing online media impression data
US9749669B2 (en) Method and system for assessing viewing quality of media objects
US10621069B2 (en) Information processing apparatus and non-transitory computer readable medium
US11184449B2 (en) Network-based probabilistic device linking
CN110008050B (en) Method and device for processing information
WO2017094847A1 (en) Quality of experience optimizing device, network quality estimating device, mobile terminal, quality of experience optimizing method, network quality estimating method, and program
CN112514403B (en) Distribution of embedded content items by an online system
JPWO2016080354A1 (en) Video quality estimation apparatus, video quality estimation method, and video quality estimation program
EP3891686A1 (en) Adaptive data platforms
JP2021508119A (en) Dynamically change the system to improve system efficiency
US10432490B2 (en) Monitoring single content page application transitions
WO2023209802A1 (en) User sensory quality estimation device, user sensory quality estimation method, and program
US20200118058A1 (en) Real-time workflow tracking
CN111614526A (en) Method, device, storage medium and terminal for rapidly maintaining HINOC link
US10805653B2 (en) Accounting for locations of a gaze of a user within content to select content for presentation to the user
WO2023209801A1 (en) Quality of user experience estimation device, quality of user experience estimation method, and program
US10789619B1 (en) Advertisement metric prediction
CN113365088B (en) Data processing method, data processing apparatus, electronic device, storage medium, and program product
WO2019194034A1 (en) Viewing behaviour estimation device, viewing behaviour estimation method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22940082

Country of ref document: EP

Kind code of ref document: A1