WO2024038499A1 - Operation learning level determination device, operation learning level determination method, and program - Google Patents

Operation learning level determination device, operation learning level determination method, and program Download PDF

Info

Publication number
WO2024038499A1
WO2024038499A1 PCT/JP2022/030917 JP2022030917W WO2024038499A1 WO 2024038499 A1 WO2024038499 A1 WO 2024038499A1 JP 2022030917 W JP2022030917 W JP 2022030917W WO 2024038499 A1 WO2024038499 A1 WO 2024038499A1
Authority
WO
WIPO (PCT)
Prior art keywords
learning level
level determination
operator
learning
information
Prior art date
Application number
PCT/JP2022/030917
Other languages
French (fr)
Japanese (ja)
Inventor
憲子 吉村
則次 恵木
Original Assignee
日本電信電話株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電信電話株式会社 filed Critical 日本電信電話株式会社
Priority to PCT/JP2022/030917 priority Critical patent/WO2024038499A1/en
Publication of WO2024038499A1 publication Critical patent/WO2024038499A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70—Game security or game management aspects
    • A63F13/79—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
    • A63F13/798—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories for assessing skills or for ranking players, e.g. for generating a hall of fame
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0852—Delays

Definitions

  • the present disclosure relates to a technology for determining a user's level of proficiency in operating an operating device such as a game device regarding a communication network.
  • Non-Patent Document 1 Conventionally, service providers and network operators have conducted user subjective quality evaluation experiments (see Non-Patent Document 1) to obtain subjective evaluation data regarding the deterioration factors, regarding the impact that deterioration factors have on users in the quality of user experience. By doing so, we have clarified its evaluation characteristics.
  • the present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to improve the efficiency of an operator's (user) learning operation of an operating device.
  • the invention according to claim 1 provides an operation proficiency level determination device for determining an operator's mastery level of operation for an operation device, the device for determining the degree of operation proficiency of an operator from the operation device to the operation device via a communication network.
  • a receiving unit that receives operation information including operation content related to the operation by the operator and performance information indicating the performance of the operation by the operator with respect to the operation content;
  • a mastery level determination unit that determines whether the specific value satisfies the mastery level achievement criteria, and determines that the operator has mastered the operation content;
  • An output unit that outputs learning level determination result information indicating that the operating learning level is determined.
  • FIG. 1 is an overall configuration diagram of a communication system according to this embodiment.
  • FIG. 1 is an electrical hardware configuration diagram of a device (operation learning level determination device, quality of experience estimation device, content distribution device) according to the present embodiment.
  • FIG. 2 is an electrical hardware configuration diagram of the operating device according to the present embodiment.
  • FIG. 2 is a functional configuration diagram of an operation learning level determination device. It is a conceptual diagram of an operation result information management DB. It is a conceptual diagram of a mastery level achievement criteria management DB.
  • 3 is a flowchart illustrating a method for determining the degree of operation proficiency that is executed by the device for determining the degree of operation proficiency in the phase of determining the degree of learning; 3 is a flowchart illustrating a method for determining the degree of operation proficiency that is executed by the device for determining the degree of operation proficiency in the phase of determining the degree of learning;
  • FIG. 1 is an overall configuration diagram of a communication system according to this embodiment.
  • the communication system 1 of this embodiment is constructed by an operation proficiency determination device 3, each operating device 5, a quality of experience estimation device 7, and a content distribution device 9.
  • the operating device 5 includes, for example, an operating device 5a as a game device, an operating device 5b as a personal computer, an operating device 5c as an industrial product used in a factory or a construction site, etc. Note that the operating device 5 may be a device other than these game devices.
  • the operating device 5 is managed and used by an operator (user). Further, the operating device 5 is a general term for the operating devices 5a, 5b, and 5c.
  • the number of each of the operation learning level determination device 3, the quality of experience estimation device 7, and the content distribution device 9 may be one or more.
  • the operation learning level determination device 3, the operating device 5, the quality of experience estimation device 7, and the content distribution device 9 can communicate via a communication network 100 such as the Internet.
  • the communication network 100 includes an ISP (Internet Service Provider) network provided by a network carrier (telecommunications carrier).
  • the connection form of the communication network 100 may be either wireless or wired.
  • the operation learning level determination device 3, the quality of experience estimation device 7, and the content distribution device 9 are configured by one or more computers. For example, when the operation learning level determination device 3 is configured by a plurality of computers, it may be referred to as an "operation learning level determination device" or an "operation learning level determination system.”
  • the operation learning level determining device 3 executes processing in a "learning level determining phase” and a "user experience quality estimation phase” which will be described later.
  • the operation learning level determining device 3 determines the user's learning level of operations on the operating device 5, for example, in the “learning level determining phase”. This will be explained in detail later.
  • the quality of experience estimating device 7 executes the process in the "estimation phase of the quality of experience for the user.”
  • the quality of experience estimating device 7 estimates (predicts) future user quality of experience (QoE) for various information and communication services (video distribution service, rich web content, etc.) provided by the communication network 100.
  • the information on the quality of user experience in this embodiment is not information inputted by the user himself/herself, but is information measured by a predetermined application installed in the operating device 5, which indicates the communication quality experienced by the user.
  • Information on the user experience quality includes, for example, not only the operational quality (resolution, frame rate, bit rate, etc.), but also the time from when a video playback instruction is given until the video starts playing, and the time during video playback. Indicates indicators including the number of times the video stopped.
  • the content distribution device 9 is used in processing in the "user experience quality estimation phase". It is managed by a content provider and distributes content data in an information communication service to the operating device 5 via the communication network 100.
  • the operating device 5 includes a computer, and in FIG. 1, an operator (user) operates the operating device 5.
  • the operating device 5 executes processing in a "mastery level determination phase” and a "user experience quality estimation phase” which will be described later.
  • a communication quality measurement application is installed on the operating device 5 to measure the playback quality of the content being played back on the operating device 5 in order to execute the "user experience quality estimation phase.” Thereby, the operating device 5 periodically transmits this communication quality to the perceived quality estimating device 7 as the user perceived quality.
  • FIG. 2 is an electrical hardware configuration diagram of the device (operation learning level determination device, quality of experience estimation device, content distribution device) according to this embodiment.
  • the operation proficiency level determination device 3 is a computer that includes a CPU (Central Processing Unit) 301 as a microprocessor, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, and an SSD. (Solid State Drive) 304, external device connection I/F (Interface) 305, network I/F 306, media I/F 309, and bus line 310.
  • CPU Central Processing Unit
  • ROM Read Only Memory
  • RAM Random Access Memory
  • SSD Solid State Drive
  • the CPU 301 controls the operation of the operation learning level determination device 3 as a whole.
  • the ROM 302 stores programs used to drive the CPU 301, such as IPL (Initial Program Loader).
  • RAM 303 is used as a work area for CPU 301.
  • the SSD 304 reads or writes various data under the control of the CPU 301.
  • an HDD Hard Disk Drive
  • SDD Serial Digital
  • the external device connection I/F 305 is an interface for connecting various external devices.
  • External devices in this case include a display, speaker, keyboard, mouse, USB (Universal Serial Bus) memory, printer, and the like.
  • the network I/F 306 is an interface for data communication via the communication network 100.
  • the media I/F 309 controls reading or writing (storage) of data to a recording medium 309m such as a flash memory.
  • the recording media 309m also include DVDs (Digital Versatile Discs), Blu-ray Discs (registered trademark), and the like.
  • the bus line 310 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 301 shown in FIG. 2.
  • the quality of experience estimation device 7 and the content distribution device 9 have the same configuration as the operation proficiency level determination device 3, so a description of the electrical hardware configuration of the quality of experience estimation device 7 and the content distribution device 9 will be omitted. .
  • FIG. 3 is an electrical hardware configuration diagram of the operating device.
  • the operating device 5 is a computer that includes a CPU 501 as a microprocessor, a ROM 502, a RAM 503, an SSD 504, an external device connection I/F (Interface) 505, a network I/F 506, a display 507, and an operation. It includes a device 508, a media I/F 509, and a bus line 510.
  • the CPU 501 controls the operation of the operating device 5 as a whole.
  • the ROM 502 stores programs used to drive the CPU 501 such as IPL.
  • RAM 503 is used as a work area for CPU 501.
  • the SSD 504 reads or writes various data under the control of the CPU 501. Note that an HDD (Hard Disk Drive) may be used instead of the SSD 504.
  • HDD Hard Disk Drive
  • the external device connection I/F 505 is an interface for connecting various external devices.
  • External devices in this case include a display, speaker, keyboard, mouse, USB memory, printer, and the like.
  • the network I/F 506 is an interface for data communication via the communication network 100.
  • the display 507 is a type of display means such as liquid crystal or organic EL (Electro Luminescence) that displays various images.
  • the operating device 508 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. Note that when the user uses a keyboard, the function of the operating device 508 may be turned off.
  • the operating device 5 is an operating device 5a that is a game device
  • the operating device 508 is a game controller, a game pad, or the like.
  • the media I/F 509 controls reading or writing (storage) of data to a recording medium 509m such as a flash memory.
  • the recording media 509m also include DVDs, Blu-ray Discs (registered trademark), and the like.
  • the bus line 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501 shown in FIG. 4.
  • FIG. 4 is a functional configuration diagram of the operation learning level determination device.
  • the operation learning level determining device 3 includes a receiving section 31, a storage/reading section 33, a learning level determining section 35, and an output section 39. Each of these units is a function realized by instructions from the CPU 301 in FIG. 2 based on a program. Further, the operation learning level determination device 3 includes a storage unit 20 constructed from a RAM 303 or an SSD 304.
  • FIG. 5 is a conceptual diagram of the operation result information management DB.
  • FIG. 6 is a conceptual diagram of the mastery level achievement criteria management DB.
  • the operation result information management DB 21 stores operation result information for each operating device ID.
  • the operation result information is managed in association with the operation information and each piece of performance information.
  • the operation information includes the operator ID, the date and time of the operation, and the details of the operation.
  • the operating device ID is an example of operating device identification information for identifying the operating device.
  • the operator ID is an example of operator identification information for identifying the operator (user).
  • the performance information is information indicating the performance of operations on the operating device 5 by the operator (user) for each performance index.
  • the performance index indicates an index (standard) of the performance of the operation on the operating device 5 by the operator (user) with respect to the operation content.
  • FIG. 5 “0 times”, “10 seconds”, etc. are shown as examples of performance information. Further, as examples of performance indicators, “number of failures within a certain period of time” and “time to avoid a predetermined obstacle" are shown.
  • the mastery level achievement standard indicates a standard for an operator (user) to achieve a specific value based on specific performance information in a performance index for operation content.
  • the receiving unit 31 receives a predetermined operating device ID and predetermined operation result information from the operating device 5.
  • the storage/reading unit 33 stores data (information) in the storage unit 20 and reads data (information) from the storage unit 20.
  • the proficiency level determination section 35 determines the information contained in the predetermined operation information via the storage/readout section 33.
  • the operation result information management DB 21 (FIG. 5) based on the set of information of a predetermined operator ID and predetermined operation content, the same set of information as the predetermined operator ID and predetermined operation content operation information that includes a set of operation information that is associated with one or more specific operation information that includes operation date and time information within a certain period of time T from the current date and time (or a predetermined operation date and time included in the predetermined operation information) Extract one or more specific performance information (indicators).
  • the learning level determination unit 35 refers to the learning level achievement criteria management DB 22 and determines whether or not a specific value based on specific performance information satisfies the learning level achievement criteria in the performance index for the operation content. In addition, when a plurality of (n pieces) of specific performance information is acquired, the mastery level determination unit 35 determines whether a specific value related to the variance value or average value of the n pieces of specific performance information satisfies the mastery level achievement criteria. to judge. For example, the variance value is less than or equal to t_b, the average value is greater than or equal to t_a, but the present invention is not limited to this. To set the variance value t_b (average value t_a), for example, have multiple operators repeatedly perform the same operation content in advance, and set the top 10% value (average (top 90% of values) are used.
  • the mastery level determination unit 35 determines that the operator has mastered the operation content when the specific value satisfies the mastery level achievement criteria, and when the specific value does not satisfy the mastery level achievement criteria, It is determined that the operator has not mastered the operation content (has not yet mastered it).
  • the output unit 39 outputs learning level determination result information indicating the result determined by the learning level determining unit 35.
  • An example of output is when displaying on a display connected to the external device connection I/F 305 in FIG. Examples include cases where
  • FIGS. 7 and 8 are flowcharts illustrating an operation learning level determination method executed by the operation learning level determining apparatus in the learning level determination phase.
  • the receiving unit 31 receives a predetermined operating device ID and predetermined operation result information from the operating device 5.
  • the operation result information includes information as shown in FIG.
  • the storage/reading unit 33 acquires a predetermined operation device ID and predetermined operation result information from the reception unit 31, stores the predetermined operation result information for each operation device ID in the operation result information management DB 21, and receives the predetermined operation result information. A storage completion notification is sent to the unit 31.
  • the receiving unit 31 transmits the predetermined operation information included in the predetermined operation result information to the learning level determination unit 35.
  • the learning level determining unit 35 searches the operation result information management DB 21 via the storage/reading unit 33 based on a set of a predetermined operator ID and predetermined operation content information included in the predetermined operation information. Therefore, the operation information that includes the same set as the predetermined operator ID and the predetermined operation content information, and is within a certain time T from the current date and time (or the predetermined operation date and time included in the predetermined operation information).
  • One or more specific performance information (index) associated with one or more specific operation information including operation date and time information is extracted.
  • the learning level determination unit 35 determines whether the number of specific performance information is equal to or greater than a predetermined number N.
  • the mastery level determination unit 35 further refers to the mastery level achievement standard management DB 22 and determines the specific performance index for the operation content. It is determined whether the specific value based on the performance information satisfies the mastery level achievement criteria.
  • the output unit 39 outputs the learning level determination result information to the outside (the perceived quality estimating device 7, etc.).
  • the experience quality estimating device 7 executes it using a well-known method, so a description thereof will be omitted.
  • the learning level determination result information output by the output unit 39 is used as material for determining whether or not the quality of experience estimation device 7 estimates the quality of user experience of the operator. For example, the experience quality estimating device 7 estimates the user experience quality when the learning level determination result information indicates that the operation has been learned, but the learning level determination result information indicates that the operation has not been learned (unlearned). (Yes), the user experience quality is not estimated.
  • the operation learning level determining device 3 of the present embodiment performs a "learning level” determining the learning level of the user's operation contents for the operating device 5 before the "user experience quality estimation phase” for the deterioration factor of the user experience quality. Execute the “judgment phase”. This has the effect that highly reliable evaluation results can be obtained even in the "user experience quality estimation phase.”
  • the operation mastery level determination device 3 determines the user's mastery of the operation contents of the industrial product by simply executing the "mastery level determination phase” without implementing the "user experience quality estimation phase". It is also possible. In this case, for example, the operating device 5c in FIG. 1 is used not only in both the "mastery level determination phase” and the “user experience quality estimation phase” but also only in the "mastery level determination phase.” It's okay.
  • the present invention is not limited to the above-described embodiments, and may have the following configuration or processing (operation).
  • the quality of experience estimation device 7 can also be realized by a computer and a program, but this program can also be recorded on a (non-temporary) recording medium or provided via a communication network 100 such as the Internet.

Abstract

The purpose of the present disclosure is to improve the efficiency of user's operation learning work for an operation device.　For this purpose, the present disclosure relates to an operation learning level determination device for determining an operator's operation learning level for an operation device, the operation learning level determination device comprising: a reception unit that receives, from the operation device via a communication network, operation information including an operation content related to the operator's operation for the operation device, and performance information indicating performance relating to the operator's operation with respect to the operation content; a learning level determination unit that determines whether a specific value based on the performance information satisfies a learning level achievement standard, and if the specific value satisfies the learning level achievement standard, determines that the operator has already learned the operation content; and an output unit that outputs learning level determination result information indicating "having already learned".

Description

操作習得度判定装置、操作習得度判定方法、及びプログラムOperation proficiency level determination device, operation proficiency level determination method, and program
　本開示内容は、通信ネットワークを関してゲーム機器等の操作装置に対するユーザの操作の習得度を判定する技術に関する。 The present disclosure relates to a technology for determining a user's level of proficiency in operating an operating device such as a game device regarding a communication network.
　通信ネットワークの高速化に伴い、インタラクティブ性の高いタスクを要するゲームやリモートデスクトップ等のサービスが登場し、今後のさらなるサービス需要拡大が見込まれる。サービス提供事業者やネットワーク事業者(電気通信事業者)は、インタラクティブ性の高い操作が必要なサービスに対して、End-to-Endにおける遅延等の劣化要因が操作性に関する品質評価特性を解明し、ユーザの品質要求に応じた品質設計、及び制御を行うことが望ましい。 As communication networks become faster, services such as games and remote desktops that require highly interactive tasks will appear, and demand for these services is expected to increase further in the future. For services that require highly interactive operations, service providers and network operators (telecommunications carriers) need to clarify the quality evaluation characteristics related to operability due to deterioration factors such as end-to-end delays. It is desirable to perform quality design and control in accordance with user quality requirements.
　ユーザ体感品質の劣化要因がユーザに与える影響について、従来、サービス提供事業者やネットワーク事業者は、ユーザの主観品質評価実験（非特許文献１参照）を実施し、劣化要因に対する主観評価データを取得することで、その評価特性について明らかにしてきた。 Conventionally, service providers and network operators have conducted user subjective quality evaluation experiments (see Non-Patent Document 1) to obtain subjective evaluation data regarding the deterioration factors, regarding the impact that deterioration factors have on users in the quality of user experience. By doing so, we have clarified its evaluation characteristics.
　しかし、ゲームなどの操作性の評価については、それまでに関連する操作をユーザ（評価者）がどれだけ経験したかにより、操作の習得（理解）に要する時間は異なる。そのため、ユーザが操作の内容を十分に習得できていない状況においてユーザの主観的な品質評価を行った場合には、適切な評価が行えず信頼性の低い評価結果になってしまう。 However, when evaluating the operability of a game, etc., the time required to learn (understand) the operations varies depending on how much experience the user (evaluator) has had with the related operations. Therefore, if a user performs a subjective quality evaluation in a situation where the user has not sufficiently learned the contents of the operation, an appropriate evaluation cannot be performed and the evaluation result will be unreliable.
　一方で、このようなユーザに合わせて事前の操作に関する習得時間(学習時間)を長時間設けた場合、操作に対する一定の習得度(理解度)を有するユーザにとっては、過剰な習得時間を要することになるため、取得作業が非効率となる。また、ユーザの個人の特性だけでなく、評価対象となる操作そのものの複雑さや使用する操作装置（操作デバイス）によっても操作の習得に必要となる時間は異なることが想定される。 On the other hand, if a long period of time is provided for learning the operations in advance for such users, it may require excessive learning time for users who have a certain level of mastery (understanding) of the operations. Therefore, the acquisition work becomes inefficient. Further, it is assumed that the time required to learn an operation varies depending not only on the user's individual characteristics but also on the complexity of the operation itself to be evaluated and the operating device used.
　本発明は、上述の事情に鑑みてなされたもので、操作装置に対する操作者（ユーザ）の操作の習得作業の効率化を図ることを目的とする。 The present invention has been made in view of the above-mentioned circumstances, and an object of the present invention is to improve the efficiency of an operator's (user) learning operation of an operating device.
　上記目的を達成するため、請求項１に係る発明は、操作装置に対する操作者の操作の習得度を判定する操作習得度判定装置であって、前記操作装置から通信ネットワークを介して当該操作装置に対する前記操作者の操作に係る操作内容を含む操作情報及び当該操作内容に対する前記操作者の操作に関するパフォーマンスを示したパフォーマンス情報を受信する受信部と、前記パフォーマンス情報に基づく特定値が習得度達成基準を満たす否かを判断し、前記特定値が前記習得度達成基準を満たす場合には、前記操作者が前記操作内容に対して習得済みであると判定する習得度判定部と、前記習得済みである旨を示す習得度判定結果情報を出力する出力部と、を有する操作習得度判定装置である。 In order to achieve the above object, the invention according to claim 1 provides an operation proficiency level determination device for determining an operator's mastery level of operation for an operation device, the device for determining the degree of operation proficiency of an operator from the operation device to the operation device via a communication network. a receiving unit that receives operation information including operation content related to the operation by the operator and performance information indicating the performance of the operation by the operator with respect to the operation content; a mastery level determination unit that determines whether the specific value satisfies the mastery level achievement criteria, and determines that the operator has mastered the operation content; An output unit that outputs learning level determination result information indicating that the operating learning level is determined.
　以上説明したように本発明によれば、操作装置に対する操作者の操作の習得作業の効率化を図ることができるという効果を奏する。 As explained above, according to the present invention, it is possible to improve the efficiency of the operator's learning operation of the operating device.
本実施形態に係る通信システムの全体構成図である。1 is an overall configuration diagram of a communication system according to this embodiment. 本実施形態に係る装置（操作習得度判定装置、体感品質推定装置、コンテンツ配信装置）の電気的なハードウェア構成図である。FIG. 1 is an electrical hardware configuration diagram of a device (operation learning level determination device, quality of experience estimation device, content distribution device) according to the present embodiment. 本実施形態に係る操作装置の電気的なハードウェア構成図である。FIG. 2 is an electrical hardware configuration diagram of the operating device according to the present embodiment. 操作習得度判定装置の機能構成図である。FIG. 2 is a functional configuration diagram of an operation learning level determination device. 操作結果情報管理ＤＢの概念図である。It is a conceptual diagram of an operation result information management DB. 習得度達成基準管理ＤＢの概念図である。It is a conceptual diagram of a mastery level achievement criteria management DB. 習得度の判定フェーズにおいて操作習得度判定装置が実行する操作習得度判定方法を示すフローチャートである。3 is a flowchart illustrating a method for determining the degree of operation proficiency that is executed by the device for determining the degree of operation proficiency in the phase of determining the degree of learning; 習得度の判定フェーズにおいて操作習得度判定装置が実行する操作習得度判定方法を示すフローチャートである。3 is a flowchart illustrating a method for determining the degree of operation proficiency that is executed by the device for determining the degree of operation proficiency in the phase of determining the degree of learning;
　以下、図面を用いて本発明の実施形態を説明する。 Hereinafter, embodiments of the present invention will be described using the drawings.
　〔実施形態のシステム構成〕
　まず、図１を用いて、本実施形態の通信システムの構成の概略について説明する。図１は、本実施形態に係る通信システムの全体構成図である。 [System configuration of embodiment]
First, the outline of the configuration of the communication system of this embodiment will be explained using FIG. 1. FIG. 1 is an overall configuration diagram of a communication system according to this embodiment.
　図１に示されているように、本実施形態の通信システム１は、操作習得度判定装置３、各操作装置５、体感品質推定装置７、及びコンテンツ配信装置９によって構築されている。 As shown in FIG. 1, the communication system 1 of this embodiment is constructed by an operation proficiency determination device 3, each operating device 5, a quality of experience estimation device 7, and a content distribution device 9.
　操作装置５には、例えば、ゲーム機器としての操作装置５ａ、パソコンとしての操作装置５ｂ、及び工場又は工事現場等で使用される工業製品としての操作装置５ｃ等が含まれる。なお、操作装置５は、これらゲーム機器等以外の装置であってもよい。操作装置５は、操作者（ユーザ）によって管理及び使用される。また、操作装置５は、操作装置５ａ，５ｂ，５ｃの総称である。 The operating device 5 includes, for example, an operating device 5a as a game device, an operating device 5b as a personal computer, an operating device 5c as an industrial product used in a factory or a construction site, etc. Note that the operating device 5 may be a device other than these game devices. The operating device 5 is managed and used by an operator (user). Further, the operating device 5 is a general term for the operating devices 5a, 5b, and 5c.
　また、操作習得度判定装置３、体感品質推定装置７、及びコンテンツ配信装置９は、それぞれ１つ又は複数であってもよい。 Furthermore, the number of each of the operation learning level determination device 3, the quality of experience estimation device 7, and the content distribution device 9 may be one or more.
　操作習得度判定装置３、操作装置５、体感品質推定装置７、及びコンテンツ配信装置９は、インターネット等の通信ネットワーク１００を介して通信することができる。通信ネットワーク１００には、ネットワーク事業者(電気通信事業者)の提供するISP（Internet Service Provider）網等が含まれている。通信ネットワーク１００の接続形態は、無線又は有線のいずれでも良い。操作習得度判定装置３は、体感品質推定装置７、及びコンテンツ配信装置９は、単数又は複数のコンピュータによって構成されている。例えば、操作習得度判定装置３が複数のコンピュータによって構成されている場合には、「操作習得度判定装置」と示しても良いし、「操作習得度判定システム」と示しても良い。 The operation learning level determination device 3, the operating device 5, the quality of experience estimation device 7, and the content distribution device 9 can communicate via a communication network 100 such as the Internet. The communication network 100 includes an ISP (Internet Service Provider) network provided by a network carrier (telecommunications carrier). The connection form of the communication network 100 may be either wireless or wired. The operation learning level determination device 3, the quality of experience estimation device 7, and the content distribution device 9 are configured by one or more computers. For example, when the operation learning level determination device 3 is configured by a plurality of computers, it may be referred to as an "operation learning level determination device" or an "operation learning level determination system."
　操作習得度判定装置３は、後述の「習得度の判定フェーズ」及び「ユーザ体感品質の推定フェーズ」における処理を実行する。操作習得度判定装置３は、例えば、「習得度の判定フェーズ」において、操作装置５に対するユーザの操作の習得度を判定する。これに関しては、後ほど詳細に説明する。 The operation learning level determining device 3 executes processing in a "learning level determining phase" and a "user experience quality estimation phase" which will be described later. The operation learning level determining device 3 determines the user's learning level of operations on the operating device 5, for example, in the “learning level determining phase”. This will be explained in detail later.
　体感品質推定装置７は、「ユーザ体感品質の推定フェーズ」における処理を実行する。体感品質推定装置７は、通信ネットワーク１００から提供される多様な情報通信サービス（映像配信サービス、リッチなWebコンテンツ等）に対する将来のユーザ体感品質(QoE: Quality of Experience)を推定（予測）する。本実施形態のユーザ体感品質の情報は、ユーザが体感した通信品質をユーザ本人が入力する情報ではなく、操作装置５にインストールされている所定のアプリケーションが計測する情報である。ユーザ体感品質の情報は、例えば、動作品質（解像度、フレームレート、ビットレート等）だけでなく、動画の再生指示を行ってから動画の再生が開始されるまでの時間や、動画の再生中に動画が止まった回数等を含めた指標を示す。 The quality of experience estimating device 7 executes the process in the "estimation phase of the quality of experience for the user." The quality of experience estimating device 7 estimates (predicts) future user quality of experience (QoE) for various information and communication services (video distribution service, rich web content, etc.) provided by the communication network 100. The information on the quality of user experience in this embodiment is not information inputted by the user himself/herself, but is information measured by a predetermined application installed in the operating device 5, which indicates the communication quality experienced by the user. Information on the user experience quality includes, for example, not only the operational quality (resolution, frame rate, bit rate, etc.), but also the time from when a video playback instruction is given until the video starts playing, and the time during video playback. Indicates indicators including the number of times the video stopped.
　コンテンツ配信装置９は、「ユーザ体感品質の推定フェーズ」における処理で利用される。コンテンツ事業者によって管理され、通信ネットワーク１００を介し、操作装置５に対して、情報通信サービスにおけるコンテンツデータを配信している。 The content distribution device 9 is used in processing in the "user experience quality estimation phase". It is managed by a content provider and distributes content data in an information communication service to the operating device 5 via the communication network 100.
　操作装置５は、コンピュータを含み、図１では、操作者（ユーザ）が操作装置５を操作する。操作装置５は、後述の「習得度の判定フェーズ」及び「ユーザ体感品質の推定フェーズ」における処理を実行する。 The operating device 5 includes a computer, and in FIG. 1, an operator (user) operates the operating device 5. The operating device 5 executes processing in a "mastery level determination phase" and a "user experience quality estimation phase" which will be described later.
　操作装置５には、「ユーザ体感品質の推定フェーズ」を実行するために、操作装置５で再生中のコンテンツの再生品質等を計測する通信品質計測アプリケーションがインストールされている。これにより、操作装置５は、この通信品質をユーザ体感品質として定期的に体感品質推定装置７に送信する。 A communication quality measurement application is installed on the operating device 5 to measure the playback quality of the content being played back on the operating device 5 in order to execute the "user experience quality estimation phase." Thereby, the operating device 5 periodically transmits this communication quality to the perceived quality estimating device 7 as the user perceived quality.
　〔ハードウェア構成〕
　＜操作習得度判定装置のハードウェア構成＞
　次に、図２を用いて、操作習得度判定装置３の電気的なハードウェア構成を説明する。図２は、本実施形態に係る装置（操作習得度判定装置、体感品質推定装置、コンテンツ配信装置）の電気的なハードウェア構成図である。 [Hardware configuration]
<Hardware configuration of the operation proficiency level determination device>
Next, the electrical hardware configuration of the operation learning level determination device 3 will be explained using FIG. 2. FIG. 2 is an electrical hardware configuration diagram of the device (operation learning level determination device, quality of experience estimation device, content distribution device) according to this embodiment.
　操作習得度判定装置３は、コンピュータとして、図２に示されているように、マイクロプロセッサとしてのＣＰＵ(Central Processing Unit)３０１、ＲＯＭ(Read Only Memory)３０２、ＲＡＭ(Random Access Memory)３０３、ＳＳＤ(Solid State Drive)３０４、外部機器接続Ｉ／Ｆ(Interface)３０５、ネットワークＩ／Ｆ３０６、メディアＩ／Ｆ３０９、及びバスライン３１０を備えている。 As shown in FIG. 2, the operation proficiency level determination device 3 is a computer that includes a CPU (Central Processing Unit) 301 as a microprocessor, a ROM (Read Only Memory) 302, a RAM (Random Access Memory) 303, and an SSD. (Solid State Drive) 304, external device connection I/F (Interface) 305, network I/F 306, media I/F 309, and bus line 310.
　これらのうち、ＣＰＵ３０１は、操作習得度判定装置３全体の動作を制御する。ＲＯＭ３０２は、ＩＰＬ(Initial Program Loader)等のＣＰＵ３０１の駆動に用いられるプログラムを記憶する。ＲＡＭ３０３は、ＣＰＵ３０１のワークエリアとして使用される。 Among these, the CPU 301 controls the operation of the operation learning level determination device 3 as a whole. The ROM 302 stores programs used to drive the CPU 301, such as IPL (Initial Program Loader). RAM 303 is used as a work area for CPU 301.
　ＳＳＤ３０４は、ＣＰＵ３０１の制御に従って各種データの読み出し又は書き込みを行う。なお、ＳＤＤ３０４の代わりに、ＨＤＤ(Hard Disk Drive)を用いても良い。 The SSD 304 reads or writes various data under the control of the CPU 301. Note that an HDD (Hard Disk Drive) may be used instead of the SDD 304.
　外部機器接続Ｉ／Ｆ３０５は、各種の外部機器を接続するためのインターフェースである。この場合の外部機器は、ディスプレイ、スピーカ、キーボード、マウス、ＵＳＢ(Universal Serial Bus)メモリ、及びプリンタ等である。 The external device connection I/F 305 is an interface for connecting various external devices. External devices in this case include a display, speaker, keyboard, mouse, USB (Universal Serial Bus) memory, printer, and the like.
　ネットワークＩ／Ｆ３０６は、通信ネットワーク１００を介してデータ通信をするためのインターフェースである。 The network I/F 306 is an interface for data communication via the communication network 100.
　メディアＩ／Ｆ３０９は、フラッシュメモリ等の記録メディア３０９ｍに対するデータの読み出し又は書き込み（記憶）を制御する。記録メディア３０９ｍには、ＤＶＤ(Digital Versatile Disc)やＢｌｕ-ｒａｙ Ｄｉｓｃ（登録商標）等も含まれる。 The media I/F 309 controls reading or writing (storage) of data to a recording medium 309m such as a flash memory. The recording media 309m also include DVDs (Digital Versatile Discs), Blu-ray Discs (registered trademark), and the like.
　バスライン３１０は、図２に示されているＣＰＵ３０１等の各構成要素を電気的に接続するためのアドレスバスやデータバス等である。 The bus line 310 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 301 shown in FIG. 2.
　なお、体感品質推定装置７及びコンテンツ配信装置９は、操作習得度判定装置３と同様の構成を有するため、体感品質推定装置７及びコンテンツ配信装置９の電気的なハードウェア構成の説明は省略する。 Note that the quality of experience estimation device 7 and the content distribution device 9 have the same configuration as the operation proficiency level determination device 3, so a description of the electrical hardware configuration of the quality of experience estimation device 7 and the content distribution device 9 will be omitted. .
　＜操作装置のハードウェア構成＞
　次に、図３を用いて、操作装置５の電気的なハードウェア構成を説明する。図３は、操作装置の電気的なハードウェア構成図である。 <Hardware configuration of operating device>
Next, the electrical hardware configuration of the operating device 5 will be described using FIG. 3. FIG. 3 is an electrical hardware configuration diagram of the operating device.
　操作装置５は、コンピュータとして、図３に示されているように、マイクロプロセッサとしてのＣＰＵ５０１、ＲＯＭ５０２、ＲＡＭ５０３、ＳＳＤ５０４、外部機器接続Ｉ／Ｆ(Interface)５０５、ネットワークＩ／Ｆ５０６、ディスプレイ５０７、操作デバイス５０８、メディアＩ／Ｆ５０９、及びバスライン５１０を備えている。 As shown in FIG. 3, the operating device 5 is a computer that includes a CPU 501 as a microprocessor, a ROM 502, a RAM 503, an SSD 504, an external device connection I/F (Interface) 505, a network I/F 506, a display 507, and an operation. It includes a device 508, a media I/F 509, and a bus line 510.
　これらのうち、ＣＰＵ５０１は、操作装置５全体の動作を制御する。ＲＯＭ５０２は、ＩＰＬ等のＣＰＵ５０１の駆動に用いられるプログラムを記憶する。ＲＡＭ５０３は、ＣＰＵ５０１のワークエリアとして使用される。 Among these, the CPU 501 controls the operation of the operating device 5 as a whole. The ROM 502 stores programs used to drive the CPU 501 such as IPL. RAM 503 is used as a work area for CPU 501.
　ＳＳＤ５０４は、ＣＰＵ５０１の制御に従って各種データの読み出し又は書き込みを行う。なお、ＳＳＤ５０４の代わりに、ＨＤＤ(Hard Disk Drive)を用いてもよい。 The SSD 504 reads or writes various data under the control of the CPU 501. Note that an HDD (Hard Disk Drive) may be used instead of the SSD 504.
　外部機器接続Ｉ／Ｆ５０５は、各種の外部機器を接続するためのインターフェースである。この場合の外部機器は、ディスプレイ、スピーカ、キーボード、マウス、ＵＳＢメモリ、及びプリンタ等である。 The external device connection I/F 505 is an interface for connecting various external devices. External devices in this case include a display, speaker, keyboard, mouse, USB memory, printer, and the like.
　ネットワークＩ／Ｆ５０６は、通信ネットワーク１００を介してデータ通信をするためのインターフェースである。 The network I/F 506 is an interface for data communication via the communication network 100.
　ディスプレイ５０７は、各種画像を表示する液晶や有機ＥＬ(Electro Luminescence)などの表示手段の一種である。 The display 507 is a type of display means such as liquid crystal or organic EL (Electro Luminescence) that displays various images.
　操作デバイス５０８は、各種指示の選択や実行、処理対象の選択、カーソルの移動などを行う入力手段の一種である。なお、ユーザがキーボードを使う場合は、操作デバイス５０８の機能をＯＦＦにしてもよい。操作装置５がゲーム機器である操作装置５ａの場合、操作デバイス５０８は、ゲームコントローラ、又はゲームパッド等である。 The operating device 508 is a type of input means for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like. Note that when the user uses a keyboard, the function of the operating device 508 may be turned off. When the operating device 5 is an operating device 5a that is a game device, the operating device 508 is a game controller, a game pad, or the like.
　メディアＩ／Ｆ５０９は、フラッシュメモリ等の記録メディア５０９ｍに対するデータの読み出し又は書き込み（記憶）を制御する。記録メディア５０９ｍには、ＤＶＤやＢｌｕ-ｒａｙ Ｄｉｓｃ（登録商標）等も含まれる。 The media I/F 509 controls reading or writing (storage) of data to a recording medium 509m such as a flash memory. The recording media 509m also include DVDs, Blu-ray Discs (registered trademark), and the like.
　バスライン５１０は、図４に示されているＣＰＵ５０１等の各構成要素を電気的に接続するためのアドレスバスやデータバス等である。 The bus line 510 is an address bus, a data bus, etc. for electrically connecting each component such as the CPU 501 shown in FIG. 4.
　〔操作習得度判定装置の機能構成〕
　続いて、本実施形態に係る操作習得度判定装置３の機能構成について説明する。なお、操作装置５、体感品質推定装置７及びコンテンツ配信装置９は、従来から使用されている装置であるため、説明を省略する。 [Functional configuration of operation proficiency evaluation device]
Next, the functional configuration of the operation learning level determination device 3 according to this embodiment will be explained. Note that the operating device 5, the quality of experience estimating device 7, and the content distribution device 9 are devices that have been used in the past, so their explanation will be omitted.
　図４は、操作習得度判定装置の機能構成図である。 FIG. 4 is a functional configuration diagram of the operation learning level determination device.
　図４に示すように、操作習得度判定装置３は、受信部３１、記憶・読出部３３、習得度判定部３５、及び出力部３９を有する。これら各部は、プログラムに基づき図２のＣＰＵ３０１による命令によって実現される機能である。また、操作習得度判定装置３は、ＲＡＭ３０３又はＳＳＤ３０４によって構築された記憶部２０を有している。 As shown in FIG. 4, the operation learning level determining device 3 includes a receiving section 31, a storage/reading section 33, a learning level determining section 35, and an output section 39. Each of these units is a function realized by instructions from the CPU 301 in FIG. 2 based on a program. Further, the operation learning level determination device 3 includes a storage unit 20 constructed from a RAM 303 or an SSD 304.
　＜各ＤＢの説明＞
　記憶部２０には、図５に示すような操作結果情報管理ＤＢ２１、及び図６に示すような習得度達成基準管理ＤＢ２２が構築されている。図５は、操作結果情報管理ＤＢの概念図である。図６は、習得度達成基準管理ＤＢの概念図である。 <Description of each DB>
In the storage unit 20, an operation result information management DB 21 as shown in FIG. 5 and a mastery level achievement criteria management DB 22 as shown in FIG. 6 are constructed. FIG. 5 is a conceptual diagram of the operation result information management DB. FIG. 6 is a conceptual diagram of the mastery level achievement criteria management DB.
　（操作結果情報管理ＤＢ）
　図５に示すように、操作結果情報管理ＤＢ２１では、操作装置ＩＤ毎に、操作結果情報が記憶されている。操作結果情報には、操作情報及び各パフォーマンス情報が関連付けて管理されている。操作情報には、操作者ＩＤ、操作日時、及び操作内容の各情報が含まれている。なお、操作装置ＩＤは、操作装置を識別するための操作装置識別情報の一例である。また、操作者ＩＤは、操作者（ユーザ）を識別するための操作者識別情報の一例である。 (Operation result information management DB)
As shown in FIG. 5, the operation result information management DB 21 stores operation result information for each operating device ID. The operation result information is managed in association with the operation information and each piece of performance information. The operation information includes the operator ID, the date and time of the operation, and the details of the operation. Note that the operating device ID is an example of operating device identification information for identifying the operating device. Further, the operator ID is an example of operator identification information for identifying the operator (user).
　パフォーマンス情報は、パフォーマンス指標毎に、操作者（ユーザ）による操作装置５への操作のパフォーマンスを示した情報である。パフォーマンス指標は、操作内容に対して、操作者（ユーザ）による操作装置５への操作のパフォーマンスの指標（基準）を示す。図５では、パフォーマンス情報の例として「０回」、「１０秒」等が示されている。また、パフォーマンス指標の例として「一定時間内の失敗回数」、「所定障害物の回避時間」が示されている。 The performance information is information indicating the performance of operations on the operating device 5 by the operator (user) for each performance index. The performance index indicates an index (standard) of the performance of the operation on the operating device 5 by the operator (user) with respect to the operation content. In FIG. 5, "0 times", "10 seconds", etc. are shown as examples of performance information. Further, as examples of performance indicators, "number of failures within a certain period of time" and "time to avoid a predetermined obstacle" are shown.
　（習得度達成基準管理ＤＢ）
　図６に示すように、習得度達成基準管理ＤＢ２２では、操作内容、パフォーマンス指標、及び習得度達成基準が関連付けて管理されている。これらは、予め設定された情報である。習得度達成基準は、操作者（ユーザ）が操作内容に対するパフォーマンス指標において、特定のパフォーマンス情報に基づく特定値が達成すべき基準を示す。 (Learning level achievement criteria management DB)
As shown in FIG. 6, in the mastery level achievement criteria management DB 22, operation contents, performance indicators, and mastery level achievement criteria are managed in association with each other. These are preset information. The mastery level achievement standard indicates a standard for an operator (user) to achieve a specific value based on specific performance information in a performance index for operation content.
　受信部３１は、操作装置５から所定の操作装置ＩＤ、及び所定の操作結果情報を受信する。 The receiving unit 31 receives a predetermined operating device ID and predetermined operation result information from the operating device 5.
　記憶・読出部３３は、記憶部２０にデータ（情報）を記憶したり、記憶部２０からデータ（情報）を読み出したりする。 The storage/reading unit 33 stores data (information) in the storage unit 20 and reads data (information) from the storage unit 20.
　習得度判定部３５は、受信部３１から所定の操作情報（操作者ＩＤ、操作日時、操作内容）を受信したことを契機に、記憶・読出部３３を介し、当該所定の操作情報に含まれている所定の操作者ＩＤ及び所定の操作内容の情報の組に基づいて操作結果情報管理ＤＢ２１（図５）を検索することにより、所定の操作者ＩＤ及び所定の操作内容の情報の組と同じ組を含む操作情報であって、現在日時（または所定の操作情報に含まれている所定の操作日時）から一定時間Ｔ以内の操作日時情報を含む１つ以上の特定の操作情報に関連づけられている１つ以上の特定のパフォーマンス情報（指標）を抽出する。 Upon receiving predetermined operation information (operator ID, operation date and time, operation content) from the reception section 31, the proficiency level determination section 35 determines the information contained in the predetermined operation information via the storage/readout section 33. By searching the operation result information management DB 21 (FIG. 5) based on the set of information of a predetermined operator ID and predetermined operation content, the same set of information as the predetermined operator ID and predetermined operation content operation information that includes a set of operation information that is associated with one or more specific operation information that includes operation date and time information within a certain period of time T from the current date and time (or a predetermined operation date and time included in the predetermined operation information) Extract one or more specific performance information (indicators).
　また、習得度判定部３５は、特定のパフォーマンス情報の数が所定数Ｎ以上か否かを判断する。例えば、Ｎ＝５である。このように、所定数Ｎ以上であるか否かを判断するのは、特定のパフォーマンス情報の数が所定数Ｎ未満の場合には、後述の習得度判定結果の信頼性が低くなるため、このような場合を排除するためである。 Additionally, the learning level determination unit 35 determines whether the number of specific performance information is equal to or greater than a predetermined number N. For example, N=5. In this way, it is determined whether the number of specific performance information is equal to or greater than the predetermined number N because if the number of specific performance information is less than the predetermined number N, the reliability of the learning level determination result described later will be low. This is to eliminate such cases.
　更に、習得度判定部３５は、習得度達成基準管理ＤＢ２２を参照し、操作内容に対するパフォーマンス指標において、特定のパフォーマンス情報に基づく特定値が習得度達成基準を満たすか否かを判断する。また、習得度判定部３５は、複数（ｎ個）の特定のパフォーマンス情報を取得した場合、ｎ個の特定のパフォーマンス情報の分散値又は平均値に係る特定値が習得度達成基準を満たすか否かを判断する。例えば分散値は、t_b以下、平均値はt_a以上などを用いるが、これに限るものではない。分散値t_b（平均値t_a）の設定については、例えば、事前に同じ操作内容を複数人の操作者に繰り返し実施してもらい、各操作者の後半ｎ回の分散の上位１０％の値（平均の上位９０%の値）が用いられる。 Furthermore, the learning level determination unit 35 refers to the learning level achievement criteria management DB 22 and determines whether or not a specific value based on specific performance information satisfies the learning level achievement criteria in the performance index for the operation content. In addition, when a plurality of (n pieces) of specific performance information is acquired, the mastery level determination unit 35 determines whether a specific value related to the variance value or average value of the n pieces of specific performance information satisfies the mastery level achievement criteria. to judge. For example, the variance value is less than or equal to t_b, the average value is greater than or equal to t_a, but the present invention is not limited to this. To set the variance value t_b (average value t_a), for example, have multiple operators repeatedly perform the same operation content in advance, and set the top 10% value (average (top 90% of values) are used.
　また、習得度判定部３５は、特定値が習得度達成基準を満たす場合には操作者が操作内容に対して習得済みであると判定し、特定値が習得度達成基準を満たさない場合には操作者が操作内容に対して習得済みでない（未習得である）と判定する。 Further, the mastery level determination unit 35 determines that the operator has mastered the operation content when the specific value satisfies the mastery level achievement criteria, and when the specific value does not satisfy the mastery level achievement criteria, It is determined that the operator has not mastered the operation content (has not yet mastered it).
　出力部３９は、習得度判定部３５によって判定された結果を示す習得度判定結果情報を出力する。出力する例としては、図２の外部機器接続Ｉ／Ｆ３０５に接続されたディスプレイに表示させる場合、ネットワークＩ／Ｆ３０６を介して外部装置（操作装置５、体感品質推定装置７、その他装置）に送信する場合等が挙げられる。 The output unit 39 outputs learning level determination result information indicating the result determined by the learning level determining unit 35. An example of output is when displaying on a display connected to the external device connection I/F 305 in FIG. Examples include cases where
　〔操作習得度判定方法の説明〕
　続いて、図７及び図８を用いて、操作習得度判定方法について説明する。図７及び図８は、習得度の判定フェーズにおいて操作習得度判定装置が実行する操作習得度判定方法を示すフローチャートである。 [Explanation of how to judge operational proficiency level]
Next, a method for determining the degree of operation learning will be explained using FIGS. 7 and 8. FIGS. 7 and 8 are flowcharts illustrating an operation learning level determination method executed by the operation learning level determining apparatus in the learning level determination phase.
　＜習得度の判定フェーズ＞
　Ｓ１１：受信部３１は、操作装置５から所定の操作装置ＩＤ及び所定の操作結果情報を受信する。操作結果情報には、図５に示すような各情報が含まれている。 <Learning level determination phase>
S11: The receiving unit 31 receives a predetermined operating device ID and predetermined operation result information from the operating device 5. The operation result information includes information as shown in FIG.
　Ｓ１２：記憶・読出部３３は、受信部３１から所定の操作装置ＩＤ及び所定の操作結果情報を取得して、操作結果情報管理ＤＢ２１において操作装置ＩＤ毎に所定の操作結果情報を記憶し、受信部３１に記憶完了通知を送信する。 S12: The storage/reading unit 33 acquires a predetermined operation device ID and predetermined operation result information from the reception unit 31, stores the predetermined operation result information for each operation device ID in the operation result information management DB 21, and receives the predetermined operation result information. A storage completion notification is sent to the unit 31.
　Ｓ１３：受信部３１は、習得度判定部３５に、所定の操作結果情報に含まれている所定の操作情報を送信する。 S13: The receiving unit 31 transmits the predetermined operation information included in the predetermined operation result information to the learning level determination unit 35.
　Ｓ１４：習得度判定部３５は、記憶・読出部３３を介し、所定の操作情報に含まれている所定の操作者ＩＤ及び所定の操作内容情報の組に基づいて操作結果情報管理ＤＢ２１を検索することにより、所定の操作者ＩＤ及び所定の操作内容情報の組と同じ組を含む操作情報であって、現在日時（または所定の操作情報に含まれている所定の操作日時）から一定時間Ｔ以内の操作日時情報を含む１つ以上の特定の操作情報に関連づけられている１つ以上の特定のパフォーマンス情報（指標）を抽出する。 S14: The learning level determining unit 35 searches the operation result information management DB 21 via the storage/reading unit 33 based on a set of a predetermined operator ID and predetermined operation content information included in the predetermined operation information. Therefore, the operation information that includes the same set as the predetermined operator ID and the predetermined operation content information, and is within a certain time T from the current date and time (or the predetermined operation date and time included in the predetermined operation information). One or more specific performance information (index) associated with one or more specific operation information including operation date and time information is extracted.
　Ｓ１５：習得度判定部３５は、特定のパフォーマンス情報の数が所定数Ｎ以上か否かを判断する。 S15: The learning level determination unit 35 determines whether the number of specific performance information is equal to or greater than a predetermined number N.
　Ｓ１６：特定のパフォーマンス情報の数が所定数Ｎ以上の場合には（Ｓ１５；ＹＥＳ）、習得度判定部３５は、更に習得度達成基準管理ＤＢ２２を参照し、操作内容に対するパフォーマンス指標において、特定のパフォーマンス情報に基づく特定値が習得度達成基準を満たすか否かを判断する。 S16: If the number of specific performance information is equal to or greater than the predetermined number N (S15; YES), the mastery level determination unit 35 further refers to the mastery level achievement standard management DB 22 and determines the specific performance index for the operation content. It is determined whether the specific value based on the performance information satisfies the mastery level achievement criteria.
　Ｓ１７：特定値が習得度達成基準を満たす場合には（Ｓ１６；ＹＥＳ）、習得度判定部３５は、出力部３９に、操作を習得済みである旨を示す習得度判定結果情報を送信する。 S17: If the specific value satisfies the learning level achievement criteria (S16; YES), the learning level determining unit 35 transmits learning level determination result information indicating that the operation has been learned to the output unit 39.
　Ｓ１８：一方、特定のパフォーマンス情報の数が所定数Ｎ以上でない（所定数Ｎ未満の）場合には（Ｓ１５；ＮＯ）、又は特定値が習得度達成基準を満たさない場合には（Ｓ１６；ＮＯ）、習得度判定部３５は、出力部３９に、操作を未習得である旨を示す習得度判定結果情報を送信する。 S18: On the other hand, if the number of specific performance information is not more than the predetermined number N (less than the predetermined number N) (S15; NO), or if the specific value does not satisfy the mastery level achievement criteria (S16; NO ), the learning level determination unit 35 transmits to the output unit 39 learning level determination result information indicating that the operation has not been learned.
　Ｓ１９：出力部３９は、外部（体感品質推定装置７等）に習得度判定結果情報を出力する。 S19: The output unit 39 outputs the learning level determination result information to the outside (the perceived quality estimating device 7, etc.).
　＜ユーザ体感品質の推定フェーズ＞
　ユーザ体感品質の推定フェーズに関しては、体感品質推定装置７が周知の方法で実行するため、説明を省略する。 <User experience quality estimation phase>
Regarding the user experience quality estimation phase, the experience quality estimating device 7 executes it using a well-known method, so a description thereof will be omitted.
　なお、出力部３９によって出力された習得度判定結果情報は、体感品質推定装置７が操作者のユーザ体感品質を推定するか否かの判断材料に用いられる。例えば、体感品質推定装置７は、習得度判定結果情報が操作を習得済みである旨を示す場合にはユーザ体感品質を推定するが、習得度判定結果情報が操作を習得済みでない（未習得である）旨を示す場合にはユーザ体感品質を推定しない。 Note that the learning level determination result information output by the output unit 39 is used as material for determining whether or not the quality of experience estimation device 7 estimates the quality of user experience of the operator. For example, the experience quality estimating device 7 estimates the user experience quality when the learning level determination result information indicates that the operation has been learned, but the learning level determination result information indicates that the operation has not been learned (unlearned). (Yes), the user experience quality is not estimated.
　〔実施形態の主な効果〕
　以上のように、本実施形態によれば、操作装置５に対するユーザの操作の習得作業の効率化を図ることができるという効果を奏する。 [Main effects of the embodiment]
As described above, according to the present embodiment, it is possible to improve the efficiency of the user's learning of operations on the operating device 5.
　また、本実施形態の操作習得度判定装置３は、ユーザ体感品質の劣化要因に対する「ユーザ体感品質の推定フェーズ」の前に、操作装置５に対するユーザの操作内容の習得度を判定する「習得度の判定フェーズ」を実行する。これにより、「ユーザ体感品質の推定フェーズ」に入っても信頼性の高い評価結果を得ることができるという効果を奏する。 Further, the operation learning level determining device 3 of the present embodiment performs a "learning level" determining the learning level of the user's operation contents for the operating device 5 before the "user experience quality estimation phase" for the deterioration factor of the user experience quality. Execute the “judgment phase”. This has the effect that highly reliable evaluation results can be obtained even in the "user experience quality estimation phase."
　また、操作習得度判定装置３は、「ユーザ体感品質の推定フェーズ」を実施しないで、単に「習得度の判定フェーズ」を実行することで、ユーザによる工業製品の操作内容の習得度を判定することも可能である。この場合、例えば、図１の操作装置５ｃは、「習得度の判定フェーズ」及び「ユーザ体感品質の推定フェーズ」の両方に利用されるだけでなく、「習得度の判定フェーズ」のみに利用されてもよい。 Further, the operation mastery level determination device 3 determines the user's mastery of the operation contents of the industrial product by simply executing the "mastery level determination phase" without implementing the "user experience quality estimation phase". It is also possible. In this case, for example, the operating device 5c in FIG. 1 is used not only in both the "mastery level determination phase" and the "user experience quality estimation phase" but also only in the "mastery level determination phase." It's okay.
　〔補足〕
　本発明は上述の実施形態に限定されるものではなく、以下に示すような構成又は処理（動作）であってもよい。 〔supplement〕
The present invention is not limited to the above-described embodiments, and may have the following configuration or processing (operation).
　体感品質推定装置７はコンピュータとプログラムによっても実現できるが、このプログラムを（非一時的）記録媒体に記録することも、インターネット等の通信ネットワーク１００を介して提供することも可能である。 The quality of experience estimation device 7 can also be realized by a computer and a program, but this program can also be recorded on a (non-temporary) recording medium or provided via a communication network 100 such as the Internet.
１　通信システム
３　操作習得度判定装置
５，５ａ，５ｂ，５ｃ　操作装置
７　体感品質推定装置
９　コンテンツ配信装置
２０　記憶部
２１　操作結果情報管理ＤＢ（操作結果情報管理部の一例）
２２　習得度達成基準管理ＤＢ（習得度達成基準管理部の一例）
３１　受信部
３３　記憶・読出部
３５　習得度判定部
３９　出力部 1 Communication system 3 Operation learning level determination device 5, 5a, 5b, 5c Operation device 7 Experience quality estimation device 9 Content distribution device 20 Storage unit 21 Operation result information management DB (an example of operation result information management unit)
22 Mastery Achievement Criteria Management DB (Example of Mastery Achievement Criteria Management Department)
31 Receiving section 33 Storage/reading section 35 Learning level determination section 39 Output section

Claims (7)

  1. 　操作装置に対する操作者の操作の習得度を判定する操作習得度判定装置であって、
    　前記操作装置から通信ネットワークを介して当該操作装置に対する前記操作者の操作に係る操作内容を含む操作情報及び当該操作内容に対する前記操作者の操作に関するパフォーマンスを示したパフォーマンス情報を受信する受信部と、
    　前記パフォーマンス情報に基づく特定値が習得度達成基準を満たす否かを判断し、前記特定値が前記習得度達成基準を満たす場合には、前記操作者が前記操作内容に対して習得済みであると判定する習得度判定部と、
    　前記習得済みである旨を示す習得度判定結果情報を出力する出力部と、
    　を有する操作習得度判定装置。     An operation learning level determining device that determines an operator's learning level of operating an operating device, the device comprising:
    a receiving unit that receives operation information including operation details related to the operation of the operator on the operation device from the operation device via a communication network, and performance information indicating performance regarding the operation of the operator with respect to the operation details;
    It is determined whether the specific value based on the performance information satisfies the mastery level achievement criteria, and if the specific value satisfies the mastery level achievement criteria, it is determined that the operator has mastered the operation content. A proficiency level determination unit that determines;
    an output unit that outputs learning level determination result information indicating that the learning has been completed;
    An operation learning level determination device having:
  2. 　請求項１に記載の操作習得度判定装置であって、
    　前記受信部によって受信された前記操作情報及び前記パフォーマンス情報を関連付けて管理する操作結果情報管理部を有し、
    　前記操作情報には前記操作者を識別するための操作者識別情報が含まれており、
    　前記習得度判定部は、前記操作結果情報管理部で管理された同じ操作者に係る特定の操作内容及び特定のパフォーマンス情報に基づく前記特定値が前記習得度達成基準を満たす否かを判断する、操作習得度判定装置。     The operation learning level determination device according to claim 1,
    an operation result information management unit that associates and manages the operation information and the performance information received by the reception unit;
    The operation information includes operator identification information for identifying the operator,
    The learning level determination unit determines whether the specific value based on specific operation content and specific performance information regarding the same operator managed by the operation result information management unit satisfies the learning level achievement criterion. Operation learning level determination device.
  3. 　前記操作内容及び前記特定のパフォーマンス情報が複数ある場合に、前記習得度判定部は、複数の前記特定のパフォーマンス情報の分散値又は平均値に係る前記特定値が前記習得度達成基準を満たす否かを判断する、請求項２に記載の操作習得度判定装置。 When there are a plurality of the operation contents and the specific performance information, the learning level determination unit determines whether the specific value related to the variance value or the average value of the plurality of specific performance information satisfies the learning level achievement criterion. 3. The operation learning level determination device according to claim 2, which determines.
  4. 　前記パフォーマンス情報は、前記操作内容に対して前記操作者による前記操作装置への操作のパフォーマンスの指標毎に示した情報である、請求項１に記載の操作習得度判定装置。 The operation learning level determination device according to claim 1, wherein the performance information is information shown for each index of performance of the operation of the operation device by the operator with respect to the operation content.
  5. 　前記出力部によって出力された前記習得度判定結果情報は、前記操作者のユーザ体感品質を推定するか否かの判断材料に用いられる、請求項１乃至４のいずれか一項に記載の操作習得度判定装置。 The operation learning method according to any one of claims 1 to 4, wherein the learning level determination result information outputted by the output unit is used as a material for determining whether or not to estimate the quality of user experience of the operator. Degree determination device.
  6. 　操作装置に対する操作者の操作の習得度を判定する操作習得度判定装置が実行する操作習得度判定であって、
    　操作習得度判定装置は、
    　前記操作装置から通信ネットワークを介して当該操作装置に対する前記操作者の操作に係る操作内容を含む操作情報及び当該操作内容に対する前記操作者の操作に関するパフォーマンスを示したパフォーマンス情報を受信する受信処理と、
    　前記パフォーマンス情報に基づく特定値が習得度達成基準を満たす否かを判断し、前記特定値が前記習得度達成基準を満たす場合には、前記操作者が前記操作内容に対して習得済みであると判定する習得度判定処理と、
    　前記習得済みである旨を示す習得度判定結果情報を出力する出力処理と、
    　を実行する操作習得度判定方法。     An operation learning level determination performed by an operation learning level determination device that determines an operator's learning level of operations for an operating device,
    The operation learning level determination device is
    a reception process of receiving operation information including operation details related to the operation of the operator on the operation device from the operation device via a communication network, and performance information indicating performance regarding the operation of the operator with respect to the operation details;
    It is determined whether the specific value based on the performance information satisfies the mastery level achievement criteria, and if the specific value satisfies the mastery level achievement criteria, it is determined that the operator has mastered the operation content. A proficiency level determination process for determining,
    output processing for outputting mastery level determination result information indicating that the mastery has been completed;
    A method for determining operational proficiency.
  7. 　コンピュータに、請求項６に記載の方法を実行させるプログラム。 A program that causes a computer to execute the method according to claim 6.
PCT/JP2022/030917 2022-08-15 2022-08-15 Operation learning level determination device, operation learning level determination method, and program WO2024038499A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/030917 WO2024038499A1 (en) 2022-08-15 2022-08-15 Operation learning level determination device, operation learning level determination method, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/030917 WO2024038499A1 (en) 2022-08-15 2022-08-15 Operation learning level determination device, operation learning level determination method, and program

Publications (1)

Publication Number Publication Date
WO2024038499A1 true WO2024038499A1 (en) 2024-02-22

Family

ID=89941544

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/030917 WO2024038499A1 (en) 2022-08-15 2022-08-15 Operation learning level determination device, operation learning level determination method, and program

Country Status (1)

Country Link
WO (1) WO2024038499A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009048002A1 (en) * 2007-10-09 2009-04-16 Konami Digital Entertainment Co., Ltd. Game device, game method and game program
JP2011229716A (en) * 2010-04-28 2011-11-17 Square Enix Co Ltd User interface processor, user interface processing method, and user interface processing program
JP2013242717A (en) * 2012-05-21 2013-12-05 Yahoo Japan Corp Game proposal device, game proposal method and program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009048002A1 (en) * 2007-10-09 2009-04-16 Konami Digital Entertainment Co., Ltd. Game device, game method and game program
JP2011229716A (en) * 2010-04-28 2011-11-17 Square Enix Co Ltd User interface processor, user interface processing method, and user interface processing program
JP2013242717A (en) * 2012-05-21 2013-12-05 Yahoo Japan Corp Game proposal device, game proposal method and program

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SATOKO TOMINAGA, YAKO SATO, HITOSHI AOKI: "Study of QoE evaluation method for cloud games", IEICE TECHNICAL RESEARCH REPORT, CQ, IEICE, JP, vol. 115, no. 327 (CQ2015-89), 19 November 2015 (2015-11-19), JP, pages 75 - 80, XP009552649 *

Similar Documents

Publication Publication Date Title
US10453161B2 (en) Watermarking and scalability techniques for a virtual desktop planning tool
CN102487456B (en) Method for providing visit rate of online video and device thereof
CN102197362B (en) Surfacing and management of window-specific controls
JP4973145B2 (en) Management server and content transfer system
JP5668078B2 (en) Server side rendering
TW201303582A (en) Cloud-based test system, method and computer readable storage medium storing thereof
CN107846629A (en) Recommend the method, apparatus and server of video to user
CN110851710A (en) Novel recommendation method and device
KR101938203B1 (en) Apparatus for integrally managing of error generating of hardware and software in computer system
EP2731015B1 (en) Computer infrastructure performance system
CN109831688B (en) Video suspension playing method and device based on iOS system
WO2024038499A1 (en) Operation learning level determination device, operation learning level determination method, and program
US11013958B2 (en) Performance of fitness application based on fitness activities
JP2011520324A (en) Method and apparatus for media content playback and playback control in web page
US8639598B2 (en) Error reporting and technical support customization for computing devices
KR102137891B1 (en) Server managing Method, Server, and Recording medium using User Specialized Operating Mechanism on BMC environment
JP2013232071A (en) Information processing device, information processing method, program, and information processing system
CN108702526B (en) Data processing method and system
WO2023228256A1 (en) Quality-of-experience degradation estimation device, machine learning method, quality-of-experience degradation estimation method, and program
CN114996507A (en) Video recommendation method and device
US8880823B2 (en) Information processing system, information processing apparatus, and non-transitory computer readable medium storing information processing program
WO2023203771A1 (en) Quality of experience estimation device, machine learning method, quality of experience estimation method, and program
CN113038281B (en) Video playing method, device, equipment and storage medium
CN114143612B (en) Video display method, device, electronic equipment, storage medium and program product
CN114301887B (en) Audio content playing method and audio content playing device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22955673

Country of ref document: EP

Kind code of ref document: A1