JP2021114092A - Client device, content correction system and control method - Google Patents

Abstract

To provide a client device and the like that can correct a content acquired from a content distribution device which content is a target of presentation.SOLUTION: A content determination unit 32 determines content quality which is quality of a content for being requested from a content distribution device 200. A content acquisition unit 41 acquires the content having the content quality determined by the content determination unit 32 from the content distribution device 200. A correction method determination unit 44 determines a correction method of an acquired content which is the content acquired by the content acquisition unit 41. The content correction unit 45 corrects the acquired content by means of the correction method determined by the correction method determination unit 44. The content presentation unit 46 performs processing for presenting the acquired content corrected by the content correction unit 45.SELECTED DRAWING: Figure 4

Description

The present disclosure relates to client devices, content correction systems and control methods.

In recent years, video distribution according to MPEG-DASH (Dynamic Adaptive Streaming over HTTP) has been widely adopted in online video distribution services. In the following, video distribution according to MPEG-DASH is also referred to as “DASH-compatible distribution”. In DASH-compatible distribution, the bit rate of the content to be distributed can be dynamically changed. The content is, for example, a moving image.

In a system that performs DASH-compatible distribution, a plurality of data having different qualities are prepared for one content. In addition, each data is divided into segment units. As a result, the client device can request the content having the optimum quality and the highest quality from the server that performs DASH-compatible distribution according to the network status, the buffer status of the client device, and the like.

In a configuration that takes network conditions into account, the bit rate of the content is compared with the latest measured throughput index. Then, a segment file having a bit rate so as not to exceed the latest throughput is required.

In the configuration considering the buffer status of the client device, the playback duration of the content corresponding to the received segment file is compared with the transfer period of the next segment file to be acquired. Then, a segment file having a transfer period (bit rate) so as not to exceed the reproduction continuation period is required.

There is a trade-off between content quality and content acquisition time. The client device stores a standard (rate control rule) for determining a segment file to be requested, which is a standard for improving the user experience. The user experience is, for example, the degree of visibility of the content that the user feels.

For example, Patent Document 1 discloses a configuration (hereinafter, also referred to as “related configuration A”) that dynamically determines a segment file to be requested according to a communication environment, a buffer status, content attributes, and the like. There is. According to the related configuration A, it is possible to quickly realize the reproduction of high-quality content even in a situation where the throughput does not fluctuate much.

In the following description, the term "content" may be used as a term for the term "segment file".

Japanese Patent No. 6466870

The client device having a function of communicably connecting to the content distribution device as a server determines the quality of the content to be requested from the content distribution device based on the criteria for determining the quality, and the content having the quality is determined. Is acquired from the content distribution device.

The quality of the content acquired by the client device from the content distribution device may change, for example, as the communication state between the client device and the content distribution device changes. In this case, in the situation where the content having the changed quality is presented, the quality of the content may be significantly different from the expected quality.

Therefore, it is required to correct the content acquired from the content distribution device to be presented. The related configuration A cannot meet this requirement.

The present disclosure has been made to solve such a problem, and an object of the present disclosure is to provide a client device or the like capable of correcting the content acquired from the content distribution device to be presented. do.

In order to achieve the above object, the client device according to one aspect of the present disclosure has a function of communicably connecting to the content distribution device via a communication network. The client device includes an information acquisition unit that acquires information related to content quality, which is the quality of content that the client device requests from the content distribution device, the information acquired by the information acquisition unit, and the content. A content determination unit that determines the content quality of the content to be requested from the content distribution device and a content determination unit that determines the content quality based on a target standard that is a standard included in a plurality of criteria for determining the quality. The content acquisition unit acquires the content having the determined content quality based on the content acquisition unit that acquires the content having the determined content quality from the content distribution device and the target criteria used by the content determination unit to determine the content quality. The content correction unit that corrects the acquired content and the content correction unit correct the acquired content by the correction method that determines the correction method of the acquired content that is the content, and the correction method that is determined by the correction method determination unit. It is provided with a content presentation unit that performs processing for presenting the acquired content.

According to the present disclosure, the content determination unit determines the content quality, which is the quality of the content required for the content distribution device. The content acquisition unit acquires content having the content quality determined by the content determination unit from the content distribution device. The correction method determination unit determines a correction method for the acquired content, which is the content acquired by the content acquisition unit. The content correction unit corrects the acquired content by the correction method determined by the correction method determination unit. The content presenting unit performs a process for presenting the acquired content corrected by the content correction unit.

This makes it possible to provide a client device capable of correcting the content acquired from the content distribution device, which is the target of presentation.

It is a figure which shows the structure of the content correction system which concerns on Embodiment 1. FIG. It is a hardware block diagram of the client apparatus which concerns on Embodiment 1. FIG. It is a hardware block diagram of the content distribution device which concerns on Embodiment 1. FIG. It is a figure for demonstrating operation of the content correction system which concerns on Embodiment 1. FIG. It is a flowchart of the content correction control process which concerns on Embodiment 1. FIG. It is a block diagram which shows the characteristic functional structure of the client apparatus which concerns on Embodiment 1. FIG. It is a hardware configuration diagram of a client device.

Hereinafter, embodiments will be described with reference to the drawings. In the drawings below, the same components are designated by the same reference numerals. The names and functions of the components with the same reference numerals are the same. Therefore, detailed description of some of the components having the same reference numerals may be omitted.

<Embodiment 1>
(Constitution)
FIG. 1 is a diagram showing a configuration of the content correction system 500 according to the first embodiment. The content correction system 500 is, for example, a system that performs DASH-compatible distribution. Since moving image distribution according to MPEG-DASH (DASH-compatible distribution) is a known technique, detailed description thereof will be omitted.

With reference to FIG. 1, the content correction system 500 includes a client device 100 and a content distribution device 200. The client device 100 is, for example, a television receiver having a communication function. The content distribution device 200 has a function of distributing content. The content is, for example, a moving image. The content distribution device 200 is, for example, a server having a function of performing DASH-compatible distribution according to MPEG-DASH. The content distribution device 200 is, for example, a server provided by a business operator.

The client device 100 has a function of communicably connecting to the content distribution device 200 via the communication network 3. The communication network 3 is, for example, a network such as a LAN (Local Area Network). The client device 100 communicates with the content distribution device 200 via the communication network 3. The client device 100 receives the content distributed by the content distribution device 200 and displays the content.

FIG. 2 is a hardware block diagram of the client device 100 according to the first embodiment. With reference to FIG. 2, the client device 100 includes a data processing unit 101, a memory 102, a CPU (Central Processing Unit) 103, an operation unit 104, a data bus 105, a speaker 114, and a display unit 111. Be prepared.

The data bus 105 is a bus for a plurality of components connected to the data bus 105 to perform data communication with each other. The data processing unit 101, the memory 102, the CPU 103, and the operation unit 104 are connected to the data bus 105.

The memory 102 includes a non-volatile memory and a volatile memory. The non-volatile memory stores a control program and control data. The control program is a program for controlling the operation of the client device 100. The volatile memory temporarily stores data for data processing and the like.

The CPU 103 performs processing according to a control program stored in the memory 102. The CPU 103 performs processing for controlling the client device 100, for example. The operation unit 104 is an interface for operating the client device 100. The operation unit 104 has a function of accepting an operation by a user. The operation unit 104 is, for example, an operation switch, a remote controller, a touch panel, or the like.

The speaker 114 has a function of outputting sound. The display unit 111 has a function of displaying an image. The display unit 111 is, for example, a liquid crystal panel. The liquid crystal panel uses a backlight to display an image.

The data processing unit 101 has a function of processing data as contents. The data processing unit 101 includes a communication unit 106, a decoder 107, an audio signal processing circuit 112, an audio output circuit 113, a video signal processing circuit 108, a graphics superimposition circuit 109, and a video output circuit 110.

The communication unit 106 has a function of performing communication. The communication unit 106 has a function of communicating with the communication network 3. The communication unit 106 receives content from, for example, the communication network 3.

The decoder 107 decodes the content received by the communication unit 106. The audio signal processing circuit 112 performs predetermined processing on the audio signal of the content. The voice output circuit 113 outputs voice based on the voice signal from the speaker 114.

The video signal processing circuit 108 performs predetermined processing on the video signal of the content. The graphics superimposition circuit 109 superimposes graphics such as characters and characters on the image indicated by the image signal, if necessary. The video output circuit 110 causes the display unit 111 to display the video indicated by the video signal.

When DASH-compatible distribution is performed, the client device 100 sequentially reproduces the data while storing the data received from the content distribution device 200 in the buffer. The buffer is the volatile memory of the memory 102. In the following, the amount of data stored in the buffer and not being played back is also referred to as "buffer remaining amount". Further, in the following, the content for the client device 100 to request the content distribution device 200 is also referred to as "requested content". The requested content is, for example, content specified by the user.

Further, the client device 100 stores a predetermined standard. That is, the standard is set in advance in the client device 100. In this embodiment, the reference is, for example, a rate control rule. The rate control rule is, for example, a rule for preventing interruption of content playback. Further, the rate control rule is a rule for determining the quality of the requested content. The quality is, for example, a bit rate. The client device 100 stores a plurality of rate control rules as a reference. Specifically, the memory 102 of the client device 100 stores a plurality of criteria (rate control rules) for determining the quality of the requested content.

FIG. 3 is a hardware block diagram of the content distribution device 200 according to the first embodiment. With reference to FIG. 3, the content distribution device 200 includes a display unit 204, an operation unit 205, a hard disk 206, a communication unit 201, a memory 202, a CPU 203, and a data bus 207.

The data bus 207 is a bus for a plurality of components connected to the data bus 207 to perform data communication with each other. The display unit 204, the operation unit 205, the hard disk 206, the communication unit 201, the memory 202, and the CPU 203 are connected to the data bus 207.

The display unit 204 has a function of displaying an image. The display unit 204 is, for example, a liquid crystal panel. The liquid crystal panel uses a backlight to display an image. The operation unit 205 has a function of accepting an operation by a user. The operation unit 205 is, for example, one or both of a keyboard and a mouse. The hard disk 206 has a function of storing a large amount of data.

In the following, the content may be referred to as "content data". As described above, the content distribution device 200 has a function of performing DASH-compatible distribution according to MPEG-DASH. Therefore, the content distribution device 200 stores a plurality of content data having different qualities for one content.

Each content data is divided into segments. The plurality of divided content data are segment files. In the following, the segment file may be simply referred to as a "segment".

The hard disk 206 stores k contents. "K" is an integer of 1 or more. Further, the hard disk 206 stores a plurality of content data having different qualities for one content. Therefore, the hard disk 206 stores a plurality of content data (segments) as contents in k sets.

The communication unit 201 has a function of communicating with the communication network 3. The memory 202 includes a non-volatile memory and a volatile memory. The non-volatile memory stores a control program and control data. The control program is a program for controlling the operation of the content distribution device 200. The volatile memory temporarily stores data for data processing and the like. The CPU 203 performs processing according to a control program stored in the memory 202.

(motion)
FIG. 4 is a diagram for explaining the operation of the content correction system 500 according to the first embodiment. Further, FIG. 4 is a functional block diagram showing a characteristic functional configuration of the client device 100 and the content distribution device 200 included in the content correction system 500.

The client device 100 functionally includes a rate control rule management unit 30 and a content management unit 40. The rate control rule management unit 30 manages the rate control rule. The content management unit 40 manages the content.

The rate control rule management unit 30 functionally includes an information acquisition unit 31, a content determination unit 32, a storage unit 33, and an information providing unit 34.

Functionally, the content management unit 40 includes a content acquisition unit 41, a decoding unit 43, a correction method determination unit 44, a content correction unit 45, and a content presentation unit 46.

The function of each component included in the client device 100 of FIG. 4 is realized, for example, by the CPU 103 executing the control program stored in the memory 102 of the client device 100. Note that some or all of the plurality of components included in the client device 100 of FIG. 4 may be configured by hardware.

The content distribution device 200 functionally includes a request receiving unit 51 and a content transmitting unit 52. The function of each component included in the content distribution device 200 of FIG. 4 is realized, for example, by the CPU 203 executing the control program stored in the memory 202 of the content distribution device 200.

In the following, the process performed by the content correction system 500 is also referred to as “content correction control process”. FIG. 5 is a flowchart of the content correction control process according to the first embodiment. The content correction control process is a control method for correcting the content. Further, a part of the content correction control process is a control method performed by the client device 100.

Further, in the following, the throughput in the client device 100 is also referred to as “client throughput”. Since the throughput as the client throughput is known, for example, shown in the related configuration A, detailed description thereof will be omitted.

The client throughput will be briefly described below. The client throughput is, for example, the speed (communication speed) of the communication in a situation where the client device 100 communicates with the content distribution device 200. The client throughput is, for example, the speed at which the client device 100 receives data from the content distribution device 200.

The client throughput may be expressed by a value obtained from the formula (content data size / content reception time), for example. The client throughput changes depending on, for example, the state of the content distribution device 200, the degree of congestion of the communication network 3, and the like.

The client device 100 calculates the client throughput each time the content is received from the content distribution device 200. The content is, for example, a segment. That is, the client device 100 always keeps track of the latest client throughput.

First, an outline of the content correction control process will be described. With reference to FIGS. 4 and 5, the content distribution device 200 prepares a plurality of data having different qualities (step S01). Specifically, the hard disk 206 of the content distribution device 200 stores a plurality of content data having different qualities as the content required by the client device 100. As mentioned above, the quality is, for example, a bit rate. Each content data is divided into segments.

Further, as described above, the hard disk 206 stores a plurality of content data (segments) as contents in k sets. Here, for the sake of clarity, "k" is assumed to be 1. Further, each content data is encoded according to, for example, MPEG-4 AVC.

In the following, information related to the quality of the requested content for the client device 100 to request the content distribution device 200 is also referred to as “quality-related information”. Further, in the following, the quality of the required content is also referred to as "content quality". That is, the quality-related information is information related to content quality. The quality-related information is, for example, information indicating the state of the client throughput described above. Further, the quality-related information is, for example, the above-mentioned information indicating the remaining amount of the buffer.

The information acquisition unit 31 performs an information acquisition process (step S02). In the information acquisition process, the information acquisition unit 31 acquires quality-related information. In the following, among the plurality of criteria stored in the client device 100 (memory 102), the criteria to be used are also referred to as “target criteria”. The target reference is a reference included in a plurality of criteria stored in the client device 100. As described above, each reference stored in the client device 100 is a rate control rule. The plurality of criteria include, for example, criteria related to client throughput. In addition, the plurality of criteria include, for example, criteria related to the remaining amount of buffer.

The content determination unit 32 determines the content quality of the requested content based on the quality-related information acquired by the information acquisition unit 31 and the target standard (step S03). That is, the target standard is a standard (rate control rule) used by the content determination unit 32 to determine the content quality. In the following, the content quality determined by the content determination unit 32 is also referred to as “target content quality”.

The storage unit 33 stores a rate control rule as a target reference (hereinafter, also referred to as a “target rate control rule”) (step S04).

In summary, the content acquisition unit 41 acquires content having the target content quality determined by the content determination unit 32 from the content distribution device 200. The content acquisition unit 41 includes a content request unit 41a and a content reception unit 41b.

Specifically, the content acquisition unit 41 performs the following processing in order to acquire the content having the target content quality. First, the content requesting unit 41a requests the content distribution device 200 for content having the target content quality (step S05).

The request receiving unit 51 of the content distribution device 200 receives the above request from the client device 100 (step S06).

The content transmission unit 52 of the content distribution device 200 transmits the content data included in the plurality of content data to the client device 100 in response to the content request by the client device 100 (step S07).

As described above, the content distribution device 200 has, for example, a function of performing DASH-compatible distribution according to MPEG-DASH. Therefore, the content transmission unit 52 of the content distribution device 200 transmits the content data to the client device 100 according to MPEG-DASH (step S07).

Specifically, the content transmitting unit 52 transmits the content data as the content having the target content quality included in the plurality of content data to the client device 100 in response to the request received by the request receiving unit 51.

The content receiving unit 41b receives the content as the content data transmitted by the content distribution device 200. As a result, the content acquisition unit 41 acquires the content having the target content quality. In the following, the content acquired by the content acquisition unit 41 is also referred to as “acquired content”.

Next, the decoding unit 43 decodes the acquired content (step S08).

The information providing unit 34 transmits the target rate control rule as the target reference stored in the storage unit 33 to the correction method determining unit 44. The correction method determination unit 44 determines a correction method for the decoded acquired content based on the target rate control rule as the target reference received from the information providing unit 34 (step S09). The target rate control rule (target standard) is a rate control rule (standard) used by the content determination unit 32 to determine the content quality. It is desirable that the correction method to be determined is the optimum method (processing) for the acquired content.

The content correction unit 45 corrects the decoded acquired content by the correction method determined by the correction method determination unit 44 (step S10).

The content presentation unit 46 performs a process for presenting the acquired content corrected by the content correction unit 45 (step S11). Specifically, the content presentation unit 46 causes the display unit 111 to display the corrected acquired content.

Next, an example of the content correction control process will be described. In this embodiment, the quality of the content is, for example, a bit rate. As an example of the bit rate in the present embodiment, a low bit rate, a medium bit rate, and a high bit rate are defined.

The medium bit rate is the bit rate between the low bit rate and the high bit rate. A low bit rate is a bit rate greater than 0 and less than a medium bit rate. A high bit rate is a bit rate higher than a medium bit rate. The medium bit rate is, for example, a bit rate in the range of 501 kbps to 1.49 Mbps.

A typical value for a low bit rate is, for example, 200 kbps. A typical value of the medium bit rate is 1.1 Mbps as an example. A typical value for a high bit rate is, for example, 5 Mbps.

Further, regarding the client throughput in this embodiment, low throughput, medium throughput, and high throughput are defined as an example. When the medium throughput is expressed by, for example, the communication speed, the medium throughput is a communication speed in the range of 501 kbps to 1.9 Mbps.

Low throughput is a throughput greater than 0 and lower than medium throughput. High throughput is higher throughput than medium throughput.

When the low throughput is expressed by the communication speed, the representative value of the low throughput is 200 kbps as an example. When the medium throughput is expressed in terms of communication speed, the representative value of the medium throughput is 1.1 Mbps as an example. When the high throughput is expressed by the communication speed, the representative value of the high throughput is 5 Mbps as an example.

Further, in the following, the information indicating the state of the client throughput is also referred to as "throughput evaluation information". Throughput evaluation information indicates "good" or "bad". "Good" in the throughput evaluation information means that the client throughput is high. "Bad" indicated by the throughput evaluation information indicates that the client throughput is low.

Next, in order to make it easier to understand an example of the content correction control process, the content correction control process performed under the following premise Pm1 will be described. In the premise Pm1, the client throughput is low. That is, the communication state between the client device 100 and the content distribution device 200 is poor. Further, in the premise Pm1, the memory 102 of the client device 100 stores a plurality of rate control rules as a reference.

Further, the plurality of rate control rules in the premise Pm1 are rule R1 and rule R2. Rule R1 is a throughput-related rule. Rule R1 is a rule that, for example, when the client throughput is low, the low bit rate is determined as the content quality of the requested content. Rule R2 is, for example, a rule related to the remaining buffer capacity.

Further, in the premise Pm1, the client device 100 creates quality-related information indicating the latest client throughput at any time. In the premise Pm1, the quality-related information is throughput evaluation information. Further, in the premise Pm1, the throughput evaluation information indicates "bad".

Further, in the content correction control process in the premise Pm1, the client device 100 acquires low bit rate content in which block noise exists, as an example, from the content distribution device 200.

Further, the correction method determined in step S09 of the content correction control process in the premise Pm1 is, for example, a blurring process for making block noise (edge) existing in low bit rate content inconspicuous. The blurring process is a filter process that reduces the sharpness of the image. Since the blurring process as the filtering process is a well-known technique, detailed description thereof will be omitted.

The blurring process will be briefly described below. The blurring process is a process for reducing the high frequency component contained in the frequency component of the image. The blurring process is, for example, a process of removing a high frequency component in the spatial frequency spectrum of the image, which is obtained by performing a two-dimensional Fourier transform on the image.

Hereinafter, an example of the main processing included in the content correction control processing in the premise Pm1 will be described. The description of a part of the content correction control process (for example, steps S01, S04, etc.) will be omitted.

In the information acquisition process (step S02) of the content correction control process in the premise Pm1, the information acquisition unit 31 acquires throughput evaluation information indicating “bad” as quality-related information.

Next, in step S03, the content determination unit 32 selects the rule R1 related to throughput among the rule R1 and the rule R2 as the reference (rate control rule) as the target reference. Then, the content determination unit 32 determines the content quality of the requested content based on the throughput evaluation information (quality-related information) acquired by the information acquisition unit 31 and the rule R1 (target standard).

As described above, the rule R1 is a rule that, when the client throughput is low, the low bit rate is determined as the content quality of the requested content. Further, "bad" indicated by the throughput evaluation information indicates that the client throughput is low. In this case, in step S03, the content determination unit 32 determines the low bit rate as the content quality of the requested content according to the rule R1.

Next, the content acquisition unit 41 acquires the content having the target content quality determined by the content determination unit 32 from the content distribution device 200. The target content quality is a low bit rate. That is, the content acquisition unit 41 acquires low bit rate content from the content distribution device 200.

Specifically, in step S05, the content requesting unit 41a requests the content distribution device 200 for low bit rate content. The request receiving unit 51 of the content distribution device 200 receives the above request (step S06).

The content transmission unit 52 of the content distribution device 200 transmits the content data included in the plurality of content data to the client device 100 in response to the content request by the client device 100 (step S07). Specifically, the content transmitting unit 52 transmits the content data as the content having the target content quality included in the plurality of content data to the client device 100 based on the request received by the request receiving unit 51. As a result, the content acquisition unit 41 acquires low bit rate content as content having the target content quality.

Next, the process of step S08 described above is performed. Next, the correction method determination unit 44 determines a correction method for low bit rate content (acquired content) based on rule R1 as a target reference (target rate control rule) (step S09). The rule R1 (target standard) is a rule (standard) used by the content determination unit 32 to determine the content quality. In the premise Pm1, the correction method determined is the blurring process. The correction method is the optimum processing for low bit rate content.

The content correction unit 45 corrects the low bit rate content (acquired content) by the correction method determined by the correction method determination unit 44 (step S10). In the premise Pm1, the correction method is a blurring process that makes block noise (edges) existing in low bit rate content inconspicuous. The content correction unit 45 corrects the low bit rate content by performing a blurring process as a correction method. As a result, the content in which the block noise is inconspicuous can be obtained.

The content presentation unit 46 performs a process for presenting the content corrected by the content correction unit 45 (step S11). Specifically, the content presentation unit 46 causes the display unit 111 to display the corrected content. As a result, the content in which the block noise is inconspicuous is displayed on the display unit 111. That is, the content is presented to the user.

(summary)
As described above, according to the present embodiment, the content determination unit 32 determines the content quality, which is the quality of the content required for the content distribution device 200. The content acquisition unit 41 acquires content having the content quality determined by the content determination unit 32 from the content distribution device 200. The correction method determination unit 44 determines a correction method for acquired content, which is the content acquired by the content acquisition unit 41. The content correction unit 45 corrects the acquired content by the correction method determined by the correction method determination unit 44. The content presentation unit 46 performs a process for presenting the acquired content corrected by the content correction unit 45.

This makes it possible to provide a client device capable of correcting the content acquired from the content distribution device, which is the target of presentation.

Further, according to the present embodiment, the correction method determination unit 44 determines the correction method of the acquired content based on the target rate control rule as the target reference. The correction method is the optimum method (processing) for the acquired content. The target rate control rule (target standard) is a rate control rule (standard) used by the content determination unit 32 to determine the content quality. The content correction unit 45 corrects the content acquired from the content distribution device 200 by the correction method determined by the correction method determination unit 44.

As an example, in the content correction control process in the premise Pm1, low bit rate content is acquired from the content distribution device in a situation where the client throughput is low (that is, a situation where the communication state is poor). In addition, the content is corrected by a correction method that makes the block noise (edge) existing in the low bit rate content inconspicuous. Then, the corrected content is presented to the user.

Therefore, even in a situation where the communication state is poor, it is possible to prevent the user from feeling that the quality of the presented content is low. That is, the deterioration of the quality of the content can be suppressed. This can improve the user experience. The user experience is, for example, the degree of visibility of the content that the user feels.

Further, according to the present embodiment, the content correction system 500 including the client device 100 having the above configuration and the content distribution device 200 is realized. As a result, in the content correction system 500, for example, the user can collectively perform setting work for the quality of the content to be acquired, the correction method, and the like. Therefore, the expandability and maintainability of the content correction system 500 can be improved.

Further, according to the present embodiment, the content distribution device 200 of the content correction system 500 has a function of performing DASH-compatible distribution according to MPEG-DASH. For example, the content distribution device 200 transmits content data to the client device 100 according to MPEG-DASH. As a result, the content correction system 500 can be made compatible with the form of moving image distribution that has been widely adopted in recent years.

Further, according to the client device 100, the content distribution device 200, the content correction system 500, and the control method (content correction control process) of the present embodiment, the user can perform the above-mentioned setting work and the like semi-automatically and surely. You can perform the work.

By the way, in general, when the playback of the content is interrupted, the user experience is significantly deteriorated. Therefore, in general, the rate control rule is often a rule for requesting the content distribution device to have the content having the highest quality (bit rate) possible so that the playback of the content is not interrupted.

However, if the communication status between the client device and the content distribution device is poor and the quality (bit rate) of the requested content is too low, the quality of the content acquired by the client device to be presented to the user. There is a problem that the level of is an unacceptable level for the user.

Further, in the related configuration A, the bit rate of the content to be presented is controlled according to the communication environment (communication state), the buffer status, the content attribute, and the like. However, in the related configuration A, there is a problem that the quality of the content is deteriorated when the communication state is poor.

Therefore, the client device 100 and the content correction system 500 of the present embodiment have a configuration for achieving the above effects. Therefore, the client device 100 and the content correction system 500 of the present embodiment can solve each of the above problems.

(Functional block diagram)
FIG. 6 is a block diagram showing a characteristic functional configuration of the client device BL10 according to the first embodiment. The client device BL10 corresponds to the client device 100. That is, FIG. 6 is a block diagram showing the main functions related to the present technology among the functions of the client device BL10.

The client device BL10 has a function of communicably connecting to the content distribution device BL20 via the communication network 3. The content distribution device BL20 corresponds to the content distribution device 200.

The client device BL10 functionally includes an information acquisition unit BL1, a content determination unit BL2, a content acquisition unit BL3, a correction method determination unit BL4, a content correction unit BL5, and a content presentation unit BL6.

The information acquisition unit BL1 acquires information related to the content quality, which is the quality of the content for the client device BL10 to request the content distribution device BL20. The information acquisition unit BL1 corresponds to the information acquisition unit 31.

The content determination unit BL2 requests the content distribution device BL20 based on the information acquired by the information acquisition unit BL1 and the target criteria which are the criteria included in the plurality of criteria for determining the content quality. Determine the content quality of the content. The content determination unit BL2 corresponds to the content determination unit 32.

The content acquisition unit BL3 acquires the content having the content quality determined by the content determination unit BL2 from the content distribution device BL20. The content acquisition unit BL3 corresponds to the content acquisition unit 41.

The correction method determination unit BL4 determines a correction method for the acquired content, which is the content acquired by the content acquisition unit BL3, based on the target standard used by the content determination unit BL2 to determine the content quality. The correction method determination unit BL4 corresponds to the correction method determination unit 44.

The content correction unit BL5 corrects the acquired content by the correction method determined by the correction method determination unit BL4. The content correction unit BL5 corresponds to the content correction unit 45. The content presentation unit BL6 performs a process for presenting the acquired content corrected by the content correction unit BL5. The content presentation unit BL6 corresponds to the content presentation unit 46.

(Other variants)
The client device and the content correction system according to the present technology have been described above based on the embodiment, but the present technology is not limited to the embodiment. The present technology also includes modifications that can be conceived by those skilled in the art within the scope of the present technology. That is, in the present technology, the embodiment can be appropriately modified or omitted within the scope of the technology.

For example, the client device 100 may not include all the components shown in the figure. That is, the client device 100 may include only the minimum components capable of realizing the effects of the present technology.

Further, each function of the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46 included in the client device 100 is realized by the processing circuit. You may.

The processing circuit is a circuit for acquiring information related to content quality, which is the quality of content for the client device to request from the content distribution device.

Further, the processing circuit requests the content distribution device based on the information acquired by the processing circuit and a target standard which is a standard included in a plurality of criteria for determining the content quality. It is also a circuit for determining the content quality of the content.

Further, the processing circuit is also a circuit for acquiring the content having the content quality determined by the processing circuit from the content distribution device.

The processing circuit is also a circuit for determining a correction method for acquired content, which is the content acquired by the processing circuit, based on the target standard used by the processing circuit to determine the content quality. be.

Further, the processing circuit is also a circuit for correcting the acquired content by the correction method determined by the processing circuit.

Further, the processing circuit is also a circuit for performing processing for presenting the acquired content corrected by the processing circuit.

The processing circuit may be dedicated hardware. Further, the processing circuit may be a processor that executes a program stored in the memory. The processor is, for example, a CPU (Central Processing Unit), a central processing unit, an arithmetic unit, a microprocessor, a microcomputer, a DSP (Digital Signal Processor), or the like.

In the following, a configuration in which the processing circuit is dedicated hardware is also referred to as “configuration Cs1”. Further, in the following, the configuration in which the processing circuit is a processor is also referred to as “configuration Cs2”. Further, in the following, the functions of the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46 are combined with hardware and software. The configuration realized by the above is also referred to as "configuration Cs3".

In configuration Cs1, the processing circuit is, for example, a single circuit, a composite circuit, a programmed processor, a parallel programmed processor, an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array), or a combination thereof. Applicable. The functions of the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46 may be realized by six processing circuits, respectively. Further, all the functions of the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46 may be realized by one processing circuit.

The configuration in which all or a part of each component included in the client device 100 is shown in hardware is as follows, for example. In the following, a client device in which all or a part of each component included in the client device 100 is shown in hardware is also referred to as “client device hd10”.

FIG. 7 is a hardware configuration diagram of the client device hd10. With reference to FIG. 7, the client device hd10 includes a processor hd1 and a memory hd2. The memory hd2 is, for example, a non-volatile or volatile semiconductor memory such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory, an EPROM, or an EEPROM. The memory hd2 is, for example, a magnetic disk, a flexible disk, an optical disk, a compact disk, a mini disk, a DVD, or the like. Further, the memory hd2 may be any storage medium used in the future.

In configuration Cs2, the processing circuit is processor hd1. In the configuration Cs2, the functions of the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46 are software, firmware, or software. It is realized by combining with firmware. The software or firmware is described as a program and stored in the memory hd2.

Further, in the configuration Cs2, the processing circuit (processor hd1) reads the program stored in the memory hd2 and executes the program to execute the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, and the correction method. The functions of the determination unit 44, the content correction unit 45, and the content presentation unit 46 are realized. That is, the memory hd2 stores the following programs.

The program is a program for causing a processing circuit (processor hd1) to execute a step of acquiring information related to content quality, which is the quality of content for the client device to request from the content distribution device.

Further, the program requests the content distribution device based on the information acquired by the processing circuit and a target standard which is a standard included in a plurality of criteria for determining the content quality. It is also a program for causing the processing circuit (processor hd1) to execute the step of determining the content quality of the content.

The program is also a program for causing the processing circuit (processor hd1) to execute a step of acquiring the content having the content quality determined by the processing circuit from the content distribution device.

Further, the program performs a step of determining a method of correcting acquired content, which is the content acquired by the processing circuit, based on the target criterion used by the processing circuit to determine the content quality. It is also a program to be executed by (processor hd1).

The program is also a program for causing the processing circuit (processor hd1) to execute the step of correcting the acquired content by the correction method determined by the processing circuit.

The program is also a program for causing the processing circuit (processor hd1) to execute a process for presenting the acquired content corrected by the processing circuit.

Further, the program includes a procedure of processing performed by each of the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46, and a method of executing the processing. Etc. are also executed by the computer.

In the configuration Cs3, some functions of the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46 are realized by dedicated hardware. Further, in the configuration Cs3, another part of the functions of the information acquisition unit 31, the content determination unit 32, the content acquisition unit 41, the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46 are software or firmware. It is realized by.

For example, the functions of the information acquisition unit 31, the content determination unit 32, and the content acquisition unit 41 are realized by the processing circuit reading and executing the program stored in the memory. Further, for example, the functions of the correction method determination unit 44, the content correction unit 45, and the content presentation unit 46 are realized by a processing circuit as dedicated hardware.

Like the above configurations Cs1, configuration Cs2, and configuration Cs3, the processing circuit can realize each of the above-mentioned functions by hardware, software, firmware, or a combination thereof.

Further, the present technology may be realized as a control method in which the operation of a characteristic component included in the client device 100 is a step. Further, the present technology may be realized as a program for causing a computer to execute each step included in such a control method. Further, the present technology may be realized as a computer-readable recording medium for storing such a program. Further, the program may be distributed via a transmission medium such as the Internet. The control method according to the present technology corresponds to, for example, the process shown in FIG.

All the numerical values used in the above-described embodiment are numerical values of an example for concretely explaining the present technology. That is, the present technology is not limited to each numerical value used in the above embodiment.

The embodiment can be appropriately modified or omitted.

For example, the content correction system 500 may be a system that distributes a moving image according to another standard different from MPEG-DASH. Further, the content distribution device 200 may be a server having a function of performing video distribution according to another standard different from MPEG-DASH. Further, the client device 100 may be a device having a communication function different from that of the television receiver.

Further, for example, in step S03 of FIG. 5, the number of criteria (rate control rules) used by the content determination unit 32 for determining the content quality is not limited to one, and may be plural. In addition, various contents are assumed for the types of standards (rate control rules) used, quality determination methods, and the like.

In the present embodiment, as an example, processing using a rate control rule that determines the content quality of the requested content based on the client throughput has been described, but the rate control rule used is not limited to this. The rate control rule may be, for example, a rule that determines the content quality of the requested content based on the remaining buffer amount.

Further, the rate control rule may be a rule for determining the content quality of the requested content based on the output information of the client device (for example, the setting of resolution, image quality, sound quality, etc.), the content attribute, and the like. The content attribute is, for example, the genre of the content. The genre is, for example, news, sports, music, and the like.

Further, for example, the rate control rule is further assumed to have various contents different from the above contents. For example, the rate control rules based on the content attributes are, for example, the following rules R11, R12, and the like.

Rule R11 is a rule that when the content to be processed is news content, priority is given to starting the reproduction of the content and continuing the reproduction as soon as possible without giving priority to the quality of the content. Rule R12 is a rule that when the content to be processed is short-time music content such as a music video, the quality of the content is prioritized by allowing some loading time for the content.

Further, for example, the rule used when the content to be processed is a long-time music content such as a music program is the following rate control rule. The rate control rule is, for example, a rule determined according to the same criteria as normal content regardless of the genre of the content.

Further, for example, in step S09 of FIG. 5, the number of correction methods determined by the correction method determination unit 44 is not limited to one, and may be plural. In addition, various contents are assumed for the type of correction method, the method of determining the correction method, and the like.

The correction method is, for example, a method in which the lower the quality (bit rate) of the content, the stronger the correction (for example, filtering) for the content.

Further, in step S09 of FIG. 5, for example, among a plurality of correction methods, the optimum correction method may be selected based on the attributes of the content to be processed.

Further, the content correction control process of FIG. 5 is not limited to the process using one rate control rule described above, and is performed under the following premise Pm2 in which a plurality of rate control rules are used, for example. It may be a process.

In the premise Pm2, rules R21, R22, R23, and R24 are set in the client device 100 as rate control rules. The rules R21, R22, R23, and R24 are rules used for acquiring contents. Rule R21 is a rule that dynamically switches the content to be acquired based on the above-mentioned throughput evaluation information.

In the following, the above-mentioned information indicating the remaining amount of the buffer is also referred to as “buffer evaluation information”. The buffer evaluation information indicates "good" or "bad". "Good" indicated by the buffer evaluation information means that the remaining amount of the buffer is large. "Bad" indicated by the buffer evaluation information indicates that the remaining amount of the buffer is low. Rule R22 is a rule that dynamically switches the content to be acquired based on the buffer evaluation information.

Rule R23 is a rule in which rule R22 is used with priority over rule R21. Rule R24 is a rule that prohibits switching to a different quality until 10 seconds have elapsed after the quality of the content to be acquired is selected. Rule R24 is a rule that is used with priority over rules R21, R22, and R23.

Further, in the premise Pm2, the information acquisition unit 31 has acquired the throughput evaluation information indicating “good” and the buffer evaluation information indicating “bad” in advance as the above-mentioned quality-related information.

In the following, "good", "normal" and "bad" are defined as the quality (image quality) of the content. "Good" indicates that the image quality of the content is good. "Medium" indicates that the image quality of the content is normal. "Evil" indicates that the image quality of the content is poor.

Further, in the premise Pm2, the content distribution device 200 stores the following contents C1, C2, and C3 which are segments. The playback length of each of the contents C1, C2, and C3 is 5 seconds. The content C1 is the above-mentioned high bit rate content, and the quality (image quality) is good. The content C2 is the above-mentioned medium bit rate content, and the quality (image quality) is average. The content C3 is the above-mentioned low bit rate content, and the quality (image quality) is poor.

Further, in the premise Pm2, the processing is performed in the continuous periods T1, T2, and T3. The period T1 is a period from the start of the content correction control process in the premise Pm2 to the elapse of 5 seconds. The period T2 is a period from the end of the period T1 to the elapse of 5 seconds. The period T3 is a period from the end of the period T2 to the elapse of 5 seconds.

Next, the main processing of the content correction control processing in the premise Pm2 will be described. In addition, the information acquisition unit 31 has acquired the throughput evaluation information indicating “good” and the buffer evaluation information indicating “bad” as quality-related information in advance.

In the content correction control process in the premise Pm2, first, in the period T1, the rules R21, R22, and R23 (particularly, the rule R22) are taken into consideration, and the content acquisition unit 41 determines the content whose quality is "normal" or "bad". (Contents C2 and C3) are acquired from the content distribution device 200.

Here, at the timing near the boundary between the period T1 and the period T2, the information acquisition unit 31 acquires the throughput evaluation information indicating “bad” and the buffer evaluation information indicating “good” as quality-related information.

In the period T2, the rule R24 is taken into consideration, and the content acquisition unit 41 acquires the content (contents C2, C3) having a quality of “normal” or “bad” from the content distribution device 200, as in the period T1. .. That is, during the period T2, the quality of the acquired content is not changed.

In the period T3, the rules R21, R22, and R23 (particularly, the rule R22) are taken into consideration, and the content acquisition unit 41 delivers the content (contents C1 and C2) whose quality is "good" or "normal" to the content distribution device. Obtain from 200. As described above, in the content correction control process in the premise Pm2, the above process is performed in the periods T1, T2, and T3.

3 Communication network, 31, BL1 information acquisition unit, 32, BL2 content determination unit, 41, BL3 content acquisition unit, 44, BL4 correction method determination unit, 45, BL5 content correction unit, 46, BL6 content presentation unit, 100, BL10 , Hd10 client device, 200, BL20 content distribution device, 500 content correction system.

Claims (4)

A client device that has a function of communicably connecting to a content distribution device via a communication network.
An information acquisition unit that acquires information related to content quality, which is the quality of content for the client device to request from the content distribution device.
The content quality of the content to be requested from the content distribution device based on the information acquired by the information acquisition unit and a target standard which is a standard included in a plurality of criteria for determining the content quality. The content decision department that decides
A content acquisition unit that acquires the content having the content quality determined by the content determination unit from the content distribution device, and a content acquisition unit.
A correction method determination unit that determines a correction method for acquired content that is the content acquired by the content acquisition unit based on the target criteria used by the content determination unit to determine the content quality.
A content correction unit that corrects the acquired content by the correction method determined by the correction method determination unit, and a content correction unit.
A content presenting unit that performs processing for presenting the acquired content corrected by the content correcting unit is provided.
Client device. A content correction system including the client device according to claim 1 and the content distribution device according to claim 1.
The content distribution device stores a plurality of data having different qualities as the content requested by the client device.
The content distribution device transmits data included in the plurality of data to the client device in response to a request for the content by the client device.
Content correction system. The content distribution device transmits data included in the plurality of data to the client device in accordance with MPEG-DASH (Dynamic Adaptive Streaming over HTTP).
The content correction system according to claim 2. It is a control method performed by a client device having a function of communicably connecting to a content distribution device via a communication network.
A step of acquiring information related to content quality, which is the quality of content for the client device to request from the content distribution device, and
A step of determining the content quality of the content to be requested from the content distribution device based on the acquired information and a target standard which is a standard included in a plurality of criteria for determining the content quality. When,
A step of acquiring the content having the determined content quality from the content distribution device, and
A step of determining a method of correcting acquired content, which is the content acquired from the content distribution device, based on the target criterion used for determining the content quality.
A step of correcting the acquired content by the determined correction method, and
A step of performing a process for presenting the corrected acquired content is provided.
Control method.

Images