WO2018139285A1 - Dispositif, procédé et programme de traitement d'image - Google Patents

Dispositif, procédé et programme de traitement d'image Download PDF

Info

Publication number
WO2018139285A1
WO2018139285A1 PCT/JP2018/001095 JP2018001095W WO2018139285A1 WO 2018139285 A1 WO2018139285 A1 WO 2018139285A1 JP 2018001095 W JP2018001095 W JP 2018001095W WO 2018139285 A1 WO2018139285 A1 WO 2018139285A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
quality
reproduction
reproduction data
playback
Prior art date
Application number
PCT/JP2018/001095
Other languages
English (en)
Japanese (ja)
Inventor
尚尊 小代
俊也 浜田
平林　光浩
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2018139285A1 publication Critical patent/WO2018139285A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Definitions

  • the present technology relates to an image processing apparatus and method, and a program, and more particularly to an image processing apparatus and method, and a program capable of reducing discomfort when viewing.
  • Bitrate Adaptation is a feature of MPEG-DASH (Moving Picture Experts Group phase-Dynamic Adaptive Streaming over HTTP) streaming (see, for example, Non-Patent Document 1).
  • the same reproduction content is prepared for each of a plurality of bit rates in the server according to the transfer rate of the transmission path.
  • data of each bit rate of content is defined as Representation.
  • MPD Media Presentation Description
  • data of an appropriate bit rate is selected while measuring the download speed of the data of the content at a constant interval, such as at each boundary position of a segment (Segment) which is a unit in which the data of the content is handled.
  • the content prepared by the server changes the encoding condition depending on the bit rate, for example, in the case of video, it is general to produce data of a plurality of patterns having different resolutions as data of different bit rates. It is.
  • compressed audio is generally used for audio, bit rates are several tenths to hundreds of times lower than video, and are rarely subject to Bitrate Adaptation in video-based distribution. .
  • the content prepared in the server is encoded under the conditions suitable for each bit rate, but the authoring work not only increases correspondingly if the number of selectable bit rates is increased The data capacity required by the server will also increase. Therefore, the number of selectable bit rates is not necessarily so large. Also, in the case of video, for example, the variation of resolution for each bit rate is generally selected from representative ones, and arbitrary resolution is not used very much.
  • the switching of the stream (bit rate) by Bitrate Adaptation is performed at the boundary of the segment, and at the boundary position, one frame before is reproduced at the quality before switching, and one frame after that is reproduced at the quality after switching. Therefore, for example, when the resolution or the like of the displayed image changes significantly before and after switching, a sense of discomfort may be generated.
  • the present technology has been made in view of such a situation, and makes it possible to reduce discomfort when viewing.
  • the image processing device switches playback from playback based on first playback data to playback based on second playback data having a quality different from that of the first playback data.
  • the reproduction control unit controls the quality of the reproduction data to change with time at the time of reproduction of reproduction data of higher quality of the first reproduction data and the second reproduction data.
  • the first reproduction data and the second reproduction data may be reproduction data of different bit rates.
  • the reproduction control unit when the quality of the first reproduction data is higher than the quality of the second reproduction data, in the portion of the first reproduction data immediately before switching to the second reproduction data, The quality of the first reproduction data may be changed such that the quality of the first reproduction data is substantially the same as the quality of the second reproduction data.
  • the reproduction control unit when the quality of the second reproduction data is higher than the quality of the first reproduction data, in the part immediately after switching from the first reproduction data in the second reproduction data, The quality of the second reproduction data is changed so that the quality of the second reproduction data is substantially the same as the quality of the first reproduction data, and the quality of the second reproduction data increases with time. can do.
  • the first reproduction data and the second reproduction data may be video data.
  • the reproduction control unit may change the quality of the reproduction data by changing at least one of a resolution, a frame rate, a bit depth, and a color gamut of the reproduction data.
  • the first reproduction data and the second reproduction data may be audio data.
  • the reproduction control unit can change the quality of the reproduction data by changing at least one of the sampling rate and the bit depth of the reproduction data.
  • the reproduction control unit causes specification information specifying a parameter for changing the quality of the reproduction data to be acquired, and changes the parameter indicated by the specification information of the plurality of the parameters in the reproduction data.
  • the quality of the reproduction data can be changed.
  • the reproduction control unit acquires order information indicating a plurality of parameters for changing the quality of the reproduction data and an adjustment order of the plurality of parameters, and the reproduction information is indicated by the order information in the reproduction data.
  • the quality of the reproduction data can be changed by adjusting the plurality of parameters in the adjustment order indicated by the order information.
  • the reproduction control unit is made to acquire processing specification information for specifying adjustment processing for changing a parameter for changing the quality of the reproduction data, and the adjustment indicated by the processing specification information among a plurality of the adjustment processing
  • the quality of the reproduction data can be changed by changing the parameter of the reproduction data by processing.
  • the reproduction data may be video data, and the parameters may be resolution, frame rate, bit depth, or color gamut.
  • the reproduction data may be audio data, and the parameter may be a sampling rate or bit depth.
  • the reproduction control unit can perform control such that the period in which the quality of the reproduction data is changed is the same for the video data as the reproduction data and the audio data as the reproduction data.
  • the image processing method or program switches playback from playback based on first playback data to playback based on second playback data having a quality different from that of the first playback data. And controlling the quality of the reproduction data to change with time at the time of reproduction of reproduction data of higher quality among the first reproduction data and the second reproduction data.
  • the first It is controlled such that the quality of the reproduction data changes with time at the time of reproduction of reproduction data of higher quality among the reproduction data and the second reproduction data.
  • the quality of video such as resolution may change at a level that can be perceived visually. Since such abrupt quality changes cause viewing discomfort, in the present technology, by appropriately adjusting the quality of the content at the time of content reproduction, the viewing sensation is reduced.
  • the present technology is not limited to MPEG-DASH streaming distribution, and any other content reproduction technology may be used as long as reproduction data of an arbitrary quality is acquired and reproduced from among reproduction data of a plurality of different qualities. It is also applicable to the case. In the following, the description will be continued with an example where the present technology is applied to MPEG-DASH streaming distribution.
  • Bitrate Adaptation In Bitrate Adaptation, one appropriate Representation is selected from a plurality of Representations, that is, bit rates of the same Adaptation Set, and segment data corresponding to the Representation is downloaded and reproduced.
  • the video reproduced by each of the plurality of segment data of the same Adaptation Set has different contents such as the resolution itself, that is, the bit rate of the video data. This is true not only for video but also for audio.
  • bit rates that can be selected by Bitrate Adaptation For example, in MPEG-DASH streaming, if the number of bit rates that can be selected by Bitrate Adaptation is increased, the data capacity necessary for the server to record data will increase accordingly. Therefore, the number of bit rates that can be selected by Bitrate Adaptation is not necessarily large.
  • the variation of resolution per bit rate is generally selected from representative values such as Full HD, ie 1920 ⁇ 1080, and it is almost the case that any resolution is used. Absent.
  • the resolutions prepared are at most 3840 ⁇ 2160, 3200 ⁇ 1800, 2560 ⁇ 1440, 1920 ⁇ 1080, 1600 ⁇ It is considered to be about seven patterns of 900, 1280 ⁇ 720, and 720 ⁇ 480. It is also well assumed that some of these resolutions are not available.
  • the cause of the sense of incongruity in viewing experience is that the quality, such as the resolution, of the content prepared on the server side differs stepwise.
  • Bitrate Adaptation switching of Representation (bit rate) is performed at the boundary position of the segment, and at the boundary position, one frame before is reproduced at the quality before switching, and one frame after that is reproduced at the quality after switching.
  • Video data of 2.5 K (2560 ⁇ 1440) and video data of 2 K (1920 ⁇ 1080) having a bit rate of 10 Mbps are prepared.
  • the MPEG-DASH client device does not switch the video quality from 4K to 2K immediately, but switches from 4K to 3.2K and then switches from 3.2K to 2.5K. After that, it is also possible to switch to 2K finally.
  • an image is displayed from 4K to 3.2K by Bitrate Adaptation.
  • the quality is switched and the segment data SG12 is downloaded.
  • the quality of the video is switched from 3.2 K to 2.5 K by Bitrate Adaptation, and the segment data SG13 is downloaded. Furthermore, at the end position of the segment data SG13 indicated by the arrow A13, the quality of the video is switched from 2.5K to 2K by Bitrate Adaptation, and the segment data SG14 is downloaded.
  • the bit rate (quality) of segment data to be downloaded is lowered stepwise, the quality difference before and after switching at each of the switching points indicated by arrows A11 to A13 can be reduced. . Therefore, compared with the case where the quality of the image is instantaneously changed from 4K to 2K, it is possible to reduce the discomfort caused by the resolution decrease.
  • the quality change at each switching point can be suppressed to a small value by raising the resolution little by little while performing video reproduction at an intermediate resolution.
  • the 2K segment data SG21 is downloaded and reproduced.
  • the quality is changed from 4K to 2K, the number of pixels of the downloaded segment data image will be reduced to a quarter.
  • the 2K segment data SG22 is also downloaded and reproduced. Then, since a sudden band fluctuation occurs while the segment data SG22 is downloaded, the quality of the video is switched from 2K to 4K by Bitrate Adaptation at the time indicated by the arrow A13.
  • segment data SG22 is downloaded
  • 4K segment data SG23 is downloaded as Segment (n + 2) data and reproduced.
  • the quality can not be changed stepwise for some reason, and when the quality of the content changes rapidly and sharply, the discomfort caused when viewing can not be reduced, and the immersive feeling is lost for the viewer You
  • a reproduction control unit realized by software or the like instructs appropriate timing by the above-described reproduction control method, and performs control such that video and audio effect processing is performed. This effect processing adjusts the quality of the content.
  • FIG. 3 is a diagram showing a configuration example of an embodiment of a client apparatus to which the present technology is applied.
  • the client device 11 shown in FIG. 3 is a playback device that downloads segment data of content from a server (not shown) and controls playback of content composed of at least one of video and audio.
  • the client device 11 includes an HTTP (Hypertext Transfer Protocol) download control unit 21, an MPD parser 22, a segment parser 23, an image / audio processing unit 24, and a reproduction control unit 25.
  • HTTP Hypertext Transfer Protocol
  • the HTTP download control unit 21 downloads (receives) the MPD file from the server and supplies it to the MPD parser 22 or downloads (receives) segment data from the server and supplies it to the segment parser 23.
  • the MPD file is data in which metadata for managing video (moving image) of content and segment data of audio is described.
  • the HTTP download control unit 21 measures the bandwidth of the transmission path (network) between the client device 11 and the server at the time of downloading segment data, that is, the transmission rate (bit rate) of segment data.
  • the HTTP download control unit 21 appropriately determines the bit rate of the segment data to be downloaded based on the measurement result of the bandwidth of the transmission path and the like, and also determines segment information on the segment data to be downloaded such as the determined bit rate. It is supplied to the reproduction control unit 25.
  • the MPD parser 22 parses (decodes) the MPD file supplied from the HTTP download control unit 21 and supplies the decryption result to the HTTP download control unit 21 or the reproduction control unit 25.
  • the segment parser 23 parses (decodes) segment data (segment file) supplied from the HTTP download control unit 21, extracts video data and audio data to be reproduced from the segment data, and supplies the image data to the audio / video processing unit 24. Do.
  • the video / audio processing unit 24 Under the control of the reproduction control unit 25, the video / audio processing unit 24 generates content based on the video data and audio data supplied from the segment parser 23, that is, video data and audio data for presentation for reproducing video and audio. Generate and output.
  • the image / sound processing unit 24 has a video decoder 31, a video effector 32, an audio decoder 33, and an audio effector 34.
  • the video decoder 31 decodes the video data supplied from the segment parser 23 and supplies the video data to the video effector 32.
  • the video effector 32 outputs the video data supplied from the video decoder 31 as it is as video data for presentation, or performs effect processing on the video data supplied from the video decoder 31, and the video for presentation obtained as a result thereof Output data.
  • the video effector 32 appropriately processes the video data for presentation into data in a form to be finally output to a subsequent device such as an image monitor and outputs the data.
  • up conversion processing of video data is performed to adjust the size of the video as necessary. That is, for example, when the output video data for presentation is switched from 4K video data to 2K video data, the display device or the like performs an upconversion process on 2K video data, and the image size is 4K.
  • the size conversion is performed so as to be the size of.
  • the video data up-conversion processing may be performed by the video effector 32.
  • the audio decoder 33 decodes the audio data supplied from the segment parser 23 and supplies the audio data to the audio effector 34.
  • the audio effector 34 outputs the audio data supplied from the audio decoder 33 as it is as audio data for presentation, or performs an effect process on the audio data supplied from the audio decoder 33, and the audio for presentation obtained as a result thereof Output data.
  • the audio effector 34 appropriately processes audio data for presentation into data in a form to be finally output to a subsequent device such as an audio DAC (Digital to Analog Converter) or an amplifier, and outputs the data.
  • a subsequent device such as an audio DAC (Digital to Analog Converter) or an amplifier
  • the reproduction control unit 25 controls the overall operation of the client device 11. For example, the reproduction control unit 25 controls the operation of the image / sound processing unit 24 based on the segment information from the HTTP download control unit 21, the decoding result from the MPD parser 22, and the like.
  • the bit rate of the video data constituting the content is the resolution of the video based on the video data
  • the frame rate of the video based on the video data the bit depth of the pixel value of each pixel of the video data, each pixel of the video data It changes by adjusting the color gamut of.
  • resolution, frame rate, bit depth, color gamut and the like can be adjusted as the quality of the image.
  • the resolution of the video can be adjusted by filter processing using a soft filter for reducing the sense of resolution of video data, resolution conversion processing such as thinning, or the like.
  • the frame rate of the video can be adjusted by thinning processing of a frame of the video, frame rate conversion processing or the like.
  • the reproduction control unit 25 causes the video effector 32 to execute processing for changing (adjusting) at least one of resolution, frame rate, bit depth, and color gamut of video data as effect processing. Change (adjust) the quality.
  • the bit rate of audio data that constitutes content changes by adjusting the sampling rate of audio data, the bit depth of the sample value of each sample of audio data, and the like. In other words, it is possible to adjust the sampling rate, bit depth and the like as the voice quality.
  • the sampling rate of audio data can be adjusted by thinning processing or filtering processing for audio data.
  • the reproduction control unit 25 changes (adjusts) the quality of sound by causing the audio effector 34 to perform processing of changing (adjusting) at least one of the sampling rate and bit depth of the sound data as effect processing.
  • switching is performed from 4K (3840 ⁇ 2160) segment data having a bit rate of 40 Mbps to 2K (1920 ⁇ 1080) segment data having a bit rate of 10 Mbps.
  • segment Segment (n-1) when reproducing segment Segment (n-1) to segment Segment (n + 2) which are temporally continuous segments, first, data of segment Segment (n-1) and segment Segment (n) As 4K segment data SG31 and segment data SG32 are downloaded.
  • bit rate is switched from 40 Mbps to 10 Mbps at the playback time indicated by the arrow A31 by Bitrate Adaptation. That is, the quality of the video is switched from 4K to 2K.
  • bit rate adaptation of the segment changes in the direction of decreasing the bit rate (quality) of the segment. That is, at the time of bit rate switching, lower bit rate segment data is downloaded (acquired).
  • the client device 11 sets a period of a predetermined length that ends at a reproduction time (hereinafter also referred to as a switching point) at which the bit rate indicated by the arrow A31 is switched. Then, the client device 11 performs effect processing on the video data in the effect period Te, and generates video data whose bit rate, that is, the quality gradually decreases, as video data for presentation.
  • a reproduction time hereinafter also referred to as a switching point
  • the effect period Te is a period in which the reproduction time in the middle of the segment Segment (n) is the start time, and the switching point which is the reproduction time at the end position of the segment Segment (n) is the end time There is.
  • the effect time Te may be any position (reproduction time) as long as the end time is a switching point, for example, for example It may be an arbitrary playback time of Segment (n-1).
  • the effect period Te may be set to straddle the boundary position of the segments, that is, to straddle a plurality of segments.
  • the resolution of the image is 4K (3840 ⁇ 2160) at the start time of the effect period Te, and the resolution of the image is 2K (1920 ⁇ 1080) at the end time (switching point) of the effect period Te.
  • Video data is generated by effect processing.
  • the video data for presentation is generated so that the resolution of the video changes continuously (smoothly) linearly or nonlinearly from 4K to 2K. Be done.
  • the effect processing for obtaining reproduction data whose quality is lowered with time as described above, that is, video data and audio data will be particularly referred to as quality deterioration effect processing.
  • the quality of the video starts to gradually decrease from the start time of the effect period Te.
  • the quality of the video decreases with time, and at the switching point at which the bit rate is switched by the Bitrate Adaptation, the quality of the video becomes equal to the quality after switching, which is reproduced later.
  • bit rate of the video data is switched to a lower bit rate when switching the bit rate, that is, if the quality of the video is switched to a lower quality, the degradation effect is applied to the higher quality video data before switching. Processing is performed.
  • the quality of the video smoothly changes with time from the quality of the video before switching to the quality of the video after switching, and it is possible to reduce discomfort when watching content. As a result, it is possible to suppress the loss of immersion when watching content.
  • the effect period Te is normally set to several seconds to several tens of seconds, but the effect period Te is determined by the reproduction control unit 25 in consideration of the cache state of the content and whether the time is visually sufficient. Ru. For example, if the segment data cache at the bit rate before switching is small, the length of the effect period Te may be shortened according to the cache volume.
  • the length of the effect period Te may be determined in advance with respect to the combination of bit rates of segment data before and after switching, that is, the combination of the bit rate before switching and the bit rate after switching. .
  • the effect period Te can be made longer.
  • the switching is performed from 2K (1920 ⁇ 1080) segment data with a bit rate of 10 Mbps to 4K (3840 ⁇ 2160) segment data with 40 Mbps.
  • 2K segment data SG41 and segment data SG42 are downloaded as data of segment Segment (n-1) and segment Segment (n).
  • the bit rate is switched from 10 Mbps to 40 Mbps at the playback time indicated by the arrow A41 by Bitrate Adaptation. That is, the quality of the video is switched from 2K to 4K.
  • the 4K segment data SG43 is downloaded, and subsequently the 4K segment data SG44 is downloaded.
  • the bit rate adaptation in the segment changes in the direction of increasing the bit rate. That is, at the time of switching the bit rate, segment data with a higher bit rate is downloaded (acquired).
  • the client device 11 sets, as the effect period Te, a period of a predetermined length in which the switching point indicated by the arrow A41 is a start time. Then, the client device 11 performs effect processing on the video data in the effect period Te, and generates video data whose bit rate, that is, the quality gradually increases, as video data for presentation.
  • the end position of the effect period Te may be any reproduction time.
  • the period after the switching point is regarded as the effect period Te, and the effect processing is performed immediately after the switching point, that is, immediately after the Bitrate Adaptation.
  • the video resolution is 2K (1920 ⁇ 1080), and at the end time of the effect period Te, the video data for presentation with the video resolution of 4K (3840 ⁇ 2160) is generated by the effect processing .
  • the video data for presentation is generated so that the resolution of the video changes continuously (smoothly) linearly or nonlinearly from 2K to 4K. Be done.
  • the display is started with the quality that the resolution is reduced to 2K, which is the quality of the video before switching, with respect to the segment data SG43 of the 4K video originally, and the original quality is gradually increased. Effect processing is performed such that the quality rises (recovers) to 4K.
  • the reproduction data whose quality is raised (restored) to the original quality with time as described above that is, the effect processing which can obtain video data and audio data, will be particularly referred to as quality restoration effect processing.
  • the video of the content is reproduced based on the video data for presentation in the effect period Te obtained by the quality recovery effect processing
  • the video is gradually transmitted from the start time of the effect period Te which is a switching point at which the bit rate is switched by Bitrate Adaptation. Quality starts to rise. Thereafter, the quality of the video rises with time, and when the end time of the effect period Te comes, the quality of the video becomes equal to the quality after switching, which is reproduced later.
  • the quality of the video smoothly changes with time from the quality of the video before switching to the quality of the video after switching, and it is possible to reduce discomfort when watching content. As a result, it is possible to suppress the loss of immersion when watching content.
  • the effect process is performed on the segment data having the higher bit rate.
  • the quality of reproduction data is controlled to change with time.
  • the quality of the reproduction data for presentation that is, the video data for presentation and the audio data for presentation may be changed.
  • FIGS. 6 and 7 show examples of switching to a lower bit rate at the switch point
  • FIGS. 8 and 9 show examples of switching to a higher bit rate at the switch point.
  • the horizontal axis indicates the reproduction time of the content
  • the vertical axis indicates the reproduction quality of the reproduction data
  • an arbitrary reproduction time in the effect period Te is also described as a reproduction time t
  • a start time of the effect period Te is also described as a start time Tst
  • a length of the effect period Te is also described as a period length ⁇ .
  • quality such as resolution of presentation reproduction data, that is, resolution of presentation video data and presentation audio data will be particularly referred to as reproduction quality.
  • bit rate of segment data to be downloaded is switched to a lower bit rate at the switching point.
  • the client apparatus 11 sets the reproduction quality of the reproduction data at the reproduction time before the switching, that is, at the reproduction time before the start of the effect period Te to 100% and the reproduction quality of the reproduction data at the reproduction time after the switching point to Y%. Do.
  • the value of Y is 100 ⁇ B / A. That is, the value of Y indicates what percentage of the quality of segment data after switching corresponds to the quality of segment data before switching.
  • the client device 11 changes the reproduction quality at each reproduction time t such that the reproduction quality of the reproduction data linearly decreases, ie, linearly decreases from 100% to Y% in the effect period Te.
  • the reproduction quality is 100% until the start time Tst of the effect period Te, and then the reproduction quality decreases linearly with time, and the end of the effect period Te which is also a switching point At time (Tst + ⁇ ), the reproduction quality is Y%. After that, the reproduction quality is kept at Y%.
  • bit rate of segment data to be downloaded is switched to a lower bit rate at the switching point.
  • the client apparatus 11 sets the reproduction quality of the reproduction data at the reproduction time before the switching, that is, at the reproduction time before the start of the effect period Te to 100%, and the reproduction quality of the reproduction data at the reproduction time after the switching point to Y%. Do.
  • the client device 11 changes the reproduction quality at each reproduction time t so that the reproduction quality of the reproduction data decreases nonlinearly from 100% to Y% in the effect period Te.
  • the reproduction quality is 100% until the start time Tst of the effect period Te, and thereafter, the reproduction quality gradually decreases with time, and the end of the effect period Te which is also a switching point At time (Tst + ⁇ ), the reproduction quality is Y%. After that, the reproduction quality is kept at Y%.
  • bit rate of segment data to be downloaded is switched to a higher bit rate at the switching point.
  • the client device 11 sets the reproduction quality of the reproduction data at the reproduction time before the switching point, that is, the reproduction time before the start time Tst of the effect period Te, to Y%, and exceeds the end time (Tst + ⁇ ) of the effect period Te.
  • the reproduction quality of reproduction data at a later reproduction time is assumed to be 100%.
  • the value of Y is 100 ⁇ B / A. That is, the value of Y indicates what percentage of the quality of segment data before switching corresponds to the quality of segment data after switching.
  • the client device 11 changes the reproduction quality at each reproduction time t such that the reproduction quality of the reproduction data linearly increases (increases) linearly from Y% to 100% in the effect period Te.
  • the reproduction quality is Y% until the start time Tst of the effect period Te which is also the switching point, and then the reproduction quality linearly increases with time, and the end of the effect period Te At time (Tst + ⁇ ), the reproduction quality is 100%. After that, the reproduction quality is kept at 100%.
  • bit rate of segment data to be downloaded is switched to a higher bit rate at the switching point.
  • the client device 11 sets the reproduction quality of the reproduction data at the reproduction time before the switching point, that is, the reproduction time before the start time Tst of the effect period Te, to Y%, and exceeds the end time (Tst + ⁇ ) of the effect period Te.
  • the reproduction quality of reproduction data at a later reproduction time is assumed to be 100%.
  • the client apparatus 11 changes the reproduction quality at each reproduction time t so that the reproduction quality of the reproduction data increases (increases) in a curved manner, that is, nonlinearly from Y% to 100% in the effect period Te.
  • the reproduction quality is Y% until the start time Tst of the effect period Te which is also the switching point, and thereafter, the reproduction quality increases with time and the end of the effect period Te At time (Tst + ⁇ ), the reproduction quality is 100%. After that, the reproduction quality is kept at 100%.
  • the reproduction quality is continuously changed, the difference in bit rate of the reproduction data before and after switching, that is, the quality is smooth even when the difference in the original quality of the reproduction data is large. Makes it possible to reduce the sense of incongruity at the time of viewing.
  • segment data before and after the switching point by Bitrate Adaptation has a mechanism for caching downloaded segment data in operation.
  • segment data is generally cached on the client side for several seconds to several tens of seconds ahead at the time of reproduction.
  • Bitrate Adaptation that is, when effect processing is to be performed in a predetermined period before the switching point after the reproduction time at the current reproduction time, it is sufficient to perform the effect processing already. Segment data of such a large amount of data is rarely held (cached).
  • segment data of a higher bit rate is downloaded as shown in FIG. 10, and at the present time, it is assumed that a portion of reproduction time shown by arrow A51 is reproduced based on segment data SG51.
  • downloading is completed up to the portion of the reproduction time shown by arrow A52, that is, to the middle part of segment data SG54, and the portion from the segment data SG51 to the reproduction time shown by arrow A52 of segment SG54 is cached.
  • the horizontal direction indicates time, and each square indicates segment data.
  • the client device downloads and caches one or more segment data in advance, and when actually reproducing, it reads out video data and audio data from the cache and supplies them to a decoder.
  • the switching of the bit rate is determined when the portion of the reproduction time indicated by the arrow A51 is being reproduced.
  • the reproduction time at the end of the segment data SG54 is taken as the switching point.
  • the playback time indicated by the arrow A53 is taken as the switching point.
  • the segment data of the switching point portion is already read ahead and decoded before the switching point reaches the playback time during playback, that is, before the playback reaches the switching point. Has been done. Therefore, it is possible to secure a sufficient time for effect processing on the reproduction data of the segment of the switching point.
  • this quality adjustment effect control process when switching of the bit rate occurs after the content reproduction on the client apparatus 11 is instructed, that is, when reproduction switching is performed to reproduction based on reproduction data having different qualities. To be done.
  • the quality adjustment effect control process may be performed separately for video and audio, or one quality adjustment effect control process common to video and audio may be performed.
  • the quality adjustment effect control process is performed only on the video.
  • quality adjustment effect control processing may be performed separately for video and audio, or one quality adjustment effect control for video and audio. Processing may be performed.
  • step S11 the reproduction control unit 25 determines whether to reduce the reproduction quality of the content to the switching point, based on the segment information of each segment before and after switching supplied from the HTTP download control unit 21.
  • step S12 the reproduction control unit 25 determines the start time Tst and the period length ⁇ of the effect period Te.
  • the period length ⁇ may be a predetermined time, or may be determined based on the segment data of the bit rate before switching, that is, the cache amount of the segment data currently reproduced.
  • the period length ⁇ is determined so as to be shorter than the length of the period from the reproduction time currently being reproduced to the switching point.
  • the playback time serving as the switching point is, for example, the playback time of the end position of the segment data of the bit rate before switching, which has been downloaded by the HTTP download control unit 21.
  • the reproduction time of the switching point is the end time (Tst + ⁇ ) of the effect period Te.
  • the effect durations of video and audio should be set so that they are the same or substantially the same. Can. In this way, the durations of the effects applied to the video and the audio become substantially the same, and it is possible to make it difficult for the user to feel discomfort due to the change in reproduction quality. Of course, it is also possible to make the effect period different for video and audio.
  • step S13 the reproduction control unit 25 sets the reproduction quality at the start time Tst of the effect period Te to 100%, and determines the reproduction quality Y% (where Y ⁇ 100) at the end time (Tst + ⁇ ) of the effect period Te. For example, as described with reference to FIG. 6 and FIG. 7, the ratio of the quality of the reproduction data at the reproduction time after the switching point to the original quality of the reproduction data before switching is Y%.
  • the value of the reproduction quality Y at the end time (Tst + ⁇ ) may not necessarily coincide with the reproduction quality of the segment data after the switching, as long as the value is substantially the same.
  • step S14 the reproduction control unit 25 performs an effect process on the reproduction data in the video effector 32 or the audio effector 34 such that the reproduction quality at the reproduction time t to be processed of the content becomes X% (where Y ⁇ X ⁇ 100). Control. That is, the reproduction control unit 25 executes the quality reduction effect processing to reduce the reproduction quality at the reproduction time t within the effect period Te of the reproduction data.
  • X ((Y ⁇ 100) (t ⁇ Tst) / ⁇ ) +100
  • the quality reduction effect processing in the video effector 32 or the audio effector 34 originally causes the quality of reproduced data to be originally
  • the operation of the video effector 32 or the audio effector 34 is controlled to be X% quality of the reproduction data quality.
  • reproduction is performed with the original quality of the reproduction data until the start time Tst, and control is performed so that the quality of the reproduction data starts to decrease with time at the start time Tst. Then, at the end time (Tst + ⁇ ) which is the portion immediately before the switching point, the quality of the reproduction data is made to be substantially the same as the quality of the reproduction data after switching. After the switching point, the original quality of the reproduction data is Is controlled to be played back.
  • step S15 the reproduction control unit 25 determines whether to end the effect processing.
  • the reproduction time t of the reproduction data to be processed becomes a time after the end time (Tst + ⁇ ) of the effect period Te, it is determined that the effect processing is to be ended.
  • step S15 If it is determined in step S15 that the effect processing is not to be ended, the processing returns to step S14, and the above-described processing is repeatedly performed until the effect period Te ends. That is, the next reproduction time is set as the reproduction time t to be processed, and the quality adjustment of the reproduction data of the reproduction time t is controlled.
  • step S15 when it is determined in step S15 that the effect processing is to be ended, control is performed so that the effect processing is ended, and the quality adjustment effect control processing is ended.
  • step S11 If it is determined in step S11 that the reproduction quality is not to be reduced, that is, if the reproduction quality is to be increased after the switching point, the process proceeds to step S16.
  • step S16 the reproduction control unit 25 determines the start time Tst of the effect period Te and the period length ⁇ .
  • the reproduction time of the end position of the segment data of the bit rate before switching, which is downloaded by the HTTP download control unit 21 is set as the switching point, and the switching point is set as the start time Tst.
  • the period length ⁇ may be a predetermined time, or may be determined based on the cache amount or the like.
  • the period length ⁇ may be any length of time, such as a time longer than the segment length, and the reproduction data at the end time (Tst + ⁇ ) may not be cached yet.
  • the effect period may be determined such that the effect period for video and the effect period for audio are the same or substantially the same. Also, the effect period may be different between video and audio.
  • step S17 the reproduction control unit 25 sets the reproduction quality at the end time (Tst + ⁇ ) of the effect period Te to 100%, and determines the reproduction quality Y% (Y ⁇ 100) at the start time Tst of the effect period Te. For example, as described with reference to FIGS. 8 and 9, the ratio of the reproduction quality of the reproduction data at the reproduction time before the switching point to the quality of the reproduction data after the switching is Y%.
  • the value of the reproduction quality Y at the start time Tst may not necessarily match the reproduction quality of the segment data before switching, as long as the value is substantially the same.
  • step S18 the reproduction control unit 25 performs an effect process on the reproduction data in the video effector 32 or the audio effector 34 such that the reproduction quality at the reproduction time t to be processed of the content becomes X% (where Y ⁇ X ⁇ 100). Control. That is, the reproduction control unit 25 executes the quality recovery effect processing to reduce the reproduction quality at the reproduction time t within the effect period Te of the reproduction data.
  • X ((100 ⁇ Y) (t ⁇ Tst) / ⁇ ) + Y
  • the quality recovery effect processing in the video effector 32 or the audio effector 34 reproduces reproduction data at reproduction time t.
  • the operation of the video effector 32 or the audio effector 34 is controlled such that the quality of the video is originally X% of the quality of the reproduction data.
  • reproduction is performed with the original quality of the reproduction data up to the switching point, and in the portion immediately after the start time Tst which is the switching point, the quality of the reproduction data after switching is the original of the reproduction data before switching Control is performed to be substantially the same as the quality.
  • the quality of the reproduction data increases with time, and at the end time (Tst + ⁇ ), control is performed such that reproduction is performed with substantially the same quality as the original quality of the reproduction data.
  • step S19 the reproduction control unit 25 determines whether to end the effect processing.
  • the reproduction time t of the reproduction data to be processed becomes a time after the end time (Tst + ⁇ ) of the effect period Te, it is determined that the effect processing is to be ended.
  • step S19 If it is determined in step S19 that the effect process is not to be ended, the process returns to step S18, and the above-described process is repeated until the effect period Te ends. That is, the next reproduction time is set as the reproduction time t to be processed, and the quality adjustment of the reproduction data of the reproduction time t is controlled.
  • step S19 when it is determined in step S19 that the effect processing is to be ended, control is performed so that the effect processing is ended, and the quality adjustment effect control processing is ended.
  • the reproduction control unit 25 determines the effect period Te, and during the effect period Te, the reproduction processing unit performs the effect processing so that the reproduction quality of the reproduction data changes continuously with time. Control the execution.
  • the change in the image quality and sound quality of the content at the time of stream change is large.
  • the present technology is useful when it is easy. Further, according to the present technology, it is possible to reduce the discomfort at the time of viewing and listening only by the implementation in the client apparatus 11 without changing the mechanism of the MPEG-DASH distribution.
  • step S41 the HTTP download control unit 21 downloads segment data for the video and audio of the content from the server and supplies the segment data to the segment parser 23. That is, the HTTP download control unit 21 requests the server to transmit segment data of a desired bit rate, and receives the segment data transmitted from the server in response to the request.
  • step S42 the segment parser 23 parses the segment data supplied from the HTTP download control unit 21.
  • the segment parser 23 reads the video data from the segment data of the video and supplies the video data to the video decoder 31, and reads the audio data from the segment data of the audio and supplies the audio data to the audio decoder 33.
  • step S 43 the video decoder 31 decodes the video data supplied from the segment parser 23 and supplies the video data to the video effector 32.
  • step S44 the video effector 32 applies an effect to the video data supplied from the video decoder 31 according to the control of the reproduction control unit 25.
  • the video effector 32 reduces the quality of the video data by performing the effect processing according to the control of the playback control unit 25 on the video data at the playback time within the effect period Te of the video.
  • Video data is used as video data for presentation.
  • the effect processing is performed, for example, in accordance with the control performed in step S14 or step S18 of FIG.
  • the video effector 32 when the reproduction quality of the video data is lowered by reducing the resolution, the video effector 32 performs thinning processing or the like as the effect processing on the video data, and video data of lower resolution (reproduction quality) Generate
  • the video effector 32 does not particularly perform the effect processing on the video data, and the video data supplied from the video decoder 31 is presented as it is Image data of
  • step S45 the video effector 32 outputs the video data for presentation obtained in the process of step S44 to the subsequent stage.
  • the image data is processed into data in a form to be output to a device at a later stage as necessary.
  • step S46 the audio decoder 33 decodes the audio data supplied from the segment parser 23 and supplies the audio data to the audio effector 34.
  • step S47 the audio effector 34 applies an effect to the audio data supplied from the audio decoder 33.
  • the audio effector 34 reduces the quality of the audio data by performing the effect processing according to the control of the reproduction control unit 25 on the audio data at the reproduction time within the effect period Te for audio.
  • Voice data is assumed to be voice data for presentation.
  • the effect processing is performed, for example, in accordance with the control performed in step S14 or step S18 of FIG.
  • the audio effector 34 when the reproduction quality of audio data is reduced by reducing the sampling rate, the audio effector 34 performs thinning processing or the like on the audio data as effect processing, and Generate voice data.
  • the audio effector 34 does not perform the effect processing on the audio data particularly for the audio data at the playback time outside the effect period Te for audio, and the audio data supplied from the audio decoder 33 is presented as it is Audio data of
  • step S48 the audio effector 34 outputs the audio data for presentation obtained in the process of step S47 to the subsequent stage, and the content reproduction process ends.
  • the audio data is processed into data in a form to be output to a device at a later stage as necessary.
  • step S43 to step S45 and the processing of step S46 to step S48 are performed in parallel.
  • the client device 11 decodes the video data and the audio data, performs an effect process on the video data and the audio data as appropriate, and generates and outputs the video data and the audio data for presentation.
  • the service providing side that is, the content providing side may want to control the process related to the reproduction quality of the content.
  • the client side may want to convey the processing procedure to be recommended when adjusting the reproduction quality of the content.
  • two or more parameters for adjusting the reproduction quality of reproduction data of content that is, parameters for changing the quality (hereinafter also referred to as quality adjustment parameters) may be changed.
  • quality adjustment parameters parameters for changing the quality
  • the service providing side can also present the method of effect processing itself.
  • the service provider can also present which order is effective as the order of changing the quality adjustment parameters. .
  • the quality adjustment parameters are, for example, the resolution, the frame rate, the bit depth of the pixel value of the pixel of the video (image), the color gamut of the video, etc. It is assumed that the bit depth of sample value etc. Further, information on quality adjustment parameters may be stored, for example, in an MPD file.
  • the service providing side prepares designated parameter information indicating the quality adjustment parameter to be preferentially selected in adjusting the playback quality of the content, and the client side adjusts the playback quality of the content based on the designated parameter information Will be described as an example.
  • designated parameter information is stored in the MPD file.
  • SupplementalProperty elements are provided in the Adaptation Set of the MPD file, an appropriate ID is newly added to the scheme IdUri according to the purpose, and a quality adjustment parameter to be designated is designated as value.
  • the designated parameter information is information indicating which quality adjustment parameter adjustment is effective for adjustment of reproduction quality, and information (ID) stored in schemeIdUri, designated value, and the like The information consisting of is made designated parameter information.
  • bitrate_adaptation_param: 2017 is stored in the scheme IdUri. Then, for the image, any one of a plurality of values such as “resolution”, “frame_rate”, “bit_depth”, and “color_primaries” is specified (described) as the value. In addition, for speech, any one of a plurality of values such as “sampling_rate” and “bits_per_sample” is specified (described) as the value.
  • resolution indicates the resolution of the image
  • frame_rate indicates the frame rate of the image
  • bit_depth indicates the bit depth of the pixel value of the pixel of the image
  • color_primaries indicates It shows the color gamut of the image.
  • sampling_rate indicates the sampling rate of speech
  • bits_per_sample indicates the bit depth of sample values of speech samples.
  • the MPD file is as shown in FIG. 13, for example.
  • designated parameter information is stored for each of video and audio.
  • sampling rate is designated as the voice quality adjustment parameter by the designated parameter information in the client device 11.
  • the client device 11 adjusts the reproduction quality of the video data by changing the resolution as the quality adjustment parameter in the effect period.
  • the client device 11 adjusts the reproduction quality of the audio data by changing the sampling rate as the quality adjustment parameter.
  • the quality adjustment parameter that can most effectively reduce the reproduction quality may be designated by the designated parameter information.
  • one quality adjustment parameter may be designated for the entire content (stream) or may be designated for each segment.
  • step S71 the reproduction control unit 25 acquires designated parameter information based on the decoding result of the MPD file supplied from the MPD parser 22. That is, the reproduction control unit 25 reads designated parameter information from the MPD file.
  • the reproduction control unit 25 uses, as designated parameter information, information indicating the resolution as the quality adjustment parameter, and information indicating the sampling rate as the quality adjustment parameter. get.
  • step S72 the reproduction control unit 25 determines quality adjustment parameters to be adjusted at the time of reproduction quality adjustment of reproduction data, that is, at the time of effect processing, for video and audio based on the designated parameter information acquired at step S71.
  • the reproduction control unit 25 sets the quality adjustment parameter indicated by the designated parameter information as the quality adjustment parameter to be adjusted at the time of reproduction quality adjustment of reproduction data. Therefore, in the example shown in FIG. 13, the resolution is selected as the image quality adjustment parameter, and the sampling rate is selected as the sound quality adjustment parameter.
  • steps S73 to S81 are performed to end the quality adjustment effect control process, but these processes are similar to the processes of steps S11 to S19 of FIG. Therefore, the explanation is omitted.
  • step S76 and step S80 the reproduction control unit 25 changes the quality adjustment parameter determined in step S72 to reduce the reproduction quality of the reproduction data of the content, thereby reducing the video effector 32 and the audio effector 34. Control the Therefore, in step S44 or step S47 of FIG. 12, the quality adjustment parameter designated by the reproduction control unit 25 among the plurality of quality adjustment parameters is adjusted.
  • the client apparatus 11 changes the reproduction quality of the reproduction data by reading the designated parameter information from the MPD file and adjusting the quality adjustment parameter indicated by the designated parameter information. This makes it possible to perform reproduction quality adjustment with more effective quality adjustment parameters, and to change the reproduction quality of the content more effectively and more smoothly.
  • the designated parameter information may be supplied from the outside, or the designated parameter information may be stored in the segment data.
  • the designated parameter information may be stored in the segment data.
  • the priorities of the plurality of quality adjustment parameters may be stored in the MPD file. In such a case, for example, the priority of each quality adjustment parameter in the client apparatus 11, the quality adjustment parameter adjustable on the client side, etc. are considered, and the quality adjustment parameter to be actually used for adjustment is selected.
  • the order information indicating in what order it is more effective to adjust those plurality of quality adjustment parameters is MPD It may be stored in a file. That is, order information indicating a plurality of quality adjustment parameters for changing the quality of reproduction data and an adjustment order of the quality adjustment parameters may be acquired from the MPD file.
  • information including the information (ID) stored in the schemeIdUri of the MPD file and the designated value is used as the order information.
  • ID information stored in the schemeIdUri of the MPD file and the designated value.
  • each quality adjustment parameter is arranged in the order to be processed with delimiters such as comma and semicolon.
  • the MPD file is as shown in FIG. 15, for example.
  • the MPD file stores order information on the video.
  • the client device 11 specifies the resolution and the frame rate as the video quality adjustment parameters by the order information, and the frame rate adjustment should be performed after the resolution adjustment. That is, according to the order information, a plurality of quality adjustment parameters to be adjusted and the order (order) of adjustment with the quality adjustment parameters can be known.
  • the client apparatus 11 When the MPD file shown in FIG. 15 is obtained from the server, the client apparatus 11 first changes the resolution as the quality adjustment parameter in the effect period, and then the quality of the image data obtained as a result is further changed.
  • the reproduction quality of the video data is adjusted by changing the frame rate as an adjustment parameter.
  • order information On the service provider side, among a plurality of quality adjustment parameters, two or more quality adjustment parameters that can most effectively reduce reproduction quality and an effective order in which those quality adjustment parameters should be adjusted Information indicating (order) is generated as order information. Note that one order information may be specified for the entire content (stream) or may be specified for each segment.
  • step S121 the reproduction control unit 25 acquires order information based on the decoding result of the MPD file supplied from the MPD parser 22. That is, the reproduction control unit 25 reads out the order information from the MPD file.
  • the reproduction control unit 25 acquires, as the order information, information indicating that the frame rate should be adjusted after adjusting the resolution.
  • step S122 the reproduction control unit 25 performs, on the basis of the order information acquired in step S121, quality adjustment parameters for performing adjustment at the time of reproduction quality adjustment of reproduction data, that is, at the time of effect processing with respect to video and audio. Determine the adjustment order of adjustment parameters.
  • the reproduction control unit 25 sets the quality adjustment parameter and the adjustment order indicated by the order information as the adjustment order of the quality adjustment parameter to be adjusted and the quality adjustment parameter. Therefore, in the example shown in FIG. 15, it is decided to adjust the frame rate after adjusting the resolution as the image quality adjustment parameter.
  • steps S123 to S131 are performed to end the quality adjustment effect control process, but these processes are the same as the processes of steps S11 to S19 of FIG. The description is omitted because it is similar.
  • step S126 or step S130 the reproduction control unit 25 changes the plurality of quality adjustment parameters in the order determined in step S122 to reduce the reproduction quality of the reproduction data of the content. And controls the audio effector 34. Therefore, in step S44 and step S47 of FIG. 12, the plurality of quality adjustment parameters designated by the reproduction control unit 25 are adjusted in the designated order.
  • the client apparatus 11 changes the reproduction quality of the reproduction data by reading out the order information from the MPD file and adjusting the quality adjustment parameter indicated by the order information in the order indicated by the order information. As a result, the reproduction quality adjustment can be performed more effectively, and the reproduction quality of the content can be changed more effectively and smoothly.
  • the resolution as the quality adjustment parameter can be adjusted by filter processing such as a soft filter, or can be adjusted by resolution conversion processing. Even when the adjustment of the same quality adjustment parameter is performed, depending on what kind of process is used to perform the adjustment, the sense of incongruity that occurs when the content after adjustment is reproduced may differ.
  • processing for adjusting a predetermined quality adjustment parameter (hereinafter, also referred to as adjustment processing) may be specified on the service providing side.
  • adjustment processing specification information indicating the adjustment processing to be performed when adjusting the quality adjustment parameter is stored in the MPD file.
  • the adjustment process specification information is information for specifying the adjustment process for changing the quality adjustment parameter for changing the quality of the reproduction data.
  • the adjustment process specification information is stored in the MPD file and supplied, for example, the adjustment process specification information is read together with the specified parameter information and the order information in step S71 of FIG. 14 and step S121 of FIG. Furthermore, in step S72 of FIG. 14 and step S122 of FIG. 16, not only the quality adjustment parameter to be adjusted but also adjustment processing for the quality adjustment parameter are determined.
  • step S76 and step S80 of FIG. 14 and step S126 and step S130 of FIG. 16 adjustment of the quality adjustment parameter is performed by the adjustment process determined based on the adjustment process specification information of the plurality of adjustment processes. Control takes place. By doing this, it is possible to adjust the reproduction quality of the content more effectively so as not to cause discomfort.
  • the client device 11 changes the predetermined quality adjustment parameter or the arbitrarily determined quality adjustment parameter by performing the adjustment process indicated by the adjustment process specification information.
  • the present technology is not limited to this, and the present technology is also applicable to content delivery etc. that can implement the same technology as Bitrate Adaptation of the MPEG-DASH. It can apply.
  • the present technology may be applied, for example, when performing quality control of video and audio.
  • the series of processes described above can be executed by hardware or software.
  • a program that configures the software is installed on a computer.
  • the computer includes, for example, a general-purpose computer capable of executing various functions by installing a computer incorporated in dedicated hardware and various programs.
  • FIG. 17 is a block diagram showing an example of a hardware configuration of a computer that executes the series of processes described above according to a program.
  • a central processing unit (CPU) 501 a read only memory (ROM) 502, and a random access memory (RAM) 503 are mutually connected by a bus 504.
  • CPU central processing unit
  • ROM read only memory
  • RAM random access memory
  • an input / output interface 505 is connected to the bus 504.
  • An input unit 506, an output unit 507, a recording unit 508, a communication unit 509, and a drive 510 are connected to the input / output interface 505.
  • the input unit 506 includes a keyboard, a mouse, a microphone, an imaging device, and the like.
  • the output unit 507 includes a display, a speaker, and the like.
  • the recording unit 508 includes a hard disk, a non-volatile memory, and the like.
  • the communication unit 509 is formed of a network interface or the like.
  • the drive 510 drives a removable recording medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
  • the CPU 501 loads, for example, the program recorded in the recording unit 508 into the RAM 503 via the input / output interface 505 and the bus 504, and executes the above-described series. Processing is performed.
  • the program executed by the computer (CPU 501) can be provided by being recorded on, for example, a removable recording medium 511 as a package medium or the like. Also, the program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
  • the program can be installed in the recording unit 508 via the input / output interface 505 by attaching the removable recording medium 511 to the drive 510. Also, the program can be received by the communication unit 509 via a wired or wireless transmission medium and installed in the recording unit 508. In addition, the program can be installed in advance in the ROM 502 or the recording unit 508.
  • the program executed by the computer may be a program that performs processing in chronological order according to the order described in this specification, in parallel, or when necessary, such as when a call is made. It may be a program to be processed.
  • the present technology can have a cloud computing configuration in which one function is shared and processed by a plurality of devices via a network.
  • each step described in the above-described flowchart can be executed by one device or in a shared manner by a plurality of devices.
  • the plurality of processes included in one step can be executed by being shared by a plurality of devices in addition to being executed by one device.
  • present technology can also be configured as follows.
  • the first playback data and the second An image processing apparatus comprising: a reproduction control unit configured to control the quality of the reproduction data to change with time when reproducing reproduction data of higher quality among reproduction data.
  • the reproduction control unit performs the process in the portion of the first reproduction data immediately before switching to the second reproduction data.
  • the image processing apparatus according to (1) or (2), wherein the quality of the first reproduction data is changed such that the quality of the first reproduction data becomes substantially the same as the quality of the second reproduction data.
  • the reproduction control unit performs the process immediately after switching from the first reproduction data in the second reproduction data.
  • the quality of the second reproduction data is changed such that the quality of the second reproduction data becomes substantially the same as the quality of the first reproduction data, and the quality of the second reproduction data becomes higher with time
  • the image processing apparatus according to any one of (3) to (3).
  • the image processing apparatus according to any one of (1) to (4), wherein the first reproduction data and the second reproduction data are video data.
  • the image processing apparatus changes the quality of the reproduction data by changing at least one of a resolution, a frame rate, a bit depth, and a color gamut of the reproduction data.
  • the image processing apparatus according to any one of (1) to (4), wherein the first reproduction data and the second reproduction data are audio data.
  • the reproduction control unit changes the quality of the reproduction data by changing at least one of a sampling rate and a bit depth of the reproduction data.
  • the reproduction control unit acquires specification information specifying a parameter for changing the quality of the reproduction data, and changes the parameter indicated by the specification information of the plurality of the parameters in the reproduction data.
  • the image processing apparatus according to any one of (1) to (4), wherein the quality of the reproduction data is changed.
  • the reproduction control unit acquires order information indicating a plurality of parameters for changing the quality of the reproduction data and an adjustment order of the plurality of parameters, and the reproduction information is indicated by the order information in the reproduction data.
  • the image processing apparatus according to any one of (1) to (4), wherein the quality of the reproduction data is changed by adjusting a plurality of the parameters in an adjustment order indicated by the order information.
  • the reproduction control unit acquires processing specification information specifying an adjustment processing for changing a parameter for changing the quality of the reproduction data, and the adjustment processing indicated by the processing specification information among a plurality of the adjustment processing
  • the image processing apparatus according to any one of (1) to (4), wherein the quality of the reproduction data is changed by changing the parameter of the reproduction data according to.
  • the image processing apparatus according to any one of (9) to (11), wherein the reproduction data is video data, and the parameter is a resolution, a frame rate, a bit depth, or a color gamut.
  • the reproduction control unit controls the video data as the reproduction data and the audio data as the reproduction data to have the same period during which the quality of the reproduction data changes (1) to (13) An image processing apparatus according to any one of the preceding claims.
  • the first playback data and the second Controlling the quality of the reproduction data to change with time at the time of reproduction of reproduction data of higher quality among the reproduction data.
  • the first playback data and the second A program that causes a computer to execute a process including the step of controlling the quality of the reproduction data to change with time when reproducing reproduction data of higher quality among reproduction data.

Abstract

La présente invention concerne un dispositif, un procédé et un programme de traitement d'image qui permettent de réduire une sensation non naturelle lors de la visualisation. Ce dispositif de traitement d'image est équipé d'une unité de commande de lecture permettant de commander d'une manière telle que la qualité de données de lecture change au cours du temps de lecture des données de lecture de qualité supérieure parmi des premières données de lecture et des secondes données de lecture, lors de la commutation de la lecture à partir de la lecture sur la base de premières données de lecture à lire sur la base de secondes données de lecture, dont la qualité diffère de celle des premières données de lecture. L'invention ne s'applique pas aux dispositifs clients.
PCT/JP2018/001095 2017-01-30 2018-01-17 Dispositif, procédé et programme de traitement d'image WO2018139285A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017-014121 2017-01-30
JP2017014121 2017-01-30

Publications (1)

Publication Number Publication Date
WO2018139285A1 true WO2018139285A1 (fr) 2018-08-02

Family

ID=62977976

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/001095 WO2018139285A1 (fr) 2017-01-30 2018-01-17 Dispositif, procédé et programme de traitement d'image

Country Status (1)

Country Link
WO (1) WO2018139285A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005228469A (ja) * 2005-03-03 2005-08-25 Sony Corp 記録再生装置および方法、並びに提供媒体
JP2009502067A (ja) * 2005-07-18 2009-01-22 トムソン ライセンシング メタデータを用いて複数の映像ストリームを処理する方法及び装置
JP2010171787A (ja) * 2009-01-23 2010-08-05 Alpine Electronics Inc ディジタル放送受信装置およびディジタル放送受信装置の番組切り替え方法
JP2015518350A (ja) * 2012-04-24 2015-06-25 ヴィド スケール インコーポレイテッド Ｍｐｅｇ／３ｇｐｐ−ｄａｓｈにおける滑らかなストリーム切り換えのための方法および装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005228469A (ja) * 2005-03-03 2005-08-25 Sony Corp 記録再生装置および方法、並びに提供媒体
JP2009502067A (ja) * 2005-07-18 2009-01-22 トムソン ライセンシング メタデータを用いて複数の映像ストリームを処理する方法及び装置
JP2010171787A (ja) * 2009-01-23 2010-08-05 Alpine Electronics Inc ディジタル放送受信装置およびディジタル放送受信装置の番組切り替え方法
JP2015518350A (ja) * 2012-04-24 2015-06-25 ヴィド スケール インコーポレイテッド Ｍｐｅｇ／３ｇｐｐ−ｄａｓｈにおける滑らかなストリーム切り換えのための方法および装置

Similar Documents

Publication Publication Date Title
JP7407373B2 (ja) 表示装置、表示方法、および、コンピュータプログラム
US10187668B2 (en) Method, system and server for live streaming audio-video file
US9800948B2 (en) Method and system for trick play in over-the-top video delivery
KR101622785B1 (ko) Mpeg/3gpp-dash에서의 원활한 스트림 스위칭을 위한 방법 및 장치
KR101918017B1 (ko) 정보 처리 장치 및 정보 처리 방법
KR102525577B1 (ko) 데이터 스트리밍 방법 및 장치
US20070217505A1 (en) Adaptive Decoding Of Video Data
KR101978922B1 (ko) 관심 영역과 배경프레임 개별 전송을 이용한 고화질 360도 영상 스트리밍 방법
WO2018139284A1 (fr) Dispositif et procédé de traitement d'image, et programme
JP2013255210A (ja) 映像表示方法、映像表示装置および映像表示プログラム
US9516357B2 (en) Recording variable-quality content stream
CN103635938B (zh) 在流传输客户端中用于处理视频流传输数据的方法、流传输客户端
US20190373213A1 (en) Information processing device and method
WO2015131934A1 (fr) Système et procédé de diffusion en continu et en direct d'une vidéo
WO2018139285A1 (fr) Dispositif, procédé et programme de traitement d'image
JP6535273B2 (ja) 受信装置、セグメント取得方法、及びプログラム
JP2010212947A (ja) 情報処理装置および方法、情報処理システム、並びにプログラム
WO2018139283A1 (fr) Dispositif, procédé et programme de traitement d'image
JP4970912B2 (ja) 動画分割サーバおよびその制御方法
Lee et al. Quality adaptation scheme for improving QoE of MPEG DASH
JP6987567B2 (ja) 配信装置、受信装置及びプログラム
JP2012222399A (ja) 映像再生システム、映像再生方法、映像再生装置及びプログラム
JP5471328B2 (ja) 動画像再生装置及び動画像再生方法並びにプログラム
WO2018142947A1 (fr) Dispositif et procédé de traitement d'informations
JP7458848B2 (ja) ユーザ端末及びプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18744249

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18744249

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP