JP2016127328A - Electronic apparatus and signal processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic apparatus and a signal processing method.SOLUTION: An electronic apparatus is used in an image signal transmission system in which a first image data of first resolution is broadcasted as a basic image signal and an expansion image signal for obtaining a second image data of second resolution, which is higher than the first resolution, by reproducing the same in combination with the basic image signal, and which is delivered via a transmission channel different from the basic image signal. The electronic apparatus includes: a first storage section; a second storage section; a control unit; and a reproduction section. The first storage section receives the basic image signal and records the same. The second storage section receives the expansion image signal and records the same. The control unit controls, when the second storage section fails to properly acquire the expansion image signal, to receive and record the expansion image signal at a different timing. The reproduction section reproduces the expansion image signal which is recorded in the second storage section in combination with the basic image signal which is recorded in the first storage section responding to a reproduction instruction of the second image data of the second resolution.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an electronic device that receives a high-definition television broadcast and a signal processing method.

  Currently, digital television (HD (High Definition) TV) broadcasts use video signals with a horizontal pixel count of 1920 or 1440, a vertical pixel count of 1080, and a video frequency (frame rate) of 60 Hz. Has been.

  Compared to HDTV, 4K (3840 × 2160), frame rate 60 Hz 4K (UHD (Ultra High Definition)) broadcast, 16 times (7680 × 4320), frame rate 120 Hz 8K (8KUHD) broadcasting is also being standardized.

  However, it is required that HDTV broadcasts can be received by receivers (television receivers) that are currently widely used. For this reason, in 4K or 8K broadcasting, a video signal includes basic video information (hereinafter referred to as a basic layer) that is substantially equivalent to HDTV broadcasting and a video signal corresponding to 4K (8K) broadcasting. Separated into extended video information (hereinafter referred to as an extension layer), the extension layer is transmitted on a transmission path (for example, an IP network) different from the HDTV broadcast in which the base layer is transmitted, and the base layer and the extension are transmitted on the receiving side. A method has been proposed in which layers are received at the same time and both can be synthesized synchronously.

  In this way, the method of improving the image quality by receiving the enhancement layer transmitted on a transmission path different from the base layer and synthesizing both in synchronism is the only way to receive broadcast waves and view the content. In addition, it is conceivable that the program content is recorded for HDTV broadcasts.

JP 2006-75182 A

  According to the above-described image quality enhancement method using the enhancement layer, a high-quality video can be obtained by acquiring the enhancement layer in accordance with reception of the base layer of the target content. However, if the line is congested due to the concentration of access to the server that provides the enhancement layer, there is a risk that problems such as incompatibility with the base layer may occur due to lack of the enhancement layer or a decrease in transfer speed. There is. As described above, the image quality of the portion lacking the enhancement layer cannot be improved normally, and if the synchronization with the base layer is not synchronized, the image quality may not be improved.

  An object of the present invention is to provide an electronic device and a signal processing method capable of reliably obtaining an enhancement layer and realizing high image quality.

  In the electronic device of the embodiment, the first video data having the first resolution is broadcast as the basic video signal, and the second resolution higher than the first resolution is reproduced together with the basic video signal. Used for a video signal transmission system in which an extended video signal for obtaining the second video data is distributed on a transmission path different from the basic video signal, and a first recording unit, a second recording unit, A control unit and a playback unit are provided. The first recording unit receives and records the basic video signal. The second recording unit receives and records the extended video signal. The control unit receives and records the extended video signal of the video content at another timing when the extended video signal cannot be normally acquired when the video content is broadcasted to the second recording unit. To control. The reproduction unit reproduces the extended video signal recorded in the second recording unit together with the basic video signal recorded in the first recording unit in response to an instruction to reproduce the video content.

The block diagram which shows an example of the video signal transmission / reception system which concerns on embodiment. 1 is a block diagram illustrating an example of a recording apparatus (electronic device) according to an embodiment. The block diagram which shows an example of the processing block of the basic layer of the recording apparatus which concerns on embodiment, and an extended layer. 9 is a flowchart showing a first example of a processing sequence for improving the image quality of recorded content by the extended transmission method according to the embodiment. The figure which shows an example of the setting screen of an extended layer acquisition time in a 1st Example. The figure which shows an example of the reproduction | regeneration selection screen of an enhancement layer acquisition completion content in a 1st Example. 12 is a flowchart showing a second example of a processing sequence for improving the image quality of recorded content by the extended transmission method according to the embodiment. The figure which shows an example of the setting screen which sets acquisition of the extended layer for image quality improvement to a user-specified timing in 3rd Example. 12 is a flowchart showing a third example of a processing sequence for improving the image quality of recorded content by the extended transmission method according to the embodiment. The figure which shows an example of the screen which notifies a user that acquisition of an expansion layer fails in 3rd Example, and it transfers to the recording and reproducing operation by normal image quality.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram illustrating a configuration of a video signal transmission / reception system according to an embodiment. In the system shown in FIG. 1, an electronic device (for example, a television broadcast receiving device, hereinafter referred to as a television device) 1 transmits a broadcast wave (a ground wave and a satellite wave) transmitted from a broadcast station that is a program supply source through an antenna ANT. ). The TV apparatus 1 receives 2K (HDTV (video signal having a horizontal pixel count of 1920 or 1440, a vertical pixel count of 1080, and a video frequency (frame rate) of 60 Hz)) broadcast, which is now widely used. Is possible. Also, the broadcast wave received by the television apparatus 1 is 4K broadcast (UHD (Ultra High Definition), ultra-high definition) with a pixel number four times (3840 × 2160) and a frame rate of 60 Hz compared to 2K (HD) broadcast. Broadcast). The broadcast wave received by the television apparatus 1 may also be 8K broadcast (8KUHD broadcast) with 16 times the number of pixels (7680 × 4320) and a frame rate of 120 Hz compared to 2K (HD) broadcast.

  In 4K broadcasting or 8K broadcasting, a video signal (broadcast wave) is separated into first video information (basic layer) and second video information (extended layer), and the bandwidth of two channels is occupied. A transmission method can be used. The basic layer (first video information) substantially corresponds to a 2K (HD) broadcast signal and is preferably usable as it is as a 2K (HD) broadcast wave. The enhancement layer (second video information) is prepared independently of the base layer, and can be used to reproduce 4K (8K) video when used together with the base layer. In this case, the base layer occupies the bandwidth for one channel, and the extension layer occupies the bandwidth for another one channel. However, according to this method, reception of 2K (HD) broadcasts by a receiver (television receiver) that receives 2K (HD) broadcasts that are currently widely used is not affected at all.

  The television apparatus 1 can also acquire an image from an external video supply source, for example, a video camera device or a portable terminal device 2001 capable of capturing an image. In this case, the image may be acquired using, for example, a short-range wireless communication method or a wired transmission method using a connection cable. Further, the television apparatus 1 is connected to the network NTW and can receive a video signal and video information from a service server (hereinafter referred to as a server) SV located on the network NTW. Note that the television device 1 may be a personal computer (PC), a home server, a recorder or a STV (Set Top Box), a monitor device connected to the recorder or the STV, and the like. In the following description, the television apparatus 1 receives at least one broadcast of 2K (2K1K or 1920 × 1080), 4K (4K2K or 3840 × 2160), or 8K (8K4K or 7680 × 4320) broadcast, and video And voice (sound) can be reproduced. However, in the following, for convenience of explanation, it is described as a 2K / 4K compatible television device.

  In the following description, the broadcast received by the television apparatus 1 and reproducing video and audio is provided by a broadcaster (broadcast station) as radio waves propagating in space, or a cable (including optical fiber) network. And those distributed by a distribution company through a network such as an IP (Internet Protocol) network. In addition, broadcasting indicates a form in which various programs including video and audio and / or music and having a fixed time (broadcast time) as a unit are provided. A program may be called a content, a stream, or a title. In addition, the video includes a moving image, a still image, text (information represented by characters or symbols indicated by a coded code string), and any combination thereof. In addition, a program received on the first transmission path (for example, satellite wave) of programs (broadcasting) acquired through two transmission paths (for example, satellite waves), a main channel, a main service, and a main channel TS (Transport Stream). May be referred to as a main video signal, HD video signal, HDTV broadcast signal, 2K video signal current service or current broadcast signal, and the like. In addition, a program received on another (second) transmission path among programs (broadcasts) acquired through two transmission paths (for example, satellite waves), subchannel, subservice, subchannel TS, and high-quality video signal It may be referred to as a 4K video signal, a 4K broadcast signal, an extended service, or an extended broadcast signal.

  FIG. 2 illustrates an example of a main configuration of the television device. Note that the television apparatus can record the received program in a hard disk (HDD) or a storage device described later.

  The television apparatus 1 includes an input unit (tuner) 11, a signal processing unit (TS separation unit) 12, a video output processing block 21, an audio processing block 31, a main control block 51, and the like.

  The input unit 11 is connected to an antenna ANT that receives a broadcast provided using a spatial wave (a ground wave or a satellite wave). For example, an STB (Set Top Box) or a video camera device is connected to the input unit 11 as an external video supply source. The video camera device may be a portable terminal device capable of taking an image, such as a tablet PC (Personal Computer) device. Further, the display 26 in the television device 1 may display a program transmitted by the video storage device (recorder) or the receiving device (STB or tuner) in a wireless manner without contact with the television device 1.

  The input unit 11 is a tuner that can receive broadcasts (programs) of at least two channels, for example, 2K (HD) broadcasts (broadcasts using spatial waves (surface waves)). Including degree. The input unit 11 preferably includes about three tuners capable of receiving BS broadcasts broadcasted by a broadcasting satellite or CS broadcasts relayed via a communication satellite.

  Broadcast that is input to the input unit 11 is separated by a signal processing unit (TS separation unit) 12 by TS (Transport Stream). That is, the signal processing unit (TS separation unit) 12 separates the video signal (video), the audio signal (audio), and the control information. The control information includes SI (Service Information, that is, program arrangement information / PSI (Program Specific Information)), NIT (Network Information Table), EIT (Event Information Table), and the like. The SI includes a description regarding TS (stream) distribution rules and contents, schedule or timing, and the like. The description in SI is, for example, a packet identifier (PID), “PID = 0” indicating a packet storing an image, sound, control information, etc. as a packet value defining “0xYZ (YZ is a predetermined integer)”. PAT (Program Association Table) to be referred to, PMT (Program Map Table) to be referred to in “PID = P”, and the like are included. The NIT includes a description regarding stream distribution (distribution) information. The EIT includes program information, for example, a description related to a program such as a program name, broadcast date and time, or broadcast content.

  The EIT, NIT, or PAT indicates whether or not there is an extension layer corresponding to the received broadcast (basic layer), that is, a 2K (HD) broadcast signal (whether the extension layer is provided by another channel or a different transmission method). An “identifier or description” may be included. Further, the “identifier or description” indicating the presence / absence of the enhancement layer (whether or not the enhancement layer is provided) may be specified by specifying another description or another reference location.

  The enhancement layer is video information that is separated from the base layer on the transmission side when the broadcast received by the television apparatus 1 is a 4K broadcast that conforms to the SHVC (Scalable High Efficiency Video Coding) encoding method. Specifically, the enhancement layer is used to generate a prediction image at the time of encoding (SHVC encoding) on the transmission side, and includes inter prediction (motion compensation prediction), intra prediction (intra-screen prediction), and inter-layer prediction (inter-image prediction). This is video information generated by executing at least one. More specifically, the SHVC encoding scheme is based on inter-picture prediction (layer prediction), in addition to inter-picture prediction (motion compensation prediction / inter prediction) and intra-picture prediction (intra prediction) used in HEVC (High Efficiency Video Coding). Inter prediction). The inter-layer prediction predicts a reference layer constituting a 2K (HD) video, that is, an extended layer (extended video) that can be used when outputting 4K (ultra high definition image quality) video from a basic video. That is, in the SHVC encoding method, it is possible to use, as a prediction candidate, a video obtained by up-converting a decoded basic video to an ultra-high definition image quality (4K video) during video playback. As a result, the SHVC encoding method can compress video information with higher compression efficiency than a method of directly compressing 4K video, and 4K video that can use the current broadcast network (broadcast band) as it is. Can be sent and received.

  Further, as described above, the enhancement layer corresponds to a program received on another transmission path out of programs acquired through the two transmission paths, and is set on the transmission side so as to be acquired via a network, for example. In some cases.

  A display 26 and a speaker 36 are connected to the video output processing block 21 and the audio processing block 31, respectively.

  The video output processing block 21 superimposes the OSD video generated by the OSD (On Screen Display) processing unit 24 on the playback video signal output from the high-definition image restoration unit 201 described later with reference to FIG. The unit 25 converts to a predetermined resolution and output method that can be displayed on the display 26. The output of the display control unit 25 may be output to an output terminal 27 to which, for example, an externally connected monitor device or a projection device (projector device) can be connected.

  The audio processing block 31 includes an audio (audio) decoder 32, an audio (audio) processing unit 33, a delay unit 34, a DA (Digital to Analog) converter 35, and the like.

  As for the audio signal (audio), the audio signal decoded by the audio decoder 32 in the audio processing unit 33 is converted into a predetermined format that can be suitably reproduced by the speaker 36. The DA converter 35 converts the audio signal converted by the audio processing unit 33 into an analog audio output signal. Thereby, when the speaker 36 is connected to the DA converter 35, the speaker 36 outputs an audible sound (analog voice (audio) output). Note that the output of the DA converter 35 may be branched to an output terminal 37 to which an AV (Audio Visual) amplifier or the like can be connected, for example. The audio signal input to the DA converter 35 is controlled to be delayed by a predetermined amount (time) by the delay unit 34 in accordance with the type of content. For example, when the content is a game, the size (length) of the delay (time) defined by the delay unit 34 is the size (length) of the delay (time) applied when the broadcast signal (program) is reproduced. Smaller (shorter). In addition, although it is assumed that the enhancement layer includes, for example, 7.1ch surround information (signal) and reproduced sound range information (signal) of about 60 kHz, the time required for decoding audio (sound) will be described below. Compared to the time required to decode 4K video. However, as will be described later, 2K (HD) based on the base layer is accompanied by an enhancement layer, and the enhancement layer is lost during 4K (UHD) video playback (or the acquisition of the enhancement layer becomes unstable). Broadcast may be played. When an enhancement layer is acquired again from this state (a state where 2K broadcast is being played back) and 4K broadcast is played back, it is preferable to delay the audio for a predetermined period until decoding of 4K video is completed.

  The main control block 51 includes, for example, a CPU (main processing circuit) 52, a ROM (read only memory) 53 that holds a control program executed by the CPU 52, and a RAM (random access memory (work memory)) 54 that provides a work area to the CPU 52. , An NVM (nonvolatile (rewritable) memory) 55 that holds various setting information, control information, and the like, an enhancement layer recording management unit 56, and the like. The main control block 51 also includes an operation unit 61, a reception unit 62, a communication interface 63, a network control unit 64, a USB (Universal Serial Bus) interface 65, and an HDMI ((registered trademark) High-definition Digital Media Interface) control unit 66. , A storage device 67, etc. are connected. The USB interface 65 can be connected to an external device conforming to the USB standard, such as a USB-connected HDD (Hard Disk Drive), a keyboard, or the like.

  The operation unit 61 inputs a control command corresponding to a direct operation by the user to the main control block 51.

  The receiving unit 62 inputs a command corresponding to an instruction (operation input) from the remote control terminal (remote controller) 71 or a portable terminal device to the main control block 51.

  The communication interface 63 is connected to a communication unit 81 that can communicate with any other device (communication partner). The communication unit 81 realizes wireless communication with a short-range wireless communication device (partner device) that complies with, for example, the WiFi (Wireless Fidelity) standard. For example, the Bluetooth (registered trademark) standard, NFC (Near Field Communication), or the like can be used as the short-range wireless communication standard. The communication unit 81 can exchange signals with, for example, a wireless keyboard or a mouse. The communication unit 81 may also be, for example, a card reader capable of wireless communication (Read / Write) with a non-contact communication type card medium. Note that the communication unit 81 may communicate with the counterpart device in a wired manner.

  The network control unit 64 controls, for example, acquisition and transmission of various information from an external network (Internet network (network 1001), access to the Internet network (network 1001), and the like.

  The USB interface 65 can be connected to an external device conforming to the USB standard, such as a USB-connected HDD (Hard Disk Drive) 69, a memory card, or a keyboard.

  The HDMI control unit 66 enables wired communication between devices using the HMDI standard or the MHL standard.

  The storage device 67 stores various information related to received broadcasts (programs) and programs stored in the storage device 67 and the USB-connected HDD 69.

  The main control block 51 (or CPU 52) is based on the user operation (control input) through the operation unit 61, the remote control 71 received by the reception unit 62, or the operation information (control input) from a portable terminal device. Control each element of.

  The main control block 51 records the video signal, the audio signal, and the like output from the high-definition image restoration unit 201 and the signal processing unit 12 in the storage device 67 and the HDD 69 based on a user operation (control input). Is possible. When recording a video signal, an audio signal, or the like in the storage device 67 or the HDD 69, the main control block 51 encrypts the video signal, the audio signal, etc., and converts it into a predetermined recording format. The main control block 51 reads out and decodes a desired video signal, audio signal, etc. from the storage device 67 or the HDD 69 based on an operation (instruction input) by the user from the remote controller 71 or the like, and decodes the video output processing block 21 (display control). Unit 25) to execute video display and audio reproduction.

  The main control block 51 also includes subtitle information (including live subtitles obtained by converting the voice uttered by the anchor (announcer) in the news program) from the TS separated by the signal processing unit (TS separation unit) 12 and EPG (electronic program guide). ) Information can be obtained. A procedure (method) for acquiring subtitle information and EPG is prepared as a program or application stored in the NVM 55 or the ROM 53, or firmware of the CPU 52, for example.

  Under the control of the CPU 52 of the main control block 51, the extension layer recording management unit 56 sends metadata indicating the presence or absence of an extension layer corresponding to the 2K broadcast (basic layer) being recorded to the HDD 69 or the storage device 67. Created when recording received programs. For example, the metadata records and manages the period during which the enhancement layer is received (recorded) as, for example, “enhancement layer recording information”. The metadata includes the time t0 when the extension layer cannot receive (or the reception has become unstable) in the state where the base layer is received, and (again) the extension layer for the broadcast to be recorded that is being received. As long as the received time t1, t2 and t3, and t4 and tN-1 can be identified, the recording format, the recording order, and the like are arbitrary.

  For example, metadata is recorded only for 2K broadcasts in the time zone in which an extension layer is missing (unstable) within the time when an arbitrary program is received and recorded, that is, within the broadcast time of one program. It is managed as being (no enhancement layer recording). That is, the time zone in which the enhancement layer capable of reproducing 4K video can be received is managed as having enhancement layer recording. As a method of managing the time when the enhancement layer does not exist, for example, the broadcast start time of the recording target program is set to “00:00”, and the time when the enhancement layer is lost and the time when the enhancement layer is eliminated are managed. Alternatively, time information (PCR (Program Clock Reference)) used in the recording apparatus may be acquired and managed as, for example, “22: 22: 22—23: 45: 60”.

  When there is a user instruction (operation input from the remote controller 71 or a portable terminal device or the operation unit 61), the television apparatus 1 sets “identifier or description” in the main control block 51 (enhancement layer recording management unit 56). When extraction is possible, 4K video is recorded, and when playback is instructed, 4K video can be displayed on the display 26. Note that the basic reception setting in the television apparatus 1 is a setting for using a 2K (HD) broadcast wave as it is when a basic layer substantially corresponding to a 2K (HD) broadcast signal is received. For this reason, when an enhancement layer capable of reproducing 4K broadcast is received, switching of each unit for reproducing 4K broadcast is necessary. An example of a configuration in which 4K video is decoded using an enhancement layer supplied by a channel or transmission path specified by “identifier or description” and a base layer corresponding to the enhancement layer will be described later with reference to FIG. To do. In order to record only the 4K broadcast transmitted by the broadcast station (channel) that the remote control terminal 71 has received an enhancement layer capable of reproducing 4K broadcast (detected as 4K broadcast), for example, a [4K] selection key When the key 71a is turned on (pressed), as a general rule, it can be set to record a program of a broadcasting station (channel) to which 4K broadcasting is transmitted.

  FIG. 3 shows an example of a configuration for decoding 4K (UHD) video using an enhancement layer supplied by a channel or transmission path specified by “identifier or description” and a base layer corresponding to the enhancement layer. Indicates. Note that the base layer and the extension layer are prepared in advance on the transmission side (broadcasting station / distribution station) when the base video (program) is transmitted as a 4K broadcast signal. The base layer substantially corresponds to an HD broadcast signal, and when received, is used as an HD broadcast wave as it is. The extension layer is auxiliary information that can reproduce 4K video and sound (sound) when used at the same time as the base layer, and may include 7.1ch surround information (signal) or reproduced sound range information (signal) of about 60 kHz, for example. is there.

  As illustrated in FIG. 3, the signal processing unit 12 of the television device 1 includes a high-definition image restoration unit 201 that processes the enhancement layer and reproduces 4K video using the basic video and the enhancement layer corresponding to the enhancement layer.

  The high-definition image restoration unit 201 performs a decoding process on the broadcast signal selected by the input unit 11 to restore a video signal, an audio signal, caption / text super information, program-related information, and the like. In the first signal processing unit 203 and the second signal processing unit 205, a system time reference value STC (System Time Clock) is common.

  The high-definition image restoration unit 201 receives an input terminal 260 to which a basic layer (HDTV signal) is input to the first signal processing unit 203, a transmission path decoding unit 261, and an extension layer to the second signal processing unit 205. It includes at least an input terminal 280 and a transmission path decoding unit 281.

  The high-definition image restoration unit 201 also includes a first decoder (MPEG-2 decoder) 270, an up-converter 274, a buffer memory 276, a clock reproduction control unit 278, an output selector (video output switching unit) 298, and the like. The high-definition image restoration unit 201 operates under the control of the CPU 52 of the main control block 51. That is, the CPU 52 controls the first decoder 270, the up converter 274, the buffer memory 276, the clock reproduction control unit 278, the output selector 298, and the like.

  In the high-definition image restoration unit 201, the basic layer input to the input terminal 260 is input to the transmission path decoding unit 261, and the enhancement layer input to the input terminal 280 is input to the transmission path decoding unit 281. The transmission path decoding units 261 and 281 demodulate the base layer and the enhancement layer, respectively, and decode them by transmission path decoding processing. The transmission path decoding units 261 and 281 output the decoded signals (first TS signal and second TS signal).

  The clock recovery control unit 278 generates second clock information for synchronizing the decoding timing, and outputs the time information acquired from the second demultiplexing unit 284. In addition, since the clock regeneration control unit 278 has a common STC, based on PCR (Program Clock Reference), the first decoder 270 and the second decoder (SHVC decoder) 292 (on the second signal processing unit 205 side). ) Control the synchronization.

The up-converter 274 up-converts the resolution, screen size, and color band of 2K video supplied as the base layer. That is, the up-converter 274 up-converts the video signal (second decoded video signal) decoded by the decoder 270, generates a video signal (second expanded decoded video) signal generated by the up-conversion, and generates the video signal The second extended decoded video is output. For example, the up-converter 274 converts the resolution of the 2K video signal ( HD video ) to the resolution of the 4K video signal (second enlarged 4K video signal).

  The buffer memory 276 temporarily holds various signals and the second enlarged 4K video signal.

  Based on the STC, the output selector 298 outputs 2K video (HD video) decoded by the decoder 270 of the first signal processing unit 203 or 4K video (UHD video) decoded by the SHVC decoder 278 of the second signal processing unit 205. One of these is output. Note that the output selector 298 can also output information (data) including audio, program guide, and the like in association with the video to be output. The output selector 298 also outputs the selected video signal (selected video signal) to the display control unit 25. At this time, selection information for identifying the selected video signal is also output.

  The selected video signal output from the output selector 298 is superimposed on the OSD output from the OSD processing unit 24 in the display control unit 25, and the display control unit 25 supplies it to the display 26 or the output terminal 27.

  More specifically, the first signal processing unit 203 decodes the first TS signal from the input terminal 260 into a first display signal, that is, a 2K video signal. The second signal processing unit 205 decodes the second TS signal (an enhancement layer corresponding to 4K video) from the input terminal 280 into a second display signal. More specifically, the second signal processing unit 205 decodes the second high-quality video signal (4K video signal) from the first TS signal (2K video signal) and the second TS signal. .

  More specifically, the first signal processing unit 203 includes a first demultiplexing unit 264, a first descrambler 266, a first ECM / EMM processing unit 268, a first (basic video) decoder 270, and A PSI / SI processing unit 272 is included at least.

  The first demultiplexing unit 264 separates the input base layer into various information, control signals, and video signals. The first demultiplexing unit 264 includes a PID filter 265 that takes in only signals that satisfy the filter condition set by the main control block 51 (CPU 52). The first demultiplexing unit 264 sets the value of the PID filter 265 based on the control of the CPU 52.

  The first demultiplexing unit 264 extracts, for example, a PAT (Program Association Table, that is, PSI of “PID = 0”) by the PID filter 265, and a PMT (Program Map) of the content specified by the user operation (control input) Table) is extracted. The first demultiplexing unit 264 extracts the video signal specified by the PMT specified by this PID, and outputs the extracted video signal and time information signal.

  The first ECM / EMM processing unit 268 extracts a scramble key from the ECM and EMM of the control information separated by the first demultiplexing unit 264. Specifically, the first ECM / EMM processing unit 268 decrypts the encrypted EMM with a unique key prepared in association with the television apparatus 1, and works from the decrypted EMM (Entitlement Management Message). Take out the key. Next, the first ECM / EMM processing unit 268 decrypts an ECM (Entitlement Control Message) using the work key, and extracts a scramble key from the decrypted ECM.

  The first descrambler 266 cancels the encryption processing of the video signal output from the first demultiplexing unit 264. That is, the first descrambler 266 releases the encryption processing of various signals processed with the scramble key on the transmission side. Note that the encryption processing rule is an example, but it is preferable that the processing rule is MULTI2 or equivalent.

  The first decoder 270 decodes (decodes) the video signal (2K broadcast) separated (for transmission) by the first demultiplexing unit 264. The first decoder 270 decodes the video signal using an encoding format used on the transmission side, for example, MPEG (Moving Picture Experts Group) -2, and outputs the decoded 2K video signal.

  The PSI / SI processing unit 272 processes program identification information (PSI) and service information (SI) based on control by the CPU 52 (main control block 51), and outputs information (data) related to PSI, SI, and the like. To do. The PSI / SI processing unit 272 is based on an ES (Elementary Stream) extracted by the control of the CPU 52 and selects a channel selection list (selection channel) including a channel selection procedure including a video signal to be selected, a display timing, and the like. Station information). Here, the channel selection list is information for controlling the channel selection procedure (timing) and instructions for a plurality of display signals to be selected. The PSI / SI processing unit 272 transmits and receives signals to and from the first demultiplexing unit 264, the second demultiplexing unit 284, and the output selector 298.

  More specifically, the second signal processing unit 205 includes a second demultiplexing unit 284, a second ECM / EMM processing unit 286, a second descrambler 288, a PSI / SI processing unit 290, and a second demultiplexing unit 284. A decoder (SHVC decoder) 292 is provided at least.

  The second demultiplexing unit 284 separates the input enhancement layer into various information, control signals, and video signals. The second demultiplexing unit 284 also outputs the time information included in the enhancement layer to the clock recovery control unit 278. The second demultiplexing unit 284 includes a PID filter 285 that takes in only signals that satisfy the filter condition set by the control block 51 (CPU 52). The second demultiplexing unit 284 sets the value of the PID filter 285 based on the control of the CPU 52.

  The second demultiplexing unit 284 uses the PID filter 285 to extract the PAT from the PSI and extract the PMT PID of the content specified by the user operation (control input). The second demultiplexing unit 284 extracts the video signal specified by the PMT specified by this PID, and outputs the extracted video signal and time information signal.

  The second ECM / EMM processing unit 286 extracts a scramble key from the ECM and EMM of the control information separated by the second demultiplexing unit 284. Specifically, the second ECM / EMM processing unit 286 decrypts the encrypted EMM with a unique key prepared in association with the television apparatus 1 and extracts the work key from the decrypted EMM. Next, the second ECM / EMM processing unit 286 decrypts the ECM using the work key and extracts a scramble key from the decrypted ECM.

  The second descrambler 288 cancels the encryption processing of the video signal output from the second demultiplexing unit 284. That is, the second descrambler 288 cancels the encryption processing of various signals processed with the scramble key on the transmission side. The encryption processing rule is an example, but is preferably AES (Advanced Encryption Standard) or a processing rule based thereon.

  The PSI / SI processing unit 290 processes program identification information (PSI) and service information (SI) based on control by the CPU 52 (main control block 51), and outputs information (data) related to PSI, SI, and the like. To do. The PSI / SI processing unit 290, based on ES (Elementary Stream) extracted by the control of the CPU 52, selects a channel selection list (selection channel) including a channel selection procedure including a video signal to be selected, display timing, and the like. Station information). Here, the channel selection list is information for controlling the channel selection procedure (timing) and instructions for a plurality of display signals to be selected. The PSI / SI processing unit 290 transmits and receives signals to and from the first demultiplexing unit 264, the second demultiplexing unit 284, and the output selector 298.

  The SHVC decoder (second decoder) 292 decodes (decodes) the video signal (enhancement layer) that has been packetized (for transmission) separated by the second demultiplexing unit 284. That is, the SHVC decoder 292 decodes an enhancement layer that is a video signal that has been subjected to scalable coding (SHVC (MPEG-HEVC Video) coding). In addition, the SHVC decoder 292 uses the video signal that is the basis of the 4K video obtained by decoding the enhancement layer and the video signal decoded by the first decoder 270 and up-converted by the up-converter 274, that is, the second enlarged decoded video, to generate UHD. A video signal (ultra high definition, for example, 4K) is generated and output to the selector 298.

  Note that the 4K (UHD) video output from the SHVC decoder 292 is subjected to image quality improvement processing by the metadata processing unit 294 and the image quality improvement processing unit 296 located at the subsequent stage of the SHVC decoder 292. For example, the metadata processing unit 294 is information attached to the enhancement layer when separating the base layer and the enhancement layer on the transmission side, and includes, for example, a contrast and a color band for improving the quality of the basic layer. Alternatively, grading information for grading processing such as gradation characteristics is generated (restored). Further, the image quality improvement processing unit 296 can improve the image quality by grating the UHD (for example, 4K) video signal output from the SHVC decoder 292 based on the grating information.

  The first PSI / SI processing unit 272 and the second PSI / SI processing unit 290 perform the first demultiplexing based on the PSI / SI prepared on the transmission side for each of the base layer and the enhancement layer. Video signals (base layer and enhancement layer) are transmitted and received between the unit 264, the second demultiplexing unit 284, and the output selector 298. In other words, the output selector 298 determines whether the video signal output to the display 26 (or the output terminal 27) is a 2K (HD) video based on the base layer or a 4K (UHD) video based on the enhancement layer. The ES included in the first PSI / SI processing unit 272 and the second PSI / SI processing unit 290 is selected and selected. When the PSI / SI prepared on the transmission side is shared in the base layer and the enhancement layer, either the first PSI / SI processing unit 272 or the second PSI / SI processing unit 290 is used. By reading the received PSI / SI, for example, the decoding start timing of 4K video can be advanced. For example, when “identifier or description” indicating that the enhancement layer is prepared is included in the PSI / SI of the base layer, decoding of 4K video is started when “identifier or description” is read. The time until 4K video after decoding is output can be reduced.

  In the television apparatus 1 having the above-described configuration, an image quality improvement process of 4K broadcast or 8K broadcast according to the present embodiment will be described below with an example.

(First embodiment)
FIG. 4 is a flowchart showing a first embodiment of a processing sequence for improving the image quality of recorded content by a transmission method according to basic / extended layers (hereinafter referred to as an extended transmission method), and FIG. FIG. 3B shows a flowchart for acquisition, FIG. 3B shows an enhancement layer acquisition, and FIG. 4C shows a flowchart for playback of recorded content.

  First, in FIG. 4A, when the broadcast of the content to be recorded is received (step S11), the recording process is started, the basic layer and the extension layer are acquired and stored in the recording medium, and the metadata is analyzed. Execute (Step S12). Here, it is determined whether the acquisition of the extension layer has failed due to a network failure or the like (step S13), and if the acquisition failure is detected, the re-acquisition reservation for the extension layer is registered (step S14). When the enhancement layer can be acquired or when a reacquisition reservation is registered (step S14), the recording process is ended when the recording target content is broadcast (step S15).

  Next, in FIG. 4B, when the specified time (the acquisition time of the enhancement layer set in advance by the user or the like) has come (step S16), whether the enhancement layer reacquisition reservation is registered. When the determination is made (step S17) and there is a reacquisition reservation, the enhancement layer acquisition process is started. On the other hand, when the enhancement layer acquisition reservation is not registered, the enhancement layer acquisition process is not performed.

  Here, in the enhancement layer acquisition process, network access is made to the enhancement layer distribution server (step S18), and the enhancement layer of the target content is obtained (step S19). It is conceivable that the target content for acquiring the extension layer is collated by metadata (broadcast time zone of a recorded program, title information, broadcast channel, etc.) and the like. When the enhancement layer is acquired, the basic layer of the same target content is searched from the basic layers of the target content that have already been recorded (step S20). As a result of the search, synchronization processing is performed between the extension layer and the base layer that are found (step S21), and the extension layer and the base layer are associated with each other and stored in the recording medium (step S22).

  Next, in FIG. 4C, when a recorded content playback operation by the user or the like is received (step S31), it is determined whether or not the enhancement layer has been normally acquired for the target recorded content (step S32). If it is possible to obtain the high-quality image, the base layer and the extended layer are read from the recording medium and reproduced in synchronism (step S33). If the enhancement layer cannot be acquired normally, normal playback is performed using the base layer (step S34).

  In the above processing, if there is other recorded content for which an enhancement layer is to be acquired, the processing can be executed continuously.

  Here, the acquisition time of the enhancement layer in step S21 may be a method specified in advance by the user, a method automatically determined according to a predetermined algorithm in the recording / playback apparatus, or the like. As an example, it is considered effective to acquire in a time zone in which the user's access is not concentrated, such as a midnight time zone, or a time zone in which viewing or recording is not performed. For example, as shown in FIG. 5, an operation screen that allows the user to set the time for obtaining the enhancement layer for high image quality may be displayed, and the time may be set according to the operation. As a result, the enhancement layer can be obtained for all the content recorded up to the enhancement layer acquisition start set time.

  The synchronization process in step S21 may be performed in parallel with the reproduction process when the recorded content is reproduced.

  Further, in the reproduction of the recorded content in step S31, there is a method of informing the user whether or not the high-quality reproduction by the extended transmission method is currently possible by displaying whether or not the enhancement layer has been acquired in the recorded content list. It is done. The user may select one or more contents that require an enhancement layer from among a plurality of recorded contents. In addition, it is preferable to make a reservation setting so that the enhancement layers of the selected content are sequentially acquired. At this time, since acquisition of the enhancement layer is suppressed to a necessary minimum, the recording capacity to the recording medium can be suppressed. Note that, as shown in FIG. 6, a method for selecting the extension layer acquisition content may be a method of selecting a content displayed as “enhanced high image quality completed” from the recorded content list. As a result, the user can reproduce and select content in which the enhancement layer has already been normally acquired from the recorded content, and can always realize high image quality by the enhanced transmission method.

  As described above, in the recorded content, by acquiring the enhancement layer at a timing different from that at the time of reception, the user can realize high-quality reproduction with the enhanced transmission method with high quality.

(Second embodiment)
In the first embodiment, it is assumed that a plurality of image quality enhancement target contents are recorded, including the case of separately acquiring an extension layer of each of the image quality enhancement target contents. Then, when the enhancement layer of the target recorded content to be reproduced has not been recorded yet, a method of acquiring the enhancement layer at the time of recording / reproduction is realized.

  FIG. 7 is a flowchart showing a second embodiment of the processing sequence for improving the image quality of recorded content. Corresponding to the flowchart shown in FIG. 4C of the first embodiment, the recording content of the target recorded content in step S32 is shown. In the enhancement layer recording completion determination, if the enhancement layer has not been recorded, the enhancement layer distribution server is accessed (step S35), and it is determined whether or not the enhancement layer of the target recorded content can be acquired (step S36). If acquisition is possible, the enhancement layer is acquired and high-quality playback in step S33 is executed. If acquisition is not possible, normal playback using the basic layer in step S34 is executed.

  According to the present embodiment, compared to when a plurality of recordings are executed, the acquisition target of the enhancement layer is limited only to the recording / playback content, and therefore the enhancement layer can be acquired with a small load.

  In the first embodiment, the case where the enhancement layer acquisition start timing is designated by time has been described. However, it is not time, but for example, when recording content is selected as shown in FIG. May be set.

(Third embodiment)
FIG. 9 is a flowchart showing a third embodiment of a processing sequence for improving the image quality of recorded content by the extended transmission method. In the present embodiment, when the broadcast content of the recorded content is received by the target extended transmission method, if the user is watching the broadcast content and the enhancement layer cannot be acquired normally, the recording / playback operation of the recorded content is performed. Then, a means for ensuring the time to acquire and synchronize the enhancement layer normally by recording and reproducing from a certain time older than the broadcast time is proposed.

  In FIG. 8, in a state where the user is viewing the broadcast content by the extended transmission method (step S41), it is detected (determined by a network failure or the like) that the acquisition of the extension layer of the content being viewed has failed (step S42). ), It is determined whether or not the apparatus of the present embodiment is recording the viewing content (step S43). If it is not recorded, the process proceeds to a recording start process (step S44). On the other hand, if the device of the present embodiment is not recording viewing content, recording of the viewing content is started, and similarly the recording / playback operation is performed (step S45). At this time, the user may be prompted to start recording / playback.

  At the time after the content position where the recording / reproduction is started, the enhancement layer has not been acquired. Therefore, the recording / reproduction is waited by pausing at this position (steps S46 and S47). When it is confirmed that the enhancement layer has been acquired, the enhancement layer is synchronized with the playback position of the base layer (step S48). Next, when there is a recording / reproduction restart process (step S49), high-quality recording / reproduction is started by the base layer and the extension layer (step S50). In step S42, as shown in FIG. 10, it is also possible to have means for notifying the user that the acquisition of the enhancement layer has failed and the recording / playback operation with the normal image quality is to be performed.

  In this way, in the extended transmission method, when acquisition of the enhancement layer temporarily fails, when the acquisition of the enhancement layer is resumed later by recording and recording the base layer internally, the user can High quality playback can be carried out from the continuation. This is a new effect of the present embodiment.

  By acquiring an enhancement layer for improving the image quality of recorded content at a different timing, it is possible to obtain extension information without loss. Then, when the user selects and reproduces the recorded content after the acquisition of the enhancement layer, the user can reproduce with high image quality.

  As in the second embodiment, the recording capacity of the storage medium can be reduced by acquiring only the necessary high-quality enhancement layer at different timings.

  If acquisition of a high-quality extended layer fails during content viewing, the process proceeds to a recording / playback operation and the basic layer is recorded internally. Thereby, when the acquisition of the enhancement layer is resumed, the reproduction can be resumed in synchronization with the recorded base layer. Thereby, the user can reproduce with high image quality from the continuation of his / her viewing.

  In the above embodiment, the extension layer provision period may be limited with respect to the base layer distribution timing in order to reduce the load on the enhancement layer provision server. Further, the distribution of the extension layer may be either wired or wireless.

  Further, the basic layer may be provided free of charge and the extended layer may be provided for a fee. Alternatively, the extension layer may be provided at a charge different from the base layer. Further, only the pay broadcast member registrant may provide the extension layer. As described above, in consideration of the case where there is a condition for receiving the service for providing the enhancement layer, the television apparatus 1 confirms that the user is charged for the delivery of the enhancement layer when the user requests the delivery of the enhancement layer. Display means to display, authentication means for user authentication at the time of demodulation of the extension layer, billing processing means for executing the billing process, and encrypted extension layer so that the reception of the extension layer is possible with consent of a fee It is preferable to provide a decoding means for decoding.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 1 ... Television apparatus (electronic device), 11 ... Input part, 12 ... Signal processing part, 23 ... Video output processing block, 31 ... Audio processing block, 51 ... Main control block, 52 ... CPU, 56 ... Expansion layer recording management part , 67 ... Storage device, 69 ... HDD (storage device), 71 ... Remote control terminal (instruction mechanism), 81 ... Communication unit (short-range wireless communication unit), 201 ... High-definition image restoration unit, 203 ... First signal processing 205, second signal processing unit, 270, first decoder (MPEG-2 decoder), 272, PSI / SI processing unit, 274, up-converter, 276, buffer memory, 290, PSI / SI processing unit, 292: Second decoder (SHVC decoder), 294: Metadata processing unit, 296: High image quality processing unit, 298: Selector

Claims (10)

The first video data having the first resolution is broadcast as the basic video signal, and the second video data having the second resolution higher than the first resolution is reproduced by playing together with the basic video signal. Used in a video signal transmission system in which an extended video signal to be obtained is distributed on a transmission path different from the basic video signal,
A first recording unit for receiving and recording the basic video signal;
A second recording unit for receiving and recording the extended video signal;
A control unit that controls the second recording unit to receive and record the extended video signal at a different timing when the extended video signal cannot be normally acquired by the second recording unit;
In response to an instruction to reproduce the second video data having the second resolution, the extended video signal recorded in the second recording unit is reproduced together with the basic video signal recorded in the first recording unit. An electronic device comprising a playback unit.   The control unit displays a screen for selecting a time zone in which the user acquires the extended video signal, and executes the reception and recording of the extended video signal in a time zone selected by a screen selection operation. The electronic device according to claim 1, wherein the recording unit is controlled.   When a plurality of basic video signals are recorded in the first recording unit, the control unit displays a screen on which a user arbitrarily selects an extended video signal corresponding to each of the plurality of basic video signals. The electronic apparatus according to claim 1, wherein the second recording unit is controlled to execute reception / recording of the extended video signal selected by the screen selection operation.   The control unit displays a screen for setting a timing for acquiring the extended video signal to a timing acquired in conjunction with a user operation or device operation, and receives the extended video signal at a timing selected by a screen selection operation. The electronic apparatus according to claim 1, wherein the second recording unit is controlled to execute recording.   When the extended video signal cannot be normally acquired in a state where the extended video signal is received and reproduced together with the basic video signal when receiving the broadcast of the basic video signal, the control unit 2. The electronic apparatus according to claim 1, wherein the operation proceeds to a recording operation of the basic video signal and the extended video signal by the second recording unit, and the basic video signal and the extended video signal are reproduced together from a time older than a broadcasting time. . The first video data having the first resolution is broadcast as the basic video signal, and the second video data having the second resolution higher than the first resolution is reproduced by playing together with the basic video signal. Used in a video signal transmission system in which an extended video signal to be obtained is distributed on a transmission path different from the basic video signal,
Receiving and recording the basic video signal;
Receiving and recording the extended video signal;
If the extended video signal could not be acquired normally, control to receive and record the extended video signal at another timing,
A signal processing method for an electronic device that reproduces the extended video signal together with the basic video signal in response to an instruction to reproduce the second video data having the second resolution.   The electronic device according to claim 6, wherein a screen for selecting a time zone for acquiring the extended video signal is displayed, and control is performed so as to receive and record the extended video signal in a time zone selected by a screen selection operation. Signal processing method.   When a plurality of the basic video signals are recorded, the user displays a screen for arbitrarily selecting an extended video signal corresponding to each of the plurality of basic video signals, and the extended video signal selected by the screen selection operation 7. The signal processing method for an electronic device according to claim 6, wherein control is performed so as to execute reception and recording of the electronic device.   Displays a screen for setting the timing for acquiring the extended video signal to the timing acquired in conjunction with user operation or device operation, and executes reception / recording of the extended video signal at the timing selected by the screen selection operation The signal processing method for an electronic device according to claim 6, wherein the control is performed as described above.   Recording operation of the basic video signal and the extended video signal when the extended video signal cannot be normally acquired in a state where the extended video signal is received and reproduced together with the broadcast of the basic video signal. 7. The signal processing method for an electronic device according to claim 6, wherein the basic video signal and the extended video signal are reproduced together from a time older than a broadcasting time by shifting to the above.

Images