JP2010016521A - Video image processing apparatus and video image processing method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video image processing apparatus, which allows the same zapping viewing as real-time viewing while reducing the throughput for viewing and recording, and to provide a video image processing method. <P>SOLUTION: The video image processing apparatus includes: a video image combining means which acquires a plurality of video images and combines them so that they are laid out within one video image without overlapping; and a video image reproducing means which records the combined combination video image and can extract and reproduce one of combined video images from the recorded combination video image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to multi-channel video information processing, and more particularly to multi-channel video recording and playback processing.

  For example, in television broadcasting with video distribution, broadcast waves of a plurality of channels can be received depending on the region. The user can view the video information modulated into the broadcast wave, that is, the program by selecting the channel.

  Normally, a single tuner and a storage device that records a series of video streams, such as an HDD (Hard Disk Drive), can be used to view or record a single program. In order to record as being broadcast on the channel, it is necessary to have the number of facilities for viewing or recording in parallel. For multi-program recording, as long as the writing speed of the HDD allows, it may be possible to record simultaneously on one HDD, but in order to allow zapping as in normal TV viewing, more programs must be recorded simultaneously. I must.

  However, if the number of programs being broadcast at the same time is reached, advanced processing capability is required, and it is not practical from the viewpoint of product cost.

As a simultaneous recording method, there has been proposed a method of recording a plurality of programs using a multi-angle function of a DVD (Digital Versatile Disk) standard (see Patent Document 1).
JP 2007-505586 A

  When viewing and recording a plurality of television programs broadcast at the same time, the apparatus is required to have a high processing capability. In the method proposed in Patent Document 1, there is a problem that the original function is limited in addition to viewing and recording according to the DVD standard.

  The present invention has been made in view of the above problems, and an object thereof is to provide a video processing apparatus and a video processing method that enable zapping viewing similar to that during real-time viewing while suppressing the processing amount for viewing and recording. To do.

With the video processing apparatus according to the present invention,
A plurality of video acquisition means, video synthesis means for outputting a composite video synthesized so that each of the videos acquired by the video acquisition means does not overlap each other, and reads the composite video A video processing apparatus comprising: storage means for storing data; and video playback means capable of extracting and playing back the video acquired by one of the video acquisition means from the recorded composite video. Is provided.

Also. An image processing method according to the present invention includes:
A video processing method for recording and playing back a plurality of videos, acquiring a plurality of videos, and generating a synthesized image so that the acquired plurality of videos are arranged in one screen without overlapping each other. The composite video is stored in a storage device so as to be readable, and one video generated from the plurality of videos is extracted from the composite video, and the extracted video is reproduced.

It is possible to provide a video processing apparatus that enables zapping viewing similar to that during real-time viewing while suppressing the processing amount for viewing and recording.

  FIG. 1 is a diagram illustrating an example of a video processing system according to the present embodiment. FIG. 1 shows a television 100, an antenna 101, and a remote controller 102.

  The television 100 has a function of playing back a video stream of a program that is received and distributed through a television broadcast wave on a display provided in the television 100. In addition, the television 100 has an HDD, and has a function of recording received program information and reading the recorded program information from the HDD and playing it on a display for viewing.

  The antenna 101 receives a television broadcast wave and supplies it to the television 100.

  The remote control 102 has a function of operating the television 100 from a remote location. The television 100 receives a command transmitted from the remote controller 102 and executes a process predetermined for the command.

  Although FIG. 1 assumes a TV set having a program viewing function, a PC (Personal Computer) with a tuner or a video recorder may be used.

  FIG. 2 is a diagram illustrating an example of a block configuration diagram according to the present embodiment. 2 shows a video receiving unit 200, a tuner unit 201, a demodulating unit 202, a DEMUX unit 203, a decoder unit 204, an HDD 205, a memory 206, an encoder unit 207, an internal bus 208, a display control unit 209, and a display unit 210. ing.

  The digital tuner 200 has a function of extracting broadcast waves from a specific broadcasting station from radio waves input from the antenna 101 and generating program information including video images and audio images. One digital tuner 200 is assigned to one program, and N digital tuners 200 are configured to view and record N programs in real time.

  The tuner unit 201 has a function of extracting a specific frequency from the input signal and outputting it as an analog signal.

  The demodulation unit 202 has a function of receiving the analog signal extracted by the tuner unit 201 and outputting digitized program information. In the present embodiment, it is assumed that program information distributed by broadcast waves is digitized.

  The DEMUX unit 203 has a function of separating video information from the digitized stream output from the demodulation unit 202. This stream can send a plurality of data in a time division manner, and includes, for example, digitized video data, audio data, program guide data, and other additional data. The DEMUX unit 203 can output these data separately.

  The decoder unit 204 has a function of decoding digitized stream data into a reproducible video image and audio image. In the case of digital broadcasting, since compression encoding such as MPEG is performed for the purpose of reducing the amount of data to be transmitted, decoding processing is necessary for viewing.

  The HDD 205 is, for example, a magnetic disk device, and refers to a large-capacity storage device that can record and read digital data. In this embodiment, it is mainly used for storing video data and audio data.

  The memory 206 is, for example, a RAM (Random Access Memory) composed of a semiconductor memory. It is used to temporarily store work areas and various table information required in various processes.

  The encoder unit 207 has a function of receiving a video image and an audio image and outputting encoded video data and audio data. In this function, when the program information output from the digital tuner 200 is recorded in the HDD 205, if the reproducible image output from the digital tuner 200 is recorded as it is, the amount of data becomes enormous and only a short time recording is possible. Therefore, data obtained by compressing and encoding data by the encoder unit 207 is recorded.

  The internal bus 208 is a bus mechanism that connects various components in the television 100 and enables information exchange.

  The display control unit 209 has a function of arranging display of video images output from the digital tuner 200 in a predetermined layout and outputting display data. In addition, the video image is decoded from the compression-encoded video data and has a function of selectively displaying only a predetermined display area.

  The display unit 210 has a function of displaying the video image generated by the display control unit 209 so that it can be viewed by the user. For example, an LCD (Liquid Crystal Display) or a CRT (Cathode Ray Tube) can be used.

  FIG. 3 is a diagram illustrating an example of a functional block diagram according to the present embodiment. FIG. 3 shows a plurality of digital tuners 200, HDD 205, program information database 300, user preference database 301, layout generation engine 302, layout time table 303, and video composition engine 304.

  The program information database 300 stores information on channels and broadcast programs. Each program includes a start time, an end time, and a title for each broadcasting station, and also includes attribute information such as a program genre and performers as necessary.

The user preference database 301 is a database of user preferences for programs, and the programs that the user wants to watch are set to have higher weights. For example, the weight is set based on attributes such as a program title, performer, genre, or program viewing frequency that matches a keyword set by the user, and a tendency of the program that the user reserves to record the program. In the present embodiment, the program information database 300 and the user preference database 301 are stored in the HDD 205.

  The layout generation engine 302 generates layout time table 303 by determining layout information indicating which multiple programs are displayed at which positions on the screen and in what size each time. Information about programs broadcast every hour is acquired from the program information database 300. Further, the size for displaying the program is determined based on the weight set in the user preference database 301.

  The layout time table 303 records layout information generated by the layout generation engine 302 every hour.

  The video composition engine 304 has a function of synthesizing video images output from the plurality of digital tuners 200 according to the layout information recorded in the layout time table 303. The synthesized video image is recorded in the HDD 205 together with the layout information used for the synthesis process as the image or as video data compressed and encoded by the encoder unit 207.

  At this time, for example, if a program with a strong user preference is configured so that a larger size is allocated in the screen, a program with a higher preference can be viewed and recorded with a larger quality, that is, with a higher quality video.

  FIG. 4 is a diagram illustrating an example of video composition according to the present embodiment. A video image of the program 400 output from each digital tuner 200 is synthesized by the video synthesis engine 304 to create a multi-channel video 401. Although the video images of the programs A to D decoded by the digital tuner 200 can be obtained with the same image quality, they are reduced or enlarged based on the layout information recorded in the layout time table 303 so that the respective video images do not overlap. Composite at the specified position. At this time, if the video images of the programs are largely combined according to the weights recorded in the user preference database 301, the multi-channel image with less influence of image degradation due to the reduction of the image image is displayed for the program that the user wants to watch. The image 401 can be left.

  The resolution of the multi-channel video 401 may be a resolution defined by the standard, for example, a full HD resolution, but a higher resolution than that may be adopted. The higher the resolution of the multi-channel video 401 after the video synthesis, the more the video image of each program can be synthesized with high quality because image degradation due to image reduction can be avoided.

  The video image of the combined multi-channel video 401 is compressed and encoded by the encoder unit 207 and recorded in the HDD 205 in preparation for later playback.

  With the recording method of the present embodiment, the recording capacity can be kept constant even when recording a plurality of programs broadcast at the same time.

  FIG. 5 is a diagram showing an example of the layout time table 303 according to the present embodiment. The layout time table 303 is generated on the memory 206 by the layout generation engine 302. The table is a time table in which the vertical axis indicates the time zone and the horizontal axis describes the coordinates and size for synthesizing the video image of the program broadcast in each time zone for each received channel. In this embodiment, the numerical values in each frame indicate the start coordinates of the image to be synthesized in the upper stage, and the size in the XY direction of the image in the lower stage. It can be seen that the range of images represented by these notifications is specified so that there is no overlapping part as far as the time zone is concerned.

  FIG. 6 is a diagram illustrating an example of viewing one program according to the present embodiment. The multi-channel video 401 recorded in the HDD 205 can be recognized as a video image of an individual program based on numerical information in the layout time table 303 used when synthesizing the video recorded in the HDD 205. FIG. 6 shows how video images of program B and program C are extracted. In other words, if it is known that what size and what size program is combined in which range of the multi-channel video 401, a video image for each program can be acquired from one video image.

The user may view the multi-channel video 401 as it is, or can view a specific program on the full screen. When a specific program is viewed on the full screen, the amount of information is reduced when the video composition engine 304 synthesizes the video, and the information deteriorates. When this is enlarged and displayed on the entire screen, it cannot be denied that it is inferior to the image quality of the actually broadcast video image. Preferably, it is desirable to improve the deteriorated image quality by performing super-resolution processing in the decoding processing of the display control unit 209. The super-resolution processing here refers to an image processing technique that complements deterioration of a video image enlarged based on an input video image.

  By performing appropriate super-resolution processing, it is possible to bring a video image deteriorated at the time of video composition close to an image quality close to that before composition.

  FIG. 7 is a diagram showing an example of a video recording processing flowchart according to the present embodiment.

First, the digital tuner unit 200 separates and acquires program information included in the received broadcast wave. It is determined whether or not program information newer than the program information acquired up to now is included (step S01). Here, an embodiment in which program information is simultaneously broadcast on broadcast waves is shown. Although not shown, it may be obtained from the program information distribution server via the Internet.

  When new program information is included (Yes), it is stored in the program information database 300 and the layout time engine 303 is updated by the layout generation engine 302 (step S02). If there is no new program information (No), the layout time table 303 is not updated.

Next, the current time is acquired by the clock function built in the television 100 (step S03).
By obtaining the current time, the time zone of the layout time table 303 is determined, and the layout of each channel can be uniquely acquired (step S04).

  Whether or not to update the screen layout is determined based on whether or not the layout obtained in step S04 is the same as the layout used in the current multi-channel image 401 (step S05). If it is determined that the screen layout needs to be updated (Yes), the position and size for decoding and displaying the image data are changed for each program indicated by the channel (step S06). If there is no need to change the screen layout (No), the current screen layout remains unchanged.

  Next, each program is decoded by the decoder unit 204 of each digital tuner 200 (step S07).

  Next, the video composition engine 304 synthesizes the multi-channel screen 401 according to the screen layout acquired from the layout time table 303, and compresses and encodes it by the encoder unit 207 (step S08).

  The encoded and encoded multi-channel image 401 is recorded and stored in the HDD 205 together with the information of the screen layout from which the encoded multi-channel image 401 is generated (step S09).

  By this series of image recording processes, programs of a plurality of broadcasting stations broadcast in the same time zone can be recorded and stored as a multi-channel image 401. Further, the size of each program image is stored in a higher quality as the program is preferred by the screen layout generated according to the weight of the user preference database 301.

  FIG. 8 is a diagram showing an example of a video reproduction processing flowchart according to the present embodiment.

First, the multi-channel video 401 recorded and stored in the HDD 205 is read (step S10), and if it is compressed and encoded, it is decoded into a video image by the display control unit 209 (step S11).

  The decoded video image is displayed to the user by the display unit 210 (step S12).

  At this time, it is determined whether or not the specific program is being enlarged and displayed on the entire screen (step S13).

  When the enlarged display is not being performed (No), it is determined whether or not the channel button for instructing channel switching of the remote controller 102 has been pressed (step S14). If the channel button has not been pressed (No), it is determined whether or not the multi-channel button for displaying a plurality of screens has been pressed (step S15).

  If the channel button has been pressed (Yes) or if the multi-channel button has not been pressed (No), the time zone of the layout time table 303 indicated by the current time is specified and acquired (step S16), and the screen layout is updated. It is determined whether or not it is necessary (step S17). When the screen layout needs to be updated (Yes), the program area of the corresponding channel instructed by pressing the channel button is enlarged and displayed on the entire screen (step S18). If the layout update itself is unnecessary (No), a series of flows is terminated without doing anything.

  If a multi-channel image is being displayed in step S13 (Yes), it is determined whether or not the channel button on the remote controller 102 has been pressed. If it is not pressed (No), the series of processing is terminated. If the channel button has been pressed (Yes), the processing after step S16 is performed.

  In step S15, if the multichannel button for displaying the multichannel image 401 as it is on the display unit 210 is not pressed (No), the processing is the same as the processing in and after step S16. If the multi-channel button has been pressed (Yes), the enlarged display of the specific program is terminated (step S20). From the next time, the multi-channel image 401 is displayed on the display unit 210 as an image.

  The video processing apparatus according to the present embodiment provides a video processing apparatus and a video processing method that enable zapping viewing similar to that during real-time viewing while suppressing the processing amount for viewing and recording even when switching between programs. be able to.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

It is a figure which shows an example of the video processing system concerning this embodiment. It is a figure which shows an example of the block block diagram concerning this embodiment. It is a figure which shows an example of the functional block diagram concerning this embodiment. It is a figure which shows an example of the image | video synthesis | combination concerning this embodiment. It is a figure which shows an example of the layout time table concerning this embodiment. It is a figure which shows an example of 1 program viewing concerning this embodiment. It is a figure which shows an example of the video recording processing flowchart concerning this embodiment. It is a figure which shows an example of the video reproduction processing flowchart concerning this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Television, 101 ... Antenna, 102 ... Remote control, 200 ... Digital tuner, 201 ... Tuner part, 202 ... Demodulation part, 203 ... DEMUX part, 204 ... Decoder unit, 205 ... HDD, 206 ... Memory, 207 ... Encoder unit, 208 ... Internal bus, 209 ... Display control unit, 210 ... Display unit, 300 ... Program information Database, 301 ... User preference database, 302 ... Layout generation engine, 303 ... Layout time table, 304 ... Video composition engine, 400 ... Program, 401 ... Multi-channel image

Claims (8)

A plurality of video acquisition means;
Video synthesizing means for outputting a synthesized video synthesized so that each of the videos obtained by the video obtaining means does not overlap and is arranged in one image;
Storage means for storing the composite video in a readable manner;
A video processing apparatus comprising: a video playback unit capable of extracting and playing back the video acquired by one of the video acquisition units from the recorded composite video.   2. The video processing according to claim 1, wherein the video synthesizing unit synthesizes the video acquired by the video unit so that the sizes of the video are different based on a preset priority. 3. apparatus.   The video processing apparatus according to claim 2, wherein the priority is set based on an attribute of the video.   2. The video processing apparatus according to claim 1, wherein, when playing back the extracted video, the video playback means expands the video to the entire playback image and plays back the video. A video processing method for recording and reproducing a plurality of videos,
Acquire multiple videos,
Generate a composite image that is synthesized so that each of the acquired videos does not overlap and is placed in one screen,
The composite video is stored in a storage device so as to be readable,
Extracting one video generated from the plurality of videos from the synthesized video;
A video processing method characterized by reproducing the extracted video.   6. The video processing method according to claim 5, wherein when the composite image is generated, the video images are synthesized so that the sizes of the video images are different based on a priority set in advance for each of the video images.   The video processing apparatus according to claim 6, wherein the priority is set based on an attribute of the video.   6. The video processing method according to claim 5, wherein when the extracted video is played, the video is enlarged and played back on the entire playback image.

Images