JP2003219309A - Multichannel video processing unit and method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an inexpensive multichannel video processing unit. <P>SOLUTION: The multichannel video processing unit of the invention includes: a decoding section for sequentially selecting a bit stream from a plurality of bit streams each including encoded data of an image of one channel, decoding the selected bit stream by one frame each, an outputting decoded data; a vertical filtering section for sequentially selecting a channel from a plurality of channels corresponding to the decoded images, performing vertical processing for the decoded data corresponding to the selected channel, and outputting vertically- processed data; a horizontal filtering section for sequentially selecting a channel according to the position at which the image is to be displayed, performing horizontal processing for the vertically-processed data corresponding to the selected channel, and outputting horizontally-processed data; and an output processing section for generating a video signal for display of images of a plurality of channels by synthesizing the horizontally-processed data and outputting the generated signal. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video processing technique for decoding a bit stream having video coded data and generating a video signal for displaying the decoded video. In particular, the present invention relates to a multi-channel video processing technique for handling video of a plurality of channels.

[0002]

2. Description of the Related Art In recent years, satellite digital broadcasting and terrestrial digital broadcasting have become active in various parts of the world. In digital broadcasting, data such as video and audio is compression-encoded by a method such as MPEG (moving picture experts group), and video of a plurality of channels is often distributed and multiplexed.

In a digital broadcast receiver, when a bit stream in which coded data of video of a plurality of channels is multiplexed is received, basically, a video stream and an audio stream of a designated one channel are separated, and these are separated. Is decoded and output.

On the other hand, in some cases, it is necessary to decode coded data of not only a single channel but also a plurality of channels of video and simultaneously display the decoded video. For example, Patent Document 1 discloses a device that uses a plurality of decoders and causes each decoder to decode a bit stream of one channel.

[0005]

[Patent Document 1] JP-A-9-93131

[0006]

As described above, in order to decode coded data of video of a plurality of channels,
Multiple decoders were used. Therefore, there is a problem that it is difficult to reduce the cost required for the decoder.

The present invention provides a low-cost multi-channel video processing device for decoding coded data of multi-channel video and generating a video signal for displaying multi-channel video, and a method thereof. With the goal.

[0008]

In order to solve the above-mentioned problems, the means taken by the invention of claim 1 is, as a multi-channel video processing device, a plurality of bits each having coded data for video of one channel. A decoding unit that outputs the decoded data obtained by sequentially selecting each bit stream from the stream and decoding one frame at a time, and one from a plurality of channels corresponding to the video decoded by the decoding unit Are sequentially selected, and vertical processing is performed on the decoded data corresponding thereto to output the obtained data after the vertical processing, and the vertical filter processing unit according to the position where the video is displayed. To sequentially select one from a plurality of channels and perform horizontal processing on the vertically processed data corresponding to the selected one The horizontal filter processing unit that outputs the obtained data after the horizontal processing and the data after the horizontal processing are combined to generate and output a video signal for displaying the video of a plurality of channels. And an output processing unit for performing the same.

According to the first aspect of the present invention, the encoded data of the video is decoded by one decoder for a plurality of channels, and the size of the video of each channel is adjusted in the vertical and horizontal directions. It can be displayed on a display device.

According to a second aspect of the present invention, in the multi-channel image processing device according to the first aspect, a bit stream in which encoded data of images of a plurality of channels are time-division multiplexed is provided for each channel. The decoding unit further includes a stream separating unit that separates and outputs a plurality of bitstreams having encoded data for video, and the decoding unit receives and processes the bitstreams separated by the stream separating unit.

According to the invention of claim 2, it is possible to process a bit stream in which coded data of video of a plurality of channels is time-division multiplexed.

According to a third aspect of the present invention, in the multi-channel video processing device according to the second aspect, a bit stream having encoded data of video of one channel, and a plurality of stream output from the stream separation unit. The decoder further includes a selector that selects and outputs one of the bitstreams, and the decoding unit receives and processes the bitstream selected by the selector.

According to the third aspect of the present invention, it is possible to simultaneously display a bit stream video in which coded data of a plurality of channels of video is time-division multiplexed and a bit stream video input from the outside.

According to a fourth aspect of the invention, in the multi-channel video processing device according to the first aspect, the decoding unit performs processing on the coded data of one frame for the plurality of channels, and thereafter, The vertical filter processing unit performs processing for the next frame, performs the processing for the decoded data of one field for the plurality of channels, and then performs the processing for the next field. The horizontal filter processing section performs processing on the data after the vertical processing of one line on the channel displayed on the line, and then performs processing on the next line.

According to a fifth aspect of the present invention, in the multi-channel video processing device according to the first aspect, the vertical filter processing section is provided with the next vertical synchronization after the decoding section starts processing for one frame. After the signal, the processing for the frame is started, and the horizontal filter processing unit and the output processing unit are provided after the next vertical blanking period after the vertical filter processing unit starts the processing for the frame. The processing for the frame is started.

According to the invention of claim 6, in the multi-channel video processing device according to claim 1, the order of the channels processed by the vertical filter processing unit is the same as the frame to be processed. It is characterized in that the order is the same as that in the processing by the decoding unit.

According to a seventh aspect of the present invention, in the multi-channel video processing device according to the first aspect, the decoding unit processes one or more slices in the second field of the frame in which the vertical filter processing unit is one. After doing
The processing of the next frame is started.

Further, in the invention of claim 8, in the multi-channel video processing device according to claim 1, the vertical filter processing unit starts processing of one channel, and then the number of the plurality of channels is increased. The processing of the next channel is started after the lapse of the period excluding the interval of the vertical synchronizing signal.

According to a ninth aspect of the present invention, in the multi-channel video processing device according to the first aspect, the vertical filter processing unit starts processing one channel and then changes the number of the plurality of channels. When the period excluding the interval of the vertical synchronizing signal has elapsed, the processing of that channel is ended.

According to the ninth aspect of the present invention, even if the vertical processing is not completed within a predetermined time, it is possible to prevent the processing of other channels from being affected.

According to a tenth aspect of the present invention, in the multi-channel image processing device according to the first aspect, the output processing unit includes an output processing circuit corresponding to each of the channels of the images displayed on the same line. The output processing circuits each store the data after the horizontal processing of the corresponding one of the channels of the video displayed on the line to be processed.

According to the tenth aspect of the present invention, the output processing section may be provided with an output processing circuit corresponding to each channel of the images displayed side by side in the horizontal direction on the screen,
Since it is not necessary to provide for all the channels multiplexed in the bit stream, the hardware can be downsized.

According to the invention of claim 11, claim 10 is provided.
In the multi-channel video processing device described in, the output processing unit combines the outputs of the output processing circuits that store the data of the channels of the video displayed on the line to be processed and outputs the combined output. is there.

According to the twelfth aspect of the present invention, in the multi-channel video processing device according to the first aspect, the vertical filter processing section is configured to perform the decoding when the decoding section stops processing of some channels. The vertical processing is performed in the same channel order as when the vertical filter processing unit processes the frame before the frame in which the unit stops processing of the some channels.

According to the twelfth aspect of the invention, even if the decoding unit stops the processing of some channels, it does not affect the processing of other channels by the vertical filter processing unit. Further, it is possible to perform vertical processing on the video of a frozen channel for which processing by the decoding unit has been stopped to perform scaling.

According to the thirteenth aspect of the present invention, in the multi-channel video processing device according to the first aspect, when the number of channels to be processed is changed, the decoding unit decodes the changed number of channels. Done,
The vertical filter processing unit performs vertical processing on the changed channel number after the next vertical sync signal after the decoding unit starts decoding on the changed channel number, and then performs the horizontal filter processing unit. Is for performing the horizontal processing on the changed channel number after the next vertical blanking period after the vertical filter processing unit starts the vertical processing on the changed channel number.

According to the thirteenth aspect of the present invention, it is not necessary to stop the video output when changing the number of channels to be processed.

According to a fourteenth aspect of the present invention, in the multi-channel video processing device according to the thirteenth aspect, the next field after the vertical filter processing unit starts vertical processing for the changed channel number is It is configured to operate in synchronization with a synchronization signal for displaying an image after changing the number of channels to be processed from the start.

According to the fourteenth aspect of the present invention, when changing the number of channels to be processed, the vertical synchronizing signal is not disturbed, and it is possible to continuously output a video without any disturbance.

Further, in the invention of claim 15, in the multi-channel video processing device according to claim 1, the output processing section generates a video signal for displaying the video of the plurality of channels side by side in the horizontal direction. To do.

According to a sixteenth aspect of the present invention, in the multi-channel video processing device according to the first aspect, the output processing unit generates a video signal for displaying a plurality of screens. At least one of the plurality of screens has a different size from the other screens.

The invention of claim 17 is a multi-channel video processing device, wherein each bit stream is sequentially selected from a plurality of bit streams each having encoded data for video of one channel, and one bit frame is selected at a time. By decoding, the decoded data for the video of a plurality of channels is obtained, and based on the decoded data obtained, a video signal for displaying the video of a plurality of channels is generated and output.

According to the seventeenth aspect of the present invention, the encoded data of the video can be decoded by one decoder for a plurality of channels, and the video of a plurality of channels can be displayed on the display device.

The invention of claim 18 provides a multi-channel video processing method, wherein each bit stream is sequentially selected from a plurality of bit streams each of which has encoded data for video of one channel, and one frame of each is selected. A decoding step of obtaining decoded data by decoding and one of a plurality of channels corresponding to the video decoded in the decoding step are sequentially selected, and the decoded data corresponding to this is subjected to vertical processing. Thus, a vertical filter processing step for obtaining the obtained data after the vertical processing and one of the plurality of channels are sequentially selected according to the position where the video is displayed, and the vertical processing corresponding to the vertical processing is performed. Water is obtained by performing horizontal processing on the data of And filtering step, by combining the data after the horizontal processing, in which an output processing step of generating a video signal for displaying an image of a plurality of channels.

According to the eighteenth aspect of the present invention, the encoded data of the video is decoded for a plurality of channels by using one decoder, and the size of the video of each channel is adjusted in the vertical and horizontal directions. The image may be displayed on the display device.

According to a nineteenth aspect of the present invention, in the multi-channel image processing method according to the eighteenth aspect, a bit stream in which encoded data of images of a plurality of channels are time-division multiplexed is provided for each channel. The method further comprises a stream separating step of separating into a plurality of bit streams having encoded data for video, and the decoding step processes the bit stream separated in the stream separating step.

According to the invention of claim 20, in the multi-channel video processing method according to claim 19, a bit stream having encoded data of video of one channel, and a plurality of streams separated in the stream separation step. Further comprising a selecting step of selecting any one of the bitstreams, the decoding step comprising:
The bitstream selected in the selecting step is processed.

Further, the invention of claim 21 is the multi-channel image processing method according to claim 18, wherein, in the decoding step, after processing the coded data of one frame for the plurality of channels, The process for the next frame is performed, and in the vertical filtering process step, the process for the decoded data of one field is performed for the plurality of channels, and then the process for the next field is performed for the horizontal filtering process step. In this case, the processing for the data after the vertical processing of one line is performed for the channel displayed on that line, and then the processing for the next line is performed.

The invention of claim 22 is the multi-channel image processing method according to claim 18, wherein in the vertical filter processing step, the next vertical synchronization after the processing for one frame is started in the decoding step. After the signal, processing for the frame is started, and in the horizontal filtering step and the output processing step, after the next vertical blanking period after the processing for the frame is started in the vertical filtering step, the frame The process for is started.

The invention according to claim 23 is the multi-channel image processing method according to claim 18, wherein the order of the channels processed in the vertical filter processing step is:
It is characterized in that the order is the same as that in the processing in the decoding step for the same frame as the processing target frame.

The invention of claim 24 is the multi-channel image processing method according to claim 18, wherein in the decoding step, one or more slices in the second field of one frame are processed in the vertical filter processing step. After that, processing of the next frame is started.

The invention according to claim 25 is the multi-channel image processing method according to claim 18, wherein in the vertical filter processing step, the number of the plurality of channels is changed after the processing of one channel is started. The processing of the next channel is started after the lapse of the period excluding the interval of the vertical synchronizing signal.

The invention according to claim 26 is the multi-channel image processing method according to claim 18, wherein in the vertical filter processing step, the number of the plurality of channels is changed after the processing of one channel is started. When the period excluding the interval of the vertical synchronizing signal has elapsed, the processing of that channel is ended.

The invention according to claim 27 is the multi-channel image processing method according to claim 18, wherein in the output processing step, after the horizontal processing corresponding to the channel of the image displayed on the line to be processed. Is to synthesize the data of.

According to a twenty-eighth aspect of the present invention, in the multi-channel video processing method according to the eighteenth aspect, when the processing of some channels is stopped in the decoding step, the decoding is performed in the vertical filter processing step. The vertical direction processing is performed in the same channel order as when the frame before the frame in which the processing of some of the channels is stopped in the step is processed in the vertical filter processing step.

According to a twenty-ninth aspect of the present invention, in the multi-channel video processing method according to the eighteenth aspect, when the number of channels to be processed is changed, the decoding of the changed number of channels is performed in the decoding step. In the vertical filter processing step, after the next vertical synchronizing signal after the decoding of the changed channel number is started in the decoding step, the vertical processing is performed for the changed channel number, and the horizontal filter In the processing step, the horizontal processing is performed on the changed channel number after the next vertical blanking period after the vertical processing is started on the changed channel number in the vertical filtering step.

According to a thirtieth aspect of the invention, in the multi-channel image processing method according to the twenty-ninth aspect, the next field after the vertical direction processing of the changed number of channels in the vertical filter processing step is started. Since then, the processing is performed in synchronization with the synchronization signal for displaying the image after changing the number of channels to be processed.

According to the invention of claim 31, claim 18
In the multi-channel video processing method described in (4), the output processing step is to generate a video signal for displaying the video of the plurality of channels side by side in the horizontal direction.

According to the invention of claim 32, claim 18
In the multi-channel video processing method according to, the output processing step is for generating video signals for displaying a plurality of screens, and among the plurality of screens,
At least one is of a different size than the other screens.

[0050] The thirty-third aspect of the present invention provides a multi-channel image processing method, wherein each bit stream is sequentially selected from a plurality of bit streams each having encoded data for the image of one channel, and one frame at a time. By decoding, the decoded data for the video of a plurality of channels is obtained, and a video signal for displaying the video of a plurality of channels is generated based on the decoded data obtained.

According to the thirty-third aspect of the present invention, the encoded data of the video can be decoded by using one decoder for a plurality of channels, and the video of a plurality of channels can be displayed on the display device.

[0052]

BEST MODE FOR CARRYING OUT THE INVENTION Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) FIG. 1 shows a first embodiment of the present invention.
3 is a block diagram showing an example of a configuration of a multi-channel video processing device according to the embodiment of FIG. The multi-channel video processing device of FIG. 1 includes a digital broadcast reception processing unit 11, a stream separation unit 12, a frame memory 20, a decoding unit 18, and an output processing unit 32. The frame memory 20 includes stream buffers 21, 22, and 23.
And decoding video buffers 26, 27 and 28.

The digital broadcast reception processing section 11 is supplied with a reception signal RS containing information on the multiplexed bit stream. The digital broadcast reception processing unit 11 outputs a bit stream BST obtained by performing channel selection and demodulation from the input reception signal RS to the stream separation unit 12. In this bit stream BST, coded data of video of a plurality of channels is time-division multiplexed. In the following, as an example, it is assumed that coded data of video of three channels is multiplexed in this bit stream BST. Further, it is assumed that the video data of each channel is for the interlace system and the field interval is about 1/60 second.

The stream buffers 21, 22, and 23 are
They correspond to channels 1, 2 and 3, respectively. The stream demultiplexing unit 12 uses the multiplexed bitstream BS.
T is separated into bitstreams for each channel, that is, bitstreams each having encoded data for video of one channel, and output to the corresponding one of the stream buffers 21 to 23. The stream buffers 21 to 23 store the coded data included in the bit stream of the corresponding channel.

The decoding section 18 has only one decoder. The decoding unit 18 has one of three channels
Of the stream buffers 21 to 23 corresponding to the selected channel, the encoded data of the selected channel is read out as a bit stream frame by frame. Decoding video buffer 26, 2
Frame buffers 7 and 28 correspond to channels 1, 2, and 3, respectively. The decoding unit 18
The read encoded data is decoded one frame at a time by one decoder, and the obtained decoded data is
Output to the corresponding one of the decoded video buffers 26 to 28. The decoded video buffers 26 to 28 store the decoded data of the corresponding channels.

The output processing unit 32 reads out the decoded data of a plurality of channels from the decoded video buffers 26 to 28, synthesizes them as needed, and outputs a video signal for displaying the images of a plurality of channels side by side in the horizontal direction. VO is generated and output. The video signal VO is a CRT (cathode-ray tu
be) and the like and is displayed on the display device.

FIG. 2A shows a display example in which the images of channel 1 (CH1) and channel 2 (CH2) are displayed in the upper half of the screen of the display device, and the image of channel 3 (CH3) is displayed in the lower half. FIG. 2 (b) is
It is explanatory drawing which shows the example of a display when the image of channel 1 and channel 3 is displayed on the upper half of the screen of a display apparatus, and the image of channel 2 is displayed on the lower half.

FIG. 3 is a timing chart showing an example of the operation of the decoding unit 18 and the output processing unit 32 of the multi-channel video processing device of FIG. FIG. 3 shows a case where the images of channels 1 and 2 are displayed in the upper half of the screen of the display device and the image of channel 3 is displayed in the lower half of the screen, as shown in FIG.

In FIG. 3, the processing target is, for example, "1".
In the following, in the notation of each process, the first "1", "2" or "3" indicates the channel to be processed, and the next "n", "n +".
1 "and the like indicate the number of the frame to be processed (n is an integer). Also," 1f "or" 2f "at the end indicates that the processing is for the first field and the second field, respectively. For example, “1_n + 1” is “1_n
(N + 1) ”is meant.

In FIG. 3, the decoding unit 18 outputs the bit stream of each channel to the stream buffers 21 to 21.
The decoded data is sequentially read out from 23 and decoded, and the obtained decoded data is stored in the decoded video buffers 26 to 28.
The output processing unit 32 reads the decoded data from the decoded video buffers 26 to 28, and outputs the video signal VO so that the video of each channel is displayed at the desired position on the display screen.

For example, it is assumed that the decoding unit 18 processes the nth frame in the order of channel 1, channel 2 and channel 3. In this case, the decoding unit 1
8 decodes the bit stream of channel 1 for one frame (decoding process “1_n”), and when this process is completed, next decodes the bit stream of channel 2 for one frame (decoding process “2_n”), and this process Is completed, the bit stream of channel 3 is then decoded for one frame (decoding process “3_
n ″). After the next vertical blanking period after the decoding of channel 1 is started, the output processing unit 32 performs output processing so that each channel is displayed as shown in FIG. Generates and outputs the signal VO (output processing “1_n_1f”, “2_n_1f” and “3_n_1”
f ").

As described above, according to the multi-channel video processing device of FIG. 1, the encoded data of the video of a plurality of channels is sequentially decoded by one decoding unit for each channel, and the video of a plurality of channels is converted into one.
It can be displayed on one display device at the same time.

FIG. 4 is a timing chart showing another example of the operations of the decoding unit 18 and the output processing unit 32 of the multi-channel video processing device of FIG. 4 is shown in FIG.
As shown in (b), the case where the images of channels 1 and 3 are displayed in the upper half of the screen of the display device and the image of channel 2 is displayed in the lower half of the screen of the display device is shown.

In the case of FIG. 4, when the decoding processing "3_n" of the channel 3 in the decoding unit 18 has hardly progressed and the processing for one field has not been completed,
The process of outputting the video of channel 3 in the output processing unit 32 has started. Therefore, the image of channel 3 displayed at this time is a composite of the decoded portion of the current frame and the previous frame. Therefore, the image of channel 3 is not displayed normally.

In the multi-channel image processing apparatus of FIG. 1, in order to display the images of channels 1 to 3 normally at any position, before the start of the output process,
That is, the decoding for one frame of three channels must be completed within the period of one field. In other words, the decoding unit is required to have twice the performance as compared with the case where decoding of one frame of the same number of channels is performed within one frame period. That is, the decoding unit needs high decoding performance. Therefore, in the second embodiment, even if the decoding performance is not very high,
A multi-channel image processing device capable of displaying images of channels 1 to 3 normally at any position will be described.

(Second Embodiment) FIG. 5 shows a second embodiment of the present invention.
3 is a block diagram showing an example of a configuration of a multi-channel video processing device according to the embodiment of FIG. The multi-channel video processing device of FIG. 5 includes a stream separation unit 102, stream buffers 104, 105 and 106, and a decoding unit 10.
8 and decoding video buffers 110, 111, 112
A vertical filter processing unit 114, video vertical buffers 116, 117 and 118, and a horizontal filter processing unit 120.
And an output processing unit 122 and a system control unit 124.

The bit stream BST is input to the stream separation unit 102 and the system control unit 124. In the bit stream BST, coded data of video of a plurality of channels is time-division multiplexed. Here, the bit stream BST is assumed to be the same as that described in the first embodiment.

The system control section 124 determines the number of channels multiplexed in the input bit stream BST. The system control unit 124 also controls the enlargement / reduction ratio of the image of each channel and the display position on the screen. The system control unit 124 uses the stream separation unit 10
2. Various controls are performed on the decoding unit 108, the vertical filter processing unit 114, the horizontal filter processing unit 120, and the output processing unit 122.

The stream separation unit 102 separates the input bitstream BST into bitstreams of respective channels, and stream buffers 104, 105, 10
Output to any one of 6. Stream buffer 104,
Reference numerals 105 and 106 respectively correspond to channels 1, 2, and 3, and store the encoded data included in the bit streams of the corresponding channels.

The decoding unit 108 has only one decoder. The decoding unit 108 includes the system control unit 12
In accordance with the instruction of No. 4, one of the three channels is sequentially selected, and the encoded data is read out one frame at a time from the stream buffers 104, 105 and 106 corresponding to the selected channel. Decoding unit 108
Decodes the read encoded data for each frame by one decoder, and outputs the obtained decoded data to any of the decoded video buffers 110, 111, 112. Decoding video buffer 110, 11
1, 112 are frame buffers, which correspond to channels 1, 2, and 3, respectively. The decoded video buffers 110, 111, 112 store the decoded data of the corresponding channels.

The vertical filter processing unit 114 sequentially selects one of the three channels according to the instruction of the system control unit 124, and decodes the decoded video buffers 110, 111 ,.
Decoded data is read from the one corresponding to the selected channel of 112 one field at a time. The vertical filter processing unit 114 performs vertical processing on the read decoded data, that is, vertical enlargement / reduction processing of the screen and vertical filtering processing according to the instructions of the system control unit 124 and the decoding unit 108. The data after the vertical processing is processed by the video vertical buffers
It is output to either 7, 118. The video vertical buffers 116, 117, 118 are frame buffers and correspond to channels 1, 2, 3 respectively. The video vertical buffers 116, 117, 118 store the data after the vertical processing of the corresponding channels.

The horizontal filter processing section 120 sequentially selects one of the three channels as necessary according to the display position of the image of each channel in the screen according to the instruction given by the system control section 124. The horizontal filter processing unit 120 includes the video vertical buffers 116, 117, 11
The data after vertical processing is read line by line from the one corresponding to the selected channel out of eight. The horizontal filter processing unit 120 performs horizontal processing on the read data, that is, horizontal enlargement / reduction processing of the screen and horizontal filter processing, and outputs the obtained data after the horizontal processing to the output processing unit 122. . Output processing unit 122
Performs an output process of synthesizing the data after the horizontal processing, and outputs an output video signal VOUT. Video signal VOU
T is given and displayed on a display device such as a CRT.

FIG. 6 is a block diagram showing an example of the configuration of the output processing unit 122 shown in FIG. In FIG. 6, the output processing unit 122 includes output processing circuits 131, 132, 139 and an image synthesizing unit 142. Output processing circuit 131,
Reference numerals 132 and 139 correspond to respective video channels displayed on the same line in the screen.
The output processing circuits 131, 132, and 139 are respectively the data of the corresponding channels, and the line being displayed,
And store the data of the line to be displayed next. The image synthesizing unit 142 sequentially reads out data from the output processing circuits 131, 132, and 139 and adds them according to the display position of the image of each channel in the screen according to the instruction of the system control unit 124, and outputs the output video signal VOUT. Output.

Since the output processing unit 122 of FIG. 6 includes three output processing circuits 131, 132, and 139, three channels of video are displayed on the same line, that is, three channels. The images can be displayed side by side horizontally on the screen. If it is sufficient to display, for example, two channels of video on the same line, only two output processing circuits may be provided. That is, it is not necessary to provide an output processing circuit corresponding to all the channels multiplexed in the input bit stream BST.

FIG. 7 is a flow chart showing the flow of decoding processing performed by the decoding unit 108 in FIG. First,
In step S11, the decoding unit 108 selects from among the three channels multiplexed in the bitstream BST.
Whether to start decoding the first channel is determined from the timing of the vertical synchronizing signal. If the vertical sync signal is detected, the process proceeds to step S12 to start decoding the first channel, and if the vertical sync signal is not detected, step S11 is executed again. In step S12, the decoding unit 108 receives the designation of the channel to be processed from the system control unit 124.

In step S13, the decoding unit 108
Selects one of the stream buffers 104, 105, 106 that corresponds to the specified channel,
Read the stored encoded data. Decoding unit 108
Decodes the read encoded data for one frame, and the decoded video buffers 110, 111,
The decoded data obtained is stored in the one corresponding to the designated channel out of 112. Decoding section 1
08 decodes the first field and then decodes the second field of the same frame.

In step S14, the decoding unit 108
Determines whether the decoding of all three channels multiplexed in the bit stream BST has been completed. If it is completed, the process proceeds to step S11 to process the next frame, and if it is not completed, step S11 is performed.
Returning to step 12, the unprocessed channel is decoded.

FIG. 8 shows the vertical filter processing unit 114 of FIG.
5 is a flowchart showing a flow of vertical processing performed by First, in step S21, the vertical filter processing unit 114 detects a vertical synchronization signal. If the vertical synchronizing signal is detected, the process proceeds to step S22 to start the processing of the first channel, and if the vertical synchronizing signal is not detected, step S21 is executed again.

In step S22, the vertical filter processing unit 114 receives the designation of the channel to be processed from the system control unit 124. The order in which the channels are specified is
Basically, the order is the same as when the decoding unit 108 performs the processing for the same frame.

In step S23, the vertical filter processor 114 determines the decoded video buffers 110, 111, 11
Of the two, the decoded data is read from the one corresponding to the designated channel. The vertical filter processing unit 114
Performs vertical processing on the read decoded data,
Of the video vertical buffers 116, 117 and 118, the obtained vertical processed data is stored in the one corresponding to the designated channel. In step S23, the vertical filter processing unit 114 performs processing on a slice-by-slice basis.
Proceed to 24. A slice is a strip-shaped area that constitutes a part of the screen of one field.

In step S24, the vertical filter processing section 114 determines whether or not it is within the time that can be used for processing one field of one channel. The time available for processing one field of one channel is the time per field divided by the number of channels of the video multiplexed in the bit stream BST. For example, when the field interval is about 1/60 second and the video of three channels is multiplexed in the bit stream BST, the processing time available for one channel is about 1/180 second. If the time from the start of the processing of the field being processed is within the processing time that can be used for one channel and the processing of this field is not completed, the vertical filter processing unit 114 proceeds to step S
23, the processing of the next slice is performed, and in other cases, the vertical filter processing is terminated and the process proceeds to step S25.

In step S25, the vertical filter processing section 114 determines whether or not the processing for all channels has been completed. If completed, the process proceeds to step S21 to process the next field, and if not completed, returns to step S22 to process an unprocessed channel.

FIG. 9 shows the horizontal filter processing section 120 of FIG.
5 is a flowchart showing a flow of horizontal processing performed by First, in step S31, the horizontal filter processing unit 120 determines whether or not it is a vertical blanking period. If it is in the vertical blanking period, step S31 is executed again. If it is not in the vertical blanking period, the process proceeds to step S32 to start the process of the first channel.

In step S32, the horizontal filter processing section 120 receives the designation of the channel to be processed from the system control section 124. Here, one of the channels displayed on the same line is designated. In step S33, the horizontal filter processing unit 120 reads the vertically-processed data from the video vertical buffers 116, 117, and 118 corresponding to the specified channel. The horizontal filter processing unit 120 performs horizontal processing on the read data, and outputs the obtained data after horizontal processing to the output processing unit 122.

In step S34, the horizontal filter processing section 120 determines whether or not to process another channel. When displaying images of two or more channels on the same line, it is necessary to process all the channels displayed on the line. If another channel is to be processed, the process returns to step S32 to process the unprocessed channel. If no other channel is to be processed, the process proceeds to step S31 to process the next line.

FIG. 10 is a flow chart showing the flow of output processing performed by the output processing unit 122 of FIG. First, in step S41, the output processing unit 122 determines whether or not it is a vertical blanking period. If it is in the vertical blanking period, step S41 is executed again, and if it is not in the vertical blanking period, the process proceeds to step S42.

In step S42, the output processing unit 122
Specifies the channel to be displayed by the system control unit 12
Receive from 4. In step S43, the output processing unit 12
2 displays one line by synthesizing the data of each channel according to the position where the image should be displayed. Then, it progresses to step S41 and the process of the following line is performed.

FIG. 11 is a timing chart for explaining an example of the operation of the multi-channel video processing device shown in FIG. FIG. 11 shows channels 1 and 2 as shown in FIG.
Is displayed in the upper half of the screen, and channel 3 is displayed in the lower half of the screen. In FIG. 11, a period in which the signal waveform indicating the vertical blanking period has a low potential indicates a vertical blanking period.

In FIG. 11, the decoding process "1_n"
Is a process in which the decoding unit 108 reads the encoded data of the n-th frame of channel 1 from the stream buffer 104, decodes the encoded data, and outputs the obtained decoded data to the decoded video buffer 110. The decoding unit 108 starts this process after the vertical synchronization signal.

The decoding process "2_n" is performed by the decoding unit 1
08 reads the encoded data of the n-th frame of channel 2 from the stream buffer 105 and decodes it, and the obtained decoded data is decoded video buffer 11
This is a process of outputting to 1. The decoding unit 108 starts the decoding process “2_n” after the decoding process “1_n” is completed.

The decoding process "3_n" is performed by the decoding unit 1
08 decodes the encoded data of the n-th frame of channel 3 from the stream buffer 106 and decodes the obtained decoded data.
This is the process of outputting to 2. The decoding unit 108 starts the decoding process “3_n” after the decoding process “2_n” is completed.

The decoding section 108 performs the decoding process "1_
In each of n ”,“ 2_n ”, and“ 3_n ”, the first field is processed in the first half and the second field is processed in the second half.
Processing the field.

The vertical processing "1_n_1f" is vertical processing for the first field in the n-th frame of channel 1. In this processing, the vertical filter processing unit 114 reads the decoded data of channel 1 from the decoded video buffer 110, performs vertical processing, and outputs the obtained data after vertical processing to the video vertical buffer 116. Processing. The vertical filter processing unit 114 performs this process on the first vertical synchronization signal after the decoding process “1_n” is started and a period corresponding to one field elapses, for example, after the decoding process “1_n” is started. Start later.

The vertical processing "2_n_1f" is vertical processing for the first field in the n-th frame of channel 2. In this processing, the vertical filter processing unit 114 reads the decoded data of channel 2 from the decoded video buffer 111, performs vertical processing, and outputs the obtained data after vertical processing to the video vertical buffer 117. Processing. As described with reference to FIG. 8, the processing time given to one channel is about 1
/ 180 seconds, the vertical filter processing unit 114
This process is started about 1/180 seconds after the vertical process "1_n_1f" is started.

The vertical processing "3_n_1f" is vertical processing for the first field in the nth frame of channel 3. In this processing, the vertical filter processing unit 114 reads the decoded data of channel 3 from the decoded video buffer 112, performs vertical processing, and outputs the obtained data after vertical processing to the video vertical buffer 118. Processing. The vertical filter processing unit 114 performs this processing in the vertical direction "2_n_1f".
Starts about 1/180 seconds after the start of.

Next, the horizontal processing "1_n" for one line is performed.
_1f "and horizontal processing for one line" 2_n_1f "
Are alternately performed, and after the processing for one field for channels 1 and 2 is completed, the horizontal processing “3_n_
1f ″ is performed so that channels 1 and 2 are displayed in the upper half of the screen and channel 3 is displayed in the lower half of the screen, as shown in FIG.

Horizontal processing "1_n_1f" is horizontal processing for the first field in the n-th frame of channel 1. In this processing, the horizontal filter processing unit 120 reads out the vertically processed data of channel 1 from the video vertical buffer 116, performs the horizontal processing, and outputs the obtained horizontally processed data to the output processing unit 122. This is the process of outputting. The horizontal filter processing unit 120 performs this processing in the vertical direction "1_n_1f".
After the start of, the processing is started after a period corresponding to one field has elapsed, for example, after the first vertical blanking period after the vertical processing "1_n_1f" is started. The horizontal filter processing unit 120 performs horizontal processing for each line according to an instruction from the system control unit 124.

Similarly, the horizontal processing "2_n_1f",
"3_n_1f" is horizontal processing for the first field in the nth frame of channels 2 and 3, respectively. These processes are performed by the horizontal filter processing unit 12
0 reads the data after the vertical processing of channels 2 and 3 from each of the video vertical buffers 117 and 118, performs the horizontal processing, and outputs the obtained data after the horizontal processing to the output processing unit 122. Processing.

The output process "1_n_1f" is an output process for the first field in the nth frame of channel 1. This process is a process in which the output processing unit 122 outputs the data after the horizontal processing of the channel 1 to the screen at an appropriate timing according to the instruction of the system control unit 124.

The output processing unit 122 starts the output processing for a line after the time corresponding to one line after the horizontal filter processing unit 120 starts the processing for the line.

Similarly, output processing "2_n_1f", "3"
_N_1f ″ is an output process for the first field in the n-th frame of channels 2 and 3, respectively. These processes are performed by the output processing unit 122 according to the instruction of the system control unit 124. This is a process of outputting the data after the horizontal processing to the screen at an appropriate timing.

When the vertical filter processing unit 114, the horizontal filter processing unit 120, and the output processing unit 122 complete the processing for the first field, they similarly perform the processing for the second field. The vertical filter processing unit 114 starts the vertical processing "1_n_1f" and then, for example, the vertical processing "1" after a period corresponding to one field has elapsed.
After the first vertical synchronizing signal after the start of "_n_1f", the vertical processing "1_n_2" for the second field is performed.
f "is started.

The same applies to the processing of the (n + 1) th and subsequent frames. The decoding unit 108 starts the decoding process “1_n” and, after a period corresponding to one frame elapses, for example, after the second vertical synchronization signal after starting the decoding process “1_n”, the n + 1 th channel of the channel 1. Processing “1_n + 1” for encoded data of frame
To start.

The decoding unit 108 preferably starts the decoding process “1_n + 1” for the next (n + 1) th frame immediately after the vertical filter processing unit 114 finishes the process for one slice in the vertical processing “1_n_2f”. . Then, the vertical filter processing unit 114
Performs vertical processing "1_n_" using the decoded data of the second field in the n-th frame of channel 1.
It is possible to prevent the decoding unit 108 from overwriting the decoded data with the decoded data of the second field in the (n + 1) th frame of the channel 1 before finishing 2f ″. The maximum can be secured.

Of the three channels, the first half of the decoding process "1_n" of the channel 1 which is processed first (the process for the first field) is completed before the vertical process "1_n_1f" of the channel 1 is started. If you have. The first half of the decoding process “2_n” and the first half of the decoding process “3_n” may be completed before the vertical processes “2_n_1f” and “3_n_1f” are started.

The decoding unit 108, before starting the vertical processing "1_n_1f" of channel 1, namely,
Since it is not necessary to complete the decoding process for the n-th frame for all channels during the interval V of the vertical synchronization signal, the performance of the decoding unit 108 does not need to be very high. For example, in FIG. 11, in the period that can be used to decode the n + 1-th frame of all channels, the vertical processing "3_n + 1" is completed after the processing of one slice is completed in the vertical processing "1_n_2f".
It is just before the end of "_1f" and its length is about 1.
It is 9V.

The vertical filter processing unit 114, if the vertical processing for one field of one channel is not completed within the time V / c (c is the number of channels) after the processing is started, the vertical filter processing unit 114 outputs the time V / c. The process ends when is passed. Therefore, it is possible to prevent the vertical processing of other channels from being affected. In this case, the horizontal filter processing unit 120 reads the data after the vertical processing of the previous frame from the corresponding one of the video vertical buffers 116 to 118 for the portion that cannot be processed.

FIG. 12 is a timing chart for explaining another example of the operation of the multi-channel video processing device shown in FIG. FIG. 12 shows channel 1 as shown in FIG.
3 is displayed in the upper half of the screen and channel 2 is displayed in the lower half of the screen. Figure 2 (a)
2B is that the position where the video of channel 2 is displayed and the position where the video of channel 3 is displayed are opposite. Therefore, in FIG.
The processing of channel 2 and the processing of channel 3 in the horizontal processing and the output processing of FIG. 11 are interchanged. The other points are the same as in the case of FIG. 11, and thus the description thereof will be omitted.

As described above, in the multi-channel video processing device of FIG. 5, the decoding process is completed for all three channels before the output process is started in both cases of FIG. 11 and FIG. Therefore, there is no possibility that the decoding process of some channels will not be in time and the video of one frame before that channel will be displayed. Therefore, it is possible to display, at any position, any of the images of the plurality of channels that are decoded.

As described above, according to the multi-channel video processing device of FIG. 5, the encoded data of the video of a plurality of channels is sequentially decoded by one decoding section for each channel, and the video of a plurality of channels is decoded by one.
It can be simultaneously displayed on any position of one display device.

The multi-channel video processing device shown in FIG.
Since it is sufficient to decode one frame of three channels within a period of one frame, the decoding processing performance does not need to be so high as compared with the multi-channel video processing device of FIG. Since it is not necessary to perform the decoding process at high speed, the hardware of the decoding unit can be downsized.

FIG. 13A is an explanatory diagram showing a display example when the screen of channel 3 is horizontally longer than the screens of other channels. FIG. 13B is an explanatory diagram showing a display example when the screen of channel 1 is vertically longer than the screens of other channels. In this way, the screen size of some channels may be different from the screen size of other channels.

FIG. 14 is a timing chart for explaining an example of the operation of the multi-channel video processing device shown in FIG. 5 when channel 2 is frozen.

The decoding unit 108 performs the same processing as the processing described with reference to FIG. 11 until the processing of the (n-1) th frame is completed. As shown in FIG. 14, in the processing of the nth frame, the decoding unit 108 stops the decoding processing for the channel 2 to be frozen and waits until the decoding processing of the next channel 3 is started. In this case, the vertical filter processing unit 114 does not indicate the order in which the decoding unit 108 processes the nth frame, but the frame before the frame in which the decoding unit 108 stops processing (n−1th frame). Each channel is processed in the same order as in the vertical processing.

That is, the vertical filter processing unit 114
Vertical processing "1_n_1f", "2_n_1f", "3_n_1" without omitting the processing of channel 2
f ″ is performed in order. The vertical filter processing unit 114 reads the data of the frame before freezing from the decoded video buffer 111 when processing the channel 2 being frozen. 120 is
The horizontal processing of channel 2 is not omitted. The same processing is performed for the (n + 1) th and subsequent frames.

As described above, in the multi-channel video processing device of FIG. 5, even if the decoding section stops the processing of some channels and freezes some channels, it does not affect the processing of other channels. Further, since the vertical direction processing, the horizontal direction processing, and the output processing are also performed on the frozen channel image, the vertical and horizontal enlargement / reduction processing and the display position can be changed.

FIG. 15 is a timing chart for explaining an example of the operation of the multi-channel video processing device of FIG. 5 when changing the number of channels to be processed from single-channel processing to multi-channel processing.

In the case of FIG. 15, first, the multi-channel video processing device of FIG. 5 operates based on the synchronization signal of channel 1, and the system control unit 124 causes the decoding unit 108, the vertical filter processing unit 114, and the horizontal filter processing unit 114 to operate. It is assumed that the filter processing unit 120 and the output processing unit 122 are designated with the number of channels to be processed “1”. In addition, this multi-channel video processing device is the N-th (N
Is an integer, and the number of channels to be processed is changed from single-channel processing to multiple-channel processing after processing N = n−1) frames in FIG.

It is assumed that the stream buffer 104 stores channel 1 encoded data. The decoding unit 108 reads the coded data of channel 1 from the stream buffer 104 and performs decoding processing “N” for the Nth frame. The decoding unit 108 stores the obtained decoded data in the decoded video buffer 110.

The vertical filter processing unit 114 receives the decoded video buffer 1 after the next vertical synchronizing signal after starting the decoding process "N" and after the next vertical synchronizing signal.
Decoded data is read from 10 and processed in the vertical direction "N_
1f ”and“ N — 2f ”are performed respectively.The vertical filter processing unit 114 stores the obtained data after the vertical processing in the video vertical buffer 116.

The horizontal filter processing section 120, after the next vertical blanking period after starting the vertical processing "N_1f" and after the next vertical blanking period,
Data after vertical processing is read from the video vertical buffer 116, and horizontal processing “N_1f” and “N_2” is performed.
The horizontal filter processing unit 120 outputs the obtained data after the horizontal processing to the output processing unit 122. The output processing unit 122 generates a video signal based on the input data. Output.

When the decoding process "N" is completed, the system control unit 124 changes the number of channels to be processed,
The number of changed channels “3” is designated in the decoding unit 108. After the second vertical synchronization signal after the decoding process “N” is started, the system control unit 124 causes the decoding unit 108 to perform the decoding process “1_
n ”,“ 2_n ”, and“ 3_n ”are sequentially performed.

When the vertical processing "N_2f" is completed, the system control unit 124 causes the vertical filter processing unit 1 to operate.
The number of changed channels "3" is designated as 14. After the decoding unit 108 starts the decoding process “1_n”, the system control unit 124 causes the vertical filter processing unit 114 to perform vertical processing “1_n_1f”, “2_n_1f”, “ 3_
n_1f ″ is performed in order.

Further, when the horizontal processing "N_2f" is completed, the system control unit 124 causes the horizontal filter processing unit 1 to operate.
The number of channels after change "3" is designated as 20. After the vertical filter processing unit 114 starts the vertical processing “1_n_1f”, the system control unit 124 causes the horizontal filter processing unit 120 to perform the horizontal processing “1_n_1f” of the plurality of channels after the next vertical blanking period. 2_
n_1f ”and“ 3_n_1f ”are performed.

Decoding section 108, vertical filter processing section 1
14 and the horizontal filter processing unit 120 repeat the same processing for the subsequent fields.

The multi-channel video processing device shown in FIG.
After the vertical filter processing unit 114 starts the processing of a plurality of channels, it operates in synchronization with the synchronization signal A until the next field starts and thereafter in synchronization with the synchronization signal B. Here, the synchronization signal A is a single channel (channel 1).
Shows a vertical synchronizing signal and a horizontal synchronizing signal for displaying
3 shows a vertical synchronizing signal and a horizontal synchronizing signal for displaying (3). It is assumed that the sync signal A and the sync signal B are in sync.

The video signal output by the multi-channel video processing apparatus of FIG. 5 for displaying a plurality of channels and the video signal output for displaying a single channel are HDTV (high-definition signals). definition
television) signal and standard signal SDTV
It may be any of the (standard definition television) signals.

As described above, in the multi-channel video processing device of FIG. 5, when changing the number of channels to be processed from single-channel processing to multi-channel processing, it is not necessary to stop the video output and there is no disturbance. Images can be output continuously.

FIG. 16 is a timing chart for explaining an example of the operation of the multi-channel video processing device of FIG. 5 when the number of channels to be processed is changed from the processing of a plurality of channels to the processing of a single channel.

In the case of FIG. 16, first, the multi-channel video processing device of FIG. 5 operates based on the synchronization signals of a plurality of channels, and the system control unit 124 causes the decoding unit 108, the vertical filter processing unit 114, and the horizontal filter processing unit 114 to operate. It is assumed that the filter processing unit 120 and the output processing unit 122 have designated the number of channels to be processed, “3”. In addition, this multi-channel video processing device uses n + of channels 1 to 3
After processing the first frame, the number of channels to be processed is changed from the processing of a plurality of channels to the processing of a single channel. In FIG. 16, N = n + 2.

The decoding unit 108 performs decoding processing "1_n + 1", "2_n +" on the n + 1th frame.
1 "and" 3_n + 1 "are performed in order. The vertical filter processing unit 114 performs vertical processing" 1_n + 1_1f "and the like after the vertical synchronizing signal next to the decoding processing" 1_n + 1 "and after the vertical synchronizing signal next to the decoding processing" 1_n + 1 ". "1_n + 1_
2f "etc. are performed respectively. Horizontal filter processing unit 120
Performs horizontal processing "1_n + 1_1f" etc. and "1_n + 1_2f" etc. after the vertical blanking period next to the vertical processing "1_n + 1_1f" and after the vertical blanking period next to it. The horizontal filter processing unit 120 outputs the obtained data after the horizontal processing to the output processing unit 122, and the output processing unit 122 synthesizes the input data to generate and output a video signal.

When the decoding process "3_n + 1" is completed, the system control unit 124 changes the number of channels to be processed, and designates the changed number of channels "1" to the decoding unit 108. The system control unit 124 causes the decoding unit 108 to perform the decoding process “N” of channel 1 after the second vertical synchronization signal after the decoding process “1_n + 1” is started.

Further, vertical processing "3_n + 1_2f"
When the process ends, the system control unit 124 specifies the changed channel number “1” to the vertical filter processing unit 114. After the decoding unit 108 starts the decoding process “N”, the system control unit 124 causes the vertical filter processing unit 114 to perform the vertical direction processing “N — 1f” of the channel 1 after the next vertical synchronizing signal.

Further, horizontal processing "3_n + 1_2f"
When the process ends, the system control unit 124 specifies the changed channel number “1” to the horizontal filter processing unit 120. The system control unit 124 includes a vertical filter processing unit 11
4 starts the vertical processing "N_1f", and then after the next vertical blanking period, the horizontal filter processing unit 12
0 causes channel 1 horizontal processing "N_1f" to be performed.

Decoding section 108, vertical filter processing section 1
14 and the horizontal filter processing unit 120 repeat the same processing for the subsequent fields.

The multi-channel image processing apparatus shown in FIG.
After the vertical filter processing unit 114 starts the processing of the channel 1, it operates in synchronization with the synchronization signal B until the next field starts and thereafter in synchronization with the synchronization signal A. Here, the synchronization signal A and the synchronization signal B are the same as those described with reference to FIG. 15, and it is assumed that the synchronization signal A and the synchronization signal B are synchronized.

As described above, the multi-channel video processing apparatus of FIG. 5 does not need to stop the video output even when changing the number of channels to be processed from the processing of a plurality of channels to the processing of a single channel, and the disturbance of the disturbance is prevented. It is possible to continuously output images that are not present.

(First Modification of Second Embodiment) FIG.
[Fig. 8] is a block diagram showing an example of a configuration of a multi-channel video processing device according to a first modification of the second embodiment of the present invention. The multi-channel video processing device of FIG. 17 is different from the multi-channel video processing device of FIG. 5 in that it further includes selectors 251, 252, 253.
A system control unit 224 is provided instead of 24. Other components are the same as those described with reference to FIG.

The stream separating unit 102 selects the bit streams of the separated channels from the selectors 251 to 253.
Output to each of. In addition, a bit stream E each having encoded data of video of one channel
B1, EB2, and EB3 are input to the selectors 251 to 253 from the outside of the multi-channel video processing device of FIG. Each of the selectors 251 to 253 selects one of the two input bit streams according to an instruction from the system control unit 224,
Output to the corresponding one of the stream buffers 104 to 106.

In the case of FIG. 17, the selectors 251 and 253 select and output the bit stream output by the stream separation unit 102, and the selector 252 selects and outputs the bit stream EB2 input from the outside. Therefore, it is possible to display a video of a bit stream different from the bit stream BST input to the stream separation unit 102 as a video of channel 2.

As described above, according to the multi-channel video processing device of FIG. 17, the bit stream in which the coded data of the video of a plurality of channels are time-division multiplexed and the bit provided from another device as an external input are provided. Video from any channel can be combined and displayed from the stream.

(Second Modification of Second Embodiment) FIG.
[Fig. 8] is a block diagram showing an example of a configuration of a multi-channel video processing device according to a second modification of the second embodiment of the present invention. The multi-channel video processing device of FIG. 18 includes a memory card reader 362 and a system control unit 324 instead of the stream separation unit 102 and the system control unit 124 in the multi-channel video processing device of FIG. .

Bit streams EB1 and EB3 are input to the stream buffers 104 and 106, respectively, from the outside of the multi-channel video processing apparatus shown in FIG. The memory card reader 362, according to an instruction from the system control unit 324, is a removable memory card 36
The data stored in 4 is read and output to the stream buffer 105 as a bit stream. The memory card 364 is a memory card such as an SD (secure digital) memory card, compact flash (registered trademark), or smart media. The memory card 364 may be incorporated in the multi-channel video processing device shown in FIG.

As described above, according to the multi-channel video processing device of FIG. 18, the data stored in the memory card can be read and displayed together with the video obtained from other bit streams.

In the above embodiments, the video signal output from the multi-channel video processing device is given to a display device such as a CRT for display.
This video signal may be recorded in a VTR or other recorder. Further, this video signal may be given to the computer and displayed on the display of the computer. In this case, for example, images of a plurality of channels may be displayed in one of the windows on the display.

The processing in the above multi-channel video processing device may be performed by software using a CPU.

Further, the stream separation unit, the decoding unit, the vertical filter processing unit, the horizontal filter processing unit, and the output processing unit may include the function of the system control unit.

Further, the multi-channel video processing device and method according to the present invention is a DVD (digital versatil
For example, a bit stream read from a recording medium such as an e disc), a CD (compact disk), and a hard disk can be processed.

[0150]

As described above, according to the present invention, encoded data of video is decoded for a plurality of channels, and signals for displaying video of a plurality of channels are generated.
A multi-channel image processing device and method can be realized. Since decoding of a plurality of channels of video can be performed by one decoder, cost reduction can be achieved. Further, even if the decoding processing performance is not so high, the video of any channel can be displayed at an arbitrary position, so that the cost can be further suppressed.

[Brief description of drawings]

FIG. 1 is a block diagram showing an example of a configuration of a multi-channel video processing device according to a first embodiment of the present invention.

FIG. 2A is a display example in which channel 1 (CH1) and channel 2 (CH2) images are displayed in the upper half of the display screen and channel 3 (CH3) image is displayed in the lower half. It is an explanatory view shown. (B) is an explanatory view showing a display example in which images of channels 1 and 3 are displayed in the upper half of the screen of the display device, and images of channel 2 are displayed in the lower half.

3 is a timing chart showing an example of operations of a decoding unit and an output processing unit of the multi-channel video processing device of FIG.

4 is a timing chart showing another example of the operation of the decoding unit and the output processing unit of the multi-channel video processing device of FIG.

FIG. 5 is a block diagram showing an example of a configuration of a multi-channel video processing device according to a second embodiment of the present invention.

6 is a block diagram showing an example of a configuration of an output processing unit in FIG.

7 is a flowchart showing a flow of a decoding process performed by the decoding unit in FIG.

8 is a flowchart showing a flow of vertical processing performed by a vertical filter processing unit in FIG.

9 is a flowchart showing a flow of horizontal processing performed by the horizontal filter processing unit in FIG.

10 is a flowchart showing a flow of output processing performed by the output processing unit in FIG.

11 is a timing chart explaining an example of the operation of the multi-channel video processing device of FIG.

12 is a timing chart explaining another example of the operation of the multi-channel video processing device of FIG.

FIG. 13A is an explanatory diagram showing a display example when the screen of channel 3 is horizontally longer than the screens of other channels. (B) is an explanatory view showing a display example when the screen of channel 1 is vertically longer than the screens of other channels.

FIG. 14 shows a case where channel 2 is frozen.
6 is a timing chart explaining an example of the operation of the multi-channel video processing device of FIG. 5.

15 is a timing chart illustrating an example of the operation of the multi-channel video processing device in FIG. 5 when changing the number of channels to be processed from single-channel processing to multi-channel processing.

16 is a timing chart illustrating an example of the operation of the multi-channel video processing device of FIG. 5 when the number of channels to be processed is changed from multi-channel processing to single-channel processing.

FIG. 17 is a block diagram showing an example of a configuration of a multi-channel video processing device according to a first modification of the second embodiment of the present invention.

FIG. 18 is a block diagram showing an example of a configuration of a multi-channel video processing device according to a second modification of the second embodiment of the present invention.

[Explanation of symbols]

12, 102 Stream separation unit 21, 22, 23, 104, 105, 106 Stream buffer 18, 108 Decoding unit 26, 27, 28, 110, 111, 112 Decoding video buffer 114 Vertical filter processing unit 116, 117, 118 Video Vertical buffer 120 Horizontal filter processing unit 32, 122 Output processing unit 124, 224, 324 System control unit 131, 132, 139 Output processing circuit

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Toshiaki Tsuji             1006 Kadoma, Kadoma-shi, Osaka Matsushita Electric             Sangyo Co., Ltd. F-term (reference) 5C025 BA14 BA25 BA28 CA02 CA06                       CA10 CA11 DA01 DA10                 5C059 MA00 RB01 SS02 UA05 UA11                       UA32                 5C063 AB03 AC01 CA11 CA23 DA01                       DA13 DB10

Claims (33)

[Claims] 1. Decoded data obtained by sequentially selecting each bitstream from a plurality of bitstreams each having coded data for video of one channel and decoding by one frame is output. By sequentially selecting one from a decoding unit and a plurality of channels corresponding to the video decoded by the decoding unit, and performing vertical processing on the decoded data corresponding thereto,
A vertical filter processing unit that outputs the obtained data after the vertical processing and one of the plurality of channels is sequentially selected according to the position where the image is displayed, and the corresponding data after the vertical processing is selected. By performing the horizontal direction processing on the, by the horizontal filter processing unit that outputs the data after the obtained horizontal direction processing, by combining the data after the horizontal direction processing,
A multi-channel video processing device comprising: an output processing unit that generates and outputs video signals for displaying video of a plurality of channels. 2. The multi-channel video processing device according to claim 1, wherein coded data of video of a plurality of channels is time-division multiplexed, and each bit stream has coded data for video of one channel. A multi-channel video processing device, further comprising: a stream separation unit that separates and outputs a plurality of bit streams, wherein the decoding unit receives and processes the bit streams separated by the stream separation unit. . 3. The multi-channel video processing device according to claim 2, wherein a bit stream having encoded data of video of one channel, and one of a plurality of bit streams output from the stream separation unit. The multi-channel video processing device, further comprising a selector that selects and outputs any one of the above, and the decoding unit receives and processes the bit stream selected by the selector. 4. The multi-channel video processing device according to claim 1, wherein the decoding unit performs processing for the coded data of one frame on the plurality of channels and then performs processing for the next frame. The vertical filter processing unit performs a process for the decoded data of one field on the plurality of channels, and then performs a process for the next field, and the horizontal filter processing unit The multi-channel video processing device is characterized in that, after performing the processing on the data of the line 1 in the vertical direction on the channel displayed on the line, the processing on the next line is performed. 5. The multi-channel video processing device according to claim 1, wherein the vertical filter processing unit for the frame is performed after the next vertical synchronization signal after the decoding unit starts processing for one frame. The horizontal filter processing unit and the output processing unit start processing for the frame after the next vertical blanking period after the vertical filter processing unit starts processing for the frame. A multi-channel video processing device, characterized by being 6. The multi-channel video processing device according to claim 1, wherein the order of channels processed by the vertical filter processing unit is:
A multi-channel video processing device, characterized in that the same order as in the processing by the decoding unit for the same frame as the processing target frame is performed. 7. The multi-channel video processing device according to claim 1, wherein the decoding unit processes one or more slices in a second field of one frame by the vertical filter processing unit, and then the next frame. A multi-channel video processing device, characterized in that it starts the processing of. 8. The multi-channel video processing device according to claim 1, wherein the vertical filter processing unit starts processing of one channel, and then divides an interval of vertical synchronization signals by the number of the plurality of channels. A multi-channel video processing device, characterized in that the processing of the next channel is started after the lapse of the period. 9. The multi-channel video processing device according to claim 1, wherein the vertical filter processing unit starts processing of one channel and then divides an interval of vertical synchronization signals by the number of the plurality of channels. A multi-channel video processing device, characterized in that the processing of the channel is ended when the period has passed. 10. The multi-channel video processing device according to claim 1, wherein the output processing unit includes an output processing circuit corresponding to each of the channels of the video displayed on the same line. The multi-channel video processing device, wherein each processing circuit stores data after the horizontal processing of a corresponding one of the video channels displayed on the line to be processed. 11. The multi-channel video processing device according to claim 10, wherein the output processing unit outputs one of the output processing circuits that stores data of a channel of a video displayed on the line to be processed. A multi-channel video processing device, characterized in that the video is synthesized and output. 12. The multi-channel video processing device according to claim 1, wherein in the vertical filter processing unit, when the decoding unit stops processing of some channels, the decoding unit includes some of the channels. 2. The multi-channel video processing device, wherein the vertical direction processing is performed in the same channel order as when the vertical filter processing unit processed the frame before the frame in which the processing is stopped. 13. The multi-channel video processing device according to claim 1, wherein when changing the number of channels to be processed, the decoding unit decodes the changed number of channels, and the vertical filter processing unit. The decoding unit performs vertical processing on the changed number of channels after the next vertical synchronization signal after the decoding of the changed number of channels is started, and the horizontal filter processing unit includes the vertical filter. A multi-channel image processing device, wherein the processing unit performs horizontal processing for the changed number of channels after the next vertical blanking period after starting the vertical processing for the changed number of channels. 14. The multi-channel video processing device according to claim 13, wherein the vertical filter processing unit performs vertical processing on the changed number of channels from the time when the next field starts after the processing starts. A multi-channel image processing device, which is configured to operate in synchronization with a synchronization signal for displaying an image after changing the number of channels. 15. The multi-channel video processing device according to claim 1, wherein the output processing unit generates a video signal for displaying videos of the plurality of channels side by side in a horizontal direction. And multi-channel video processing device. 16. The multi-channel video processing device according to claim 1, wherein the output processing unit generates a video signal for displaying a plurality of screens, and at least one of the plurality of screens. One is a multi-channel video processing device characterized by having a different size from other screens. 17. From a plurality of bitstreams each having encoded data for video of one channel,
Video for displaying video of multiple channels based on the decoded data obtained by sequentially selecting each bitstream and decoding one frame at a time to obtain decoded data for video of multiple channels. A multi-channel video processing device that generates and outputs signals. 18. From a plurality of bitstreams, each having encoded data for one channel of video,
A decoding step of obtaining decoded data by sequentially selecting each bit stream and decoding one frame at a time, and one of a plurality of channels corresponding to the video decoded in the decoding step are sequentially selected, and A vertical filter processing step of obtaining vertical-processed data obtained by performing vertical processing on the corresponding decoded data, and one of the plurality of channels is sequentially processed according to the position where the image is displayed. By selecting and performing horizontal processing on the vertical processed data corresponding thereto, a horizontal filter processing step of obtaining data after the horizontal processing, and by combining the data after the horizontal processing,
An output processing step of generating video signals for displaying video of a plurality of channels, a multi-channel video processing method. 19. The multi-channel video processing method according to claim 18, wherein coded data of video of a plurality of channels is time-division multiplexed, and each bit stream has coded data for video of one channel. A multi-channel video processing method, further comprising a stream separation step of separating into a plurality of bit streams, wherein the decoding step processes the bit stream separated in the stream separation step. 20. The multi-channel video processing method according to claim 19, wherein a bit stream having encoded data of video of one channel and one of a plurality of bit streams separated by the stream separation step. A multi-channel video processing method, further comprising a selection step of selecting any one of the above, wherein the decoding step processes the bit stream selected in the selection step. 21. The multi-channel video processing method according to claim 18, wherein in the decoding step, after processing the coded data of one frame for the plurality of channels, processing for the next frame is performed. In the vertical filtering step, after processing the decoded data of one field for the plurality of channels, processing for the next field is performed, and in the horizontal filtering step, A multi-channel image processing method, comprising: performing processing on data after vertical processing on a channel displayed on that line, and then performing processing on the next line. 22. The multi-channel video processing method according to claim 18, wherein, in the vertical filter processing step, the vertical synchronization signal for the frame is received after the next vertical synchronization signal after the processing for one frame is started in the decoding step. Starting the processing, in the horizontal filtering step and the output processing step, after the next vertical blanking period after starting the processing for the frame in the vertical filtering step,
A multi-channel image processing method, comprising: starting processing for the frame. 23. The multi-channel image processing method according to claim 18, wherein the order of the channels processed in the vertical filter processing step is the same as that of a frame to be processed in the decoding step. A multi-channel video processing method, which is in the same order as. 24. The multi-channel video processing method according to claim 18, wherein, in the decoding step, after processing one or more slices in the second field of one frame in the vertical filtering step, the subsequent frame is processed. A multi-channel video processing method, characterized in that the processing of (1) is started. 25. The multi-channel image processing method according to claim 18, wherein, in the vertical filtering step, after processing of one channel is started, a vertical synchronization signal interval is divided by the number of the plurality of channels. A multi-channel video processing method, characterized in that the processing of the next channel is started after the lapse of the period. 26. The multi-channel image processing method according to claim 18, wherein, in the vertical filtering step, after processing of one channel is started, an interval of vertical synchronization signals is divided by the number of the plurality of channels. A multi-channel video processing method, characterized in that the processing of the channel is terminated when the period has passed. 27. The multi-channel image processing method according to claim 18, wherein in the output processing step, the processed data in the horizontal direction corresponding to a channel of an image displayed on a line to be processed is combined. Characteristic multi-channel video processing method. 28. The multi-channel video processing method according to claim 18, wherein in the decoding step, processing of some channels is stopped, in the vertical filter processing step, some channels are processed in the decoding step. 2. The multi-channel video processing method, wherein the vertical direction processing is performed in the same channel order as in the case of processing the frame before the frame in which the processing is stopped in the vertical filter processing step. 29. The multi-channel video processing method according to claim 18, wherein when the number of channels to be processed is changed, the decoding step performs decoding with the changed number of channels, and the vertical filter processing step Then, in the decoding step, after the next vertical synchronizing signal after the decoding for the changed channel number is started, the vertical direction processing for the changed channel number is performed, and in the horizontal filter processing step, the vertical filter A multi-channel image processing method, wherein horizontal processing is performed on the changed number of channels after the next vertical blanking period after the vertical processing on the changed number of channels is started in the processing step. 30. The multi-channel video processing method according to claim 29, wherein a channel to be processed is started from the time when the next field after the vertical processing of the changed number of channels in the vertical filtering step is started. A multi-channel video processing method, characterized in that processing is performed in synchronization with a sync signal for displaying a video after changing the number. 31. The multi-channel video processing method according to claim 18, wherein the output processing step generates a video signal for displaying videos of the plurality of channels side by side in a horizontal direction. And multi-channel video processing method. 32. The multi-channel video processing method according to claim 18, wherein said output processing step generates a video signal for displaying a plurality of screens, and at least one of said plurality of screens. One is a multi-channel video processing method, which is of a different size from other screens. 33. From a plurality of bitstreams, each having encoded data for one channel of video,
Video for displaying video of multiple channels based on the decoded data obtained by sequentially selecting each bitstream and decoding one frame at a time to obtain decoded data for video of multiple channels. A multi-channel video processing method for generating a signal.