JP4367970B2 - Receiver - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
This invention relates to a suitable receiving device and applied to a broadcasting system. Specifically, it is possible to send omnidirectional video information as image information, and by selecting additional information transmitted simultaneously on the receiving side, it is possible to freely select a video at an arbitrary imaging angle or an omnidirectional panning video. Thus, it is possible to view an omnidirectional video.
[0002]
[Prior art]
With the development of digital technology, an interactive integrated digital broadcasting system (referred to as an ISDB (Integrated Services Digital Broadcasting) system) in which various kinds of information including broadcast signals are digitized is being researched and developed.
[0003]
More specifically, the ISDB system is used for not only current broadcast signals (standard television signals, high-definition signals), but also software and facsimile data, as well as multimedia information such as voice, text, graphics, and images. It is a broadcasting system in which each is digitized (encoded), integrated and multiplexed, and then subjected to modulation processing matching the transmission form to be transmitted and received.
[0004]
When various types of information including broadcast signals are integrated and multiplexed, in addition to these pieces of information, additional information used as control information on the receiving side can also be integrated and multiplexed at the same time. The integrated ISDB broadcast signal (digital signal) is transmitted using ground waves, satellite waves, optical cables, or the like.
[0005]
On the receiving terminal side, it is possible to receive the integrated ISDB broadcast signal, discriminate the target signal, display it on the monitor and enjoy it as a normal television broadcast. (Save) or transfer to another terminal. Further, if the received additional information is used, the received information can be used according to the user's preference, such as monitor control, recording control, and processing control on the monitored image. That is, an interactive broadcasting system can be constructed.
[0006]
[Problems to be solved by the invention]
Therefore, if this ISDB system is used, the service content for the user improves as the additional information to be transmitted becomes more diverse, and a more interactive broadcasting system can be constructed.
[0007]
Now, in the current broadcasting system, only the video captured from one camera angle is viewed, but there are cases where it is desired to view a panoramic video captured by rotating the imaging camera 360 °. For example, in a natural travel program, such as a program on the theme of a prairie like Africa or Mongolia, or when shooting a view from the top of a mountain, you may be asked to enjoy 360 ° video. . In order to do so, it is necessary to simultaneously send out images captured by a plurality of imaging cameras using a plurality of channels, and the current broadcasting system cannot meet the demand. This is because it is a passive and unilateral system.
[0008]
If you can use multiple channels to send video from each camera angle at the same time and the viewer can select any video from them, you can fully enjoy the video at the desired angle and pan the 360 ° panoramic video It can be enjoyed as a video, and viewers can create videos with the same realism as the interview site.
[0009]
Therefore, the present invention is made to achieve such a problem, and sends out omnidirectional video information as one of the image information, while the viewer side selects the video to obtain panning video or the like. It proposes a receiving apparatus that can enjoy the omnidirectional image.
[0012]
[Means for Solving the Problems]
In the receiving apparatus according to the first aspect of the present invention, a plurality of codes obtained by encoding a plurality of pieces of video information corresponding to different angular ranges of the omnidirectional video information having an imaging range of 0 ° to 360 °. An apparatus for receiving a broadcast signal transmitted by multiplexing multiplexed information and encoded additional information obtained by encoding additional information having a plurality of pieces of identification information for identifying each of a plurality of video information, Channel selection means for receiving and selecting a broadcast signal; signal separation means for separating the specific broadcast signal selected by the channel selection means into at least a plurality of encoded information and encoded additional information; and A plurality of decoding means for decoding a plurality of pieces of encoded information and outputting a plurality of pieces of video information each corresponding to a different angular range of the omnidirectional video information having an imaging range of 0 ° to 360 °; Decode encoded additional information Additional information decoding means for outputting additional information having a plurality of pieces of identification information for identifying a plurality of pieces of video information, and referring to the additional information output by the additional information decoding means, and according to an input control signal Control means for selectively outputting the plurality of video information to a television monitor, wherein the plurality of decoding means decode at least the first encoded information to First decoding means for outputting first video information corresponding to the first angular range; and second corresponding to the second angular range of the omnidirectional video information by decoding the second encoded information. Second decoding means for outputting the video information, and third decoding for decoding the third encoded information and outputting the third video information corresponding to the third angular range of the omnidirectional video information And the additional information decoding means includes the encoding Decoding the additional information and outputting the additional information having the first, second, and third identification information for identifying at least the first, second, and third video information; , Referring to the additional information having the first, the second, and the third identification information, and according to the input control signal, the first, the second, and the third video information. Is selectively output to the television monitor, and at least the menu screens corresponding to the first, second, and third identification information are output to the television monitor, and further panning is performed. A menu screen indicating the mode is controlled to be output to the television monitor, and a selection signal for selecting at least one of the first, second, and third identification information is input from the outside. When the above memory The video information corresponding to the one identification information temporarily stored in the stage is controlled to be output to the television monitor, and when the selection signal for selecting the panning mode is input from the outside, the memory means Control is performed so that at least the first, second, and third video information stored temporarily is read and output to the television monitor so that the reading position is gradually shifted in the horizontal direction. .
[0014]
In the receiving device according to the second aspect of the present invention, in the first, second, and third video information, angular ranges adjacent to each other in that order are imaged by a camera having the same imaging angle. Ru video information der.
4. The receiving apparatus according to claim 3 , wherein at least the first, second, and third video information decoded by the first, second, and third decoding means. Memory means for temporarily storing the at least first, second and third video images temporarily stored in the memory means in response to an input control signal. that controls so that the information selectively output to the television monitor.
In the receiving apparatus according to the invention described 請 Motomeko 4, Ru provided with a remote control device for transmitting a control signal for selecting the identification information or the panning mode the one with respect to the control means.
6. The receiving apparatus according to claim 5 , wherein the first decoding means also decodes the first audio signal collected together with the first video information and collected by a directional microphone. The second decoding means also decodes the second audio signal collected together with the second video information and collected by the directional microphone, and the third decoding means The third audio signal collected by the directional microphone encoded with the video information is also decoded, and the control means outputs the audio signal corresponding to the selectively output video information. you control.
In the receiving apparatus according to the invention described in claim 6, the plurality of identification information, Ru identification information der identifying the camera each captured the plurality of video information.
In the receiving apparatus according to the invention described in claim 7, said plurality of identification information, Ru identification information der identifying the imaging angle of the camera that captured the plurality of video information.
[0015]
Since it is possible to recognize from which camera angle the video is taken by an identifier or the like used as additional information, it is possible to select and display a video from a specific camera angle by designating the identifier or the like. If the identifier is selected so that the camera angle is panned from a specific direction, the panned omnidirectional video can be enjoyed.
[0016]
Since the imaging angles are imaged so as to overlap each other, the continuity of the left and right images is not lost, which is suitable for panning images. The sound is switched simultaneously with the switching of the imaging camera, so that the sound suitable for the video can be heard.
[0017]
DETAILED DESCRIPTION OF THE INVENTION
Subsequently, an embodiment of the engagement Ru receiving device according to the present invention will be described in detail with reference to the drawings.
[0018]
FIG. 1 is a system diagram of a main part showing an embodiment of an ISDB transmitting apparatus 10 according to the present invention. In this example, the main information transmitted in an integrated manner is the same as that of a standard television signal. It is assumed that it is a broadcast signal of a multi-channel multiplex program that transmits a program using a plurality of channels. Additional information such as control information is added to each of them for multiplexing. Various kinds of additional information can be considered. For a standard television signal, a time code can be considered.
[0019]
Referring to FIG. 1, the video signal SNV of the standard television signal is supplied to the terminal 12a, and the audio signal SNA associated therewith is supplied to the terminal 12b. The encoding unit 14 performs appropriate encoding processing including compression and the like. Is given. In synchronization with this encoding process, the additional information generating means 16 operates to generate additional information such as control information. In this example, a time code is illustrated as additional information, and thus the time code generating unit 16 is configured. The encoded standard television signal and time code TC are supplied to the multiplexing unit 20 and multiplexed together with other information.
[0020]
Examples of sources include omnidirectional video information in addition to standard television signals. As shown in FIG. 2, the omnidirectional video is an imaging range of the entire range from 0 ° to 360 °. In this example, the 360 ° range is divided into n equal parts. In the example of FIG. 2, it is divided into three equal parts, and a camera angle (imaging angle) is approximately 120 ° angle range. The three equal parts are an example, and it is preferable that n is large.
[0021]
In order to obtain imaging information at each n-divided position, the simplest example is to prepare three imaging cameras. For example, the A camera captures an angular range from 0 ° to 120 ° as shown in FIG. The B camera captures an angular range of 120 ° to 240 ° at the same point. Similarly, the C camera captures an angular range of 240 ° to 360 ° at the same point. As shown in FIG. 3, the camera angle is actually imaged by overlapping between adjacent imaging cameras by a predetermined angular range L (range of 5 ° to 10 °). This is to prevent an area that is not partly imaged from occurring.
[0022]
The divided video materials SA, SB, and SC imaged by the three cameras are subjected to the same encoding process as described above by the encoding units 22A, 22B, and 22C shown in FIG. The divided video materials SA, SB, and SC are composed of audio signals SAA, SBA, and SCA corresponding to the video signals SAV, SBV, and SCB, respectively, and the audio signals collected by a highly directional microphone are used. This is because the audio signal is optimal for the camera angle.
[0023]
Additional information for the plurality of divided video materials SA, SB, and SC is supplied to the terminal 24. This additional information is an identifier (A camera, B camera, C camera, etc.) for identifying each of the imaging cameras A, B, and C, and the camera angle θ of each imaging camera (each imaging with respect to the clockwise direction). Angle range), panning direction, panning speed, etc. Since the overlap angle is uniformly overlapped, the joint of the screen is a half of the corner position. The additional information is supplied to the encoding unit 26 in synchronization with the above-described divided video material and digitized.
[0024]
The encoded information and additional information obtained from each are multiplexed in the multiplexing unit 20 shown in FIG. In the multiplexing unit 20, for example, a process is performed in which each piece of encoded information is packetized and multiplexed for error correction is multiplexed in units of transmission frames to form a bit stream. The types of additional information and main information described above can be inserted into a header (packet header) when packetized or inserted into a non-video period (such as a blanking period).
[0025]
The multiplexed data is modulated by the transmission unit 34 into an ISDB broadcast signal having a transmission form suitable for transmission means (for example, a broadcasting satellite), and in this example, the data is multiplexed by an up-converter 36 and a transmission antenna (parabolic antenna) 38. Sent to the broadcasting satellite.
[0026]
FIG. 4 shows an example of the receiving apparatus 40 according to the present invention for receiving the ISDB broadcast signal as described above.
[0027]
The satellite wave received by the receiving antenna (parabolic antenna) 42 is down-converted to a 1 GHz band by the down converter 44 and then supplied to the ISDB tuner 46 for channel selection processing. Therefore, the ISDB broadcast signal of a specific channel including the character broadcast is selected by the channel selection signal SC from the terminal 48.
[0028]
The selected ISDB broadcast signal is supplied to the signal separation unit 50 and separated into original main information and additional information. For example, when a specific channel of a standard television signal is selected, the standard television signal and additional information (time code or the like) associated with the specific channel are separated.
[0029]
The separated main information is supplied to the decoding unit 52 (52A) to be decoded. Thereafter, the video is supplied to the monitor 56 via the changeover switch 54 and displayed.
[0030]
When the omnidirectional video material described above is handled as the main information and the camera angle is divided into three, at least three more decoding units 52B, 52C, and 52D are required. Of these decoded video materials, the video signal is temporarily stored in the memory means 58 for screen synthesis. In addition to the camera angle image determined by using the memory means 58, an image at an arbitrary camera angle can be displayed on the monitor 56. This point will be described later. As the memory means 58, a fast-access semiconductor memory (RAM or the like) is suitable.
[0031]
Of the decoded video material, an audio signal is supplied to the audio processing unit 60, subjected to audio processing such as separation / synthesis, and output as a single channel audio signal or a synthesized audio signal using a plurality of channels. The The output audio signal and the video signal after the above-described image synthesis are supplied to the changeover switch 54, and switching between the video material from the decoding unit 52A is performed. Therefore, in some cases, the omnidirectional video material is selected and displayed.
[0032]
The additional information separated by the signal separation unit 50 is decoded by a dedicated decoding unit 62 and then supplied to the memory means 58 and the control unit 64. Then, referring to the obtained additional information, the data reading control for the memory means 58 is performed based on the control signal from the control unit 64, and the voice processing control in the voice processing unit 60 is executed. The changeover switch 54 is controlled by the output of the control unit 64.
[0033]
The control unit 64 constituted by a microcomputer generates a control signal for changing the display mode or selecting the monitor contents by remote control from the commander 68. For example, as shown in FIG. 5, the commander 68 is provided with a channel selection numeric keypad (10 key) 72, a channel selection switch 74, and a volume switch 76 in addition to a power switch 70, and a display mode selection switch 78 for the monitor 60. Is provided. The cursor key 80 is a key for moving a cursor K (see FIG. 6) displayed on the screen, and is used for designating an imaging camera.
[0034]
In the memory means 58 described above, the following image processing is performed under the intervention of the control unit 64. However, the processing example is merely an example and is not limited to the presentation example.
[0035]
When a standard television signal or the like is being displayed, the screen display is the same as before, and the decoded output is directly supplied to the changeover switch 54 without passing through the memory means 58.
[0036]
When a multi-channel multiplexed program (omnidirectional display mode) capable of omnidirectional video is selected using the display mode selection switch 78, the menu screen M synthesized and displayed on the screen as shown in FIG. 6 is viewed. Selection of additional information is performed. If an imaging camera is illustrated as additional information, the imaging camera used as shown in FIG. 6 is displayed in the order of camera angles.
[0037]
When, for example, “A” is clicked with the cursor K, the image A ′ (FIG. 3) captured by the A camera is selectively displayed. When the user selects A → B → C, the video A ′ captured by the A camera is switched to the video B ′ of the B camera, and then automatically switched to the video C ′ of the C camera. With this, it is possible to enjoy 360 ° panoramic video with the direction changed by 120 °.
[0038]
Further, when the panning mode P is selected from the menu screen M, the state of reading data from the memory means 58 is controlled, and an omnidirectional panning video is obtained. Here, panning is an imaging technique in which the direction of the camera is rotated horizontally at a constant speed while imaging.
[0039]
When the panning mode P is selected, the horizontal position to be read is gradually shifted in the panning direction so as to switch from the video A ′ of the A camera to the video B ′ of the B camera. This reading operation is continued until the last video data of the video C ′ of the C camera.
[0040]
By reading out such video data, a panoramic video can be enjoyed in a direction of 360 ° from the starting point. Since a predetermined overlap L is provided between adjacent imaging cameras, there is no possibility that there is an area that is not partly imaged during panning. Therefore, a smooth panning image can be obtained even when the image is switched between the images A ′ and B ′ and between the images B ′ and C ′. The overlap section may be subjected to interpolation processing to output data.
[0041]
If the reading direction with respect to the memory means 58 is reversed, a panning image in which the panning direction is reversed can be obtained, so that another way of enjoying is possible. By changing the panning readout speed, it is possible to enjoy an interesting video, and various ways of enjoying it can be developed by the user.
[0042]
Simultaneously with the panning of the video, the audio processing unit 60 is controlled and an audio signal corresponding to the video is output, so that a sound field full of presence can be realized. Therefore, this panning image is particularly effective when it is an image from a grassland, mountain top, coast, shipboard, or airplane. It is also possible to prepare several types of panning templates in advance and configure the software so that the user selects them.
[0043]
【The invention's effect】
As described above, in the engagement Ru receiving device according to the present invention, as one embodiment of a broadcast signal, the omnidirectional image material is sent with the additional information, successively choose the image material, or sequential video material at the receiving end It can be selected and projected.
[0044]
According to this, it is possible to enjoy while switching omnidirectional video for each camera angle, and by devising data reading in the memory means, the panning method can be realized by software. It is possible to display a video when the user turns 360 degrees from the mountain top, the coast, the ship, or the airplane to enjoy the scenery. Accordingly, the present invention has a feature that users can enjoy user-participation-type television broadcasting that has not been obtained so far, and therefore the present invention is extremely suitable for application to an ISDB system for digital broadcasting.
[Brief description of the drawings]
FIG. 1 is a system diagram of an essential part showing an embodiment of an ISDB transmission device according to the present invention.
FIG. 2 is an explanatory diagram of an omnidirectional video.
FIG. 3 is a diagram illustrating a relationship between a camera angle and an imaging range.
FIG. 4 is a system diagram of an essential part showing an embodiment of an ISDB receiver according to the present invention.
FIG. 5 is a configuration diagram illustrating a specific example of a commander.
FIG. 6 is a diagram illustrating a menu display example.
[Explanation of symbols]
10 ISDB Transmitter 14, 22A-22C Encoding Unit 16, Time Code Generation Unit 20 Multiplexing Unit 46 ISDB Tuner 52, 62 Decoding Unit 58 Screen Synthesis Unit 56 Monitor 64 Control Unit

Claims (7)

A plurality of pieces of encoded information obtained by encoding a plurality of pieces of video information corresponding to different angular ranges of the omnidirectional video information having an imaging range of 0 ° to 360 °, and a plurality of pieces for identifying each of the plurality of pieces of video information An apparatus for receiving a broadcast signal that is transmitted by being multiplexed with encoded additional information obtained by encoding additional information having identification information of:
Channel selection means for receiving and selecting the broadcast signal;
Signal separating means for separating the specific broadcast signal selected by the channel selecting means into at least a plurality of encoded information and encoded additional information;
A plurality of decoding means for decoding each of the plurality of pieces of encoded information and outputting a plurality of pieces of video information corresponding to different angular ranges of omnidirectional video information having an imaging range of 0 ° to 360 °;
Additional information decoding means for decoding the encoded additional information and outputting additional information having a plurality of identification information for identifying each of the plurality of video information;
Control means for referring to the additional information output by the additional information decoding means and controlling to selectively output the plurality of video information to a television monitor according to an input control signal;
The plurality of decoding means are at least:
First decoding means for decoding first encoded information and outputting first video information corresponding to a first angular range of the omnidirectional video information;
Second decoding means for decoding the second encoded information and outputting second video information corresponding to the second angular range of the omnidirectional video information;
Third decoding means for decoding the third encoded information and outputting third video information corresponding to the third angular range of the omnidirectional video information,
The additional information decoding means includes:
Decoding the encoded additional information and outputting the additional information having first, second, and third identification information for identifying at least the first, second, and third video information;
The control means includes
The additional information having the first, second, and third identification information is referred to, and the first, second, and third video information is determined in accordance with an input control signal. Control to selectively output to the TV monitor ,
Control to output a menu screen corresponding to at least the first, second, and third identification information to a television monitor;
In addition, control to output a menu screen showing the panning mode to the TV monitor,
The one identification stored temporarily in the memory means when a selection signal for selecting at least one identification information of the first, second, and third identification information is inputted from the outside. Control to output video information corresponding to the information to the TV monitor,
When a selection signal for selecting the panning mode is input from the outside, at least the first, second, and third video information temporarily stored in the memory means is read in a horizontal direction. A receiving apparatus that controls to read out and output to the television monitor while being gradually shifted . Said first, said second, and said third video information, the same by a camera having an imaging angle, the receiving apparatus of the order of adjacent corner range is 請 Motomeko 1 wherein Ru video information der imaged together. At least memory means for temporarily storing the first, second and third video information decoded by the first, second and third decoding means;
The control means selectively outputs at least the first, second, and third video information temporarily stored in the memory means to a television monitor in response to an input control signal. receiving apparatus 請 Motomeko 1, wherein that control the. Receiving apparatus 請 Motomeko 1 wherein Ru provided with a remote control device for transmitting a control signal for selecting the identification information or the panning mode the one with respect to the control means. The first decoding means also decodes the first audio signal collected together with the first video information and collected by a directional microphone,
The second decoding means also decodes the second audio signal collected together with the second video information and collected by the directional microphone,
The third decoding means also decodes a third audio signal collected together with the third video information and collected by a directional microphone,
It said control means receiving apparatus 請 Motomeko 1 wherein that controls to output the audio signal corresponding to the image information output to said selective. It said plurality of identification information, the receiving apparatus identifying information der Ru請 Motomeko 1 wherein identifying the camera each captured the plurality of video information. It said plurality of identification information, the receiving apparatus identifying information der Ru請 Motomeko 1 wherein identifying the imaging angle of the camera that captured the plurality of video information.

Images