JP4479721B2 - Receiver - Google Patents

Description

This invention relates to a suitable receiving device and applied to a broadcasting system. Specifically, omnidirectional video information in which a part of the angular range of adjacent video information overlaps is transmitted , and the receiving side selectively monitors the omnidirectional video information with reference to the additional information transmitted at the same time. By controlling to output to, you can freely select the video at any imaging angle and panning video in all directions, and can view the omnidirectional video without losing the continuity of the left and right video To.

  With the development of digital technology, an interactive integrated digital broadcasting system (referred to as an ISDB (Integrated Services Digital Broadcasting) system) in which various kinds of information including broadcast signals are digitized is being researched and developed in the broadcasting industry.

  More specifically, the ISDB system is used for not only current broadcast signals (standard television signals, high-definition signals), but also software and facsimile data, as well as multimedia information such as voice, text, graphics, and images. It is a broadcasting system in which each is digitized (encoded), integrated and multiplexed, and then subjected to modulation processing matching the transmission form to be transmitted and received.

  When various types of information including broadcast signals are integrated and multiplexed, in addition to these pieces of information, additional information used as control information on the receiving side can also be integrated and multiplexed at the same time. The integrated ISDB broadcast signal (digital signal) is transmitted using ground waves, satellite waves, optical cables, or the like.

  On the receiving terminal side, it is possible to receive the integrated ISDB broadcast signal, discriminate the target signal, display it on the monitor and enjoy it as a normal television broadcast. (Save) or transfer to another terminal. Further, if the received additional information is used, the received information can be used according to the user's preference, such as monitor control, recording control, and processing control on the monitored image. That is, an interactive broadcasting system can be constructed.

  Therefore, if this ISDB system is used, the service content for the user is improved and the more interactive broadcasting system can be constructed as the variety of additional information to be transmitted increases.

  Now, in the current broadcasting system, only the video captured from one camera angle is viewed, but there are cases where it is desired to view a panoramic video captured by rotating the imaging camera 360 °. For example, a natural travel program, such as a theme of a prairie like Africa or Mongolia, or shooting a view from the top of a mountain, it may be requested to enjoy 360 ° video. . In order to do so, it is necessary to simultaneously send out images captured by a plurality of imaging cameras using a plurality of channels, and the current broadcasting system cannot meet the demand. This is because it is a passive and unilateral system.

  If you can use multiple channels to send video from each camera angle at the same time and the viewer can select any video from them, you can fully enjoy the video at the desired angle and pan the 360 ° panoramic video It can be enjoyed as a video, and viewers can create videos with the same realism as the interview site.

  Therefore, the present invention is made to achieve such a problem, and sends out omnidirectional video information as one of the image information, while the viewer side selects the video to obtain panning video or the like. We propose a broadcasting system that allows you to enjoy omnidirectional video.

A receiving apparatus according to an aspect of the present invention includes a plurality of pieces of encoded information obtained by encoding a plurality of pieces of video information corresponding to different angular ranges of omnidirectional video information having an imaging range of 0 ° to 360 °, An apparatus for receiving a broadcast signal transmitted by multiplexing and transmitting encoded additional information obtained by encoding additional information having a plurality of identification information for identifying each of a plurality of video information, and receiving the broadcast signal Channel selection means for selecting the channel, signal separation means for separating the specific broadcast signal selected by the channel selection means into at least a plurality of encoded information and encoded additional information, and the plurality of encoding A plurality of decoding means for decoding a plurality of pieces of information and outputting a plurality of pieces of video information corresponding to different angular ranges of omnidirectional video information having an imaging range of 0 ° to 360 °; and the encoded additional information To decode the video information Additional information decoding means for outputting additional information having a plurality of identification information to be identified, and the plurality of video information with reference to the additional information output by the additional information decoding means and in accordance with an input control signal Control means for selectively outputting to a television monitor, and the plurality of video information includes a part of an angular range of adjacent video information overlapping, and the plurality of decoding means includes: A first decoding means for decoding at least the first encoded information and outputting the first video information corresponding to the first angular range of the omnidirectional video information; and the second encoded information A second decoding means for decoding and outputting second video information corresponding to the second angular range of the omnidirectional video information; and decoding the third encoded information to The third video information corresponding to the third angular range is output. The additional information decoding means decodes the encoded additional information to identify at least the first, second, and third video information. The additional information having the second and third identification information is output, and the control means selectively selects the first, second, and third video information according to the input control signal. A menu screen that controls to output to a monitor, controls to output at least a menu screen corresponding to the first, second, and third identification information to a television monitor, and further displays a panning mode When the selection signal for selecting at least one of the first identification information, the second identification information, and the third identification information is input from the outside. The movie corresponding to the identification information When the information is controlled to be output to the television monitor and a selection signal for selecting the panning mode is input from the outside, at least the first, second, and third video information is read out at the reading position. reading so as to be gradually shifted in the horizontal direction is received device for controlling to output to the television monitor.

  Memory means for temporarily storing at least the first, second, and third video information decoded by the first, second, and third decoding means can be further provided. The control means selectively outputs at least the first, second and third video information temporarily stored in the memory means to a television monitor in accordance with an input control signal. Can be controlled.

  A remote control device that transmits the control information for selecting the one identification information or the panning mode to the control means may be further provided.

  The first decoding means also decodes the first audio signal collected together with the first video information and collected by a directional microphone, and the second decoding means decodes the second video. The second audio signal collected by the directional microphone encoded with the information is also decoded, and the third decoding means collects the sound by the directional microphone encoded with the third video information. The decoded third audio signal is also decoded, and the control means can control to output the audio signal corresponding to the selectively output video information.
  The plurality of pieces of identification information may be pieces of identification information for identifying a camera that has captured each of the plurality of pieces of video information.
  The plurality of identification information may be identification information for identifying an imaging angle of a camera that images the plurality of video information.
  According to the present invention, a broadcast signal is received and selected, and the selected specific broadcast signal is separated into at least a plurality of encoded information and encoded additional information, and each of the plurality of encoded information is decoded. A plurality of pieces of video information corresponding to different angular ranges are output from the omnidirectional video information having an imaging range of 0 ° to 360 °, and the encoded additional information is decoded to identify the plurality of pieces of video information. Additional information having a plurality of pieces of identification information is output, the output additional information is referred to, and a plurality of pieces of video information are selectively output to a television monitor according to an input control signal. In addition, a plurality of pieces of video information overlap a part of the angular range between adjacent video information, and the first encoded information is decoded to correspond to the first angular range of the omnidirectional video information. First video information is output, second encoded information is decoded, second video information corresponding to a second angular range of the omnidirectional video information is output, and third encoded information is output. Is decoded to output third video information corresponding to the third angular range of the omnidirectional video information, and the encoded additional information is decoded to at least the first, second, and third information. Additional information having first, second, and third identification information for identifying video information is output, and the first, second, and third video information are selected according to an input control signal. Output to a television monitor at least, and at least the first, second, and upper A menu screen corresponding to the third identification information is output to the television monitor, and further, a menu screen indicating the panning mode is output to the television monitor, and at least the first, second, and third identification information from the outside. When a selection signal for selecting one of the identification information is input, video information corresponding to the one identification information is output to the television monitor, and a selection signal for selecting the panning mode is input from the outside. At least the first, second, and third video information are read and output to the television monitor so that the reading position is gradually shifted in the horizontal direction.

According to the receiving apparatus according to the present invention, is transmitted omnidirectional video information portion of the angular range between the adjacent video information is overlap, on the receiving side, adding identifies the omnidirectional image information sent simultaneously Control is performed so that the omnidirectional video information is selectively output to the television monitor with reference to the information.

  With this configuration, it is possible to freely select an image at an arbitrary imaging angle and an omnidirectional panning image, and to listen to an omnidirectional image without losing the continuity of the left and right images.

  This makes it possible to enjoy omnidirectional video while switching between omnidirectional images for each camera angle, and by devising data reading in the memory means, the panning method can be realized by software, especially on the grassland and mountain peaks, Video can be projected when the user turns 360 ° from the coast, on the ship, or on the plane to enjoy the scenery. Therefore, it becomes possible to enjoy user-participation-type television broadcasting that has never been obtained.

  Next, an embodiment of the ISDB transmission device and the reception device according to the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a system diagram of a main part showing an embodiment of an ISDB transmitting apparatus 10 according to the present invention. In this example, the main information transmitted in an integrated manner is the same as that of a standard television signal. It is assumed that it is a broadcast signal of a multi-channel multiplex program that transmits a program using a plurality of channels. Additional information such as control information is added to each of them for multiplexing. Various kinds of additional information can be considered. For a standard television signal, a time code can be considered.

  Referring to FIG. 1, the video signal SNV of the standard television signal is supplied to the terminal 12a, and the audio signal SNA associated therewith is supplied to the terminal 12b. The encoding unit 14 performs appropriate encoding processing including compression and the like. Is given. In synchronization with this encoding process, the additional information generating means 16 operates to generate additional information such as control information. In this example, a time code is illustrated as additional information, and thus the time code generating unit 16 is configured. The encoded standard television signal and time code TC are supplied to the multiplexing unit 20 and multiplexed together with other information.

  Examples of sources include omnidirectional video information in addition to standard television signals. As shown in FIG. 2, the omnidirectional video is an imaging range of the entire range from 0 ° to 360 °. In this example, the 360 ° range is divided into n equal parts. In the example of FIG. 2, it is divided into three equal parts, and a camera angle (imaging angle) is approximately 120 ° angle range. The three equal parts are an example, and it is preferable that n is large.

  In order to obtain imaging information at each n-divided position, the simplest example is to prepare three imaging cameras. For example, the A camera captures an angular range from 0 ° to 120 ° as shown in FIG. The B camera captures an angular range of 120 ° to 240 ° at the same point. Similarly, the C camera captures an angular range of 240 ° to 360 ° at the same point. As shown in FIG. 3, the camera angle is actually imaged by overlapping between adjacent imaging cameras by a predetermined angular range L (range of 5 ° to 10 °). This is to prevent an area that is not partly imaged from occurring.

  The divided video materials SA, SB, and SC imaged by the three cameras are subjected to the same encoding process as described above by the encoding units 22A, 22B, and 22C shown in FIG. The divided video materials SA, SB, and SC are composed of audio signals SAA, SBA, and SCA corresponding to the video signals SAV, SBV, and SCB, respectively, and the audio signals collected by a highly directional microphone are used. This is because the audio signal is optimal for the camera angle.

  Additional information for the plurality of divided video materials SA, SB, and SC is supplied to the terminal 24. This additional information is an identifier (A camera, B camera, C camera, etc.) for identifying each of the imaging cameras A, B, and C, and the camera angle θ of each imaging camera (each imaging with respect to the clockwise direction). Angle range), panning direction, panning speed, etc. Since the overlap angle is uniformly overlapped, the joint of the screen is a half of the corner position. The additional information is supplied to the encoding unit 26 in synchronization with the above-described divided video material and digitized.

  The encoded information and additional information obtained from each are multiplexed in the multiplexing unit 20 shown in FIG. In the multiplexing unit 20, for example, a process is performed in which each piece of encoded information is packetized and multiplexed for error correction is multiplexed in units of transmission frames to form a bit stream. The types of additional information and main information described above can be inserted into a header (packet header) when packetized or inserted into a non-video period (such as a blanking period).

  The multiplexed data is modulated by the transmission unit 34 into an ISDB broadcast signal having a transmission form suitable for transmission means (for example, a broadcasting satellite), and in this example, the data is multiplexed by an up-converter 36 and a transmission antenna (parabolic antenna) 38. Sent to the broadcasting satellite.

  FIG. 4 shows an example of the receiving apparatus 40 according to the present invention for receiving the ISDB broadcast signal as described above.

  The satellite wave received by the receiving antenna (parabolic antenna) 42 is down-converted to a 1 GHz band by the down converter 44 and then supplied to the ISDB tuner 46 for channel selection processing. Therefore, the ISDB broadcast signal of a specific channel including the character broadcast is selected by the channel selection signal SC from the terminal 48.

  The selected ISDB broadcast signal is supplied to the signal separation unit 50 and separated into original main information and additional information. For example, when a specific channel of a standard television signal is selected, the standard television signal and additional information (time code or the like) associated with the specific channel are separated.

  The separated main information is supplied to the decoding unit 52 (52A) to be decoded. Thereafter, the video is supplied to the monitor 56 via the changeover switch 54 and displayed.

  When the omnidirectional video material described above is handled as the main information and the camera angle is divided into three, at least three more decoding units 52B, 52C, and 52D are required. Of these decoded video materials, the video signal is temporarily stored in the memory means 58 for screen synthesis. In addition to the camera angle image determined by using the memory means 58, an image at an arbitrary camera angle can be displayed on the monitor 56. This point will be described later. As the memory means 58, a fast-access semiconductor memory (RAM or the like) is suitable.

  Of the decoded video material, an audio signal is supplied to the audio processing unit 60, subjected to audio processing such as separation / synthesis, and output as a single channel audio signal or a synthesized audio signal using a plurality of channels. The The output audio signal and the video signal after the above-described image synthesis are supplied to the changeover switch 54, and switching between the video material from the decoding unit 52A is performed. Therefore, in some cases, the omnidirectional video material is selected and displayed.

  The additional information separated by the signal separation unit 50 is decoded by a dedicated decoding unit 62 and then supplied to the memory means 58 and the control unit 64. Then, referring to the obtained additional information, the data reading control for the memory means 58 is performed based on the control signal from the control unit 64, and the voice processing control in the voice processing unit 60 is executed. The changeover switch 54 is controlled by the output of the control unit 64.

  The control unit 64 constituted by a microcomputer generates a control signal for changing the display mode or selecting the monitor contents by remote control from the commander 68. For example, as shown in FIG. 5, the commander 68 is provided with a channel selection numeric keypad (10 key) 72, a channel selection switch 74, and a volume switch 76 in addition to a power switch 70, and a display mode selection switch 78 for the monitor 60. Is provided. The cursor key 80 is a key for moving a cursor K (see FIG. 6) displayed on the screen, and is used for designating an imaging camera.

  In the memory means 58 described above, the following image processing is performed under the intervention of the control unit 64. However, the processing example is merely an example and is not limited to the presentation example.

  When a standard television signal or the like is being displayed, the screen display is the same as before, and the decoded output is directly supplied to the changeover switch 54 without passing through the memory means 58.

  When a multi-channel multiplexed program (omnidirectional display mode) capable of omnidirectional video is selected using the display mode selection switch 78, the menu screen M synthesized and displayed on the screen as shown in FIG. 6 is viewed. Selection of additional information is performed. If an imaging camera is illustrated as additional information, the imaging camera used as shown in FIG. 6 is displayed in the order of camera angles.

  When, for example, “A” is clicked with the cursor K, the image A ′ (FIG. 3) captured by the A camera is selectively displayed. When the user selects A → B → C, the video A ′ captured by the A camera is switched to the video B ′ of the B camera, and then automatically switched to the video C ′ of the C camera. With this, it is possible to enjoy 360 ° panoramic video with the direction changed by 120 °.

  Further, when the panning mode P is selected from the menu screen M, the state of reading data from the memory means 58 is controlled, and an omnidirectional panning video is obtained. Here, panning is an imaging technique in which the direction of the camera is rotated horizontally at a constant speed while imaging.

  When the panning mode P is selected, the horizontal position to be read is gradually shifted in the panning direction so as to switch from the video A ′ of the A camera to the video B ′ of the B camera. This reading operation is continued until the last video data of the video C ′ of the C camera.

  By reading out such video data, a panoramic video can be enjoyed in a direction of 360 ° from the starting point. Since a predetermined overlap L is provided between adjacent imaging cameras, there is no possibility that there is an area that is not partly imaged during panning. Therefore, a smooth panning image can be obtained even when the image is switched between the images A ′ and B ′ and between the images B ′ and C ′. The overlap section may be subjected to interpolation processing to output data.

  If the reading direction with respect to the memory means 58 is reversed, a panning image in which the panning direction is reversed can be obtained, so that another way of enjoying is possible. By changing the panning readout speed, it is possible to enjoy an interesting video, and various ways of enjoying it can be developed by the user.

  Simultaneously with the panning of the video, the audio processing unit 60 is controlled and an audio signal corresponding to the video is output, so that a sound field full of presence can be realized. Therefore, this panning image is particularly effective when it is an image from a grassland, mountain top, coast, shipboard, or airplane. It is also possible to prepare several types of panning templates in advance and configure the software so that the user selects them.

  The present invention is extremely suitable when applied to an ISDB system for digital broadcasting.

It is a systematic diagram of the principal part which shows one Embodiment of the transmission apparatus for ISDB which concerns on this invention. It is explanatory drawing of an omnidirectional video. It is a figure which shows the relationship between a camera angle and an imaging range. It is a systematic diagram of the principal part which shows one Embodiment of the receiver for ISDB which concerns on this invention. It is a block diagram which shows the specific example of a commander. It is a figure which shows a menu display example.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... ISDB transmitting device, 14, 22A to 22C ... Encoding unit, 16 ... Time code generating unit, 20 ... Multiplexing unit, 46 ... ISDB tuner, 52, 62 ..Decoding unit, 58... Screen composition unit, 56... Monitor, 64.

Claims (6)

A plurality of pieces of encoded information obtained by encoding a plurality of pieces of video information corresponding to different angular ranges of the omnidirectional video information having an imaging range of 0 ° to 360 °, and a plurality of pieces for identifying each of the plurality of pieces of video information An apparatus for receiving a broadcast signal that is transmitted by being multiplexed with encoded additional information obtained by encoding additional information having identification information of:
Channel selection means for receiving and selecting the broadcast signal;
Signal separating means for separating the specific broadcast signal selected by the channel selecting means into at least a plurality of encoded information and encoded additional information;
A plurality of decoding means for decoding each of the plurality of pieces of encoded information and outputting a plurality of pieces of video information corresponding to different angular ranges of omnidirectional video information having an imaging range of 0 ° to 360 °;
Additional information decoding means for decoding the encoded additional information and outputting additional information having a plurality of identification information for identifying each of the plurality of video information;
Control means for referring to the additional information output by the additional information decoding means and controlling to selectively output the plurality of video information to a television monitor in accordance with an input control signal;
In the plurality of video information, a part of the angular range between adjacent video information overlaps ,
The plurality of decoding means are at least:
First decoding means for decoding first encoded information and outputting first video information corresponding to a first angular range of the omnidirectional video information;
Second decoding means for decoding the second encoded information and outputting second video information corresponding to the second angular range of the omnidirectional video information;
Third decoding means for decoding the third encoded information and outputting third video information corresponding to the third angular range of the omnidirectional video information,
The additional information decoding unit includes first, second, and third identification information for decoding the encoded additional information and identifying at least the first, second, and third video information. Output information,
The control means includes
Control to selectively output the first, second, and third video information to a television monitor according to an input control signal,
Control to output a menu screen corresponding to at least the first, second, and third identification information to a television monitor;
In addition, control to output a menu screen showing the panning mode to the TV monitor,
When a selection signal for selecting at least one of the first, second, and third identification information is input from the outside, video information corresponding to the one identification information is displayed on the television monitor. Control to output to
When a selection signal for selecting the panning mode is input from the outside, at least the first, second, and third video information are read so that the reading position is gradually shifted in the horizontal direction. Control to output to the above TV monitor
RECEIVER. At least, further comprising the first memory means for temporarily storing said second, and said third said first decoded by the decoding means, the second, and the third image information,
The control means selectively outputs at least the first, second, and third video information temporarily stored in the memory means to a television monitor in response to an input control signal. To control
The receiving apparatus according to 請 Motomeko 1. Further comprising a remote control device for transmitting a control signal for selecting the identification information or the panning mode the one with respect to the control means
The receiving apparatus according to 請 Motomeko 1. The first decoding means also decodes the first audio signal collected together with the first video information and collected by a directional microphone,
The second decoding means also decodes the second audio signal collected together with the second video information and collected by the directional microphone,
The third decoding means also decodes a third audio signal collected together with the third video information and collected by a directional microphone,
The control means controls to output the audio signal corresponding to the selectively output video information.
The receiving apparatus according to 請 Motomeko 1. The plurality of identification information is identification information for identifying a camera that has captured each of the plurality of video information.
The receiving apparatus according to 請 Motomeko 1. The plurality of identification information is identification information for identifying an imaging angle of a camera that images the plurality of video information.
The receiving apparatus according to 請 Motomeko 1.

Images