TWI634779B - Viewing angle control system and method for playing surround image through set-top box - Google Patents

Abstract

The invention relates to a viewing angle control system and method for playing a panoramic image through a set-top box, which mainly uses a rotating viewing angle module to dynamically predict a picture according to a rotating viewing angle according to a rotating viewing angle signal transmitted from a remote controller to a set-top box. The motion vector contained therein produces a rotational viewing angle rate to dynamically present a predicted picture that rotates according to the rotational viewing angle rate, which allows the user to have a better viewing of the panoramic image experience.

Description

 Viewing angle control system and method for playing surround image through set-top box  

The invention relates to a viewing angle control system and method, and more particularly to a dynamic viewing angle control system and method for playing a panoramic image through a set-top box.

Three hundred and sixty degrees of panoramic video playback has become a highly-focused technology in recent years. Many manufacturers have implemented surround video playback on smart phones, tablets, personal computers, etc., and then through gyroscopes, touch or The mouse and the like control the angle of view. However, when the scene image is transmitted to the television through the set-top box, it is necessary to control the angle of view through the remote controller. However, the general remote controller is not specially designed and sent to the machine. The signal of the upper box is a discrete signal, and the on-board box rotates a fixed angle of view every time a discrete signal of the direction key is received. Since there is a time interval between each moving angle of view, image jitter is inevitably generated. The phenomenon of such picture jitter will considerably reduce the user's experience of viewing the surround image.

In the prior art, for the scene video playback, there are several optimized systems or methods, for example, after receiving the instruction to play the panorama, the user's current perspective is obtained, and then the paragraph corresponding to the current perspective is extracted from the stream. For playback, a segmented playback of a panoramic image is realized. However, through this technique, the image jitter caused by the discrete signal of the remote controller cannot be solved.

In view of the above problems, it is necessary for a person skilled in the art to provide a surround view angle control technology that can meet the special needs of the set-top box.

In order to solve the problems in the prior art, the present invention provides a viewing angle control system for playing a panoramic image through a set-top box, which is provided with at least one video decoding module and a rotating viewing angle module in an on-board box.

The video decoding module is connected to the original network module in the set-top box, and is used for video decoding of the video stream when the network module receives the video stream of the surround image. The decoded image frame and the motion vector corresponding to the image frame, and the original display module in the set-top box can display the decoded image frame to the user.

In addition, the rotating viewing angle module is used to determine whether the signal transmitted by the user to the remote control box is a rotating viewing angle event, and if the signal is a rotating viewing angle event, according to the predicted image after the rotating viewing angle The motion vector is dynamically calculated, and a rotational viewing angle rate is generated, so that the display module presents a predicted image corresponding to the viewing angle according to the rotating viewing angle rate, and performs necessary deformation adjustment on the predicted image to be transmitted to the television for use. The viewing angle module determines whether the rotation angle of view event is based on whether the interval time of the remote control transmission direction key signal is less than a threshold value, that is, when the user is less than the threshold value, the direction key is continuously pressed. Or press and hold the direction key to transmit the signal, it is judged to rotate the angle of view event; and if there is no new remote control direction key event within the threshold time, the rotation angle event can be ended, and the image can be fixed at one angle of view. Picture.

In addition, in the present invention, if the motion vector in the prediction picture is higher than the original image frame after the rotation of the viewing angle, the rotating viewing angle module generates a higher rotation viewing angle, so that the rotating viewing angle event can be faster. Rotating the angle of view through the image image of the scene image with low degree of dynamics; conversely, if the motion vector in the prediction picture is lower than the original image frame after rotating the angle of view, the rotation angle module generates a lower rotation angle of view. The rotating viewing angle event can rotate the viewing angle slowly through the dynamic image of the scene image.

Corresponding to the system of the present invention, the present invention also provides a viewing angle control method for playing a panoramic image through a set-top box, the steps comprising: 1. The video decoding module in the set-top box is in the network in the set-top box When receiving the video stream, the module performs video decoding on the video stream to obtain a decoded image frame and a motion vector of the corresponding image frame; 2. the rotating view module in the set-top box determines that the remote controller transmits the Whether the signal of the set-top box is a rotating viewing angle event; if it is a rotating viewing angle event, the rotational viewing angle is dynamically calculated according to the motion vector in the predicted picture after the current image frame is rotated by the rotating viewing angle event; 3. The rotating viewing angle module presents a predicted image of the corresponding viewing angle according to the rotating viewing angle rate through the display module in the set-top box.

Through the perspective control system and method for playing a panoramic image through the set-top box of the present invention, the disadvantages of the prior art can be overcome, and the set-top box device can smoothly display the panoramic image for the user to watch.

100‧‧‧Video Server

200‧‧‧Machine box

210‧‧‧Network Module

220‧‧‧Video Decoding Module

230‧‧‧Rotary Viewing Module

231‧‧‧Rotating angle event judgment module

232‧‧‧Rotary viewing angle rate calculation module

240‧‧‧ display module

300‧‧‧TV

400‧‧‧Remote control

1 is a system architecture diagram of the present invention; FIG. 2 is a schematic diagram of a ringscape image; FIG. 3 is a first exemplary diagram of controlling a perspective of a surround view image according to the present invention; Example diagram; FIG. 5 is a third exemplary diagram of controlling the perspective of the surround view image with the present invention.

The present invention will be further described with reference to the accompanying drawings. First, please refer to FIG. 1 , which is a system architecture diagram of a view control system for playing a surround view image through a set-top box of the present invention, where the video server 100 transmits The video stream of the one-view image in the scene image is transmitted to the set-top box 200, and is received by the network module 210 in the set-top box 200, and the video decoding module 220 in the set-top box 200 is in the video stream. The motion vector of the current view image and the corresponding image frame are decoded, wherein the motion vector A _mv is calculated by dividing the sum of the movement amounts of all the frames in the image frame by the value of the length and width of the image, and the video decoding module 220 The image of the current viewing angle is transmitted to the display module 240 in the set-top box 200, and the display module 240 performs the necessary deformation adjustment of the panoramic image, and then transmits the adjusted image to the television 300, and the user can The video image of the current viewing angle is viewed on the television 300.

In the process of the user viewing the panoramic image, the rotating viewing angle module 230 in the set-top box 200 continuously receives the motion vector of the current viewing angle decoded by the video decoding module 220 from the video stream; When switching to other viewing angles in the panoramic image, the user transmits a signal to the set-top box 200 through the remote controller 400, and the rotating viewing angle event determining module 231 in the rotating viewing angle module 230 determines that the remote controller 400 transmits according to a threshold value. Whether the incoming signal is a rotating viewing angle event, if it is determined to be a rotating viewing angle event, the other rotating viewing angle rate calculating module 232 in the rotating viewing angle module 230 is notified to calculate the rotational viewing angle rate. At this time, the basic rotation can be attempted first. The rate is R _base to rotate, and the video decoding module 220 continues to decode the motion vector in the prediction picture that the user wants to rotate. At this time, after the rotation angle rate calculation module 232 obtains the motion vector in the prediction picture, Angle adjustment of the rotation rate R is divided by R _Base screen motion vector prediction value of a _mv, then rotate the camera 240 exhibits prediction picture rate R through the display module to the electrical Depending on 300, the rotating view module 230 can dynamically adjust the rotational view rate by continuously acquiring the motion vector in the predicted picture, so as to provide the view image in the surround view image to the user at a rate more suitable for the user to view. .

Referring to FIG. 2 again, it is an example image of a ring image, showing an example real-time motion picture of a street shooting with a photographic lens; in this embodiment, the user is using the set-top box of the system of the present invention. The first viewing angle in the example is viewed on the television, that is, the intermediate position in the panoramic image, as shown in the perspective view of FIG. 3, compared with FIG. 2, wherein the user's viewing angle is only visible. In the image frame of the normal brightness frame, the rest of the scene image is processed by the dark mask, so that the reader can easily understand the part that the user of the present invention can actually watch, and the expressions of Figures 3 and 4 are also with.

When the user sends a signal to the set-top box through the remote controller to adjust the viewing angle from the first viewing angle to the right to the second viewing angle (the second viewing angle is shown in the perspective view of FIG. 4), the video decoding module of the present invention attempts Obtaining a prediction screen that the user wants to adjust to the right (that is, an image frame in a frame with normal brightness in the figure), and most of the area of the predicted picture is a building or a floor tile, and these objects are not moving objects, obviously, The motion vector of the predicted picture of the two views should be lower than that of the original view image. At this time, when the rotational view rate calculation module calculates the rotational view rate ( R is R _base divided by the value of the predicted picture dynamic vector A _mv ), The display module is rotated to a predicted picture at a higher rotational viewing rate, allowing the user to swipe through the background portion of the landscape picture at a faster rate.

When the user sends a signal to the set-top box through the remote controller to adjust the viewing angle from the first viewing angle to the left to the third viewing angle (the third viewing angle is shown in the perspective view of FIG. 5), the video decoding module of the present invention is Try to obtain the prediction picture that the user wants to adjust to the left (that is, the image picture in the frame with normal brightness in the picture). This prediction picture contains more pedestrians, and these objects belong to objects that will continue to move, so it is known that the third The motion vector of the predicted picture of the angle of view should be higher than the picture of the original view. At this time, when the rotational view rate calculation module calculates the rotational view rate ( R is R _base divided by the value of the predicted picture dynamic vector A _mv ), The lower rotational viewing rate allows the display module to rotate to the predicted picture, allowing the user to carefully view the moving parts of the landscape picture at a lower speed.

It is to be understood that the foregoing detailed description of the embodiments of the present invention is not intended to limit the scope of the invention. Both should be included in the scope of the patent in this case.

The invention is innovative in terms of technical idea, and also has various functions that are inferior to the prior art, and has fully complied with the statutory invention patent requirements of novelty and progressiveness, and has filed a patent application according to law, and urges your office to approve the invention patent application. Invented, to the sense of virtue.

Claims (8)

A viewing angle control system for playing a panoramic image through a set-top box, which is disposed in a set-top box and includes at least: a video decoding module in the set-top box, and a network module in the set-top box Receiving a video stream for video decoding of the video stream to obtain a decoded image frame and a motion vector of the corresponding image frame; and a rotating view module in the set-top box for determining the remote control Whether the signal transmitted to the set-top box is a rotating viewing angle event, and if it is a rotating viewing angle event, the rotating viewing angle module in the set-top box dynamically calculates the generated motion vector according to the motion vector in the predicted image after the rotating viewing angle The viewing angle is rotated, and the rotating viewing angle module presents a predicted image of the corresponding viewing angle according to the rotating viewing angle rate through the display module in the set-top box. The viewing angle control system of claim 1, wherein if the motion vector in the prediction picture is higher than the original image after rotating the viewing angle, the rotating viewing angle module generates a higher rotation viewing angle. The rotating viewing angle event can rotate the viewing angle faster through the image image with low dynamic degree in the landscape image. The viewing angle control system of claim 1, wherein if the motion vector in the prediction picture is lower than the original image after rotating the viewing angle, the rotating viewing angle module generates a lower rotation viewing angle. The rotating viewing angle event can rotate the viewing angle slowly through the dynamic image of the scene image. The viewing angle control system according to any one of claims 1 to 3, wherein the rotating viewing angle module determines whether the rotating viewing angle event is based on whether the interval time of the remote control transmitting direction key signal is less than a threshold value. . A viewing angle control method for playing a panoramic image through a set-top box, the method comprising: a video decoding module in a set-top box, when the network module in the set-top box receives the video stream, and the video stream Performing video decoding to obtain a decoded image frame and a motion vector corresponding to the image frame; a rotating viewing angle module in the set-top box determines whether the direction key signal transmitted by the remote controller to the set-top box is a rotating viewing angle event; Wherein, if it is a rotating viewing angle event, the rotating viewing angle module in the set-top box dynamically calculates a rotational viewing angle rate according to the motion vector in the predicted picture after the current image frame is rotated by the rotating viewing angle event; and The rotating viewing angle module presents a predicted image of the corresponding viewing angle according to the rotating viewing angle rate through the display module in the set-top box. The viewing angle control method of claim 5, wherein if the motion vector in the prediction picture is higher than the original image after rotating the viewing angle, the rotating viewing angle module generates a higher rotation viewing angle. The rotating viewing angle event can rotate the viewing angle faster through the image image with low dynamic degree in the landscape image. The viewing angle control method of claim 5, wherein if the motion vector in the prediction picture is lower than the original image after rotating the viewing angle, the rotating viewing angle module generates a lower rotation viewing angle. The rotating viewing angle event can rotate the viewing angle slowly through the dynamic image of the scene image. The viewing angle control method according to any one of claims 5 to 7, wherein the rotating viewing angle module determines whether it is a rotating viewing angle event according to whether the interval time of the remote control transmitting direction key signal is less than a threshold value. .