TW201822536A - Viewing angle control system and method for playing panoramic image through set-top box capable of dynamically presenting a predictive picture that rotates according to the rotating speed of the viewing angle - Google Patents

Abstract

The present invention relates to a viewing angle control system and method for playing panoramic images through a set-top box. In the invention, through a viewing angle rotating module and based on a viewing angle rotation signal transmitted to a set-top box from a remote control, a viewing angle rotating speed is dynamically generated according to the motion vector included in a predictive picture after the viewing angle is rotated, so as to dynamically present a predictive picture that rotates according to the rotating speed of the viewing angle, thereby providing the user with a better experience of viewing panoramic images.

Description

   View angle control system and method for playing surrounding scene image through set-top box   

The present invention relates to a viewing angle control system and method, and more particularly to a dynamic viewing angle control system and method for playing a surrounding scene image through a set-top box.

360 degree surround view video playback has become a technology of great concern in recent years. Many manufacturers have implemented surround view video playback on smart phones, tablets, personal computers and other devices, and then use gyroscopes, touch or Use a mouse, etc. to control the angle of view. However, when the surround view image is implemented on the TV through the set-top box, the angle of view must be controlled by the remote control. However, the general remote control is not specially designed and sent to the machine. The signal of the upper box is a discrete signal, and the set-top box rotates a fixed angle of view every time it receives a discrete signal of the arrow keys. Because there is a time interval between each movement of the angle of view, it will inevitably produce screen jitter. This phenomenon of screen jitter will considerably reduce the user's experience of watching surrounding images.

In the prior art, there are several optimized systems or methods for the playback of surrounding scenes. For example, after receiving the instruction to play the panorama, the user's current perspective is obtained, and the corresponding paragraph of the current perspective is retrieved from the stream. The playback is used to realize a segmented playback of the surrounding scene image. However, with this technology, the picture jitter caused by the discrete signal of the remote control of the set-top box cannot be solved.

In view of the above problems, it is necessary for a person skilled in the art to provide a surround view image angle control technology that can respond to the special needs of a set-top box.

In order to solve the problems in the prior art, the present invention provides an angle of view control system for playing surround view images through a set-top box. The system is provided with at least one video decoding module and a rotating view angle module in the set-top box.

The video decoding module is connected to the original network module in the set-top box. When the network module receives the video stream of the surrounding scene image, it is used to perform video decoding on the video stream to obtain The decoded image frame and the motion vector corresponding to the image frame, and the original display module in the set-top box can present the decoded image frame to the user.

In addition, the rotation angle module is used to determine whether the signal transmitted by the user to control the remote control to the set-top box is a rotation angle event. If the signal is a rotation angle event, then according to the corresponding prediction screen after the rotation angle The motion vector is dynamically calculated, and a rotation angle of view rate is generated, so that the display module presents the predicted picture of the corresponding angle of view according to the rotation angle of view rate, and the necessary deformation of the surrounding scene image is adjusted and transmitted to the television for use. The viewing angle module is based on whether the interval time of the direction key signal transmitted by the remote control is less than a threshold value to determine whether it is a rotating angle event, that is, when the user continuously presses the direction key within the threshold value again. Or press and hold the arrow keys to transmit a signal, it is judged as a rotation angle event; if there is no new remote control arrow key event within the threshold time, you can end the rotation angle event and output the image at a fixed angle. Screen.

In addition, in the present invention, if the motion vector in the prediction frame after the rotation angle is higher than the original image frame, the rotation angle module generates a higher rotation angle rate, so that the rotation angle event can be made faster. The rotating perspective passes through the low dynamic image frame in the surrounding image. On the contrary, if the motion vector in the predicted frame is lower than the original image frame after the rotating perspective, the rotating perspective module generates a lower rate of the rotating perspective. The rotation angle of view event enables the angle of rotation to pass through the high dynamic image frame in the surrounding scene image slowly.

Corresponding to the system of the present invention, the present invention also provides a method for controlling the viewing angle of the surrounding scene image through a set-top box, the steps include: 1. the network of the video decoding module in the set-top box in the set-top box When the module receives the video stream, it performs video decoding on the video stream to obtain the decoded video frame and the motion vector corresponding to the video frame; 2. The rotating perspective module in the set-top box determines that the remote control transmits to the remote control Whether the signal of the set-top box is a rotation angle event; if it is a rotation angle event, dynamically calculate the rate of rotation angle according to the motion vector in the predicted picture after the rotation angle event is rotated in the current image frame; 3. the The rotating viewing angle module presents the predicted picture of the corresponding viewing angle according to the rotating viewing angle rate through the display module in the set-top box.

By using the angle of view control system and method for playing a surround view image through a set-top box of the present invention, the shortcomings in the prior art can be overcome, and the set-top box device can smoothly display the surround view image for the user to watch.

100‧‧‧video server

200‧‧‧ Set-top box

210‧‧‧ Network Module

220‧‧‧Video Decoding Module

230‧‧‧Rotating view module

231‧‧‧Rotating perspective event judgment module

232‧‧‧Rotating angle rate calculation module

240‧‧‧Display Module

300‧‧‧ TV

400‧‧‧Remote control

Fig. 1 is a system architecture diagram of the present invention; Fig. 2 is an exemplary diagram of a surrounding scene image; Fig. 3 is a first exemplary diagram of controlling the scene scene angle of the present invention; and Fig. 4 is a second diagram of controlling the scene scene angle of the present invention Exemplary diagram; FIG. 5 is a third exemplary diagram of controlling the viewing angle of the surrounding scene image according to the present invention.

The following will further explain the present invention with embodiments and drawings. First, please refer to FIG. 1, which is a system architecture diagram of a viewing angle control system for playing a surrounding scene image through a set-top box according to the present invention, which is transmitted by the video server 100. The video stream from a perspective image in the surround view image is transmitted to the set-top box 200 and received by the network module 210 in the set-top box 200, and the video decoding module 220 in the set-top box 200 is from the video stream Decode the image frame of the current view and the motion vector of the corresponding image frame. The motion vector A _mv is calculated by dividing the sum of the movement of all frames in the image frame by the value of the length and width of the frame. The video decoding module 220 The video image of the current perspective is transmitted to the display module 240 in the set-top box 200. The display module 240 performs the necessary deformation adjustment of the surrounding scene image, and then transmits the adjusted video image to the TV 300, and the user can View the video image of the current viewing angle on the TV 300.

While the user is watching the surrounding image, the rotating perspective module 230 in the set-top box 200 continuously receives the video decoding module 220 to decode the motion vector of the current perspective from the video stream; and when the user needs When switching to other perspectives in the surround view image, the user will send a signal to the set-top box 200 through the remote control 400, and the rotation perspective event determination module 231 in the rotation perspective module 230 will judge the remote control 400 to transmit based on a threshold value. Whether the incoming signal is a rotation angle event, if it is determined to be a rotation angle event, notify another rotation angle rate calculation module 232 in the rotation angle angle module 230 to calculate the rotation angle rate. At this time, you can first try to use the basic rotation The rate is R _base to rotate, and the video decoding module 220 will continue to decode the motion vector in the prediction picture to which the user wants to rotate. At this time, after rotating the viewing angle rate calculation module 232 to obtain the motion vector in the prediction picture, that is, Adjust the rotation angle of view rate R to be the value of R _base divided by the predicted picture motion vector A _mv , and then present the predicted picture of rotation of the angle of view rate R to the power through the display module 240. Vision 300. In this way, the rotation angle of view module 230 can dynamically adjust the rotation angle of view by continuously acquiring the motion vector in the predicted picture, so as to provide the angle of view in the surrounding scene image to the user at a rate more suitable for the user to watch. .

Please refer to FIG. 2 again, which is an example of a surrounding scene image, showing an example real-time dynamic image of shooting streets with a photography lens surrounding scene. In this embodiment, a user is using a set-top box of the system of the present invention to The first angle of view in this example, that is, the middle position in the surrounding image, is shown on the television, as shown in the perspective view of FIG. 3, compared with FIG. 2, where the perspective of the user of the present invention can only be viewed The image in the frame of the normal brightness in the picture, the rest of the surrounding image is processed by dark masks, in order to make it easier for the reader to understand the parts that the user of the present invention can actually watch, and the expressions in Figures 3 and 4 are also with.

When the user sends a signal to the set-top box via the remote control to adjust the viewing angle from the first viewing angle to the right to the second viewing angle (the second viewing angle is shown in the example viewing angle of FIG. 4), the video decoding module of the present invention attempts Obtain the prediction picture that the user wants to adjust to the right (that is, the image picture in the frame of normal brightness in the figure). Most of the area in this prediction picture is a building or a floor tile. These objects are not moving objects. Obviously, the The motion vector of the two-view prediction picture should be lower than the original view image picture. At this time, when the rotation view rate calculation module calculates the rotation view rate ( R is the value of R _base divided by the prediction picture dynamic vector A _mv ), The display module is rotated to the prediction screen at a higher rotation angle of view, so that the user can quickly pass through the background portion of the surrounding scene.

When the user sends a signal to the set-top box through the remote control to adjust the viewing angle from the first viewing angle to the left to the third viewing angle (the third viewing angle is shown in the viewing angle example of FIG. 5), the video decoding module of the present invention Try to obtain the prediction picture that the user wants to adjust to the left (that is, the image picture in the frame of normal brightness in the figure). This prediction picture contains more pedestrians. These objects are objects that will continue to move. Therefore, we know that the third The motion vector of the predicted picture of the viewing angle should be higher than that of the original picture. At this time, when the rotating view rate calculation module calculates the rotating view rate ( R is the value of R _base divided by the predicted picture dynamic vector A _mv ), The lower rotation angle of view allows the display module to rotate to the prediction screen, so that the user can carefully watch the moving part of the surrounding scene at a lower speed.

It should be understood that the detailed descriptions above are specific descriptions of the feasible embodiments of the present invention, but each of the embodiments is not intended to limit the patent scope of the present invention, and any equivalent implementation or change without departing from the technical spirit of the present invention, All should be included in the patent scope of this case.

The invention is technically innovative and possesses multiple effects that are inferior to the previous technology. It has fully met the requirements for statutory invention patents of novelty and progress. It has filed a patent application in accordance with the law. Your office is requested to approve this invention patent application for encouragement. Invented to the utmost.

Claims (8)

    An angle-of-view control system for playing surround-view images through a set-top box, which is provided in a set-top box and includes at least: a video decoding module, and when a network module in the set-top box receives a video stream, It is used to perform video decoding on the video stream to obtain the decoded video frame and a motion vector corresponding to the video frame; and a rotation angle module to determine whether the signal transmitted by the remote control to the STB is rotating The viewing angle event, if it is a rotating viewing angle event, dynamically calculates a rotating viewing angle rate according to the motion vector in the predicted picture after the rotating viewing angle, so as to present the corresponding viewing angle according to the rotating viewing angle rate through the display module in the set-top box Prediction screen.         According to the viewing angle control system described in item 1 of the scope of patent application, if the motion vector in the prediction picture after rotating the viewing angle is higher than the original image picture, the rotating viewing angle module generates a higher rate of the rotating viewing angle, The rotation angle of view event enables the angle of rotation to pass through the low dynamic image frame in the surrounding scene image faster.         According to the viewing angle control system described in Item 1 of the scope of patent application, if the motion vector in the prediction picture after rotating the viewing angle is relatively low relative to the original image picture, the rotating viewing angle module generates a lower rate of the rotating viewing angle, The rotation angle of view event enables the angle of rotation to pass through the high dynamic image frame in the surrounding scene image slowly.         The viewing angle control system according to any one of claims 1 to 3, wherein the rotating viewing angle module determines whether it is a rotating viewing angle event according to whether the interval time of the direction key signal transmitted by the remote controller is less than a threshold value. .         A method for controlling the viewing angle of a surround view image through a set-top box, the steps include: when a video decoding module in a set-top box receives a video stream from a network module in the set-top box, the video stream is Video decoding is performed to obtain a decoded image frame and a motion vector corresponding to the image frame. A rotation angle module in the set-top box determines whether the direction key signal transmitted by the remote control to the set-top box is a rotation angle event; If it is a rotation angle event, dynamically calculate a rotation angle rate based on a movement vector in the predicted image after the rotation angle event of the current image frame through the rotation angle event; and the rotation angle module passes through the set-top box The display module displays the predicted picture of the corresponding viewing angle according to the rotating viewing angle rate.         According to the angle of view control method described in item 5 of the scope of patent application, if the motion vector in the prediction frame after the angle of rotation is relatively high relative to the original image frame, the rotation angle module generates a higher rate of the angle of rotation, The rotation angle of view event enables the angle of rotation to pass through the low dynamic image frame in the surrounding scene image faster.         According to the angle of view control method described in item 5 of the scope of patent application, if the motion vector in the prediction frame after the rotation angle is lower than the original image frame, the rotation angle module generates a lower rate of the rotation angle, The rotation angle of view event enables the angle of rotation to pass through the high dynamic image frame in the surrounding scene image slowly.         The viewing angle control method according to any one of claims 5 to 7, wherein the rotating viewing angle module determines whether it is a rotating viewing angle event according to whether the interval time of the direction key signal transmitted by the remote controller is less than a threshold value. .