JP2003280632A - Method and system for continuously scaling video image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an improved technique for scaling images on a video display. <P>SOLUTION: A video data stream is processed into video data, which is displayed on a video display at a predetermined aspect ratio. A user manipulable controller, such as a joystick, is operative with a graphics processor unit for scaling images on the video display. In this case, video source values of pixel width and height to be displayed are obtained and the smallest integer increment on the x/y axis that will maintain the desired aspect ratio is determined by using a greatest common denominator to reduce the ratio to the lowest integer. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

FIELD OF THE INVENTION The present invention relates to the technical field of video displays, and more particularly to scaling video images on video displays.

[0002]

2. Description of the Related Art A three-dimensional audio processor incorporating a growing number of video game systems, a three-dimensional graphics processor unit (GPU), a high-speed central processing unit (CPU) with a high-speed bus transfer rate, and a built-in hardware. It has a drive and large megabyte integrated memory. Typically provided within these video game systems are various types of removable memory cards,
There are custom game controller ports, HDTV ports, expansion card ports, and often built-in DVD (Digital Versatile / Video Disc) players with appropriate DVD software drivers to drive the device. Examples of such systems include various video games from Sony Corporation, such as PlayStation 2, Nintendo GameCube, and the XBox game system from Microsoft Corporation. For example, the XBox gaming system includes a front-loading DVD tray and software driver that works with a DVD player, four game controller ports and a gamepad that enables multiplayer gaming, and other features that include a voice-activated headset. It includes ports that allow connection of peripheral devices. The system also features an Ethernet port for broadband connectivity, NVIDIA graphics processing unit (GPU), Intel 733MHz.
Includes processor, internal hard drive. In some conventional video game systems, and in many consumer DVD players, image scaling or zooming is typically provided as a "step" zoom functionality achieved by pressing a zoom button. Has been done. When the zoom button is depressed, it is possible to perform several different zoom functions. For example, in the first zoom function, the current view is magnified by a factor of 2 or some other arbitrary division. For example, 720 on a 720x480 display
Depressing the "zoom" button while looking at x480 pixel source content results in a view of the 360x240 pixel source content scaled to fit on a 720x480 video display. Subsequent depression of the zoom button will increment the zoom level by the same arbitrary magnification level. In yet another zoom function, a pannable bracket [] is displayed on the monitor screen or other video display and specifies the area to be zoomed to full screen by pressing the next "Enter" button. This type of "zoom" method and function also increases the magnification level by any fixed amount. One of the drawbacks of this type of conventional system is that the user is "real time".
It does not allow panning the image zoomed in and does not provide the user with a means to increase or decrease the zoom level in a perceptually continuous manner.

[0003]

SUMMARY OF THE INVENTION The present invention has been made in view of the above points, and provides a method and system for continuously scaling a video image, which overcomes the above-mentioned drawbacks of the prior art. The purpose is to

[0004]

The present invention provides a method of continuously scaling an image on a display to provide a continuous zoom function. In one aspect of the invention, video data is generated as a stream of video data and displayed at a predetermined aspect ratio on a video display. During playback or in pause mode, the pixel width and pixel height video source values to be displayed are obtained. The smallest integer increment on the x / y axis that maintains the desired aspect ratio
Is determined by using the largest common denominator to reduce the ratio to the lowest integer.

The video data stream can be generated from a DVD (Digital Versatile / Video Disc) player or as a High Definition Television (HDTV) signal. It is possible to manipulate the joystick to initiate the zoom function and scale the image on the video display. The joystick can be moved upwards to increase the zoom factor by a predetermined number of pixels, or it can be moved downwards to decrease the zoom factor by a predetermined number of pixels until fully zoomed out. It is possible to operate the second joystick to change the x / y position of the zoomed area in a continuous manner.

In yet another aspect of the invention, the video data is operatively connected to a game port of a video game box including a DVD player or similar optical disc reader, central processing unit, graphics processor unit. It can be displayed on a video display.

In yet another aspect of the invention, it is possible to specify a destination or destination area on the display for displaying the video source value to be displayed. If the area of the video source data does not have a one-to-one correspondence with the area of the destination area, the video source data is scaled in the graphics processor unit.

According to the present invention, there is further provided a video game operating method for processing a video data stream generated from an optical disc player and displaying the video data on a video display in a predetermined aspect ratio. There is a step to make. The desired aspect ratio by using the largest common denominator to obtain the video source value of the pixel and height to be displayed and reduce the ratio to the lowest integer in response to a predetermined operation of the game controller. The game controller is operated to continuously scale the image on the video display by determining the smallest integer increment on the x / y axis that holds

In accordance with another aspect of the present invention, there is further provided a video display system, the system processing a video data stream and associated central processing unit for generating video data to be displayed. It has a graphics processor unit. A video display receives the video data and displays the video image in a predetermined aspect ratio. The smallest on the x / y axis that maintains the desired aspect ratio using the largest common denominator to obtain the video source value of pixel width and height to be displayed and reduce the ratio to the lowest integer. A user-operable controller works with the graphics processor unit to scale the image on the video display by determining an integer increment.

In another aspect of the invention, the video display comprises a television. An optical disc reader, such as a DVD (Digital Versatile / Video Disc) player, is included as part of the video game system to generate the video data stream. The video data stream is also a high definition television (H
It is possible to have a DTV) signal. User-operable controls can include one or more joysticks.

DETAILED DESCRIPTION OF THE INVENTION The present invention will now be described in more detail with reference to the accompanying drawings, in which preferred embodiments of the present invention are shown. However, the invention can be realized in many different forms and should not be construed as limited to the examples described below.
Rather, these examples are provided so that this disclosure will be complete and will clearly demonstrate the scope of the invention to those skilled in the art. In addition, the same reference numerals are given to the same components.

The present invention is a video game system using an optical disc player such as a consumer DVD player, for example, a DVD player, and a DVD or optical disc player, a high-definition TV (HDTV).
It provides advantages over conventional "stepped" scaling and zoom functionality common to similar video systems that receive a signal, or video data stream derived from other similar video generation systems. Many conventional systems are limited and zoom on a game controller or other system that only scales the current view displayed on the LCD or video display screen by a factor of 2 or some arbitrary resolution. It was operated by pressing the button down. For example,
User 720 on 720 × 480 display
When the user depresses the zoom button while looking at the source content of x480 pixels, the user sees 7
You will see 360x240 pixel source content scaled to fit on a 20x480 display. Then press the zoom button down,
The zoom level is incremented by the same arbitrary zoom level. In another conventional "step" zoom function system, a pannable bracket {} is displayed on the screen and specifies the area that will be zoomed to full screen the next time the "Enter" button is depressed. This method also allowed an increase in the zoom level by an arbitrary fixed amount.

The drawback of these two types of conventional systems is that they do not allow the user to pan the zoomed image in "real time."
It also does not provide the user with a means to increase or decrease the zoom level in a perceptually continuous manner.

The present invention provides a display, such as a processed video data stream, obtained from a DVD or HDTV device driven by a multi-directional controller such as, for example, a pair of joysticks in a gamepad controller or other similar controller. It effectively enables a continuous zoom feature for use with displayed video images such as captured video data.

Scaling can be accomplished on a graphics processor unit (GPU). For example, when a zoom function is generated by operating a game controller or a joystick, the coordinates of the source data desired to be displayed are set and the display destination or destination area is full screen 640.
Specified on a x480 pixel display.
If the area of the source data does not have a one-to-one correspondence with the area of the destination or destination area, the graphics processor unit can scale the data in hardware. It is possible to use software scaling, but it is more CPU intensive as is the case with software algorithms and other common conventional software scaling systems that are CPU resource intensive. Will be things. The present invention is also applicable to maintain the aspect ratio in a given region that does not require it to be functionally scaled, in these cases giving better visual results. . Scaling is used in a continuous fashion and it is possible to zoom and pan simultaneously and optimized for stabilization.

The present invention will first be described by way of non-limiting example:
It can be operated by looking at a display that displays DVD or HDTV video data at normal source resolution. Naturally, hard disk, optical disk,
It is possible to use other source video data, including data generated from the Internet or other sources known to those skilled in the art. The following description will be made in connection with the case of watching a DVD or HDTV.
This is because these video data streams are currently involved when using many gaming video systems.

The DVD or HDTV viewer software can be driven by a multi-directional controller, such as a pair of joysticks on a gamepad controller, for example. At any time during normal playback or still playback, the controller with X / Y coordinates is moved to continuously change the current zoom factor. For example, moving the joystick up can increase the zoom factor by a very small number of pixels, while moving the joystick down can increase the zoom factor until it is fully zoomed out. Can be reduced. If a second joystick is available in the game controller or gamepad, this control can change the X / Y position of the zoomed area in a continuous fashion.

The present invention also provides a consumer DVD or HDT.
It provides a novel zoom feature in a V-playback device, and ensures that the zoomed rectangle always maintains its balance or blend relative to the overall source and jitter or "bob". That is, it provides a smooth centering algorithm that minimizes the effects of sudden movements.

Although described below with reference to a DVD player, any video data stream including a data stream produced by a compact disc, video disc, tape, cassette, or other digital video data stream may be used. It should be understood that it can be processed. It is customary for DVDs to contain video data whose data capacity has been increased by a factor of 7 compared to CDs by tightening tolerances throughout the system. Other aspects of the invention regarding aspect ratios are known to those skilled in the art. The use of joysticks and gameports is well known to those of ordinary skill in the art. "High Definition Television (HDT
The term "V)" refers to several methods for obtaining more detail in an improved television picture as compared to a conventional National Television System Committee (NTNC) TV signal.

Referring to FIG. 1, video display system 10 as part of video game system 12 which employs a method and system for continuously scaling an image on video display 14 in accordance with the present invention.
It is shown. Many different types of central processing units
(CTU), graphics processing unit (GTU), chipsets, memory devices, bridges, slots, frame buffer circuits, and other game and video display and system architectures can be used in accordance with the present invention. The present invention will be described with respect to the video game system architecture shown in FIG.

As shown, the video game system 12
Is a central processing unit 16 and chipset 1 that provides signals to a microprocessor and has associated support circuits to link various systems and peripherals.
Have eight. The main memory 20 is the chipset 18
Connected to work. PCs known to those skilled in the art
Various slots 22 such as I slot and ISA slot
Is a bridge 24 such as a PCI bridge as shown in the figure.
Connected to. For example, a graphics processing unit (GP) such as an NVIDIA graphics processing unit.
U) 26 is operatively connected to the chipset 18 and, in the illustrated example, an advanced graphics port 28 and a frame buffer 30 as known to those skilled in the art.
have. Advanced graphics port 28 incorporates dedicated pipeline access to main memory via chipset 18 or other means known to those skilled in the art. It is capable of moving data between a dedicated frame buffer 30 and main system memory 20. Various expansion cards can be provided as required by the user or those skilled in the art.

A controller 32, such as a game controller, is operatively connected to CPU 16 and graphics processing unit 26 via slot 22, PCI bridge 24 or game port 34, as shown. The controller 32 has a joystick, and in the illustrated example, it is 2
It has individual joysticks 36, 36a. DV
The D-player 38 is part of the overall system and is typically contained within a single video game housing 40 that contains most or all of the system components. The DVD player 38 is driven by an appropriate DVD software driver as known to those skilled in the art. An Ethernet port 42 is included and receives HDTV signals with the graphics processing unit 26 or HDT as known to those skilled in the art.
A high definition television (HDTV) port 44 for generating the V signal is included.

The video display 14 can be integrated into the system, or as known to those skilled in the art, via a wireless or wired connection via the video output port 46 to a television, HDTV, LCD or otherwise. It is possible to connect to the video display of.

FIG. 2 shows a basic high level flow chart illustrating the method and system of the present invention.
The system will be described in connection with operating a video game.

DVD exemplified by video data stream
It is generated and processed (100) from an optical disc player such as a player (Fig. 1). The video data is displayed on the video display in a predetermined aspect ratio (102).

A game controller such as a joystick is operated (104). The pixel width and height video x / y source values to be displayed are obtained (106). The destination on the video display is designated to display the video source value to be displayed
(108). The smallest integer increment on the x / y axis that maintains the desired aspect ratio is determined by using the largest common denominator to reduce that ratio to the lowest integer (110). If the area of the video source data does not have a one-to-one correspondence with the area of the destination area, then the video source data in the graphics processor unit is scaled (112).

Scaling calculates the new width and height as the current pixel width and height to be displayed and an increment of the width and height and fixes the x and y position at the x and y center points -or +. Each new width and height / 2
It is possible to do by fixing as (1
14). The system zooms to the newly calculated coordinates of the source content (116).

Pseudo code implementing the functionality of the present invention is shown below, which illustrates the functional algorithms in a high-level form.

[0028]

[Table 1]

The code described in more detail in the C ++ language is set forth below as a representative of the types of code functionality that can be used in the present invention as a non-limiting example.

[0030]

[Table 2]

[0031]

[Table 3]

[0032]

[Table 4]

[0033]

[Table 5]

The specific embodiments of the present invention have been described above in detail, but the present invention should not be limited to these specific examples, and various modifications can be made without departing from the technical scope of the present invention. It goes without saying that the above can be modified.

[Brief description of drawings]

FIG. 1 is a schematic block diagram illustrating a video display system as part of a video game system according to the present invention.

FIG. 2 is a flow chart showing the basic method of scaling an image according to the present invention.

[Explanation of symbols]

12 video game system 16 Central processing unit 18 chipsets 20 main memory 22 slots 24 bridge 26 Graphics Processing Unit (GPU) 28 Advanced Graphic Port 30 frame buffer 32 controller 34 Game Port 36 Joystick 38 DVD player 40 housing 42 Ethernet Port 44 HDTV port 46 video output ports

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Theodor H. Hermanson             United States of America, Pennsylvania             17078, Palmyra, East Maine               Street 211 F-term (reference) 2C001 BC00 BC07 BC10 CA06 CB01                       CB06                 5C082 AA06 AA21 AA37 BA41 CA40                       CB05 MM05

Claims (46)

[Claims] 1. A method for continuously scaling an image on a display, wherein video data generated as a video data stream is displayed on a video display at a predetermined aspect ratio, and is displayed during playback or in pause mode. On the x / y axis that maintains the desired aspect ratio by obtaining the video source value of pixel width and pixel height to be done and using the largest common denominator to reduce the ratio to the least significant integer. Determine the smallest integer increment,
A method comprising the above steps. 2. The method of claim 1, further comprising the step of generating a video data stream from an optical disc player. 3. The high-definition television according to claim 1, further comprising:
(HDTV) signal generating a video data stream. 4. The method of claim 1, further comprising manipulating a joystick to initiate a zoom function for scaling the image on the video display. 5. The method of claim 4, further comprising moving the joystick upwards to increase the zoom factor by a predetermined number of pixels and reducing the zoom factor by a predetermined number of pixels until fully zoomed out. A step of moving the joystick downward. 6. The method of claim 5, further comprising manipulating a second joystick to transform the x / y position of the zoomed region in a continuous manner. 7. The method of claim 1, further comprising displaying video data on a video display operatively connected to a video game box including an optical disc player, a central processing unit, a graphics processor unit, and a game port. A method having. 8. The method according to claim 1, further comprising jitter /
A method comprising processing the video data such that a zoomed rectangle in relation to a video source value maintains its balance to minimize the "Bob" effect. 9. The method of claim 1, wherein when zooming out an image on the video display, the current pixel width and height and the width and height increments to be added are greater than the maximum width and height that can be displayed. If small,
Compute new width and height as current pixel width and height and width and height increment to be displayed and fixed x and y position x and y center point-respective new width and height / Method of fixing as 2. 10. The method of claim 1, wherein when zooming in on an image on the video display, the current pixel width and height and the width and height increments to be added are greater than the minimum width and height that can be displayed. Where the new pixel width and height to be displayed and the new width and height as increments of width and height and fixed x and y position x and y center points-the new width and respectively A method of fixing the height / 2. 11. A method for continuously scaling an image on a display, wherein video data generated as a video data stream is displayed on a video display at a predetermined aspect ratio and is displayed during playback or in pause mode. Obtain a video x, y source value of pixel width and pixel height to be played, specify a destination area on the display to display the video source value to be displayed, and reduce the ratio to the least significant integer To determine the smallest integer increment on the x / y axis that maintains the desired aspect ratio by using the largest common denominator to make the area of the video source data 1: 1 with the area of the destination area. If the video source data is not supported by the graphics processor unit, Is scaled Te, wherein the having the respective steps. 12. The method of claim 11, further comprising the step of generating a video data stream from an optical disc player. 13. The method of claim 11, further comprising generating the video data stream as a high definition television (HDTV) signal. 14. The method of claim 11, further comprising manipulating a joystick to initiate a zoom function to scale the image on the video display. 15. The method of claim 14, further comprising moving the joystick upwards to increase the zoom factor by a predetermined number of pixels and decreasing the zoom factor by a predetermined number of pixels until fully zoomed out. The step of moving the joystick downward. 16. The method of claim 15, further comprising manipulating a second joystick to change the x / y position of the zoomed area in a continuous manner. 17. The video data display of claim 11 further comprising a video display operatively connected to a video game box including an optical disc player, a central processing unit, a graphics processor unit and a game port. A method comprising steps. 18. The method of claim 11, further comprising processing the video data such that the zoomed rectangle maintains its balance in relation to the video source value to minimize jitter / "Bob" effects. A method comprising: 19. When zooming out an image on the video display according to claim 11, the current pixel width and height and the width and height increments to be added are smaller than the maximum width and height that can be displayed. In case,
Compute the new width and height as the current pixel width and height to display and the width and height increments and x
And y center point fixed x and y center points-fixed as new width and height / 2 respectively. 20. When zooming in an image on the video display according to claim 11, the current pixel width and height and the width and height increments to be added are larger than the minimum width and height that can be displayed. In case,
Calculate the new width and height as the current pixel width and height to be displayed and the width and height increments and x
And y center point fixed x and y center points-fixed as new width and height / 2 respectively. 21. A method of operating a video game, comprising processing a video data stream generated from an optical disc player and displaying the video data on a video display in a predetermined aspect ratio, the pixel width and height to be displayed. On the x / y axis that maintains the desired aspect ratio by using the greatest common denominator to obtain the video source value of the and to reduce the ratio to the least significant integer in response to a predetermined operation of the game controller. Operating the game controller to continuously scale the image on the video display by determining the smallest integer increment of 22. The method of claim 21, further comprising operating the game controller by operating a joystick. 23. The method of claim 22, further comprising moving the joystick upward to increase the zoom factor by a predetermined number of pixels and decreasing the zoom factor by a predetermined number of pixels until fully zoomed out. The step of moving the joystick downward. 24. The method of claim 22, further comprising manipulating a second joystick to change the x / y position of the zoomed area in a continuous manner. 25. The method of claim 21, further comprising displaying video data on a video display operatively connected to a video game box including an optical disc player, a central processing unit, a graphics processor unit, and a game port. A method having. 26. The method of claim 21, further comprising processing the video data such that the rectangle being zoomed to minimize jitter / “Bob” effects maintains its balance in relation to the video source value. A method comprising: 27. The method of claim 21, wherein when zooming out an image on the video display, the current pixel width and height to be added and the width and height increments are greater than the maximum width and height that can be displayed. If smaller, the new pixel width and height to be displayed and the new width and height as increments of width and height and fixed x and y position x and y center points-the new width of each And fixing as height / 2. 28. The method of claim 21, wherein when zooming in on an image on the video display, a current pixel width and height to be added and a width and height increment are greater than a minimum displayable width and height. Where the new pixel width and height to be displayed and the new width and height as increments of width and height and fixed x and y position x and y center points-the new width and respectively A method of fixing the height / 2. 29. A method of operating a video game, processing a video data stream generated from a DVD (Digital Versatile / Video Disc) player device and displaying the video data on a video display at a predetermined aspect ratio, Manipulate the game controller to continuously scale the image on the video display, in which case get the video x, y source value of the pixel width and height to be displayed and display the video source value to be displayed The smallest integer on the x / y axis that maintains the desired aspect ratio by specifying the destination area on the video display to use and using the largest common denominator to reduce the ratio to the least significant integer. The increment is determined, and the area of the video source data has a one-to-one correspondence with the area of the designated area If not, scaling the video source data in a graphics processor unit. 30. The method of claim 29, further comprising operating the game controller by operating a joystick. 31. The method of claim 30, further comprising moving the joystick upwards to increase the zoom factor by a predetermined number of pixels and decreasing the zoom factor by a predetermined number of pixels until fully zoomed out. The step of moving the joystick downward. 32. The method of claim 30, further comprising manipulating a second joystick to change the x / y position of the zoomed area in a continuous manner. 33. The DV of claim 29, further comprising:
A method comprising displaying video data on a video display operatively connected to a video game box containing a D player, a central processing unit, a graphics processor unit, a game port. 34. The method of claim 29, further processing the video data such that the zoomed rectangle maintains its balance relative to the overall source to minimize jitter / "Bob" effects. A method comprising steps. 35. The method of claim 29, wherein when zooming out an image on the video display, the current pixel width and height to be added and the width and height increments are greater than the maximum width and height that can be displayed. If small, calculate the new width and height as the current pixel width and height to be displayed and increments of width and height and fixed x and y position x and y center points-respectively new. A method of fixing as width and height / 2. 36. In claim 29, when zooming in on an image on the video display, the current pixel width and height to be added and the width and height increments are greater than the minimum displayable width and height. If the current pixel width and height to be displayed and the new width and height as increments of width and height and the x and y position fixed x and y center points-the new width of each And fixing as height / 2. 37. In a video display system, a central processing unit and associated graphics processor unit for processing a video data stream and generating video data to be displayed, receiving video data and video in a predetermined aspect ratio. A video display for displaying the data, maintaining the desired aspect ratio using the largest common denominator to obtain the video source value of the pixel width and height to be displayed and reduce the ratio to the lowest integer x A user-operable controller operating with the graphics processor unit to scale the image on the video display by determining the smallest integer increment on the / y axis. Video display system. 38. The video display system of claim 37, wherein the video display comprises a television. 39. The video display system of claim 37, further comprising an optical disc reader including a DVD (Digital Versatile / Video Disc) player for generating the video data stream. . 40. The video display system according to claim 37, wherein the video data stream comprises a high definition television (HDTV) signal. 41. The video display system according to claim 37, wherein the user-operable controller has a joystick. 42. In a video display system, a central processing unit and associated graphics processor unit for processing a video data stream and generating video data to be displayed, receiving video data and video in a predetermined aspect ratio. A video display for displaying an image, operable by a user working with the graphics processor unit to scale the image on the video display by obtaining a video x, y source value of pixel width and height to be displayed Controller,
A desired destination area on the display for displaying the video source value to be displayed, and by using the largest common denominator to reduce the ratio to the least significant integer. Determining the smallest integer increment on the x / y axis that maintains the aspect ratio, and if the area of the video source data does not have a one-to-one correspondence with the area of the destination area, the video source data is transferred to the graphics processor unit. Video display system characterized by scaling. 43. The video display system of claim 42, wherein the video display comprises a television. 44. The video display system of claim 42, further comprising an optical disc reader including a DVD (Digital Versatile / Video Disc) player for generating the video data stream. . 45. The video display system of claim 42, wherein the video data stream comprises high definition television (HDTV) signals. 46. The video display system of claim 42, wherein the user-operable controller comprises a joystick.