JP3643796B2 - Program, information storage medium, and game device - Google Patents

Description

【００５９】
また、図１０（ｂ）に示すように、β＝γ＝１／２となる場合には、内挿される画素Ｐの色ＣＰは、次式のようになる。
ＣＰ＝（ＣＴ１＋ＣＴ２＋ＣＴ３＋ＣＴ４）／４ ・・・（２）
【００６０】
画像抽出部２２２は、リプレイ表示領域ＲＰのサイズに合わせて拡大、或いは縮小した抽出画像９０を、抽出画像記憶部５４０に格納する。図１１は、抽出画像９０を抽出画像記憶部５４０へ格納する際の格納方法の一例を説明するための図である。図１１（ａ）は、１／６０秒毎に生成され、フレームバッファ５２０に順次格納される表示画像を示したものであり、フレームバッファ５２０は、第１フレームＦ１から順に、１／６０秒毎に生成される表示画像により上書きされる。生成した表示画像における抽出画像９０は、図１１（ｂ）に示す抽出画像記憶部５４０に記憶される。
【００６１】
後述するが、本実施形態においては、被写体の画像を、１／６０秒毎に生成される画像のうち、例えば、３フレーム毎に被写体画像を抽出することとする。図１１（ｂ）に示すように、抽出画像記憶部５４０には、記憶領域１から順に、３フレーム毎に抽出される抽出画像９０が格納される。即ち、第１フレームＦ１における抽出画像９０を領域１に、第４フレームＦ４における抽出画像９０を領域２に、というように順次格納していく。また、この図１１における例では、抽出画像記憶部５４０の記憶領域は、３２個分の抽出画像９０を格納する領域が確保されている。この３２個の記憶領域全てに抽出画像９０が格納された場合には、領域１から順に上書きしていくこととする。尚、抽出画像記憶部５４０への抽出画像の格納方法はこれに限られるものではなく、例えば図２、或いは図３に示すように、リプレイ表示領域として１２個の表示領域が設定される際には、抽出画像１２枚分のデータを確保し、表示可能な画像のみを保存することとしてもよい。
【００６２】
以上説明した機能を有する画像抽出部２２２は、画像抽出プログラム４２２に従って処理を実行するものであり、この画像抽出部２２２の動作は、図１２に示すフローチャートに従う。即ち、先ず、ビューボリューム内に被写体（例えば、図７（ｂ）に示す直方体オブジェクト７２）が存在するか否かを判定する（ステップＳ４１）。このステップＳ４１において、被写体がビューボリューム内に存在しないと判断する場合は、本画像抽出を終了する。
【００６３】
ステップＳ４１において、被写体がビューボリューム内に存在すると判断する場合には、予め設定される抽出条件に従って、当該被写体の画像を表示画像から抽出するか否かを判定する（ステップＳ４２）。本実施形態においては、例えば、抽出条件として、３フレーム毎に表示画像から被写体画像を抽出するように設定することとする。尚、抽出条件はこれに限定されるものではなく、抽出タイミングを設定し、このタイミングを判定することにより抽出することとしてもよい。また、この判定処理を行わず、毎フレーム抽出することとしても勿論構わない。このステップＳ４２において、抽出処理を行わないと判断する場合は、本画像抽出を終了する。
【００６４】
ステップＳ４２において、抽出処理を行うと判断する場合、画像抽出部２２２は、被写体の座標値をスクリーン座標系（Ｘｓ、Ｙｓ）の座標値に変換する処理を行う（ステップＳ４３）。
【００６５】
次に、画像抽出部２２２は、スクリーン座標系（Ｘｓ、Ｙｓ）に変換された被写体の、スクリーンにおける上端、下端、左端、右端の座標値を参照して被写体領域を決定するとともに、この被写体を表示する表示領域の縦横比に従って抽出領域を決定する（ステップＳ４４）。
【００６６】
次に、画像抽出部２２２は、フレームバッファ５２０に格納される表示画像データから、ステップＳ４４において決定される抽出領域に対応する領域を抽出する（ステップＳ４５）。そして、抽出した抽出画像のサイズを表示領域に合わせてサイズ変更する（ステップＳ４６）。即ち、表示領域のサイズよりも抽出画像のサイズが小さい場合は当該抽出画像を拡大し、また、表示領域のサイズよりも抽出画像のサイズが大きい場合には当該抽出画像を縮小して、抽出画像のサイズを変更する。
【００６７】
次いで、表示領域のサイズに従ってサイズ変更した抽出画像を、抽出画像記憶部５４０に格納して（ステップＳ４７）、本画像抽出処理を終了する。
【００６８】
画像抽出部２２２における画像抽出処理が終了すると、リプレイを表示するか否かを判定する（図６；ステップＳ５０）。このステップＳ５０において、リプレイ画面を表示しないと判断する場合は、ステップＳ１０に戻って上記した各処理を繰り返す。
【００６９】
ステップＳ１０において、リプレイ画面を表示すると判断する際には、表示制御部２２４が、リプレイ表示処理を実行する（ステップＳ６０）。
【００７０】
表示制御部２２４におけるリプレイ表示処理は、リプレイ画面を表示すると判断する際に、抽出画像記憶部５４０に格納される抽出画像を表示するものである。表示制御部２２４は、抽出画像記憶部５４０に格納される複数の抽出画像の表示を制御する。例えば、格納される複数の抽出画像を配列して配置するように制御するとともに、当該複数の抽出画像を配列する際に、所定の時間差を設けて表示する。
【００７１】
図２、或いは図３に示す１２個のリプレイ表示領域ＲＰ１、ＲＰ２、・・・、ＲＰ１２に抽出画像を表示する場合について説明する。先ず、抽出画像記憶部５４０から、このリプレイ表示領域ＲＰ１、ＲＰ２、・・・、ＲＰ１２に表示する１２枚を決定する。例えば、図１１に示す抽出画像記憶部５４０の記憶領域に格納される最新の抽出画像が、領域３２に格納される抽出画像である場合、この領域３２からさかのぼった１２枚の抽出画像、即ち、領域２１〜領域３２に格納される抽出画像を表示する。具体的には、リプレイ表示領域ＲＰ１に領域２１に格納される抽出画像を、リプレイ表示領域ＲＰ２に領域２２に格納される抽出画像を、そして、リプレイ表示領域ＲＰ１２に領域３２に格納される抽出画像を、所定の時間差に従って表示するように、表示制御する。尚、表示する１２枚の抽出画ー像の決定方法は、これに限るものではなく、抽出画像記憶部５４０に記憶される抽出画像から任意の画像を選択して表示することとしてもよい。
【００７２】
そして、表示制御部２２４によるリプレイ表示処理を終了すると、本処理を終了する。
【００７３】
表示部３００は、プレー画面やリプレイ画面等のゲーム画像を表示する。処理部２００は、一時記憶部５００内のフレームバッファ５２０に格納される表示画像データを、この表示部３００に出力する。
【００７４】
記憶部４００には、各種処理プログラムやデータの他、ゲームの進行に係るゲームプログラム４２０や、ゲームの進行に必要な各種ゲーム情報（図示略）等が格納される。ゲームプログラム４２０は、本発明を実現するため、特に、画像抽出プログラム４２２と、表示制御プログラム４２４とを含む。処理部２００は、この記憶部４００から読み出すプログラム、データに基づいて種々の処理を行う。
【００７５】
一時記憶部５００には、特に、ゲーム演算部２２０がゲームプログラム４２０に従って実行した演算結果や、操作部１００から入力される情報、或いは画像生成部２４０により生成される表示画像データ等が一時的に格納される。また、この一時記憶部５００には、仮想３次元空間に含まれるオブジェクトの、ワールド座標系、視点座標系、及びスクリーン座標系における座標値も一時記憶される。この一時記憶部５００の機能は、例えば、ＲＡＭやＶＲＡＭにより実現可能である。
【００７６】
また、一時記憶部５００は、特に、画像生成部２４０により生成される画像データが格納されるフレームバッファ５２０と、画像抽出部２２２により生成される抽出画像が格納される抽出画像記憶部５４０とを含む。
【００７７】
尚、本実施形態においては、プレーヤの操作する自キャラクタを被写体として設定することとしたが、これに限られるものではなく、仮想３次元空間における任意の領域を指定することも可能である。
【００７８】
次に、本実施形態におけるゲーム装置１を実現できるハードウェアの構成の一例について、図１３を用いて説明する。図１３に示す装置では、ＣＰＵ１０００、ＲＯＭ１００２、ＲＡＭ１００４、ＶＲＡＭ１００５、情報記憶媒体１００６、画像生成ＩＣ１００８、音生成ＩＣ１０１０、Ｉ／Ｏポート１０１２、１０１４がシステムバス１０１６より相互にデータ入出力可能に接続されている。画像生成ＩＣ１００８には表示装置１０１８が、音生成ＩＣ１０１０にはスピーカ１０２０が、Ｉ／Ｏポート１０１２にはコントロール装置１０２２が、Ｉ／Ｏポート１０１４には通信装置１０２４が、それぞれ接続されている。
【００７９】
ＣＰＵ１０００は、情報記憶媒体１００６に格納されるプログラム、ＲＯＭ１００２に格納されるシステムプログラム（装置本体の初期化情報等）、コントロール装置１０２２によって入力される信号等に従って、装置全体の制御や各種データ処理を行う。
【００８０】
ＲＡＭ１００４は、ＣＰＵ１０００の作業領域等として用いられる記憶手段であり、情報記憶媒体１００６やＲＯＭ１００２内の所与の内容、ＣＰＵ１０００の演算結果等が格納される。
【００８１】
ＶＲＡＭ１００５は、図４に示す一時記憶部５００に相当するものであり、表示装置１０１８に表示される表示データを一時的に格納する記憶装置である。このＶＲＡＭ１００５は、画像生成ＩＣ１００８によって生成される１フレーム分の画像データを格納するためのフレームバッファ（図４に示すフレームバッファ５２０に相当）を備える。フレームバッファは、表示装置１０１８の解像度及び色数に応じた容量を備え、画素毎の色情報を記憶する。さらに、このＶＲＡＭ１００５は、フレームバッファに格納される表示画像データから抽出した抽出画像を記憶する記憶領域（例えば、図４に示す抽出画像記憶部５４０）を含む。
【００８２】
情報記憶媒体１００６は、プログラム、画像データ、音データ、プレイデータ等が主に格納されるものであり、情報記憶媒体としてのＲＯＭ等のメモリやハードディスク、或いはゲームカセット、ＩＣカード、磁気ディスク、光ディスク等が用いられる。この情報記憶媒体１００６の機能は、図４に示す記憶部４００に相当する。
【００８３】
例えば、本ゲーム装置を家庭用ゲーム装置に適用する場合、図４に示すゲームプログラム４２０等を格納する情報記憶媒体１００６としてＣＤ−ＲＯＭ、ゲームカセット、ＤＶＤ等が用いられ、プレイデータを格納する情報記憶媒体１００６としてメモリカードなどが用いられる。また、業務用ゲーム装置に適用する場合には、情報記憶媒体１００６としてＲＯＭ等のメモリやハードディスクが用いられる。
【００８４】
また、この装置に設けられている画像生成ＩＣ１００８と音生成ＩＣ１０１０により、音や画像の好適な出力が行えるようになっている。
【００８５】
先ず、画像生成ＩＣ１００８は、ＣＰＵ１０００の命令によって、ＲＯＭ１００２、ＲＡＭ１００４、情報記憶媒体１００６等から送られる情報に基づいて画素情報を生成する集積回路であり、生成される表示信号は表示装置１０１８に出力される。表示装置１０１８は、ＣＲＴやＬＣＤ、ＴＶ、プラズマディスプレイ、或いはプロジェクター等により実現され、図４に示す表示部３００に相当する。
【００８６】
また、音生成ＩＣ１０１０は、ＣＰＵ１０００の命令によって、情報記憶媒体１００６やＲＯＭ１００２に記憶される情報、ＲＡＭ１００４に格納される音データに応じた音信号を生成する集積回路であり、生成される音信号はスピーカ１０２０によって出力される。
【００８７】
コントロール装置１０２２は、図４に示す操作部１００に相当するものであり、プレーヤがゲームに係る操作を入力するための装置である。
【００８８】
通信装置１０２４は本ゲーム装置１内部で利用される情報を外部とやりとりするものであり、他の装置と通信回線を介して接続されてプログラムに応じた所与の情報を送受信する際に利用される。
【００８９】
そして、ゲーム進行処理等の上述した処理は、図４に示すゲームプログラム４２０等を格納した情報記憶媒体１００６と、これらプログラムに従って動作するＣＰＵ１０００、画像生成ＩＣ１００８、音生成ＩＣ１０１０等によって実現される。ＣＰＵ１０００及び画像生成ＩＣ１００８は、図４に示す処理部２００に該当するものであり、主にＣＰＵ１０００が図４に示すゲーム演算部２２０に、画像生成ＩＣ１００８が図４に示す画像生成部２４０に該当する。
【００９０】
尚、画像生成ＩＣ１００８、音生成ＩＣ１０１０等で行われる処理は、ＣＰＵ１０００或いは汎用のＤＳＰ等によりソフトウェア的に行ってもよい。この場合には、ＣＰＵ１０００が、図４に示す処理部２００に該当することとなる。
【００９１】
次に、図１４に、本ゲーム装置１を、家庭用ゲーム装置に適用した場合の例を示す。即ち、ゲーム装置本体１２００に、ゲームコントローラ１２０２、１２０４、及びディスプレイ１２０６が接続されており、プレーヤは、このディスプレイ１２０６に表示されるゲーム画像を見たり、図示しないスピーカから出力されるゲーム音を聞きながら、ゲームコントローラ１２０２、１２０４によりキャラクタ等を操作してゲームを楽しむ。更に、ゲーム装置本体１２００に対して着脱自在なＣＤ（ＤＶＤ）１２０８、或いはメモリカード１２１０やＩＣカード１２１２等の情報記憶媒体には、図４に示す記憶部４００に格納されているゲームプログラム４２０や図示しないゲームデータ等の情報が格納され、ゲーム装置本体１２００は、これらの情報に従って、各種処理（例えば、図６、或いは図１２等に示す処理）を行う。尚、図４に示す操作部１００はコントローラ１２０２、１２０４に、表示部３００はディスプレイ１２０６にそれぞれ相当するものである。
【００９２】
また、本ゲーム装置１を、業務用ゲーム装置１１００に適用した場合の例を図１５に示す。この業務用ゲーム装置１１００は、プレーヤが、スピーカ１１０２から出力されるゲーム音を聞きながら操作レバー１１０４、或いは操作ボタン１１０６・・・を操作することによって、ディスプレイ１１０８上に表示されるキャラクタ等を操作してテニスゲームを楽しむ装置である。尚、図４に示す操作部１００は操作レバー１１０４、或いは操作ボタン１１０６・・・に、表示部３００はディスプレイ１１０８に、それぞれ相当する。
【００９３】
業務用ゲーム装置１１００に内蔵されるシステム基板１１１０には、ＣＰＵ、画像生成ＩＣ、音生成ＩＣ等が実装されている。そして、図４に示すゲームプログラム４２０や図示しないゲームデータ等が、システム基板１１１０上の情報記憶媒体であるメモリ１１１２に格納されている。
【００９４】
さらに、図１６に示すように、本ゲーム装置１を、ホスト装置１３００と、このホスト装置１３００と通信回線１３０２を介して接続される端末１３０４−１〜１３０４−ｎと、を含むゲーム装置に適用することとしてもよい。この端末１３０４−１〜１３０４−ｎは、少なくとも、ゲーム画像の表示と、ゲーム音の出力と、ゲーム操作の入力とが可能な装置であり、プレーヤは、端末１３０４−１〜１３０４−ｎの何れかでテニスゲームを楽しむ。
【００９５】
この場合、図４に示すゲームプログラム４２０や図示しないゲームデータ等の情報は、例えばホスト装置１３００が制御可能な磁気ディスク装置、磁気テープ装置、メモリ等の情報記憶媒体１３０６に格納されている。端末１３０４−１〜１３０４−ｎが、ＣＰＵ、画像生成ＩＣ、音生成ＩＣを有し、スタンドアロンでゲーム画像やゲーム音を生成できる場合には、ホスト装置１３００から、情報記憶媒体１３０６に格納されるプログラムやデータ等が、通信回線１３０２を介して端末１３０４−１〜１３０４−ｎに配信され、各端末１３０４−１〜１３０４−ｎにおいて、ゲーム画像やゲーム音を生成する。一方、スタンドアロンでゲーム画像やゲーム音を生成できない場合には、ホスト装置１３００がゲーム画像やゲーム音を生成し、これを端末１３０４−１〜１３０４−ｎに配信する。そして、端末１３０４−１〜１３０４−ｎにおいて、生成した、或いは配信されたゲーム画像やゲーム音をそれぞれ出力する。
【００９６】
以上、本発明を適用したゲーム装置の一例について説明したが、本発明は、上記実施形態に限定されるものではなく、本発明の趣旨を逸脱しない範囲において適宜変更可能である。
【００９７】
例えば、予め、被写体となるオブジェクトに所与のパラメータを設定し、表示画像から抽出画像を抽出する処理を行うか否かを判定する際に、当該パラメータを判定することにより抽出するか否かを決定することとしてもよい。例えば、被写体として人オブジェクトを指定するとともに、この人オブジェクトに喜怒哀楽のパラメータを設定すれば、このパラメータを判定することにより、表示画像に表示される被写体の表情が、例えば、笑顔の場合において抽出処理を行うことも可能である。
【００９８】
また、本実施形態においては、図２或いは図３に示すように、抽出画像の表示領域として１２のリプレイ表示領域ＲＰ１、ＰＲ２、・・・ＲＰ１２を設定し、このリプレイ表示領域ＲＰ１、ＰＲ２、・・・ＲＰ１２に所定の時間差に従って抽出画像を表示することによりリプレイ画面を演出することとしたが、図１７に示すリプレイ画面のように、リプレイ表示領域ＲＰ２０を時間ｔ毎に順次抽出画像により更新することによりリプレイ画面を演出することとしてもよい。即ち、表示制御部２２４は、先ず、抽出画像を表示するリプレイ表示領域ＲＰ２０を設定し、リプレイの表示タイミングにおいて、表示する抽出画像及びその順番を決定する。そして、１番目の抽出画像をリプレイ表示領域ＲＰ２０に表示し、時間ｔ経過時において、当該リプレイ表示領域ＲＰ２０に２番目の抽出画像を表示する、というように抽出画像の表示を制御する。
【００９９】
また、図１８に示すようにリプレイ画面を演出することとしてもよい。この場合、表示制御部２２４は、リプレイ画面において表示する複数の抽出画像がスライドするように各リプレイ表示領域ＲＰ３０を設定し、リプレイの表示タイミングにおいて、抽出画像を所定の時間差に基づいて順次表示するように抽出画像の表示を制御することとしてもよい。
【０１００】
さらに、図１９に示すように、リプレイ画面に設定される各リプレイ表示領域ＲＰ４０〜４５のサイズを全て異なるようにしてもよい。即ち、表示制御部２２４の設定する抽出画像を表示する領域のサイズは任意であり、抽出して保存する抽出画像のサイズを各リプレイ表示領域のサイズに応じてそれぞれ決定することにより、リプレイ時に表示される複数の抽出画像のサイズがそれぞれ異なるようなリプレイ画面の演出が可能である。
【０１０１】
また、本実施形態においては、表示画像から抽出した画像を抽出画像記憶部５４０に保存することとしたが、抽出画像に対して、例えば、ぼかし、ノイズ、明度等の度合いやα値の変更処理、回転やゆがみ等の変形処理など、各種フィルターによる加工を施した後、当該画像を抽出画像記憶部５４０に格納することとしてもよい。さらに、この際、フィルターに設定されるフィルターパラメータを各抽出画像によって変化させて格納することとしてもよい。これによれば、例えば、抽出画像をフェイドイン或いはフェイドアウトさせるかのようなリプレイ画面を演出することができる。また、抽出画像の表示順序等を、このフィルターパラメータに従って決定してもよい。
【０１０２】
尚、上記実施形態においては、本発明をテニスゲームに適用した場合を例に説明したが、本発明は、例えば、野球ゲーム、ゴルフゲーム等の種々のスポーツゲーム、格闘ゲーム、或いはシュミレーションゲームなど、その他の種々のゲームにも適用可能である。
【０１０３】
【発明の効果】
本発明によれば、表示画像から抽出する抽出画像のサイズを、リプレイ画面において当該抽出画像を表示する表示領域の縦横比に従って決定するとともに、抽出した抽出画像を表示領域のサイズに合わせるように拡縮して保存する。これによれば、抽出画像を表示する際に、保存された抽出画像を読み出すだけでよく、特別な処理を必要としない。例えば、リプレイの対象となるキャラクタ等を被写体に指定することにより、保存される抽出画像の表示処理、或いはこの表示を制御する処理を行うだけで、当該キャラクタの動作を再現することができる。
【０１０４】
また、この際、ゲーム画像として表示画面に一度表示された画像の被写体領域の画像を複数保存することにより、この複数の画像を用いて、例えば、リプレイ、逆回しの表示等、様々な演出が可能となる。さらに、表示する際に、画像データを順次予め設定される時間差に基づいてコマ送りで表示する、或いは表示画面を分割して複数の画像データを１画面に表示する等の演出が可能となる。
【図面の簡単な説明】
【図１】本実施形態におけるプレー画面の一例を示す図である。
【図２】本実施形態におけるリプレイ画面の一例を示す図である。
【図３】本実施形態におけるリプレイ画面の一例を示す図である。
【図４】本実施形態におけるゲーム装置の機能ブロックの一例を示す図である。
【図５】表示画像を生成する処理を説明するための図である。
【図６】本実施形態における処理部の動作の一例を示すフローチャートである。
【図７】（ａ）は仮想３次元空間の一例を、（ｂ）は被写体として設定される直方体オブジェクトの一例を示す図である。
【図８】（ａ）はスクリーン座標系に変換された被写体の一例を、（ｂ）は抽出画像の表示領域の一例を示す図である。
【図９】（ａ）はフレームバッファに格納される表示画像の一例を、（ｂ）は抽出画像記憶部に格納される抽出画像の一例を示す図である。
【図１０】バイリニア・フィルタリングを説明するための図である。
【図１１】抽出画像を抽出画像記憶部に格納する処理を説明するための図である。
【図１２】本実施形態における画像抽出処理の一例を示すフローチャートである。
【図１３】本実施形態におけるハードウェア構成の一例を示す図である。
【図１４】本ゲーム装置を業務用ゲーム機に適用した場合を示す図である。
【図１５】本ゲーム装置を家庭用ゲーム機に適用した場合を示す図である。
【図１６】本ゲーム装置をホスト装置と通信回線を介して接続される端末に適用した場合を示す図である。
【図１７】リプレイ画面の演出方法の一例を説明するための図である。
【図１８】リプレイ画面の演出方法の一例を説明するための図である。
【図１９】リプレイ画面の演出方法の一例を説明するための図である。
【符号の説明】
１ ゲーム装置
１００ 操作部
２００ 処理部
２２０ ゲーム演算部
２２２ 画像抽出部
２２４ 表示制御部
２４０ 画像生成部
３００ 表示部
４００ 記憶部
４２０ ゲームプログラム
４２２ 画像抽出プログラム
４２４ 表示制御プログラム
５００ 一時記憶部
５２０ フレームバッファ
５４０ 抽出画像記憶部[0001]
BACKGROUND OF THE INVENTION
The present invention program The program The information storage medium which memorize | stored and game device.
[0002]
[Prior art]
Currently, various types of games are provided, and in particular, sports games, fighting games, racing games, and the like that have a replay function for reproducing a game screen are known. This replay function stores game data at the time of game progress, and reproduces a score scene such as a goal scene and a highlight scene such as a KO scene by referring to the game data related to the scene. Furthermore, a game device having a function of generating an image from a viewpoint different from the viewpoint at the time of progress of the game is known as a replay function.
[0003]
[Problems to be solved by the invention]
By the way, the replay function is preferably used for reference in order to make use of it for the next play, as well as dramatic production in terms of looking back on the play. Further, since advanced processing can be realized by the advancement of hardware of computers and game devices, there has been a tendency to further enhance the rendering effect is to provide more realistic images. It is an object of the present invention to provide a replay function having a high effect of production without using another method, that is, advanced processing.
[0004]
[Means for Solving the Problems]
To solve the above issues, 1st invention Is a function for causing a generation unit (for example, the image generation unit 240 shown in FIG. 4) to generate an image of a virtual space based on a given viewpoint for an apparatus having the processor by calculation and control by the processor. First storage means (for example, a frame buffer 520 shown in FIG. 4) that stores game information as an image generated by the generating means as a frame image (for example, a display image in an embodiment of the invention); Extraction means (for example, the image extraction unit 222 shown in FIG. 4) that determines an extraction area from the frame image and extracts an image of the extraction area, and a second that stores the extraction image extracted by the extraction means. Reproduction for generating a reproduction image of the game, including the storage means (for example, the extracted image storage unit 540 shown in FIG. 4) and the extracted image stored in the second storage means Stage (e.g., the display control unit 224 shown in FIG. 4), characterized in that it includes information to function and, to the device.
[0005]
Also, Other inventions Is a game device including a generation unit (for example, the image generation unit 240 shown in FIG. 4) that generates a virtual space image based on a given viewpoint, and stores the image generated by the generation unit as a frame image First storage means (for example, frame buffer 520 shown in FIG. 4) and extraction means for determining an extraction area from the frame image and extracting an image of the extraction area (for example, image extraction shown in FIG. 4) Unit 222), second storage means for storing the extracted image extracted by the extraction means (for example, the extracted image storage section 540 shown in FIG. 4), and the extracted image stored in the second storage means. Including reproduction means (for example, a display control unit 224 shown in FIG. 4) for generating a reproduction image of the game.
[0006]
this According to the invention, an image of an arbitrary region of the frame image stored in the first storage unit is extracted, and the extracted image is stored in the second storage unit, so that the extraction region in the frame image is stored. Reproduce the image. That is, by extracting an image of a necessary area from the frame image stored in the first storage unit to the second storage unit, the image of the extraction area in the frame image can be reproduced. For example, replay of an arbitrary scene in a game can be realized using an image extracted from a frame image.
[0007]
Also, Second invention Game information Is , 1st invention Information for causing the device to function setting means (for example, the game calculation unit 220 shown in FIG. 4) for setting the subject (for example, the player's own character in the embodiment of the invention) and the subject in the virtual space. Information for causing the apparatus to function calculation means (for example, the image extraction unit 222 shown in FIG. 4) that calculates the position of the subject in the frame image corresponding to the position by coordinate conversion based on the viewpoint; And an extraction unit including information for determining an extraction region based on a calculation result by the calculation unit.
[0008]
this Second invention According to this, for example, an object arranged in a virtual space can be specified as a subject to be stored, and an image of this subject can be stored in the second storage means. Further, when extracting an image of a subject, the position of the subject in the frame image is determined by coordinate conversion based on the position of the viewpoint installed in the virtual space. According to this, even when the subject is not actually drawn on the frame image due to other objects existing in the virtual space becoming an obstacle, the region that is the position of the subject based on the viewpoint in the frame image is determined. Can be extracted.
[0009]
Furthermore, in this case Third invention Game information As , Second invention The extraction unit may include information for determining an extraction region according to the size of the subject in the frame image.
[0010]
this Third invention Accordingly, the ratio of the subject in the extracted image can be made constant regardless of the size of the subject in the frame image. According to this, it is possible to extract an area where the subject just fits from the frame image.
[0011]
4th invention Game information for 2nd or 3rd invention The information for causing the apparatus to function size setting means (for example, the image extraction unit 222 shown in FIG. 4) for setting the size of the extracted image stored in the second storage means, and And information for determining the aspect ratio of the extraction area based on the aspect ratio of the size of the extracted image set by the size setting means.
[0012]
this 4th invention According to the above, the size of the extracted image stored in the second storage means is set in advance, and the aspect ratio of the extracted region is set based on the aspect ratio of the size of the extracted image. The aspect ratio of the extraction area in the image can be made constant.
[0013]
Furthermore, in this case 5th invention Game information As , 4th invention The size setting means sets the vertical size of the extracted image to 1 / integer of the vertical size of the frame image and / or sets the horizontal size of the extracted image to an integer of the horizontal size of the frame image 1 may be included.
[0014]
this 5th invention According to the above, when determining the size of the extracted image, the size of the extracted image can be determined according to the size of the frame image, that is, the size of the display screen. That is, the size of the extracted image can be determined based on the aspect ratio of the screen on which the extracted image is displayed.
[0015]
6th invention Game information for Any of the first to fifth inventions The information for causing the device to function scaling means (for example, the image extracting unit 222 shown in FIG. 4) for scaling the extracted image extracted by the extracting means to a given size, and the second storage And means for functioning to store the extracted image scaled by the scaling means.
[0016]
this 6th invention According to this, the size of the extracted extracted image is changed by enlarging or reducing according to a given size set by the size setting means. Therefore, when the size of the extracted image is set according to the size required for reproducing, no special processing is required when generating the reproduced image using the extracted image.
[0017]
Also, 7th invention Game information for Any of the first to sixth inventions In the above, information for causing the device to function an extraction time setting means (for example, the game calculation unit 220 shown in FIG. 4) for setting the extraction time, and a time when the extraction means is set by the extraction time setting means And information for extracting the extracted image from the frame image corresponding to.
[0018]
this 7th invention Accordingly, it is possible to set conditions for extracting an image from a frame image, and it is possible to extract only a subject that satisfies the condition. As the extraction condition, for example, a timing for extracting an image, a preset parameter, and the like are determined. This parameter includes information such as the characteristics and state of the subject set for the subject. Specifically, for example, a person object can be designated as a subject, a emotion parameter can be set for the person object, and this parameter can be set as an extraction condition. According to this, extraction processing can be performed according to the facial expression of the subject displayed in the display image.
[0019]
further, Eighth invention Game information for Any one of the first to seventh inventions And the second storage means arranges information for accumulating the extracted images extracted by the extraction means, and the reproduction means arranges a plurality of extracted images stored in the second storage means. And information for generating a reproduced image.
[0020]
this Eighth invention Accordingly, since the image of the subject is accumulated, for example, if a character or the like moving in the virtual space is designated as the subject, the motion of the subject can be recorded. This makes it possible to reproduce the movement of the subject as necessary. At this time, since it is only necessary to read out the extracted image stored in the second storage means, the motion of the subject can be reproduced without requiring any special processing. According to this, by controlling the arrangement order or the like when arranging the plurality of extracted images stored in the second storage means, the replay, reverse rotation, etc. of the subject motion are realized in the generated reproduced image. I can do things. Furthermore, when generating a reproduced image, a plurality of stored extracted images are sequentially displayed on a frame basis based on a preset time difference, or a plurality of extracted images are displayed on one screen by dividing the display screen. For example, a reproduced image can be produced.
[0021]
In this case, Ninth invention Game information As , Eighth invention The reproduction unit may include information for selecting an extraction image to be included in the reproduction image from a plurality of extraction images stored in the second storage unit.
[0022]
this Ninth invention According to this, it is possible to select an appropriate image for generating a reproduced image from a plurality of extracted images stored in the second storage unit.
[0023]
Also, 10th invention Game information for Any of the first to ninth inventions When the second storage means stores the extracted image, it includes information for storing the extracted image by applying a given filter.
[0024]
Here, the filter is to perform some processing on the extracted image stored in the second storage means. Specifically, for example, the extracted image is blurred, noise is added, and the brightness is changed. , Processing such as setting of the α value, deformation processing of the extracted image due to rotation or distortion, and the like.
[0025]
this 10th invention According to the above, the extracted image that has passed the given filter is stored in the second storage means. Furthermore, in the case where the extracted images are accumulated and stored in the second storage means, the filter parameters set for the respective filters can be changed and stored depending on the extracted images. Therefore, by arranging the extracted image based on the parameter, it is possible to produce a reproduced image by, for example, fade-in or fade-out. The filter parameter is, for example, a value set when applying a filter such as an α value, a coefficient to be multiplied to the RGB value of each pixel, or a value for specifying an option of the filter.
[0026]
further, Eleventh invention Information storage media As , Any one of the first to tenth inventions Remember game information Configuring an information storage medium It is good as well.
[0027]
this Eleventh invention According to Any one of the first to tenth An information storage medium having the same effect as that of the present invention can be realized.
[0028]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, a game device to which the present invention is applied will be described in detail with reference to the drawings. In the following, a case where the present invention is applied to a tennis game will be described as an example. However, the present invention is not limited to this. Also, in the tennis game, a battle is realized by operating an opponent character that is an opponent of a character controlled by the player (hereinafter referred to as the player character) by computer control.
[0029]
FIG. 1 shows an example of a tennis game play screen. In FIG. 1, the player controls the player character 2 playing on the front side of the court and enjoys the tennis game by playing against the opponent character 4 playing on the back side of the court.
[0030]
FIG. 2 shows an example of a replay screen displayed to reproduce the scoring scene after scoring. In FIG. 2, the replay screen includes a real-time display area P1 and replay display areas RP1, RP2,. Here, in the real-time display area P1, for example, an arbitrary moving image such as a play screen or an explanation screen is displayed. In the replay display areas RP1, RP2,..., RP12, the action of the player character 2 in the scoring scene is displayed as 12 still images clockwise from the upper left. Further, when the image of the player character 2 displayed in the replay display areas RP1, RP2,..., RP12 is displayed, the images are displayed by frame advance at predetermined time intervals in order from the upper left replay display area RP1. .
[0031]
The present invention uses, for example, an object placed in a virtual three-dimensional space, an arbitrary area in the virtual three-dimensional space, or the like as a subject, and an image of the subject designated from image data stored in every frame in the frame buffer. Are extracted and recorded separately, and the recorded image of the subject is displayed at an arbitrary display timing. In this embodiment, the subject is the player character 2 and the display area for displaying the subject at the time of replay is recorded as the replay display areas RP1, RP2,..., RP12 shown in FIG. By displaying the image of the player character 2 in each of the replay display areas RP1, RP2,..., RP12, the scoring scene of the player character 2 is reproduced.
[0032]
FIG. 3 shows an example of a replay screen when the player character 2 plays on the back side of the court. As shown in FIG. 3, on the play screen displayed in the real-time display area P1, an image of the player character 2 playing on the back side of the court is displayed. In the replay display areas RP1, RP2, ..., RP12, images of the player character 2 in the scoring scene are displayed.
[0033]
As shown in FIG. 2 and FIG. 3, regardless of the place where the player character 2 plays, that is, the position and size of the player character 2 on the play screen, the image of the player character 2 in the scoring scene is displayed in each replay display area. RP1, RP2,..., RP12 are displayed so as to fit. Further, even if the play position of the player character 2 is moved, the image of the player character 2 is displayed at the center of each of the replay display areas RP1, RP2,.
[0034]
FIG. 4 is a diagram illustrating an example of functional blocks of the game apparatus 1 according to the present embodiment. In the figure, the functional block includes an operation unit 100, a processing unit 200, a display unit 300, a storage unit 400, and a temporary storage unit 500.
[0035]
The operation unit 100 is for the player to input operation data, and outputs an operation signal corresponding to the operation by the player to the processing unit 200. The function of the operation unit 100 can be realized by hardware such as a lever, a button, and a housing.
[0036]
The processing unit 200 performs various processes such as control of the entire game device 1, instructions to the respective function units in the game device 1, game progress processing, image processing, sound processing, and the like. Storage processing unit, setting processing of the position and line-of-sight direction of the virtual camera in the virtual three-dimensional space, processing for generating an image of the virtual three-dimensional space (hereinafter referred to as a display image) viewed from the virtual camera, and the like It is executed according to the game program 420 stored in 400. The function of the processing unit 200 can be realized by hardware such as various processors (CPU, DSP, etc.), ASIC (gate array, etc.), or a given program.
[0037]
The processing unit 200 includes a game calculation unit 220 and an image generation unit 240 as main functional units. Here, the operation of the processing unit 200 related to the generation of the game image will be described with reference to FIG.
[0038]
FIG. 5 is a diagram for explaining display image generation processing. As shown in FIG. 5, an object 600 and a viewpoint (virtual camera) 610 are set in a virtual three-dimensional space. The object 600 has a shape, color, texture, etc. defined as object data. The game calculation unit 220 sets the coordinate value of the object 600 in the world coordinate system (Xw, Yw, Zw) based on the position information and direction information of each polygon constituting the object 600 according to the object data related to the object 600. To do. Subsequently, the position of the viewpoint 610 and the direction of the line of sight are set in the world coordinate system (Xw, Yw, Zw), and the view volume 620 is determined by clipping processing. Then, each polygon included in the view volume 620 is converted into a coordinate value of the viewpoint coordinate system (Xv, Yv, Zv) with the viewpoint 610 as a reference, and then the determined viewpoint coordinate system (Xv, Yv, Zv) Based on these coordinate values, a process of converting into coordinate values of a two-dimensional screen coordinate system (Xs, Ys) is performed.
[0039]
The image generation unit 240 generates a display image based on the processing result in the game calculation unit 220. Specifically, rendering processing such as color interpolation processing and hidden surface removal processing is performed on the object 600 projected on the screen 630 based on information relating to the color, texture, and the like defined for the object 600. As a result, the object 600 is projected on the screen 630 placed on the extension of the viewpoint 610, and the display image is drawn on the screen 630. Then, the display image data is written into the frame buffer 520, and display image data for one frame corresponding to one inter time (for example, 1/60 second) is generated.
[0040]
In order to implement the present invention, the game calculation unit 220 includes an image extraction unit 222 and a display control unit 224, in particular.
[0041]
The image extraction unit 222 executes processing according to the image extraction program 422, extracts an image of a subject specified in advance from the image data stored in the frame buffer 520, and stores the subject image in the extracted image storage unit 540. Perform the process. At this time, the image of the subject is extracted and scaled according to the size of the display area for displaying the subject image.
[0042]
The display control unit 224 executes processing according to the display control program 424, and before the extraction processing by the image extraction unit 222 described later is performed, the size of the display area of the subject image (for example, the replay display shown in FIG. 2 or FIG. 3). Regions RP1, RP2,... RP12) are set. At this time, the size of the display area of the subject image is set based on the aspect ratio of the display screen. Although the size of the display area is arbitrary, as described above, the image extraction unit 222 extracts the image of the subject according to the size of the display area and stores it in the extracted image storage unit 540.
[0043]
Further, when the image stored in the extracted image storage unit 540 is displayed on the display screen, the display control unit 224 performs processing for controlling display of the image.
[0044]
Next, the operation of the processing unit 200 for realizing the present invention will be described with reference to FIG. FIG. 6 is a flowchart showing an example of the flow of processing in the present embodiment. As shown in the figure, first, the game calculation unit 220 sets the virtual three-dimensional space by arranging objects constituting the virtual three-dimensional space (step S10). Furthermore, the game calculation unit 220 arranges a virtual camera in the virtual three-dimensional space set in the world coordinate system (Xw, Yw, Zw) in step S10, and the viewpoint by the virtual camera and the direction of the line of sight from the viewpoint. Control etc.
[0045]
Next, the game calculation unit 220 performs a clipping process to determine a view volume, and coordinates a polygon positioned in the view volume in a viewpoint coordinate system (Xv, Yv, Zv) centered on the viewpoint of the virtual camera. A process of converting into a coordinate value in the two-dimensional screen coordinate system (Xs, Ys) is performed based on the coordinate value of the viewpoint coordinate system (Xv, Yv, Zv) determined and converted into a value (step S20).
[0046]
Subsequently, based on the processing results in step S10 and step S20 by the game calculation unit 220, the image generation unit 240 performs data such as the coordinate value of the object in the screen coordinate system (Xs, Ys) and the object related to each object. By executing various rendering processes based on the data, a rendering process is performed on the object projected on the screen to generate a display image (step S30). At this time, the pixel information of the generated display image is written into the frame buffer 520. The pixel information is converted into an image signal by the processing unit 200 in accordance with the display timing of the display image corresponding to the pixel information, and is output to the display unit 300.
[0047]
Next, the image extraction unit 222 executes image extraction processing (step S40). The image extraction unit 222 performs processing for extracting an image of a subject specified in advance from a display image. Here, the function of the image extraction unit 222 will be described with reference to FIGS.
[0048]
FIG. 7A shows an example of a perspective view of a virtual three-dimensional space. As shown in FIG. 7A, a cuboid object 72 and a desk object 74 are arranged in the virtual three-dimensional space, and the cuboid object 72 is arranged on the desk object 74. Further, a virtual camera 76 is installed so as to photograph the rectangular parallelepiped object 72 and the desk object 74. FIG. 7B shows a rectangular parallelepiped object 72 arranged in the virtual three-dimensional space. Here, the processing in the image extraction unit 222 will be described below by taking as an example the case where the cuboid object 72 is designated as a subject and the image of the cuboid object 72 is extracted from the display image.
[0049]
The image extraction unit 222 performs a coordinate conversion process to the screen coordinate system (Xs, Ys) only for the rectangular parallelepiped object 72 that is a subject arranged in the virtual three-dimensional space illustrated in FIG. Then, with reference to the coordinate value of each vertex of the rectangular parallelepiped object 72 converted to the screen coordinate system (Xs, Ys), the position of the rectangular parallelepiped object 72 on the screen, that is, the position of the rectangular parallelepiped object 72 in the display image is acquired. .
[0050]
FIG. 8 is a diagram for explaining extraction region determination processing when an image of the rectangular parallelepiped object 72 is extracted. FIG. 8A is a diagram showing the rectangular parallelepiped object 72 on the screen 80 when the rectangular parallelepiped object 72 is converted into the coordinate values of the screen coordinate system (Xs, Ys). First, the image extracting unit 222 sets a region 82 (hereinafter referred to as a subject region) 82 of the cuboid object 72 on the screen 80 based on the coordinate value of the vertex of the cuboid object 72 converted into the screen coordinate system (Xs, Ys). decide. Specifically, among the coordinate values of the vertices of the rectangular parallelepiped object 72 in the screen coordinate system (Xs, Ys), the coordinate values at the upper end, the lower end, the left end, and the right end, for example, the coordinate values of the vertices 86 and 88 are acquired. . Based on the coordinate values, the subject area 82 is determined so that the cuboid object 72 is included.
[0051]
By determining the subject region 82 as described above, for example, the subject image is not drawn on the display image because another object exists in front of the rectangular parallelepiped object 72 that is the subject for the virtual camera 76. Alternatively, even when only a part is drawn, the region where the rectangular parallelepiped object 72 is projected can be designated as the subject region 82. Further, since the subject area 82 is determined based on the size of the rectangular parallelepiped object 72, an area in which the rectangular parallelepiped object 72 just fits can be set as the extraction area.
[0052]
Next, the image extraction unit 222 determines an area (hereinafter referred to as an extraction area) 84 that is actually extracted from the display image based on the size of the replay display area RP that displays the subject. FIG. 8B shows an example of the replay display area RP that displays the subject. As described above, the replay display area RP that displays the image of the subject to be extracted is set in the display control unit 224 before the extraction process is performed.
[0053]
Here, as an example, as shown in FIG. 8B, the replay display area RP is a × 2a, that is, the extraction area is represented by a ratio of vertical and horizontal lengths of 1: 2. A case where 84 is determined will be described. First, the vertical and horizontal lengths in the subject area 82 are compared. Then, the extraction region 84 is determined according to the aspect ratio of the replay display region PR with the longer length as a reference. Here, since the subject area 82 is vertically long, the horizontal length is twice as long as the vertical length of the subject area 82 with reference to the vertical length b, and the size of the extraction area 84 is b ×. 2b is determined. Then, the determined coordinate value of the extraction area 84 is stored in the temporary storage unit 500.
[0054]
The image extraction unit 222 extracts a region corresponding to the extraction region 84 in the display image stored in the frame buffer 520 according to the extraction region 84 determined as described above. FIG. 9 is a diagram for explaining processing for extracting an image of the extraction region 84. FIG. 9A shows an example of a display image stored in the frame buffer 520. In the display image shown in FIG. 9A, an image 90 (hereinafter referred to as an extracted image) of an area corresponding to the extraction area 84 determined according to the coordinate values of the screen coordinate system (Xs, Ys) as described above is extracted. .
[0055]
Then, the image extraction unit 222 changes the size of the extracted image 90 according to the size of the replay display area RP to be displayed, and stores the extracted image 90 in the extracted image storage unit 540. FIG. 9B shows an example of the extracted image 90 stored in the extracted image storage unit 540. The size of the extracted image 90 shown in FIG. 9B is equivalent to the size of the replay display area RP shown in FIG. That is, when the extracted image 90 is stored in the extracted image storage unit 540, a process of enlarging or reducing the size of the extracted image 90 in accordance with the size of the replay display area RP is performed.
[0056]
Note that when the extracted image 90 is resized in accordance with the replay display area RP, a reduced image or an enlarged image may be generated by an image smoothing process using a bilinear filtering pixel data interpolation function. . In an image generation device such as a game device, interpolation pixel data calculation processing such as re-neighbor interpolation, bilinear interpolation (so-called bilinear filtering), and cubic convolution interpolation (so-called trilinear filtering) is performed. In such a case, the image smoothing process can be realized at a higher speed.
[0057]
Here, bilinear filtering will be described. FIG. 10 is a diagram illustrating a relationship between existing pixels (T1, T2, T3, and T4) and a pixel (P) interpolated by bilinear filtering. As shown in FIG. 10A, the color CP of the interpolated pixel (sampling point) P is a color obtained by interpolating the colors of the pixels T1 to T4 around P.
[0058]
Specifically, based on the coordinates of T1 to T4 and the coordinates of P, the coordinate ratio β: 1-β (0 ≦ β ≦ 1) in the x-axis direction and the coordinate ratio γ: 1-γ (y-axis direction) 0 ≦ γ ≦ 1). The P color CP (output color by bilinear filtering) can be expressed by the following equation.

[0059]
As shown in FIG. 10B, when β = γ = 1/2, the color CP of the interpolated pixel P is expressed by the following equation.
CP = (CT1 + CT2 + CT3 + CT4) / 4 (2)
[0060]
The image extraction unit 222 stores the extracted image 90 enlarged or reduced in accordance with the size of the replay display area RP in the extracted image storage unit 540. FIG. 11 is a diagram for explaining an example of a storage method when the extracted image 90 is stored in the extracted image storage unit 540. FIG. 11A shows display images that are generated every 1/60 seconds and sequentially stored in the frame buffer 520. The frame buffer 520 sequentially starts from the first frame F1 every 1/60 seconds. Is overwritten by the display image generated. The extracted image 90 in the generated display image is stored in the extracted image storage unit 540 shown in FIG.
[0061]
As will be described later, in the present embodiment, a subject image is extracted every three frames among images generated every 1/60 seconds. As illustrated in FIG. 11B, the extracted image storage unit 540 stores extracted images 90 extracted every three frames in order from the storage area 1. That is, the extracted image 90 in the first frame F1 is sequentially stored in the region 1, the extracted image 90 in the fourth frame F4 is sequentially stored in the region 2, and so on. In the example in FIG. 11, the storage area of the extracted image storage unit 540 has an area for storing 32 extracted images 90. When the extracted image 90 is stored in all 32 storage areas, the area 1 is overwritten in order. Note that the method of storing the extracted image in the extracted image storage unit 540 is not limited to this. For example, as shown in FIG. 2 or 3, when 12 display areas are set as the replay display area. May secure data for 12 extracted images and store only displayable images.
[0062]
The image extraction unit 222 having the functions described above executes processing according to the image extraction program 422, and the operation of the image extraction unit 222 follows the flowchart shown in FIG. That is, first, it is determined whether or not a subject (for example, a rectangular parallelepiped object 72 shown in FIG. 7B) exists in the view volume (step S41). If it is determined in step S41 that the subject does not exist in the view volume, the main image extraction is terminated.
[0063]
If it is determined in step S41 that the subject exists in the view volume, it is determined whether or not to extract the image of the subject from the display image in accordance with a preset extraction condition (step S42). In the present embodiment, for example, the extraction condition is set to extract the subject image from the display image every three frames. The extraction condition is not limited to this, and extraction may be performed by setting an extraction timing and determining the timing. Of course, it is possible to extract every frame without performing this determination process. If it is determined in this step S42 that the extraction process is not performed, the main image extraction is terminated.
[0064]
If it is determined in step S42 that the extraction process is to be performed, the image extraction unit 222 performs a process of converting the coordinate value of the subject into the coordinate value of the screen coordinate system (Xs, Ys) (step S43).
[0065]
Next, the image extraction unit 222 determines a subject area with reference to the coordinate values of the upper end, the lower end, the left end, and the right end of the subject converted to the screen coordinate system (Xs, Ys), and the subject. The extraction area is determined according to the aspect ratio of the display area to be displayed (step S44).
[0066]
Next, the image extraction unit 222 extracts an area corresponding to the extraction area determined in step S44 from the display image data stored in the frame buffer 520 (step S45). Then, the size of the extracted image is changed in accordance with the display area (step S46). That is, if the size of the extracted image is smaller than the size of the display area, the extracted image is enlarged, and if the size of the extracted image is larger than the size of the display area, the extracted image is reduced to reduce the extracted image. Change the size of.
[0067]
Next, the extracted image whose size has been changed according to the size of the display area is stored in the extracted image storage unit 540 (step S47), and the image extraction process ends.
[0068]
When the image extraction process in the image extraction unit 222 is completed, it is determined whether or not to display a replay (FIG. 6; step S50). If it is determined in step S50 that the replay screen is not displayed, the process returns to step S10 and the above-described processes are repeated.
[0069]
In step S10, when it is determined to display the replay screen, the display control unit 224 executes a replay display process (step S60).
[0070]
The replay display process in the display control unit 224 displays the extracted image stored in the extracted image storage unit 540 when it is determined to display the replay screen. The display control unit 224 controls display of a plurality of extracted images stored in the extracted image storage unit 540. For example, while controlling to arrange a plurality of stored extracted images and arranging the plurality of extracted images, a predetermined time difference is provided and displayed.
[0071]
The case where the extracted image is displayed in the twelve replay display areas RP1, RP2,..., RP12 shown in FIG. First, 12 images to be displayed in the replay display areas RP1, RP2,..., RP12 are determined from the extracted image storage unit 540. For example, when the latest extracted image stored in the storage area of the extracted image storage unit 540 shown in FIG. 11 is an extracted image stored in the area 32, twelve extracted images dating back from the area 32, that is, The extracted images stored in the areas 21 to 32 are displayed. Specifically, the extracted image stored in the area 21 in the replay display area RP1, the extracted image stored in the area 22 in the replay display area RP2, and the extracted image stored in the area 32 in the replay display area RP12. Is controlled to display according to a predetermined time difference. Note that the method of determining the 12 extracted images to be displayed is not limited to this, and an arbitrary image may be selected from the extracted images stored in the extracted image storage unit 540 and displayed.
[0072]
Then, when the replay display process by the display control unit 224 is finished, this process is finished.
[0073]
The display unit 300 displays game images such as a play screen and a replay screen. The processing unit 200 outputs display image data stored in the frame buffer 520 in the temporary storage unit 500 to the display unit 300.
[0074]
In addition to various processing programs and data, the storage unit 400 stores a game program 420 related to the progress of the game, various game information (not shown) necessary for the progress of the game, and the like. The game program 420 includes, in particular, an image extraction program 422 and a display control program 424 in order to implement the present invention. The processing unit 200 performs various processes based on programs and data read from the storage unit 400.
[0075]
In particular, the temporary storage unit 500 temporarily stores calculation results executed by the game calculation unit 220 according to the game program 420, information input from the operation unit 100, display image data generated by the image generation unit 240, and the like. Stored. The temporary storage unit 500 also temporarily stores the coordinate values of the objects included in the virtual three-dimensional space in the world coordinate system, the viewpoint coordinate system, and the screen coordinate system. The function of the temporary storage unit 500 can be realized by, for example, RAM or VRAM.
[0076]
The temporary storage unit 500 particularly includes a frame buffer 520 that stores image data generated by the image generation unit 240 and an extracted image storage unit 540 that stores an extracted image generated by the image extraction unit 222. Including.
[0077]
In this embodiment, the player's own character operated by the player is set as the subject. However, the present invention is not limited to this, and an arbitrary area in the virtual three-dimensional space can be designated.
[0078]
Next, an example of a hardware configuration capable of realizing the game apparatus 1 in the present embodiment will be described with reference to FIG. In the apparatus shown in FIG. 13, a CPU 1000, a ROM 1002, a RAM 1004, a VRAM 1005, an information storage medium 1006, an image generation IC 1008, a sound generation IC 1010, and I / O ports 1012, 1014 are connected to each other via a system bus 1016 so as to be able to input and output data. Yes. A display device 1018 is connected to the image generation IC 1008, a speaker 1020 is connected to the sound generation IC 1010, a control device 1022 is connected to the I / O port 1012, and a communication device 1024 is connected to the I / O port 1014.
[0079]
The CPU 1000 controls the entire apparatus and performs various data processing in accordance with a program stored in the information storage medium 1006, a system program stored in the ROM 1002 (such as initialization information of the apparatus main body), and a signal input by the control apparatus 1022. Do.
[0080]
The RAM 1004 is a storage unit used as a work area of the CPU 1000, and stores given contents in the information storage medium 1006 and the ROM 1002, the calculation result of the CPU 1000, and the like.
[0081]
The VRAM 1005 corresponds to the temporary storage unit 500 shown in FIG. 4 and is a storage device that temporarily stores display data displayed on the display device 1018. The VRAM 1005 includes a frame buffer (corresponding to the frame buffer 520 shown in FIG. 4) for storing image data for one frame generated by the image generation IC 1008. The frame buffer has a capacity corresponding to the resolution and the number of colors of the display device 1018, and stores color information for each pixel. Further, the VRAM 1005 includes a storage area (for example, an extracted image storage unit 540 shown in FIG. 4) that stores an extracted image extracted from display image data stored in the frame buffer.
[0082]
An information storage medium 1006 mainly stores programs, image data, sound data, play data, etc., and a memory such as a ROM as an information storage medium, a hard disk, a game cassette, an IC card, a magnetic disk, an optical disk, etc. Etc. are used. The function of this information storage medium 1006 corresponds to the storage unit 400 shown in FIG.
[0083]
For example, when the present game device is applied to a home game device, a CD-ROM, game cassette, DVD or the like is used as the information storage medium 1006 for storing the game program 420 shown in FIG. A memory card or the like is used as the storage medium 1006. When applied to an arcade game device, a memory such as a ROM or a hard disk is used as the information storage medium 1006.
[0084]
In addition, the image generation IC 1008 and the sound generation IC 1010 provided in this apparatus can appropriately output sound and images.
[0085]
First, the image generation IC 1008 is an integrated circuit that generates pixel information based on information sent from the ROM 1002, the RAM 1004, the information storage medium 1006, and the like according to a command from the CPU 1000. The The display device 1018 is realized by a CRT, LCD, TV, plasma display, projector, or the like, and corresponds to the display unit 300 illustrated in FIG.
[0086]
The sound generation IC 1010 is an integrated circuit that generates sound signals in accordance with information stored in the information storage medium 1006 and the ROM 1002 and sound data stored in the RAM 1004 according to instructions from the CPU 1000. Output from the speaker 1020.
[0087]
The control device 1022 corresponds to the operation unit 100 shown in FIG. 4 and is a device for the player to input an operation related to the game.
[0088]
The communication device 1024 exchanges information used inside the game device 1 with the outside. The communication device 1024 is connected to other devices via a communication line and is used when transmitting / receiving given information according to a program. The
[0089]
The above-described processing such as game progress processing is realized by the information storage medium 1006 storing the game program 420 shown in FIG. 4 and the like, and the CPU 1000, the image generation IC 1008, the sound generation IC 1010, and the like that operate according to these programs. The CPU 1000 and the image generation IC 1008 correspond to the processing unit 200 shown in FIG. 4, and the CPU 1000 mainly corresponds to the game calculation unit 220 shown in FIG. 4, and the image generation IC 1008 corresponds to the image generation unit 240 shown in FIG. .
[0090]
Note that the processing performed by the image generation IC 1008, the sound generation IC 1010, and the like may be performed by software using the CPU 1000 or a general-purpose DSP. In this case, the CPU 1000 corresponds to the processing unit 200 shown in FIG.
[0091]
Next, FIG. 14 shows an example in which the game apparatus 1 is applied to a home game apparatus. In other words, game controllers 1202 and 1204 and a display 1206 are connected to the game apparatus main body 1200, and a player views a game image displayed on the display 1206 or listens to a game sound output from a speaker (not shown). However, a game is enjoyed by operating characters and the like with the game controllers 1202 and 1204. Furthermore, a CD (DVD) 1208 that is detachable from the game apparatus main body 1200, or an information storage medium such as a memory card 1210 or an IC card 1212, a game program 420 stored in the storage unit 400 shown in FIG. Information such as game data (not shown) is stored, and the game apparatus main body 1200 performs various processes (for example, the processes shown in FIG. 6 or FIG. 12) according to the information. Note that the operation unit 100 shown in FIG. 4 corresponds to the controllers 1202 and 1204, and the display unit 300 corresponds to the display 1206.
[0092]
Further, FIG. 15 shows an example in which the game apparatus 1 is applied to an arcade game apparatus 1100. In this arcade game apparatus 1100, a player operates a character or the like displayed on a display 1108 by operating an operation lever 1104 or an operation button 1106... While listening to a game sound output from a speaker 1102. It is a device to enjoy tennis games. 4 corresponds to the operation lever 1104 or the operation buttons 1106..., And the display unit 300 corresponds to the display 1108.
[0093]
A CPU, an image generation IC, a sound generation IC, and the like are mounted on a system board 1110 built in the arcade game apparatus 1100. The game program 420 shown in FIG. 4, game data (not shown), and the like are stored in a memory 1112 that is an information storage medium on the system board 1110.
[0094]
Further, as shown in FIG. 16, the game apparatus 1 is applied to a game apparatus including a host apparatus 1300 and terminals 1304-1 to 1304-n connected to the host apparatus 1300 via a communication line 1302. It is good to do. The terminals 1304-1 to 1304-n are devices capable of at least displaying game images, outputting game sounds, and inputting game operations, and the player can select any of the terminals 1304-1 to 1304-n. Enjoy a tennis game.
[0095]
In this case, information such as the game program 420 shown in FIG. 4 and game data (not shown) is stored in an information storage medium 1306 such as a magnetic disk device, a magnetic tape device, or a memory that can be controlled by the host device 1300, for example. When the terminals 1304-1 to 1304-n have a CPU, an image generation IC, and a sound generation IC and can generate game images and game sounds stand-alone, they are stored in the information storage medium 1306 from the host device 1300. Programs, data, and the like are distributed to the terminals 1304-1 to 1304-n via the communication line 1302, and game images and game sounds are generated at the terminals 1304-1 to 1304-n. On the other hand, when a game image or game sound cannot be generated stand-alone, the host device 1300 generates a game image or game sound and distributes the game image or game sound to the terminals 1304-1 to 1304-n. The terminals 1304-1 to 1304-n output the generated or distributed game images and game sounds, respectively.
[0096]
As mentioned above, although an example of the game device to which this invention is applied was demonstrated, this invention is not limited to the said embodiment, In the range which does not deviate from the meaning of this invention, it can change suitably.
[0097]
For example, when a predetermined parameter is set in advance for an object to be a subject and it is determined whether or not to perform processing for extracting an extracted image from a display image, whether or not extraction is performed by determining the parameter is determined. It may be determined. For example, if a person object is specified as a subject and a parameter of emotion is set for this person object, the parameter of the subject is determined so that the facial expression of the subject displayed on the display image is, for example, a smile. It is also possible to perform an extraction process.
[0098]
In the present embodiment, as shown in FIG. 2 or FIG. 3, twelve replay display areas RP1, PR2,... RP12 are set as the display area of the extracted image, and the replay display areas RP1, PR2,. .. The replay screen is produced by displaying the extracted image according to a predetermined time difference on RP12, but the replay display area RP20 is sequentially updated with the extracted image every time t as in the replay screen shown in FIG. It is good also as producing a replay screen by doing. In other words, the display control unit 224 first sets the replay display area RP20 for displaying the extracted images, and determines the extracted images to be displayed and their order at the replay display timing. Then, the display of the extracted image is controlled such that the first extracted image is displayed in the replay display area RP20, and the second extracted image is displayed in the replay display area RP20 when the time t has elapsed.
[0099]
Moreover, it is good also as producing a replay screen as shown in FIG. In this case, the display control unit 224 sets each replay display area RP30 so that a plurality of extracted images to be displayed on the replay screen slide, and sequentially displays the extracted images based on a predetermined time difference at the replay display timing. As described above, the display of the extracted image may be controlled.
[0100]
Furthermore, as shown in FIG. 19, the sizes of the replay display areas RP40 to RP45 set on the replay screen may all be different. That is, the size of the area for displaying the extracted image set by the display control unit 224 is arbitrary, and the size of the extracted image to be extracted and stored is determined according to the size of each replay display area, so that it can be displayed during replay. It is possible to produce a replay screen in which the sizes of a plurality of extracted images are different.
[0101]
In the present embodiment, the image extracted from the display image is stored in the extracted image storage unit 540. However, for example, a process of changing the degree of the blur, noise, lightness, or the like or the α value for the extracted image. Alternatively, the image may be stored in the extracted image storage unit 540 after being processed by various filters such as deformation processing such as rotation or distortion. Further, at this time, the filter parameters set in the filter may be changed according to each extracted image and stored. According to this, for example, it is possible to produce a replay screen as if the extracted image is faded in or faded out. Further, the display order of the extracted images may be determined according to this filter parameter.
[0102]
In the above embodiment, the case where the present invention is applied to a tennis game has been described as an example. However, the present invention includes, for example, various sports games such as baseball games and golf games, fighting games, simulation games, and the like. It can also be applied to other various games.
[0103]
【The invention's effect】
According to the present invention, the size of the extracted image extracted from the display image is determined according to the aspect ratio of the display area on which the extracted image is displayed on the replay screen, and the extracted image is scaled to match the size of the display area. And save. According to this, when displaying the extracted image, it is only necessary to read out the stored extracted image, and no special processing is required. For example, by designating a character or the like to be replayed as a subject, it is possible to reproduce the motion of the character only by performing display processing of the extracted image to be stored or processing for controlling this display.
[0104]
At this time, by storing a plurality of images of the subject area of the image once displayed on the display screen as a game image, various effects such as replay, reverse display, etc. can be performed using the plurality of images. It becomes possible. Further, when displaying, it is possible to produce effects such as sequentially displaying image data by frame advance based on a preset time difference, or dividing a display screen to display a plurality of image data on one screen.
[Brief description of the drawings]
FIG. 1 is a diagram showing an example of a play screen in the present embodiment.
FIG. 2 is a diagram showing an example of a replay screen in the present embodiment.
FIG. 3 is a diagram showing an example of a replay screen in the present embodiment.
FIG. 4 is a diagram illustrating an example of functional blocks of the game device according to the present embodiment.
FIG. 5 is a diagram for explaining processing for generating a display image;
FIG. 6 is a flowchart illustrating an example of an operation of a processing unit in the present embodiment.
7A is a diagram illustrating an example of a virtual three-dimensional space, and FIG. 7B is a diagram illustrating an example of a rectangular parallelepiped object set as a subject.
8A is a diagram illustrating an example of a subject converted into a screen coordinate system, and FIG. 8B is a diagram illustrating an example of a display area of an extracted image.
9A is a diagram illustrating an example of a display image stored in a frame buffer, and FIG. 9B is a diagram illustrating an example of an extracted image stored in an extracted image storage unit.
FIG. 10 is a diagram for explaining bilinear filtering.
FIG. 11 is a diagram for explaining processing for storing an extracted image in an extracted image storage unit;
FIG. 12 is a flowchart illustrating an example of image extraction processing in the present embodiment.
FIG. 13 is a diagram illustrating an example of a hardware configuration according to the present embodiment.
FIG. 14 is a diagram showing a case where the present game device is applied to a commercial game machine.
FIG. 15 is a diagram showing a case where the present game device is applied to a consumer game machine.
FIG. 16 is a diagram showing a case where the present game device is applied to a terminal connected to a host device via a communication line.
FIG. 17 is a diagram for explaining an example of a replay screen rendering method;
FIG. 18 is a diagram for explaining an example of a replay screen rendering method;
FIG. 19 is a diagram for explaining an example of a replay screen rendering method;
[Explanation of symbols]
1 Game device
100 operation unit
200 processor
220 Game calculation unit
222 Image extraction unit
224 display controller
240 Image generator
300 Display section
400 storage unit
420 game programs
422 Image extraction program
424 Display control program
500 Temporary storage
520 frame buffer
540 Extracted image storage unit

Claims (15)

A program for causing a device having the processor to function as a generation unit for generating an image of a virtual space based on a given viewpoint by calculation and control by the processor to execute a game,
Setting means for setting the subject,
First storage means for storing the image generated by the generation means as a frame image;
Calculating means for calculating the position of the subject in the frame image corresponding to the position of the subject in the virtual space by coordinate conversion based on the viewpoint;
Extraction means for determining an extraction area from the frame image based on a calculation result by the calculation means, and extracting an image of the extraction area;
Second storage means for storing the extracted image extracted by the extraction means;
Reproduction means for generating a reproduction image of a game including the extracted image stored in the second storage means;
A program for causing the apparatus to function as A program for causing a device having the processor to function as a generation unit for generating an image of a virtual space based on a given viewpoint by calculation and control by the processor to execute a game,
First storage means for storing the image generated by the generation means as a frame image;
Extracting means for determining an extraction region from the frame image and extracting an image of the extraction region;
Second storage means for storing the extracted image extracted by the extraction means;
As a game reproduction image, a reproduction image in which a moving image display area for displaying a moving image and a still image display area for displaying a still image are provided in one screen is generated and stored in the second storage means Reproduction means for generating a reproduction image in which the extracted image is displayed in the still image display area;
A program for causing the apparatus to function as In claim 2 ,
Setting means for setting the subject,
Calculating means for calculating the position of the subject in the frame image corresponding to the position of the subject in the virtual space by coordinate conversion based on the viewpoint;
To further function the device as
A program for causing the extraction unit to function the apparatus so as to determine an extraction region based on a calculation result by the calculation unit.   A program for causing a device having the processor to function as a generation unit that generates an image of a virtual space based on a given viewpoint, and to execute a game by calculation and control by the processor,
  Setting means for setting the subject,
  First storage means for storing the image generated by the generation means as a frame image;
  Calculating means for calculating the position of the subject in the frame image corresponding to the set position of the subject in the virtual space by coordinate conversion based on the viewpoint;
  Extraction time determination means for determining whether it is time to extract based on given parameters of the set subject,
  When the extraction time is determined by the extraction time determination unit, an extraction region is determined based on a calculation result by the calculation unit from the frame image corresponding to the determined time, and an image of the extraction region is extracted Extraction means to
  Second storage means for storing the extracted image extracted by the extraction means;
  Reproduction means for generating a reproduction image of a game including the extracted image stored in the second storage means;
  A program for causing the apparatus to function as In claim 1 , 3 or 4,
A program for causing the extraction unit to function the apparatus so as to determine an extraction region in accordance with the size of the subject in the frame image. In claim 1, 3, 4 or 5,
Causing the apparatus to function as size setting means for setting the size of the extracted image stored in the second storage means;
A program for causing the apparatus to function so that the extraction unit determines an aspect ratio of an extraction region based on an aspect ratio of a size of an extracted image set by the size setting unit. In claim 6,
The size setting means sets the vertical size of the extracted image to 1 / integer of the vertical size of the frame image, and / or sets the horizontal size of the extracted image to 1 / integer of the horizontal size of the frame image. A program for causing the apparatus to function. In any one of Claims 1-7,
Causing the apparatus to function as an enlargement / reduction means that enlarges / reduces the extracted image extracted by the extraction means to a given size;
A program for causing the apparatus to function so that the second storage unit stores the extracted image scaled by the scaling unit.   An information storage medium for storing the program according to claim 1. A game device comprising a generation means for generating an image of a virtual space based on a given viewpoint,
Setting means for setting the subject;
First storage means for storing the image generated by the generation means as a frame image;
Calculating means for calculating the position of the subject in the frame image corresponding to the position of the subject in the virtual space by coordinate conversion based on the viewpoint;
Extracting means for determining an extraction area from the frame image based on a calculation result by the calculation means, and extracting an image of the extraction area;
Second storage means for storing the extracted image extracted by the extraction means;
Reproduction means for generating a reproduction image of the game including the extracted image stored in the second storage means;
A game device comprising: A game device comprising a generation means for generating an image of a virtual space based on a given viewpoint,
First storage means for storing the image generated by the generation means as a frame image;
Extracting means for determining an extraction region from the frame image and extracting an image of the extraction region;
Second storage means for storing the extracted image extracted by the extraction means;
As a game reproduction image, a reproduction image in which a moving image display area for displaying a moving image and a still image display area for displaying a still image are provided in one screen is generated and stored in the second storage means Reproduction means for generating a reproduction image in which the extracted image is displayed in the still image display area;
A game device comprising: In claim 11 ,
Setting means for setting the subject;
Calculating means for calculating the position of the subject in the frame image corresponding to the position of the subject in the virtual space by coordinate conversion based on the viewpoint;
With
A game apparatus in which the extraction unit determines an extraction region based on a calculation result by the calculation unit.   A game device comprising a generation means for generating an image of a virtual space based on a given viewpoint,
  Setting means for setting the subject;
  First storage means for storing the image generated by the generation means as a frame image;
  Calculating means for calculating the position of the subject in the frame image corresponding to the set position of the subject in the virtual space by coordinate conversion based on the viewpoint;
  Extraction time determination means for determining whether it is time to extract based on a given parameter of the set subject;
  When the extraction time is determined by the extraction time determination unit, an extraction region is determined based on a calculation result by the calculation unit from the frame image corresponding to the determined time, and an image of the extraction region is extracted Extraction means to
  Second storage means for storing the extracted image extracted by the extraction means;
  Reproduction means for generating a reproduction image of the game including the extracted image stored in the second storage means;
  A game device comprising: In claim 10 , 12 or 13,
A game device in which the extraction means determines an extraction area according to the size of the subject in the frame image. In claim 10, 12, 13 or 14,
Size setting means for setting the size of the extracted image stored in the second storage means;
A game apparatus in which the extraction unit determines an aspect ratio of an extraction region based on an aspect ratio of a size of an extracted image set by the size setting unit.

Images