US8049757B2 - Image processing device, image processing method and information storage medium - Google Patents

Image processing device, image processing method and information storage medium Download PDF

Info

Publication number
US8049757B2
US8049757B2 US11/432,293 US43229306A US8049757B2 US 8049757 B2 US8049757 B2 US 8049757B2 US 43229306 A US43229306 A US 43229306A US 8049757 B2 US8049757 B2 US 8049757B2
Authority
US
United States
Prior art keywords
moving picture
screen
moving
image processing
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US11/432,293
Other versions
US20060256118A1 (en
Inventor
Tomokazu Kake
Yasushi Okumura
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Sony Network Entertainment Platform Inc
Original Assignee
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc filed Critical Sony Computer Entertainment Inc
Assigned to SONY COMPUTER ENTERTAINMENT INC. reassignment SONY COMPUTER ENTERTAINMENT INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: OKUMURA, YASUSHI, KAKE, TOMOKAZU
Publication of US20060256118A1 publication Critical patent/US20060256118A1/en
Priority to US13/240,220 priority Critical patent/US8570330B2/en
Application granted granted Critical
Publication of US8049757B2 publication Critical patent/US8049757B2/en
Assigned to SONY NETWORK ENTERTAINMENT PLATFORM INC. reassignment SONY NETWORK ENTERTAINMENT PLATFORM INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: SONY COMPUTER ENTERTAINMENT INC.
Assigned to SONY COMPUTER ENTERTAINMENT INC. reassignment SONY COMPUTER ENTERTAINMENT INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SONY NETWORK ENTERTAINMENT PLATFORM INC.
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/802D [Two Dimensional] animation, e.g. using sprites
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0407Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0414Vertical resolution change
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2340/00Aspects of display data processing
    • G09G2340/04Changes in size, position or resolution of an image
    • G09G2340/0407Resolution change, inclusive of the use of different resolutions for different screen areas
    • G09G2340/0421Horizontal resolution change
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09GARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators

Definitions

  • the present invention relates to an image processing device, an image processing method and an information storage medium, and particularly relates to an image processing device, image processing method and information storage medium for displaying images including moving pictures of a plurality of users.
  • Japanese patent No. 3298870 discloses an image processing device for composing a moving picture of a user in an image formed by a computer, and controlling screen display based on content of the moving image of the user. According to this image processing device, it is possible to direct a user like a character within an image formed by a computer, and it is possible to double the interest level of game software etc.
  • a moving picture for a single user is composed at a fixed position on the screen formed by the computer, and it is not possible to control screen display using moving pictures for a plurality of users. For this reason, there is a problem that it is not possible to utilize such a scheme in a game or simulation using a plurality of users.
  • the present invention has been conceived in view of the above-described situation, and an object of the invention is to provide an image processing device, image processing method and information storage medium that can control screen display using moving pictures for a plurality of users.
  • an image processing device of the present invention comprises moving picture acquisition means for acquiring respective moving pictures for a plurality of users, moving picture display means for displaying each of the moving pictures acquired by the moving picture acquisition means on a screen, and control means for controlling display content for the screen in response to content of each moving picture.
  • an image processing method of the present invention comprises a moving picture acquisition step for acquiring respective moving pictures for a plurality of users, a moving picture display step for displaying each of the moving pictures acquired by the moving picture acquisition means on a screen, and a control step for controlling display content for the screen in response to content of each moving picture.
  • An information storage medium of the present invention stores a program for causing a computer, such as a home game machine, a portable game machine, a personal computer, server computer, portable telephone or portable information terminal, to function as moving picture acquisition means for acquiring respective moving pictures for a plurality of users, moving picture display means for displaying each of the moving pictures acquired by the moving picture acquisition means on a screen, and control means for controlling display content for the screen in response to content of each moving picture.
  • This information storage medium is a computer readable information storage medium such as a DVD-ROM, CD-ROM, or ROM cartridge, etc.
  • the present invention it is possible to control screen display using moving pictures for a plurality of users. For this reason, the invention can be adopted in a game or simulation using a plurality of users.
  • control means it is also possible for the control means to move a specified movement image on the screen according to display position of each moving picture on the screen and content of each moving picture. In this way, it becomes possible to direct a simulation between users my means of the movement image.
  • control means to move the movement image with a display position of at least one of the respective moving pictures on the screen as a start point and a display position of at least another one of the moving pictures on the screen as an end point. It then becomes possible to direct communication between a user relating to the start point moving image and a user relating to the end point moving picture.
  • control means determine a moving picture relating to the start point or the end point based on a random number, or to determine a moving image relating to the start point or end point in accordance with instructions from some or all of a plurality of users.
  • control means determine a moving picture relating to the end point according to content of a moving image relating to the start point (direction of movement or extent of movement of a user projected in the moving picture, for example). In this way, it is possible for a user to determine an end point for the movement image using their own actions.
  • control means can control the number of the movement images according to amount of variation in the moving picture relating to the start point. In this way, it is possible to show amount of movement of the moving picture, namely movement of the user, using the number of movement images.
  • control means can vary a display region for the moving picture on the screen, according to content of each moving picture. In this way, it is possible for users to vary display region for each moving picture using their own actions. As a result, it is possible to have a more interesting system when adopting the invention in an entertainment system such as a game.
  • control means to control display content of the screen according to display region of each moving picture on the screen, and display position of another picture.
  • control means it is also possible for the control means to move a display position of the other picture according to display region of each moving picture on the screen. In this way, it becomes possible for a user to move display position of another image by their own actions.
  • control means can vary a display region for the moving picture on the screen, according to a position where specific content has been projected in each moving picture.
  • the position where specific content has been projected is the position of a face to be identified using facial recognition technology, for example. In this way, it is possible for a user to arbitrarily deform a display region of a moving picture for every operation, such as varying a position where specific content is displayed.
  • FIG. 1 is a structural diagram of a network system using an entertainment system (image processing device) of an embodiment of the present invention.
  • FIG. 2 is a hardware structural diagram of an entertainment system of an embodiment of the present invention.
  • FIG. 3 is an internal structural diagram of an MPU.
  • FIG. 4 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 1 of the present invention.
  • FIG. 5 is a flowchart showing image processing for an entertainment system of embodiment 1 of the present invention.
  • FIG. 6 is a drawing showing a modified example a display screen.
  • FIG. 7 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 2 of the present invention.
  • FIG. 8 is a drawing for describing image processing for generating a display screen of embodiment 2.
  • FIG. 9 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 3 of the present invention.
  • FIG. 10 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 4 of the present invention.
  • FIG. 11 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 5 of the present invention.
  • FIG. 12 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 6 of the present invention.
  • FIG. 1 is a structural diagram of a network game machine formed using an entertainment system (image processing device) of this embodiment 1.
  • this system comprises a plurality of entertainment networks 10 connected to a network 50 such as the Internet or a LAN.
  • Each entertainment network 10 is configured including a computer connected to a camera unit 46 for photographing a moving picture of the user, and is capable of displaying a common image including moving pictures of a plurality of users, of each entertainment system 10 , by transferring data representing moving pictures of users via the network 50 .
  • FIG. 2 is a drawing showing the hardware structure of the entertainment system (image processing device) of this embodiment 1.
  • the entertainment system 10 is a computer constructed comprising an MPU (Micro Processing Unit) 11 , main memory 20 , an image processing section 24 , a monitor 26 , an input output processing section 28 , an audio processing section 30 , a speaker 32 , an optical disk reading section 34 , an optical disk 36 , a hard disk 38 , interfaces (I/F) 40 , 44 , a controller 42 , a camera unit 46 , and a network interface 48 .
  • MPU Micro Processing Unit
  • FIG. 3 is a drawing showing the structure of the MPU 11 .
  • the MPU 11 comprises a main processor 12 , sub-processors 14 a , 14 b , 14 c , 14 d , 14 e , 14 f , 14 g , 14 h , a bus 16 , a memory controller 18 and an interface (I/F) 22 .
  • I/F interface
  • the main processor 12 carries out various information processing and performs control for the sub-processors 14 a - 14 h , based on an operating system stored in ROM (Read Only Memory—not shown), for example, programs and data read out from an optical disc 36 such as a DVD (Digital Versatile Disc)-ROM, and programs and data supplied via a communication network.
  • ROM Read Only Memory—not shown
  • optical disc 36 such as a DVD (Digital Versatile Disc)-ROM
  • the sub processors 14 a to 14 h carry out various information processing in accordance with instructions from the main processor 12 , and perform control of each section of the entertainment system 10 based on programs and data read out from an optical disc 36 such as a DVD-ROM, and programs and data supplied via a communication network.
  • the bus 16 is for exchanging addresses and data with respective sections of the entertainment system 10 .
  • the main processor 12 , sub-processors 14 a to 14 h , memory controller 18 , and interface 22 are connected to each other by means of the bus 16 capable of exchanging data with each other.
  • the memory controller 18 performs accesses to the main memory 20 in accordance with instructions from the main processor 12 and sub-processors 14 a to 14 h.
  • the main memory 20 is also used as a work area for the main processor 12 and the sub-processors 14 a to 14 h.
  • the image processing section 24 and the input/output processing section 28 are connected to the interface 22 . Exchange of data between the main processor 12 and the sub-processors 14 a to 14 h , and the image processing section 24 or the input/output section 28 , is carried out via the interface 22 .
  • the image processing section 24 comprises a GPU (Graphical Processing Unit) and a frame buffer.
  • the GPU renders various screens in the frame buffer based on image data supplied from the main processor 12 and the sub-processors 14 a to 14 h .
  • a screen formed in the frame buffer is converted to video signals at a specified timing and output to the monitor 26 .
  • a household television receiver can be used as the monitor 26 .
  • the audio processing section 30 , optical disc reading unit 34 , hard disc 38 and interfaces 40 , 44 are connected to the input/output processing section 28 .
  • the input/output processing section 28 control exchange of data between the main processor 12 and sub-processors 14 a to 14 h , and the audio processing section 30 , optical disc reading section 34 , hard disc 38 , interfaces 40 , 44 and the network interface 48 .
  • the audio processing section 30 comprises an SPU (Sound Processing Unit) and a sound buffer.
  • SPU Sound Processing Unit
  • Various audio data such as game music, game effect sounds and messages read out from the optical disc 36 and the hard disc 38 are stored in the sound buffer.
  • the SPU reproduces these various audio data and outputs sounds from the speaker 32 .
  • a speaker housed in a household television receiver can be used as the speaker 32 .
  • the optical disc read out 34 reads out programs and data stored in the optical disc 36 in accordance with instructions from the main processor 12 and sub-processors 14 a to 14 h . It is also possible for the entertainment system 10 to be configured capable of reading out programs and data stored in another information storage medium besides the optical disc 36 .
  • the optical disc 36 is a general optical disc (computer readable information storage medium) such as a DVD-ROM etc.
  • the hard disc 38 is a general hard dick device.
  • Various programs and data are stored in the optical disc 36 and the hard disc 39 capable of being read by a computer.
  • the interfaces (I/F) 40 , 44 are interfaces for connecting various peripheral devices such as the controller 42 and the camera unit 46 . It is possible to use a USB (Universal Serial Bus) interface as this type of interface. Incidentally, although omitted from FIG. 1 , it is also possible to include in the entertainment system 10 an interface for connecting the entertainment system 10 to a communication network.
  • USB Universal Serial Bus
  • the controller 42 is general-purpose operation input means, and is used for a user to input various operations (for example, game operations).
  • the input/output processing section 28 scans the state of each section of the controller 42 every specified time (for example 1/60th of a second) and supplies operation signals representing the result of the scanning to the main processor 12 and the sub-processors 14 a to 14 h .
  • the main processor 12 and the sub-processors 14 a to 14 h determine contents of operations performed by the user based on these operation signals.
  • the entertainment system 10 comprises a plurality of connectable controllers 42 , and the main processor 12 and the sub-processors 14 a to 14 h execute various processes based on operation signals input from the respective controllers 42 .
  • the camera unit 46 comprises a well known digital camera, for example, and inputs black and white or color photographed images every specified time (for example, 1/60th of a second).
  • the camera unit 46 of this embodiment inputs the photographed images as image data in JPEG (Joint Photographic Experts Group) format.
  • the camera unit 46 is installed above the monitor 26 in a state with a lens facing towards a player, for example, and is connected to the interface 44 via a specified cable.
  • the network interface 48 is connected to the input/output processing section 28 and the network 50 , and relays data communication between the entertainment system and another entertainment system 10 via the network 50 .
  • FIG. 4 shows a screen displayed on the monitor 26 in one entertainment system 10 of the this embodiment 1.
  • the screen displayed on the monitor 26 includes moving pictures of other users transmitted from other entertainment systems 10 connected for communication via the network 50 , and a moving picture of the user taken by the camera unit 46 connected to the entertainment system 10 together with the monitor 26 (in FIG. 4A , a total of 16 moving pictures).
  • one or a plurality of these plurality of moving pictures are selected as start point moving pictures, and another one or plurality are selected as an end point moving picture.
  • Elements that have selected start point moving pictures 52 a , 52 b and an end point moving picture 52 c are shown in FIG. 4A .
  • the start point moving picture and the end point moving picture can also be selected from among the plurality of moving pictures included on the screen using a random number, or selected according to input of a controller 42 provided in the entertainment system 10 or in another entertainment system 10 connected for communication via the network 50 .
  • one or more movement images are moved from the display position of the start point moving picture to the display position of the end point moving picture.
  • a movement image 54 b for a plurality of hexagons is moved from the start point moving picture 52 b to the end point moving picture 52 c.
  • FIG. 5 is a flow chart showing image processing by the entertainment system 10 .
  • the entertainment system 10 receive a moving picture of a user taken by a camera unit 46 provided in another entertainment system 10 in JPEG stream format via the network 50 .
  • the received moving picture data in JPEG stream format is converted to raster format by decoding using some of the sub-processors 14 a to 14 h .
  • the data that has been converted to raster format is stored in the main memory 20 .
  • moving image data is read out from the main memory 20 by another of the sub-processors 14 a to 14 h , to carry out movement detection processing.
  • difference between frame images at respective timing for example continuous time frames
  • a sum for pixel values of this difference image or images derived by subjecting the difference images to appropriate filter processing is calculated.
  • This value represents amount of variation in the start point moving picture (amount of user movement), and this is also stored in the main memory 20 .
  • a moving picture that has been converted to raster format stored in the main memory 20 is arranged in a screen projected on the monitor 26 (S 101 ). Also, a start point moving picture and an end point moving picture are selected from among a plurality of moving pictures arranged on the screen using a random number, for example (S 102 ).
  • the entertainment system 10 of this embodiment 1 it is possible to project onto the monitor 26 an image such as if a message or energy is being sent from a user projected in the start point moving picture to a user projected in the end point moving picture.
  • movement direction of the endpoint moving picture or movement images 54 a and 54 b can be determined according to content of the start point moving picture. For example, as shown in FIG. 6 , it is possible to move the movement images 54 a and 54 b n a movement direction of the user of the start point moving picture. In this case, it is possible to select a user moving picture for the movement direction of the movement images 54 a and 54 b in the end point moving picture.
  • the direction of movement of the user can be determined by generating a difference image for the start point moving picture (difference image for a frame image at a different timing), based on position of a group of pixels holding a having value exceeding a specified value in the difference image.
  • a difference image for the start point moving picture difference image for a frame image at a different timing
  • FIG. 7 shows one example of a screen displayed on the monitor 26 in an entertainment system 10 of this embodiment 2.
  • the present embodiment 2 and embodiments 3 to 6 that will be described later also, the system structure shown in FIG. 1 to FIG. 3 is adopted, and only a program executed by the MPU 11 and stored in the optical disc 36 is different from embodiment 1.
  • a plurality of cubes are displayed on the screen.
  • These cubes are square objects 60 arranged in virtual three dimensional space organized in the main memory 20 , and the screen shown in FIG. 7 represents an appearance looking at this virtual three dimensional space from a given viewpoint.
  • a moving picture of a user transmitted from another entertainment system 10 connected for communication via the network 50 and a moving picture of a user taken using the camera unit 46 connected to the entertainment system 10 together with the monitor 26 for displaying the screen are applied as texture.
  • spherical globular objects are arranged in the virtual three dimensional space, these globular objects are subjected to parabolic motion in the virtual three dimensional space, and hen the impact with other objects such as the square objects 60 the movement direction is changed.
  • the user moves in front of the camera unit 46 (for example, moving their hands), to change the content of the moving picture, so as to change the upper surface of the square object 60 having the moving picture applied as texture.
  • the upper surface of a square object 60 is divided into a plurality of rectangular areas, and a polygon apex is provided in the corner of each rectangular area.
  • Amount of movement of a user portrayed in each rectangular area is calculated based on sections of the rectangular area among difference images of the user moving picture, and polygon apexes placed in corners of regions exhibiting the most movement are moved in a direction away from the square object 60 . This movement amount is calculated based on movement of a user projected in a rectangular region, for example.
  • a rebound direction of a globular object is calculated according to shape of the square object 60 , which means that the user can cause the globular object 64 to bounce in any direction by moving in front of their own camera unit 46 . It is also preferable to determine speed when the globular object rebounds based on transformation speed of the square object 60 .
  • FIG. 9A and FIG. 9B show one example of a screen projected on the monitor 26 in an entertainment system 10 of this embodiment 3.
  • moving pictures of a plurality of users are projected.
  • These moving pictures of users include moving pictures projected by the camera unit 46 connected to the entertainment system 10 together with the monitor 26 for displaying the screen, and moving images received from entertainment systems 10 connected for communication via the network 50 .
  • FIG. 10A and FIG. 10B show one example of a screen projected on the monitor 26 in an entertainment system 10 of this embodiment 4.
  • display region of a moving picture exhibiting user movement was not changed, but if the user projected in a particular moving picture moves a lot, as shown in FIG. 10A , the display region of the moving picture is changed according to this movement, as shown in FIG. 10B , and it is also possible to flick another moving picture in accordance with that change.
  • FIG. 11 shows one example of a screen projected on the monitor 26 in an entertainment system 10 of this embodiment 5.
  • display content of a screen projected on the monitor 26 is controlled using user movement exhibited in a moving picture, but as shown in FIG. 12 , it is possible to change a display region of a moving picture regarding a position where a body part such as a face within the moving picture, and in this manner change the position of another moving picture.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

To control screen display using moving pictures for a plurality of users.
Respective moving pictures for a plurality of users are acquired, and each of the acquired moving pictures are displayed on a screen.
Display content for the screen is controlled in response to content of each moving picture. At this time, it is also possible to move a specified movement image on the screen according to display position of each moving picture on the screen and content of each moving picture, or to change a display region of the moving picture on the screen according to content of each moving picture.

Description

BACKGROUND OF THE INVENTION
The present invention relates to an image processing device, an image processing method and an information storage medium, and particularly relates to an image processing device, image processing method and information storage medium for displaying images including moving pictures of a plurality of users.
Japanese patent No. 3298870 discloses an image processing device for composing a moving picture of a user in an image formed by a computer, and controlling screen display based on content of the moving image of the user. According to this image processing device, it is possible to direct a user like a character within an image formed by a computer, and it is possible to double the interest level of game software etc.
SUMMARY OF THE INVENTION
With the above-described related art, however, a moving picture for a single user is composed at a fixed position on the screen formed by the computer, and it is not possible to control screen display using moving pictures for a plurality of users. For this reason, there is a problem that it is not possible to utilize such a scheme in a game or simulation using a plurality of users.
The present invention has been conceived in view of the above-described situation, and an object of the invention is to provide an image processing device, image processing method and information storage medium that can control screen display using moving pictures for a plurality of users.
In order to solve the above described problems, an image processing device of the present invention comprises moving picture acquisition means for acquiring respective moving pictures for a plurality of users, moving picture display means for displaying each of the moving pictures acquired by the moving picture acquisition means on a screen, and control means for controlling display content for the screen in response to content of each moving picture.
Also, an image processing method of the present invention comprises a moving picture acquisition step for acquiring respective moving pictures for a plurality of users, a moving picture display step for displaying each of the moving pictures acquired by the moving picture acquisition means on a screen, and a control step for controlling display content for the screen in response to content of each moving picture.
An information storage medium of the present invention stores a program for causing a computer, such as a home game machine, a portable game machine, a personal computer, server computer, portable telephone or portable information terminal, to function as moving picture acquisition means for acquiring respective moving pictures for a plurality of users, moving picture display means for displaying each of the moving pictures acquired by the moving picture acquisition means on a screen, and control means for controlling display content for the screen in response to content of each moving picture. This information storage medium is a computer readable information storage medium such as a DVD-ROM, CD-ROM, or ROM cartridge, etc.
According to the present invention it is possible to control screen display using moving pictures for a plurality of users. For this reason, the invention can be adopted in a game or simulation using a plurality of users.
It is also possible for the control means to move a specified movement image on the screen according to display position of each moving picture on the screen and content of each moving picture. In this way, it becomes possible to direct a simulation between users my means of the movement image.
It is also possible, for example, for the control means to move the movement image with a display position of at least one of the respective moving pictures on the screen as a start point and a display position of at least another one of the moving pictures on the screen as an end point. It then becomes possible to direct communication between a user relating to the start point moving image and a user relating to the end point moving picture.
At this time, it is also possible for the control means to determined a moving picture relating to the start point or the end point based on a random number, or to determine a moving image relating to the start point or end point in accordance with instructions from some or all of a plurality of users.
It is also possible for the control means to determine a moving picture relating to the end point according to content of a moving image relating to the start point (direction of movement or extent of movement of a user projected in the moving picture, for example). In this way, it is possible for a user to determine an end point for the movement image using their own actions.
It is also possible, for example, to determine a moving image relating to the end point from among each of the moving pictures according to amount of variation in each partial region of a moving picture relating to the start point, and position of each partial region of the moving picture. In this way, it is possible for a user relating to a moving picture of the start point to determine an end point using their own actions.
It is also possible for the control means to control the number of the movement images according to amount of variation in the moving picture relating to the start point. In this way, it is possible to show amount of movement of the moving picture, namely movement of the user, using the number of movement images.
It is also possible for the control means to vary a display region for the moving picture on the screen, according to content of each moving picture. In this way, it is possible for users to vary display region for each moving picture using their own actions. As a result, it is possible to have a more interesting system when adopting the invention in an entertainment system such as a game.
In this case, it is also possible for the control means to control display content of the screen according to display region of each moving picture on the screen, and display position of another picture.
For example, it is also possible for the control means to move a display position of the other picture according to display region of each moving picture on the screen. In this way, it becomes possible for a user to move display position of another image by their own actions.
It is also possible for the control means to vary a display region for the moving picture on the screen, according to a position where specific content has been projected in each moving picture. The position where specific content has been projected is the position of a face to be identified using facial recognition technology, for example. In this way, it is possible for a user to arbitrarily deform a display region of a moving picture for every operation, such as varying a position where specific content is displayed.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a structural diagram of a network system using an entertainment system (image processing device) of an embodiment of the present invention.
FIG. 2 is a hardware structural diagram of an entertainment system of an embodiment of the present invention.
FIG. 3 is an internal structural diagram of an MPU.
FIG. 4 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 1 of the present invention.
FIG. 5 is a flowchart showing image processing for an entertainment system of embodiment 1 of the present invention.
FIG. 6 is a drawing showing a modified example a display screen.
FIG. 7 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 2 of the present invention.
FIG. 8 is a drawing for describing image processing for generating a display screen of embodiment 2.
FIG. 9 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 3 of the present invention.
FIG. 10 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 4 of the present invention.
FIG. 11 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 5 of the present invention.
FIG. 12 is a drawing showing one example of a screen projected on a monitor in an entertainment system of embodiment 6 of the present invention.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
Embodiments of the present invention will be described in detail in the following based on the drawings.
Embodiment 1
FIG. 1 is a structural diagram of a network game machine formed using an entertainment system (image processing device) of this embodiment 1. As show in FIG. 1, this system comprises a plurality of entertainment networks 10 connected to a network 50 such as the Internet or a LAN. Each entertainment network 10 is configured including a computer connected to a camera unit 46 for photographing a moving picture of the user, and is capable of displaying a common image including moving pictures of a plurality of users, of each entertainment system 10, by transferring data representing moving pictures of users via the network 50.
FIG. 2 is a drawing showing the hardware structure of the entertainment system (image processing device) of this embodiment 1. As shown in FIG. 2, the entertainment system 10 is a computer constructed comprising an MPU (Micro Processing Unit) 11, main memory 20, an image processing section 24, a monitor 26, an input output processing section 28, an audio processing section 30, a speaker 32, an optical disk reading section 34, an optical disk 36, a hard disk 38, interfaces (I/F) 40, 44, a controller 42, a camera unit 46, and a network interface 48.
FIG. 3 is a drawing showing the structure of the MPU 11. As shown in FIG. 3, the MPU 11 comprises a main processor 12, sub-processors 14 a, 14 b, 14 c, 14 d, 14 e, 14 f, 14 g, 14 h, a bus 16, a memory controller 18 and an interface (I/F) 22.
The main processor 12 carries out various information processing and performs control for the sub-processors 14 a-14 h, based on an operating system stored in ROM (Read Only Memory—not shown), for example, programs and data read out from an optical disc 36 such as a DVD (Digital Versatile Disc)-ROM, and programs and data supplied via a communication network.
The sub processors 14 a to 14 h carry out various information processing in accordance with instructions from the main processor 12, and perform control of each section of the entertainment system 10 based on programs and data read out from an optical disc 36 such as a DVD-ROM, and programs and data supplied via a communication network.
The bus 16 is for exchanging addresses and data with respective sections of the entertainment system 10. The main processor 12, sub-processors 14 a to 14 h, memory controller 18, and interface 22 are connected to each other by means of the bus 16 capable of exchanging data with each other.
The memory controller 18 performs accesses to the main memory 20 in accordance with instructions from the main processor 12 and sub-processors 14 a to 14 h.
Programs and data read out from the optical disc 36 and hard disc 38, and programs and data supplied via the communication network, are written into the main memory 20 as required. The main memory 20 is also used as a work area for the main processor 12 and the sub-processors 14 a to 14 h.
The image processing section 24 and the input/output processing section 28 are connected to the interface 22. Exchange of data between the main processor 12 and the sub-processors 14 a to 14 h, and the image processing section 24 or the input/output section 28, is carried out via the interface 22.
The image processing section 24 comprises a GPU (Graphical Processing Unit) and a frame buffer. The GPU renders various screens in the frame buffer based on image data supplied from the main processor 12 and the sub-processors 14 a to 14 h. A screen formed in the frame buffer is converted to video signals at a specified timing and output to the monitor 26. Incidentally, a household television receiver can be used as the monitor 26.
The audio processing section 30, optical disc reading unit 34, hard disc 38 and interfaces 40, 44 are connected to the input/output processing section 28. The input/output processing section 28 control exchange of data between the main processor 12 and sub-processors 14 a to 14 h, and the audio processing section 30, optical disc reading section 34, hard disc 38, interfaces 40, 44 and the network interface 48.
The audio processing section 30 comprises an SPU (Sound Processing Unit) and a sound buffer. Various audio data such as game music, game effect sounds and messages read out from the optical disc 36 and the hard disc 38 are stored in the sound buffer. The SPU reproduces these various audio data and outputs sounds from the speaker 32. Incidentally, a speaker housed in a household television receiver can be used as the speaker 32.
The optical disc read out 34 reads out programs and data stored in the optical disc 36 in accordance with instructions from the main processor 12 and sub-processors 14 a to 14 h. It is also possible for the entertainment system 10 to be configured capable of reading out programs and data stored in another information storage medium besides the optical disc 36.
The optical disc 36 is a general optical disc (computer readable information storage medium) such as a DVD-ROM etc. Also, the hard disc 38 is a general hard dick device. Various programs and data are stored in the optical disc 36 and the hard disc 39 capable of being read by a computer.
The interfaces (I/F) 40, 44 are interfaces for connecting various peripheral devices such as the controller 42 and the camera unit 46. It is possible to use a USB (Universal Serial Bus) interface as this type of interface. Incidentally, although omitted from FIG. 1, it is also possible to include in the entertainment system 10 an interface for connecting the entertainment system 10 to a communication network.
The controller 42 is general-purpose operation input means, and is used for a user to input various operations (for example, game operations). The input/output processing section 28 scans the state of each section of the controller 42 every specified time (for example 1/60th of a second) and supplies operation signals representing the result of the scanning to the main processor 12 and the sub-processors 14 a to 14 h. The main processor 12 and the sub-processors 14 a to 14 h determine contents of operations performed by the user based on these operation signals. Incidentally, the entertainment system 10 comprises a plurality of connectable controllers 42, and the main processor 12 and the sub-processors 14 a to 14 h execute various processes based on operation signals input from the respective controllers 42.
The camera unit 46 comprises a well known digital camera, for example, and inputs black and white or color photographed images every specified time (for example, 1/60th of a second). The camera unit 46 of this embodiment inputs the photographed images as image data in JPEG (Joint Photographic Experts Group) format. Also, the camera unit 46 is installed above the monitor 26 in a state with a lens facing towards a player, for example, and is connected to the interface 44 via a specified cable. The network interface 48 is connected to the input/output processing section 28 and the network 50, and relays data communication between the entertainment system and another entertainment system 10 via the network 50.
FIG. 4 shows a screen displayed on the monitor 26 in one entertainment system 10 of the this embodiment 1. As shown in FIG. 4A, the screen displayed on the monitor 26 includes moving pictures of other users transmitted from other entertainment systems 10 connected for communication via the network 50, and a moving picture of the user taken by the camera unit 46 connected to the entertainment system 10 together with the monitor 26 (in FIG. 4A, a total of 16 moving pictures). With this embodiment 1, one or a plurality of these plurality of moving pictures are selected as start point moving pictures, and another one or plurality are selected as an end point moving picture. Elements that have selected start point moving pictures 52 a, 52 b and an end point moving picture 52 c are shown in FIG. 4A. The start point moving picture and the end point moving picture can also be selected from among the plurality of moving pictures included on the screen using a random number, or selected according to input of a controller 42 provided in the entertainment system 10 or in another entertainment system 10 connected for communication via the network 50.
After that, if user movement is detected from the content of the start point moving picture, one or more movement images are moved from the display position of the start point moving picture to the display position of the end point moving picture. Here, together with movement of a movement image 54 a of a plurality of stars from the start point moving picture 52 a to the end point moving picture 52 c, a movement image 54 b for a plurality of hexagons is moved from the start point moving picture 52 b to the end point moving picture 52 c.
FIG. 5 is a flow chart showing image processing by the entertainment system 10. The entertainment system 10 receive a moving picture of a user taken by a camera unit 46 provided in another entertainment system 10 in JPEG stream format via the network 50. The received moving picture data in JPEG stream format is converted to raster format by decoding using some of the sub-processors 14 a to 14 h. The data that has been converted to raster format is stored in the main memory 20. In the above described start point moving image, moving image data is read out from the main memory 20 by another of the sub-processors 14 a to 14 h, to carry out movement detection processing. With the movement detection processing, difference between frame images at respective timing (for example continuous time frames) for forming moving image data for raster format (is calculated, and a sum for pixel values of this difference image or images derived by subjecting the difference images to appropriate filter processing is calculated. This value represents amount of variation in the start point moving picture (amount of user movement), and this is also stored in the main memory 20.
Using yet another of the sub-processors from among the sub-processors 14 a to 14 h, a moving picture that has been converted to raster format stored in the main memory 20 is arranged in a screen projected on the monitor 26 (S101). Also, a start point moving picture and an end point moving picture are selected from among a plurality of moving pictures arranged on the screen using a random number, for example (S102).
After that, amount of variation in the start point moving picture calculated by some of the sub-processors 14 a to 14 h as described above is readout from the main memory 20 (S103). If the readout value exceeds a specified value, the movement images 54 a and 54 b are displayed on the screen so as to move from the display position of the start point moving picture to the display position of the end point moving picture determined in S102 (S104).
According to the entertainment system 10 of this embodiment 1, it is possible to project onto the monitor 26 an image such as if a message or energy is being sent from a user projected in the start point moving picture to a user projected in the end point moving picture.
Incidentally, movement direction of the endpoint moving picture or movement images 54 a and 54 b can be determined according to content of the start point moving picture. For example, as shown in FIG. 6, it is possible to move the movement images 54 a and 54 b n a movement direction of the user of the start point moving picture. In this case, it is possible to select a user moving picture for the movement direction of the movement images 54 a and 54 b in the end point moving picture.
The direction of movement of the user can be determined by generating a difference image for the start point moving picture (difference image for a frame image at a different timing), based on position of a group of pixels holding a having value exceeding a specified value in the difference image. At this time, it is possible to vary the extent of movement of the movement images 54 a and 54 b using size of movement of the user, that is, spread in position of pixel sets having pixel values exceeding a specified value in the above-described difference image. If this is done, it becomes possible to move the movement images 54 a and 54 b quickly by the user moving a hand etc. a large amount. It is also possible to control the number of movement images 54 radiating from the moving picture according to amount of movement of the user shown in the moving picture.
Embodiment 2
FIG. 7 shows one example of a screen displayed on the monitor 26 in an entertainment system 10 of this embodiment 2. With the present embodiment 2, and embodiments 3 to 6 that will be described later also, the system structure shown in FIG. 1 to FIG. 3 is adopted, and only a program executed by the MPU 11 and stored in the optical disc 36 is different from embodiment 1.
As shown in FIG. 7, with embodiment 2 a plurality of cubes are displayed on the screen. These cubes are square objects 60 arranged in virtual three dimensional space organized in the main memory 20, and the screen shown in FIG. 7 represents an appearance looking at this virtual three dimensional space from a given viewpoint. On an upper surface of each square object 60, a moving picture of a user transmitted from another entertainment system 10 connected for communication via the network 50 and a moving picture of a user taken using the camera unit 46 connected to the entertainment system 10 together with the monitor 26 for displaying the screen, are applied as texture. Also, spherical globular objects are arranged in the virtual three dimensional space, these globular objects are subjected to parabolic motion in the virtual three dimensional space, and hen the impact with other objects such as the square objects 60 the movement direction is changed.
With this embodiment 2, the user moves in front of the camera unit 46 (for example, moving their hands), to change the content of the moving picture, so as to change the upper surface of the square object 60 having the moving picture applied as texture. Specifically, as shown in FIG. 8, the upper surface of a square object 60 is divided into a plurality of rectangular areas, and a polygon apex is provided in the corner of each rectangular area. Amount of movement of a user portrayed in each rectangular area is calculated based on sections of the rectangular area among difference images of the user moving picture, and polygon apexes placed in corners of regions exhibiting the most movement are moved in a direction away from the square object 60. This movement amount is calculated based on movement of a user projected in a rectangular region, for example. Then, polygon apexes placed in other corners are moved in the same direction by a shorter distance. In this way, the upper surface if a square object 60 having the moving picture of the user applied as texture is changed according to user movement. This change to the square object 60 is calculated in real time, and displayed on the screen.
With this embodiment 2, a rebound direction of a globular object is calculated according to shape of the square object 60, which means that the user can cause the globular object 64 to bounce in any direction by moving in front of their own camera unit 46. It is also preferable to determine speed when the globular object rebounds based on transformation speed of the square object 60.
According to embodiment 2, it is possible for the users themselves to play volleyball using a globular object 64 in virtual three dimensional space by moving in front of respective camera units 46. In this manner, it is possible to significantly increase the interest level when adopted in a game, for example.
Embodiment 3
FIG. 9A and FIG. 9B show one example of a screen projected on the monitor 26 in an entertainment system 10 of this embodiment 3. As shown in FIG. 9A, with this embodiment moving pictures of a plurality of users are projected. These moving pictures of users include moving pictures projected by the camera unit 46 connected to the entertainment system 10 together with the monitor 26 for displaying the screen, and moving images received from entertainment systems 10 connected for communication via the network 50.
With this embodiment, as shown in FIG. 9B, if a user moves in front of the camera unit 46, other moving pictures move away from the vicinity of an image region exhibiting that movement. Specifically, the display positions of other moving pictures are moved away from partial regions of the moving picture exhibiting the user movement. In this way also, it is possible for the user to enjoy a game etc. using a screen containing moving pictures of a plurality of users.
Embodiment 4
FIG. 10A and FIG. 10B show one example of a screen projected on the monitor 26 in an entertainment system 10 of this embodiment 4. With embodiment 3, display region of a moving picture exhibiting user movement was not changed, but if the user projected in a particular moving picture moves a lot, as shown in FIG. 10A, the display region of the moving picture is changed according to this movement, as shown in FIG. 10B, and it is also possible to flick another moving picture in accordance with that change.
Embodiment 5
FIG. 11 shows one example of a screen projected on the monitor 26 in an entertainment system 10 of this embodiment 5. With this embodiment, if the user movement is exhibited in the user moving picture, the display region is changed in response to this movement. Then, if this display region contacts another image displayed on the screen processing corresponding to the image is executed and the screen is updated. For example, it is possible for images of various operating buttons to be displayed on the screen, the user changes a display region of the moving picture by their own movement, and by causing the display region to come into contact with an image of an arbitrary operating button processing corresponding to that operating button is executed and the screen is updated.
Embodiment 6
With the above description, display content of a screen projected on the monitor 26 is controlled using user movement exhibited in a moving picture, but as shown in FIG. 12, it is possible to change a display region of a moving picture regarding a position where a body part such as a face within the moving picture, and in this manner change the position of another moving picture.

Claims (13)

1. An image processing device, comprising:
moving picture acquisition means for acquiring respective moving pictures for a plurality of users;
moving picture display means for displaying each of the moving pictures acquired by the moving picture acquisition means on a screen; and
control means for controlling display content for the screen in response to content of each moving picture, wherein
said control means activates a display of at least one movement image that is different from all of the respective moving pictures, and moves the at least one displayed movement image from any one or more of the moving pictures towards another of the moving pictures on the screen when user movement in the content of the one or more moving pictures is detected.
2. The image processing device of claim 1, wherein the control means moves a specified one of the at least one movement image on the screen according to display position of each moving picture on the screen and content of each moving picture.
3. The image processing device of claim 2, wherein the control means moves the specified movement image with a display position of at least one of the respective moving pictures on the screen as a start point and a display position of at least another one of the moving pictures on the screen as an end point.
4. The image processing device of claim 3, wherein the control means determines the moving picture relating to the start point or the end point based on a random number.
5. The image processing device of claim 3, wherein the control means determines the moving picture relating to the start point or end point in accordance with instruction from some or all of a plurality of users.
6. The image processing device of claim 3, wherein the control means determines the moving picture relating to the end point according to content of the moving picture relating to the start point.
7. The image processing device of claim 2, wherein the control means controls a number of the movement image according to an amount of variation in the moving picture relating to a start point.
8. The image processing device of claim 1, wherein the control means varies a display region for at least one of the moving pictures on the screen, according to content of the at least one moving picture.
9. The image processing device of claim 8, wherein the control means controls display content of the screen according to display region of each moving picture on the screen, and display position of another picture.
10. The image processing device of claim 9, wherein the control means moves a display position of the other picture according to the display region of each moving picture on the screen.
11. The image processing device of claim 8, wherein the control means varies the display region for the at least one moving picture on the screen, according to a position where specific content has been projected in each moving picture.
12. An image processing method, comprising:
acquiring respective moving pictures for a plurality of users;
displaying each of the moving pictures acquired in the moving picture, acquisition step on a screen;
controlling display content for the screen in response to content of each moving picture; and
displaying at least one movement image that is different from all of the respective moving pictures and moving the at least one displayed movement image from any one or more of the moving pictures towards another of the moving pictures on the screen when user movement in the content of the one or more of the moving pictures is detected.
13. An information storage medium storing a program for causing a computer to function as:
moving picture acquisition means for acquiring respective moving pictures for a plurality of users;
moving picture display means for displaying each of the moving pictures acquired by the moving picture acquisition means on a screen; and
control means for controlling display content for the screen in response to content of each moving picture, wherein
said control means activates a display of at least one movement image that is different from all of the respective moving pictures, and moves the at least one displayed movement image from any one or more of the moving pictures towards another of the moving pictures on the screen when user movement in the content of the one or more of the moving pictures is detected.
US11/432,293 2005-05-13 2006-05-11 Image processing device, image processing method and information storage medium Active 2027-10-22 US8049757B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US13/240,220 US8570330B2 (en) 2005-05-13 2011-09-22 Image processing device, image processing method and information storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2005-141969 2005-05-13
JP2005141969A JP4485991B2 (en) 2005-05-13 2005-05-13 Image processing apparatus, image processing method, and program

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US13/240,220 Continuation US8570330B2 (en) 2005-05-13 2011-09-22 Image processing device, image processing method and information storage medium

Publications (2)

Publication Number Publication Date
US20060256118A1 US20060256118A1 (en) 2006-11-16
US8049757B2 true US8049757B2 (en) 2011-11-01

Family

ID=37418682

Family Applications (2)

Application Number Title Priority Date Filing Date
US11/432,293 Active 2027-10-22 US8049757B2 (en) 2005-05-13 2006-05-11 Image processing device, image processing method and information storage medium
US13/240,220 Active 2026-12-15 US8570330B2 (en) 2005-05-13 2011-09-22 Image processing device, image processing method and information storage medium

Family Applications After (1)

Application Number Title Priority Date Filing Date
US13/240,220 Active 2026-12-15 US8570330B2 (en) 2005-05-13 2011-09-22 Image processing device, image processing method and information storage medium

Country Status (2)

Country Link
US (2) US8049757B2 (en)
JP (1) JP4485991B2 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5479414B2 (en) * 2010-11-24 2014-04-23 キヤノン株式会社 Information processing apparatus and control method thereof
JP2017102218A (en) * 2015-11-30 2017-06-08 株式会社ニコン Display device and display program
US10375353B2 (en) 2015-12-11 2019-08-06 Sony Corporation Information processing apparatus, information processing method, and program
CN113835979A (en) * 2020-06-23 2021-12-24 华为技术有限公司 Method and device for obtaining evaluation parameters of application sliding effect

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04127674A (en) 1990-09-18 1992-04-28 Sony Corp Picture processor
US5680152A (en) * 1994-08-29 1997-10-21 Software Garden, Inc. Method and apparatus for navigating multiple independent windowed images
JP2002218424A (en) 2001-01-12 2002-08-02 Mitsubishi Electric Corp Video display controller
US20030038884A1 (en) * 2000-02-25 2003-02-27 Nobuyuki Matsushita Method and apparatus for producing communication data, method and apparatus for reproducing communication data, and program storage medium
US20040205594A1 (en) * 1996-07-29 2004-10-14 Samir Arora Hierarchical drag and drop structure editor for web sites
US20050021625A1 (en) * 2002-01-18 2005-01-27 Matsushita Elec. Ind. Co.Ltd. Communication apparatus
US20050078172A1 (en) * 2003-10-09 2005-04-14 Michael Harville Method and system for coordinating communication devices to create an enhanced representation of an ongoing event

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4624577B2 (en) * 2001-02-23 2011-02-02 富士通株式会社 Human interface system with multiple sensors
JP3603118B2 (en) * 2001-06-08 2004-12-22 東京大学長 Pseudo three-dimensional space expression system, pseudo three-dimensional space construction system, game system, and electronic map providing system
US7084888B2 (en) * 2001-08-09 2006-08-01 Konami Corporation Orientation detection marker, orientation detection device and video game device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH04127674A (en) 1990-09-18 1992-04-28 Sony Corp Picture processor
US5680152A (en) * 1994-08-29 1997-10-21 Software Garden, Inc. Method and apparatus for navigating multiple independent windowed images
US20040205594A1 (en) * 1996-07-29 2004-10-14 Samir Arora Hierarchical drag and drop structure editor for web sites
US20030038884A1 (en) * 2000-02-25 2003-02-27 Nobuyuki Matsushita Method and apparatus for producing communication data, method and apparatus for reproducing communication data, and program storage medium
JP2002218424A (en) 2001-01-12 2002-08-02 Mitsubishi Electric Corp Video display controller
US20050021625A1 (en) * 2002-01-18 2005-01-27 Matsushita Elec. Ind. Co.Ltd. Communication apparatus
US20050078172A1 (en) * 2003-10-09 2005-04-14 Michael Harville Method and system for coordinating communication devices to create an enhanced representation of an ongoing event

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Notice of Rejection dated Dec. 15, 2009, from the corresponding Japanese Application.

Also Published As

Publication number Publication date
JP4485991B2 (en) 2010-06-23
JP2006319818A (en) 2006-11-24
US20120007893A1 (en) 2012-01-12
US8570330B2 (en) 2013-10-29
US20060256118A1 (en) 2006-11-16

Similar Documents

Publication Publication Date Title
JP5026692B2 (en) Image processing apparatus, image processing method, and program
US9792950B2 (en) Program, information storage medium, image processing device, image processing method, and data structure
JP4177381B2 (en) Image generation method, image generation apparatus, and image generation program
US8054309B2 (en) Game machine, game machine control method, and information storage medium for shadow rendering
JP4761528B2 (en) GAME PROGRAM AND GAME DEVICE
JP2008059152A (en) Image viewer, image display method and program
WO2005099842A1 (en) Game device, computer control method, and information storage medium
WO2006008950A1 (en) Game device, control method of computer, and information storage medium
JP2004213641A (en) Image processor, image processing method, information processor, information processing system, semiconductor device and computer program
US8570330B2 (en) Image processing device, image processing method and information storage medium
US8295638B2 (en) Image display control device, image display method, and information storage medium
EP1977801A1 (en) Game machine, game machine control method, and information storage medium
US20090267942A1 (en) Image processing device, control method for image processing device and information recording medium
JP4809655B2 (en) Image display device, control method and program for image display device
US8319786B2 (en) Image processing device, control method for image processing device and information recording medium
JP5502043B2 (en) Game device and program
US7932903B2 (en) Image processor, image processing method and information storage medium
US20090251463A1 (en) Image processing device, image processing method and information storage medium
JP2003334384A (en) Game apparatus, method for controlling computer game system, and program
JP5183407B2 (en) Image processing apparatus, image processing method, and program
JP2002334348A (en) Video game device, recording medium and program
JP2005321965A (en) Game software and game device
JP2002260012A (en) Image forming method and program used therefor
JP2005095434A (en) Game device, and method and program for game control

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY COMPUTER ENTERTAINMENT INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KAKE, TOMOKAZU;OKUMURA, YASUSHI;SIGNING DATES FROM 20060626 TO 20060630;REEL/FRAME:017952/0752

Owner name: SONY COMPUTER ENTERTAINMENT INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KAKE, TOMOKAZU;OKUMURA, YASUSHI;REEL/FRAME:017952/0752;SIGNING DATES FROM 20060626 TO 20060630

STCF Information on status: patent grant

Free format text: PATENTED CASE

AS Assignment

Owner name: SONY NETWORK ENTERTAINMENT PLATFORM INC., JAPAN

Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT INC.;REEL/FRAME:027445/0773

Effective date: 20100401

AS Assignment

Owner name: SONY COMPUTER ENTERTAINMENT INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SONY NETWORK ENTERTAINMENT PLATFORM INC.;REEL/FRAME:027449/0380

Effective date: 20100401

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12