CN102076388A - Portable type game device and method for controlling portable type game device - Google Patents
Portable type game device and method for controlling portable type game device Download PDFInfo
- Publication number
- CN102076388A CN102076388A CN2009801252187A CN200980125218A CN102076388A CN 102076388 A CN102076388 A CN 102076388A CN 2009801252187 A CN2009801252187 A CN 2009801252187A CN 200980125218 A CN200980125218 A CN 200980125218A CN 102076388 A CN102076388 A CN 102076388A
- Authority
- CN
- China
- Prior art keywords
- image
- game device
- portable game
- reference object
- reflecting member
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
- A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
- A63F13/655—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition by importing photos, e.g. of the player
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
- A63F13/525—Changing parameters of virtual cameras
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/90—Constructional details or arrangements of video game devices not provided for in groups A63F13/20 or A63F13/25, e.g. housing, wiring, connections or cabinets
- A63F13/92—Video game devices specially adapted to be hand-held while playing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/58—Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1043—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being characterized by constructional details
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/20—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform
- A63F2300/204—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of the game platform the platform being a handheld device
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/6009—Methods for processing data by generating or executing the game program for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content
- A63F2300/6018—Methods for processing data by generating or executing the game program for importing or creating game content, e.g. authoring tools during game development, adapting content to different platforms, use of a scripting language to create content where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/69—Involving elements of the real world in the game world, e.g. measurement in live races, real video
- A63F2300/695—Imported photos, e.g. of the player
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
- Testing Of Coins (AREA)
Abstract
Provided is a portable type game device and a method for controlling a portable type game device, which are capable of improving applicability of an image generated from an image pickup means. A pickup object image generating unit (52) picks up an image of a pickup object to generate a pickup object image. A pickup object distance measuring unit (54) measures a distance to the pickup object. An information processing execution unit (56) executes information processing on the basis of the pickup object image and the distance measured by the pickup object distance measuring unit (54).
Description
Technical field
The present invention relates to the control method of portable game device and portable game device.
Background technology
The portable game device is popularized, and player (player) can enjoy recreation in various places.In such portable game device, there is the portable game device that can be connected with shooting unit such as video camera.In the portable game device that can be connected with video camera, can carry out the personage's that takes by video camera etc. image storage, used the information processing of captured image.Exception, known for example patent documentation 1 disclosed such, relevant with three-dimensional virtual object display unit technology, this three-dimensional virtual object display unit makes three-dimensional virtual object show as being present in the real world.
The prior art document
Patent documentation
Patent documentation 1: No. 3558104 communique of Japan Patent
Summary of the invention
The problem that invention will solve
But, can with take the portable game device in the past that the unit is connected, can only generate the personage that will before camera lens, exist and wait reference object object (object) to project to the two dimensional image on two-dimentional perspective plane.Therefore, for recreation, the data that obtain from the image that is generated are insufficient, and not talkative image is fully effectively utilized.
The present invention finishes in view of above-mentioned problem, and one of its purpose is to provide the control method of a kind of portable game device and portable game device, can improve from effective usability of the image of taking the unit generation.
Be used to solve the means of problem
In order to solve above-mentioned problem, portable game device of the present invention is characterised in that to have: take the unit, the reference object object is taken, generate reference object object image; Distance measuring unit, the distance between measurement and the described reference object object; And the information processing performance element, carry out the information processing of the distance of measuring based on described reference object object image and by described distance measuring unit.
In addition, it is characterized in that of the control method of portable game device of the present invention comprises: take step, reference object object image is taken and generated to the reference object object; The range measurement step, the distance between measurement and the described reference object object; And the information processing execution in step, carry out the information processing of the described distance of measuring based on described reference object object image and by described distance measuring unit.
According to the present invention, the distance between reference object object image, reference object object and the portable game device effectively can be utilized in information processing, therefore can improve effective usability by the image of taking the unit generation.
In a mode of the present invention, it is characterized in that described distance measuring unit is measured described distance successively, described information processing performance element is according to the variation of the distance of being measured by described distance measuring unit, the content of the information processing that change will be carried out.Like this, the variation of the distance between reference object object and the portable game device effectively can be utilized in information processing.
In a mode of the present invention, it is characterized in that described information processing performance element will be presented on the display unit based on the image of the distance of being measured by described distance measuring unit.Like this, can in handling, the demonstration of image effectively utilize distance between reference object object and the portable game device.
In addition, in a mode of the present invention, it is characterized in that, described distance measuring unit is measured described distance successively, described information processing performance element generates the image of Virtual Space according in the position of the viewpoint of this Virtual Space configuration, and the image of the described Virtual Space that generated is presented on the display unit, according to the variation of the distance of measuring by described distance measuring unit, the position of changing the described viewpoint in the described Virtual Space.Like this, can in the processing of demonstration, effectively utilize the variation of the distance between reference object object and the portable game device according to the virtual space image that the position generated of the viewpoint that disposes in the Virtual Space.
In addition, in this mode, described shooting unit is taken the reference object object successively, generate reference object object image, described information processing performance element is according to the variation by the described reference object object image of described shooting unit photographs, the position of the described viewpoint of change in described Virtual Space or towards at least one side also passable.Like this, can show basis in the treatment of picture of the Virtual Space that the position generated of the viewpoint of Virtual Space configuration, effective variation that utilizes the reference object object image of taking successively.
In addition, in a mode of the present invention, it is characterized in that described shooting unit and described distance measuring unit are integrally formed.
In addition, portable game device of the present invention is characterised in that to have the shooting unit of the reference object object being taken and generated reference object object image, and described shooting unit has: a plurality of lens (lens); Catoptrical reflecting member; And capturing element, acceptance is by the light of described reflecting member reflection, generate described reference object object image, described reflecting member will be with can be will be supported through the mode that the light of each described lens moves between the reflecting member position of described capturing element reflection.
According to the present invention, can take the reference object object of different directions, gather generation reference object object image, therefore can improve effective usability by the image of taking the unit generation.
In a mode of the present invention, it is characterized in that, also comprise the reflecting member driver element, drive described reflecting member, it is moved between each described reflecting member position according to the rule of predesignating.Like this, can generate the image of the reference object object of having taken different directions according to the rule of predesignating.
It is characterized in that of the control method of portable game device of the present invention, this portable game device has the shooting unit of the reference object object being taken and generated reference object object image, and described shooting unit has: a plurality of lens; Catoptrical reflecting member; And accept by the light of described reflecting member reflection and generate the capturing element of described reference object object image, described reflecting member will be with can be will be supported through the mode that the light of each described lens moves between the reflecting member position of described capturing element reflection, this control method comprises: the reflecting member actuation step, drive described reflecting member, it is moved between each described reflecting member position according to the rule of predesignating.
Description of drawings
Fig. 1 is the stereogram of an example of the portable game device of expression one embodiment of the present invention.
Fig. 2 is the hardware structure diagram of an example of hardware configuration of the portable game device of expression one embodiment of the present invention.
Fig. 3 is the figure of an example of expression Virtual Space.
Fig. 4 A is the figure that the image of expression Virtual Space is displayed on the situation of display part.
Fig. 4 B is the figure that the image of expression Virtual Space is displayed on the situation of display part.
Fig. 4 C is the figure that the image of expression Virtual Space is displayed on the situation of display part.
Fig. 5 A is the figure that the image of expression Virtual Space is displayed on the situation of display part.
Fig. 5 B is the figure that the image of expression Virtual Space is displayed on the situation of display part.
Fig. 5 C is the figure that the image of expression Virtual Space is displayed on the situation of display part.
Fig. 6 is the functional-block diagram of the portable game device of one embodiment of the present invention.
Fig. 7 is the figure of an example of expression player base image.
Fig. 8 is the figure of an example of expression player image.
Fig. 9 is the figure of an example that is illustrated in the flow process of the processing of carrying out in the portable game device of one embodiment of the present invention.
To be explanation be used for key diagram with an example of the situation of chess recreation with the portable game device of one embodiment of the present invention to Figure 10.
Figure 11 A is the figure of an example of the portable game device of expression another embodiment of the present invention.
Figure 11 B is the figure of an example of the portable game device of expression another embodiment of the present invention.
Figure 11 C is the figure of an example of the portable game device of expression another embodiment of the present invention.
Figure 12 A is the synoptic diagram of an example of summary of structure of shoot part of the portable game device of expression another embodiment of the present invention.
Figure 12 B is the synoptic diagram of an example of summary of structure of shoot part of the portable game device of expression another embodiment of the present invention.
Figure 13 A is the synoptic diagram of an example of summary of structure of shoot part of the portable game device of expression another embodiment of the present invention.
Figure 13 B is the synoptic diagram of an example of summary of structure of shoot part of the portable game device of expression another embodiment of the present invention.
Figure 14 is the figure of an example that is illustrated in the flow process of the processing of carrying out in the portable game device of another embodiment of the present invention.
Figure 15 is the synoptic diagram of an example of summary of structure of shoot part of the portable game device of expression another embodiment of the present invention.
The specific embodiment
Below describe one embodiment of the present invention in detail based on accompanying drawing.
Fig. 1 is the stereogram of an example of the portable game device 1 of expression present embodiment.Fig. 2 is the hardware structure diagram of an example of the hardware configuration of expression portable game device 1 shown in Figure 1.As Fig. 1 and shown in Figure 2, the shape of the basket 10 of the portable game device 1 of present embodiment is a box.And the portable game device 1 of present embodiment has control part 12, storage part 14, display part 16, operating portion 18, shoot part 20, range measurement portion 22, Department of Communication Force 24.
Shoot part 20 for example comprises known digital camera and constitutes, and per stipulated time (for example 1/60 second) generates black and white, gray scale (gray scale) or colored image (for example image of JPEG form).In addition, shoot part 20 is standard camera, the video camera of looking in the distance, the wide-angle imaging machine can.In the present embodiment, shoot part 20 is set at the upside of display part 16.That is, shoot part 20 is set near the upside of positive central authorities of basket 10.
Department of Communication Force 24 for example is (particularly for example being wireless LAN module) such as internet interfaces, according to the indication from control part 12 inputs, to other portable game device 1 or the transmission information such as (not shown) of the server on the internet.In addition, this Department of Communication Force 24 outputs to control part 12 with received information.
In the present embodiment, portable game device 1 is carried out the Virtual Space and is shown processing, promptly based on the position of each the virtual object 28 in Virtual Space shown in Figure 3 26 (being virtual three-dimensional space in the present embodiment), the position and the direction of visual lines 32 of viewpoint 30, such shown in Fig. 4 A～Fig. 4 C and Fig. 5 A～Fig. 5 C, generate with portable game device 1 before player 34 facial positions or towards corresponding image, and the image that generated of demonstration.
Particularly, for example player 34 face is if advance (with reference to Fig. 4 A), and then the viewpoint 30 in the Virtual Space 26 is advanced, and the image of such Virtual Space 26 is displayed on the display part 16 such as LCD shown in Fig. 4 B.On the other hand, if player 34 face retreats (with reference to Fig. 4 A), then the viewpoint 30 in the Virtual Space 26 retreats, and the image of such Virtual Space 26 is displayed on the display part 16 shown in Fig. 4 C.
And, if player 34 face counterclockwise rotates (with reference to Fig. 5 A) with respect to portable game device 1, then viewpoint 30 in the Virtual Space 26 and direction of visual lines 32 counterclockwise rotate, and the image of such Virtual Space 26 is displayed on the display part 16 shown in Fig. 5 B.On the other hand, if player 34 face rotates (with reference to Fig. 5 A) with respect to portable game device 1 clockwise direction, then viewpoint 30 in the Virtual Space 26 and direction of visual lines 32 clockwise directions rotate, and the image of such Virtual Space 26 is displayed on the display part 16 shown in Fig. 5 C.
Fig. 6 is the functional-block diagram of the portable game device 1 of of the present invention, this embodiment.As shown in Figure 6, the portable game device 1 of this embodiment works as comprising as the device of lower part aspect functional: Virtual Space data store 40, viewpoint data store 42, base image generating unit 44, feature value calculation unit 46, base image storage part 48, base image Department of Communication Force 50, reference object object image production part 52, reference object object range measurement portion 54, information processing execution portion 56 (reference object object configuration calculating part 56a, the viewpoint data change 56b of portion and Virtual Space display part 56c).
Virtual Space data store 40 is mainly realized by storage part 14.Virtual Space data store 40 storages virtual object position data for example as shown in Figure 3, that represent the position (for example coordinate figure) of each the virtual object 28 in the Virtual Space 26.Particularly, for example as shown in Figure 3, data store 40 storage representations in Virtual Space are equivalent to the virtual object position data (for example the length of the D coordinates value at the center of the D coordinates value on each summit, ball and radius etc.) of position of the virtual object 28c of box (box) of the position of the position of the virtual object 28a in room in room, the spherical virtual object 28b of spheroid and rectangular shape.As shown in Figure 3, in this Virtual Space 26, at the virtual object 28b of spheroid of the internal configurations sphere of the virtual object 28a in the room of the box that is equivalent to the room and the virtual object 28c of box of rectangular shape.And the virtual object 28b of spheroid is configured on the lower surface of the virtual object 28a in room, and the virtual object 28c of box is configured to contact with the upper surface of the virtual object 28a in room.
Base image generating unit 44 is mainly realized by shoot part 20, control part 12 and operating portion 18.Base image generating unit 44 generates the base image of image (player's base image 60) as shown in Figure 7, expression player 34 for example etc.
Particularly, for example 44 per stipulated times of base image generating unit generate image successively, and control, and make the image that is generated be presented at successively on the display part 16 as 62 with block diagram.At this moment, player 34 moves portable game device 1, makes oneself the image (face-image 64) of face enter block diagram as in 62.At this moment, even self moving certainly, player 34 also has no relations.Here, if player 34 is operating operation portion 18 (for example pressing the button), then base image generating unit 44 will the block diagram of display part 16 in as 62 shown image be stored in the base image storage part of narrating later 48 as player's base image 60.
In addition, player 34 also can pass through operating operation portion 18, can change block diagram shown in Figure 7, that show as 62 position and size in display part 16.
In addition, outside object corresponding with the image of being taken by shoot part and the distance between the portable game device 1 are measured by range measurement portion 22, base image generating unit 44 can be controlled display part 16, to the measuring distance corresponding pixel shorter than the distance of regulation, show its image.In addition, when display part 16 display images, base image generating unit 44 also can be controlled display part 16, to give the distance of measuring with range measurement portion 22 corresponding video effect.Particularly, for example when display part 16 display images, base image generating unit 44 also can be controlled display part 16, appears out such video effect in one's mind to give video effect that face is under water such or face from dark.
In addition, have at portable game device 1 under the situation of flash lamp or lamp, base image generating unit 44 can illumination flash lamp or lamp when generating image.Thus, under dark situation, base image generating unit 44 also can the formation base image.
Feature value calculation unit 46 is mainly realized by control part 12.Image processing techniques such as the known pattern recognition technique of feature value calculation unit 46 uses etc. based on player's base image 60 shown in Figure 7, are calculated the characteristic quantity of expression player's 34 feature.Here, as characteristic quantity, particularly, for example enumerate the position, size of position, size and color (rgb value and HSV value), the eyes of color (rgb value and HSV value), the lip of face-image 64, skin and at interval, the position of nose, size and highly, the position of eyebrow, highly, the color of width and color (rgb value and HSV value), hair style, hair etc.
In addition, feature value calculation unit 46 is also according to the reference object object image calculation characteristic quantity of narrating later.About the aspect of feature value calculation unit 46, will narrate in the back according to reference object object image calculation characteristic quantity.
Base image storage part 48 is mainly realized by storage part 14.The base image (being player's base image 60 in the present embodiment) that 48 storages of base image storage part are generated by base image generating unit 44.Base image storage part 48 can be set up related the storage with the characteristic quantity that base image and feature value calculation unit 46 calculate according to this base image.
In addition, base image storage part 48 also can not be 1 image of storage, stores but a plurality of images are set up association.In addition, base image storage part 48 also can be stored the such composograph of motion images (motion portrait) as base image.In addition, base image storage part 48 also can be stored player's base image 60 of a plurality of expressions such as happiness, anger, grief and joy.Particularly, for example, base image storage part 48 is not only stored the player base image 60 of player 43 fronts when portable game device 1, also the player's base image 60 when the portable game device 1 up and down can be set up association mutually and store.
In addition, base image storage part 48 also can be to the outside object of a plurality of kinds, and the base image of this outside object is set up related the storage with the object identifier that is used to discern this outside object.Particularly, for a plurality of players 34, base image storage part 48 also can be set up related the storage with player's base image 60 of this player 34 and this player's 34 ID, name etc.
In addition, the data of the distance that also expression can be measured by range measurement portion 22 of base image storage part 48 are set up related the storage with each pixel in the base image.
Base image Department of Communication Force 50 is mainly realized by control part 12 and Department of Communication Force 24.Base image Department of Communication Force 50 also can send to server (not shown) on the internet via Department of Communication Force 24 with the base image of storage in the base image storage part 48, and is stored in the storage device that this server has.In addition, base image Department of Communication Force 50 also can with the expression whether openly send to server base image could public information send to server via Department of Communication Force 24.
In addition, server can average etc. by having set up related characteristic quantity with each base image of storage, generates average base image (for example average face-image).In addition, also can download via Department of Communication Force 24 and be set to disclosed base image, average base image by the player 34 of portable game device 1.
Reference object object image production part 52 is mainly realized by shoot part 20.The reference object object that reference object object image production part 52 is taken as the object that will be taken generates reference object object image.In the present embodiment, particularly, for example, reference object object image production part 52 generates player's image 66 shown in Figure 8.In addition, as shown in Figure 8, in player's image 66, also can comprise a plurality of players' 34 face-image 64 (the 1st face-image 64-1 of the 1st player 34-1 and the 2nd face-image 64-2 of the 2nd player 34-2).Certainly, the image of reference object object image production part 52 generations is not limited to player's image 66.In addition, reference object object image production part 52 can be taken the reference object object successively, generates reference object object image.
In addition, have at portable game device 1 under the situation of flash lamp or lamp, reference object object image production part 52 can illumination flash lamp or lamp when generating image.Like this, even under dark situation, reference object object image production part 52 also can generate reference object object image, and feature value calculation unit 46 can be according to reference object object image calculation characteristic quantity.
And, above-mentioned image processing techniques such as the known pattern recognition technique of feature value calculation unit 46 uses etc., the reference object object image (for example player's image 66) based on being generated by reference object object image production part 52 calculates characteristic quantity as described above.
Feature value calculation unit also can contrast by base image (for example player's base image 60) and the reference object object image (for example player's image 66) with storage in the base image storage part 48 for 46 this moments, thus the calculated characteristics amount.Particularly, for example as shown in Figure 8, in the player's image 66 that generates by reference object object image production part 52, comprise under a plurality of players' 34 the situation of image, feature value calculation unit 46 can with this player's image 66 with set up related player base image 60 with specific player's 34 (being the 1st player 34-1) identifiers such as ID here and contrasted, use known pattern recognition technique etc., calculate specific player's 34 face-image 64 (being the 1st face-image 64-1) according to player's image 66 here.
Reference object object range measurement portion 54 is mainly realized by range measurement portion 22.Above-mentioned reference object object and the distance between the portable game device 1 are measured by reference object object range measurement portion 54.In the present embodiment, particularly, for example measure the distance (player's distance) between player 34 (more specifically for example player 34 surface) and the portable game device 1.In addition, reference object object range measurement portion 54 also can measure the distance between reference object object and the portable game device 1 successively.Reference object object range measurement portion 54 will be corresponding with its foundation about player's distance of the point on the reference object object (for example the player 34) corresponding with this pixel for each pixel that comprises in the reference object object image (for example player's image 66).
Information processing execution portion 56 is mainly realized by control part 12 and display part 16.Information processing execution portion 56 carries out the information processing of the distance of measuring based on reference object object object (for example player's image 66) and by reference object object range measurement portion 54.Particularly, for example information processing execution portion 56 carries out and will be presented at the information processing of display part 16 based on the image of the distance of being measured by reference object object range measurement portion 54.And in the present embodiment, information processing execution portion 56 comprises reference object object configuration calculating part 56a, the viewpoint data change 56b of portion and Virtual Space display part 56c.
Reference object object configuration calculating part 56a calculates the configuration of reference object object (for example the player 34) in real space based on reference object object image (for example player's image 66) and the distance (for example player's distance) measured by reference object object range measurement portion 54.Here, reference object object configuration calculating part 56a can use the characteristic quantity that is calculated based on reference object object image (for example player's image 66) by feature value calculation unit 46, calculates the configuration of reference object object (for example the player 34) in real space.In addition, reference object object configuration calculating part 56a also can calculate the configuration of reference object object in real space successively.Particularly, reference object object configuration calculating part 56a calculated example such as player's 34 face in real space with respect to the relative coordinate figure (for example D coordinates value) of portable game device 1 and with respect to portable game device 1 towards (for example axial amount of spin of x, the axial amount of spin of y and the axial amount of spin of z).
The viewpoint data change 56b of portion changes the viewpoint data of storage in viewpoint data store 42 based on the distance of being measured by reference object object range measurement portion 54.Measure successively under the situation of the distance between reference object object and the portable game device 1 in reference object object range measurement portion 54, viewpoint data change portion can represent the viewpoint data of the position of the viewpoint 30 in the Virtual Space 26 according to the variation change of this distance.
Here, the viewpoint data change 56b of portion can be according to the variation of reference object object image (for example player's image 66), the position of the viewpoint 30 in the change Virtual Space 26 or towards at least one side of (direction of visual lines 32).That is, the viewpoint data change 56b of portion can be according to the variation of reference object object image (for example player's image 66), the viewpoint position data of change storage in viewpoint data store 42 and at least one side of direction of visual lines data.
In the present embodiment, the viewpoint data change 56b of portion is based on disposed calculating part 56a calculates, the configuration of reference object object (for example the player 34) in real space, the viewpoint data of change storage in viewpoint data store 42 by the reference object object.Particularly, for example the 56b of viewpoint data change portion based on player 34 face in real space with respect to the relative coordinate value (for example D coordinates value) of portable game device 1, with respect to portable game device 1 towards (for example axial amount of spin of x, the axial amount of spin of y and the axial amount of spin of z), the viewpoint data of change storage in viewpoint data store 42.
In addition, when being calculated the reference object object by reference object object configuration calculating part 56a and be configured in nearby (perhaps at a distance) with respect to portable game device 1, the viewpoint data change 56b of portion gets final product the viewpoints 30 in the Virtual Space 26 to front side (perhaps rear side) change.In addition, when calculating the reference object object by reference object object configuration calculating part 56a near (perhaps away from) portable game device 1, the viewpoint data change 56b of portion make the viewpoints 30 in the Virtual Space 26 advance (perhaps retreating) get final product.
In addition, when calculating the reference object object by reference object object configuration calculating part 56a and relatively be configured in right side (perhaps left side) with respect to portable game device 1, the viewpoint data change 56b of portion with the viewpoint 30 in the Virtual Space 26 to the right (perhaps left side) change get final product.
In addition, when calculating the reference object object by reference object object configuration calculating part 56a and relatively be configured in right side (perhaps left side) with respect to portable game device 1, the viewpoint data change 56b of portion make in the Virtual Space 26 viewpoint 30 to the right (perhaps left side) change get final product.
In addition, calculate by reference object object configuration calculating part 56a the reference object object with respect to portable game device 1 relatively when counterclockwise (perhaps clockwise direction) rotates, the direction of visual lines 32 that the viewpoint data change 56b of portion makes the viewpoint 30 in the Virtual Space 26 rotates to counterclockwise (perhaps clockwise direction) and gets final product.
Virtual Space display part 56c generates the image of Virtual Space 26 shown in Figure 3 according to the position of the viewpoint 30 of configuration in Virtual Space 26, and shows the image of the Virtual Space 26 that is generated.Particularly, for example, about Virtual Space 26, show from the image of the situation of the direction of visual lines 32 of watching the direction of visual lines data representation that in the viewpoint data, is comprised by the position of the represented viewpoint 30 of the viewpoint position data that comprise the viewpoint data change 56b of the portion viewpoint data after changing.
In addition, the information processing of being carried out by information processing execution portion 56 is not limited to the information processing by reference object object configuration calculating part 56a, the viewpoint data change 56b of portion and Virtual Space display part 56c execution.For example range measurement portion 22 measures the distance between reference object object and the portable game device 1 successively, and 56 variations according to this distance of measuring of information processing execution portion are carried out change and also can by the processing of the content of the processing of control part 12 execution.In addition, the information processing of information processing execution portion 56 execution also is not limited to show at display part 16 information processing of information.
Then, example with reference to the flow process of the following processing of flowchart text shown in Figure 9: set up related in the player's 34 of regulation player's base image 60 and the player's 34 who extracts from this player's base image 60 face-image 64, and be stored under the situation of base image storage part 48, in the time of before this player 34 is present in portable game device 1, show with the position of this player's 34 face and towards the image in corresponding virtual space 26.In addition, at this moment, the virtual object position data of the position (for example coordinate figure) of each the virtual object 28 in storage part 14 in the storage representation Virtual Space 26 shown in Figure 3.In addition, storage viewpoint data in viewpoint data store 42, these viewpoint data comprise the viewpoint position data of the position (for example coordinate figure) of representing the viewpoint 30 in the Virtual Space 26 and represent the direction of visual lines data of the direction of visual lines 32 of this viewpoint 30.In addition, handle in the example at this, shoot part 20 is high frame frequency camera of variable frame frequency.
At first, reference object object image production part 52 generates player's image 66 (S101) of this player 34.
Then, feature value calculation unit 46 contrasts player's base image 60 of player's image 66 and this player 34, thereby calculates the image (S102) of this player's 34 face, eyes, nose and mouth.
Then, feature value calculation unit 46 calculate between this players' 34 eyes, at least one the length (S103) of player's image 66 in eyes and nose, nose and the mouth.
Then, player 34 eyes, nose and mouth and the distance between the portable game device 1 (player's distance) are measured by reference object object range measurement portion 54, thereby set up corresponding (S104) with each pixel that comprises in player's image 66.
Then, reference object object configuration calculating part 56a calculates the configuration (S105) of this player 34 in real space based on player's image 66 and player's distance.Particularly, the face that calculates player 34 is axial about x direction of principal axis, y direction of principal axis, z respectively, with respect to the relative amount of spin of portable game device 1, and player 34 face is with respect to the relative coordinate figure of portable game device 1.
Then, the viewpoint data change 56b of portion is based on according to the position of the D coordinates value that calculates in the processing shown in S105 face that determine, this player 34 and at least one (S106) in the direction of visual lines data of the viewpoint position data of, the change position of viewpoint 30 storage, in the expression Virtual Space 26 in viewpoint data store 42 and expression direction of visual lines 32.
Then, Virtual Space display part 56c display image in Virtual Space 26, this image is represented the position of the viewpoint 30 of the viewpoint position data representation that comprises, the situation (S107) of watching the direction of visual lines 32 of direction of visual lines data representation from the viewpoint data that changed the processing shown in the S105.In addition, at this moment, display part 16 also can be used based on from attribute display images such as the resolution ratio of the indication of control part 12 or aspect ratios.
Like this, for each frame, the image that the situation of Virtual Space 26 is observed in expression is displayed on display parts 16 such as LCD.
In processing above-mentioned processing example, shown in S102 and the S103, when feature value calculation unit 46 can not be calculated the such characteristic quantity of player 34 the image of face, eyes, nose and mouth or at least one length in player's image 66 in eyes and eyes, eyes and nose, nose and the mouth, Virtual Space display part 56c also can be on showing on the display part 16 of LCD etc. according to display part 16 at LCD etc. before the shown image image of analogizing.
In addition, under above-mentioned situation, also can improve the frame frequency of shoot part 20 and carry out the processing shown in S101～S103 once more.At this moment, even number of times with the regulation of the processing execution shown in S101～S103, under can not situation, also the image that shows before on the display part 16 of LCD etc. can be presented on the display part 16 of LCD etc. based on player's image 66 calculated characteristics amounts.In addition, at this moment, even storage errors enumeration data in storage part 14 in advance is at the number of times with the regulation of the processing execution shown in S101～S103, under can not the situation based on player's 34 calculated characteristics amounts, control part 12 also can increase by 1 with the value of error count data.And, can not surpass official hour based on the time of player's image 66 calculated characteristics amounts, when perhaps the value of error count data surpassed setting, control part 12 also can be presented at error message on the display part 16.In addition, have at portable game device 1 under the situation of built-in vibrator (vibrator), loudspeaker or LED, can not surpass official hour based on the time of player's image 66 calculated characteristics amounts, when perhaps the value of error count data has surpassed setting, control part 12 also can make the vibrator vibration, the perhaps loudspeaker generation warning that has from portable game device 1, the LED flicker that portable game device 1 is had.
Then, below explanation is applied to example with chess recreation with above-mentioned embodiment.
As shown in figure 10, portable game device 1 exists the 1st player 34-1 and the 2nd player 34-2 face-to-face relatively.And, show checkerboard image 68 at the display part 16 of portable game device 1.This is an example of the virtual object 28 in the above-mentioned Virtual Space 26 with checkerboard image 68.
And, when taking turns to the 1st player 34-1 and move (hand kind), according to the face of the 1st player 34-1 with respect to the relative position of portable game device 1 and towards, control part 12 control display parts 16 are to show checkerboard image 68.Like this, be difficult to see with checkerboard image 68 from the 2nd player 34-2 aspect.On the other hand, when taking turns to the 2nd player 34-2 and move, according to the face of the 2nd player 34-2 with respect to the relative position of portable game device 1 and towards, control part 12 control display parts 16 are to show checkerboard image 68.Like this, be difficult to see with checkerboard image 68 from the 1st player 34-1 aspect.
In addition, also present embodiment can be applied to first person viewpoint shooting game (FPS) recreation.Particularly, for example under the situation of the image of the face that can not calculate players 34 by feature value calculation unit 46, control part 12 also can be carried out and hide bullet or attack, perhaps clip-fed game processing.
In addition, in the authentication processing in recreation, also can use the portable game device 1 of present embodiment.Particularly, for example, when title (title) picture of recreation is presented on the display part 16, if player 34 is with facial shoot part 20 near portable game device 1, control part 12 characteristic quantity that also can calculate then based on player's image 66 that feature value calculation unit 46 generates according to reference object object image production part 52, determine the player 34 that face is close, carry out this player's 34 authentication.At this moment, under situation that can not determine player 34, control part 12 also can be anonymous players with these player's 34 authentications.At this moment, in portable game device 1, also can upgrade player's base image 60.The control part 12 that also can be portable game device 1 can utilize the update functions of such player's base image 60 when the various information processing of beginning.
According to present embodiment, can carry out video performance, and can improve effective usability of the image that generates by shoot part 20 near the three-dimensional of the sensation of real world.
Then, describe another embodiment of the present invention in detail based on accompanying drawing.
The hardware configuration of the portable game device 1 of present embodiment is with shown in Figure 2 the same.
Figure 11 A is the front view of the portable game device 1 of present embodiment.Figure 11 B is the vertical view of the portable game device 1 of present embodiment.Figure 11 C is the rearview of the portable game device 1 of present embodiment.
Figure 12 A, Figure 12 B, Figure 13 A and Figure 13 B are the synoptic diagrams of an example of summary of structure of shoot part 20 of the portable game device 1 of expression present embodiment.Shown in Figure 12 A, Figure 12 B, Figure 13 A and Figure 13 B, the shoot part 20 of the portable game device 1 of present embodiment comprises as the lower part and constitutes: optical system 20a (the place ahead optical system 20a-1, rear optical system 20a-2 and top optical system 20a-3), shutter (shutter) 20b (the place ahead shutter 20b-1, rear shutter 20b-2 and top shutter 20b-3), reflecting member 20c (the 1st reflecting member 20c-1 and the 2nd reflecting member 20c-2) and capturing element 20d.
In the present embodiment, the place ahead optical system 20a-1 is arranged near the upside of positive central authorities of portable game device 1, rear optical system 20a-2 is arranged near the upside back side central authorities of portable game device 1, and top optical system 20a-3 is arranged on the left side slightly than the upper side central authorities of portable game device 1.Each optical system 20a can be made of lens, also can be made of a plurality of lens.In addition, no matter constitute the kind of the lens of each optical system 20a, for example standard lens, wide-angle lens, telephoto lens can.
In the present embodiment, the place ahead shutter 20b-1 is arranged on the inboard of the place ahead optical system 20a-1, and rear shutter 20b-2 is arranged on the inboard of rear optical system 20a-1, and top shutter 20b-3 is arranged on the inboard of top optical system 20a-3.In addition, these shutters 20b also can be arranged on the outside of optical system 20a.
Reflecting member 20c is catoptrical member, for example is mirror.In the present embodiment, reflecting member 20c is tabular, and is arranged on the inside of portable game device 1.
Capturing element 20d for example is ccd image sensor, cmos image sensor etc., accepts the light by reflecting member 20c reflection, generates image (view data).Particularly, capturing element 20d accepts light, generates the signal of telecommunication by light-to-current inversion, generates image (view data) based on this signal of telecommunication.
And the 1st reflecting member 20c-1 is near the inside the top center of the mode of the vertical direction inside that is set at portable game device 1 with the plane that is formed by the 1st reflecting member 20c-1.The 1st reflecting member 20c-1 will be with can be will be supported through the mode that the light of the place ahead optical system 20a-1 or rear optical system 20a-2 moves towards between each reflecting member position of capturing element 20d reflection.In the present embodiment, the 1st reflecting member 20c-1 is can being that the mode of center rotation is supported with the axle of vertical direction.Particularly, the supporting member of vertical direction (not shown) connects the 1st reflecting member 20c-1, and this support member support the 1st reflecting member 20c-1 makes it rotatable.
In the present embodiment, the 1st reflecting member 20c-1 with can will through the light of the place ahead optical system 20a-1 towards the reflecting member position, the place ahead of capturing element 20d reflection (in Figure 12 A, dispose the position of the 1st reflecting member 20c-1) and will be supported through the mode of the light of rear optical system 20a-2 rotation between the rear reflection member position (in Figure 12 B, disposing the position of the 1st reflecting member 20c-1) of capturing element 20d reflection.
And when the 1st reflecting member 20c-1 moved to reflecting member position, the place ahead, the place ahead shutter 20b-1 opened, and when moving to the rear reflection member position, rear shutter 20b-2 opens.
In addition, portable game device 1 for example has actuator reflecting member drive divisions (not shown) such as (actuator), and this reflecting member drive division also can drive the 1st reflecting member 20c-1, and it is moved between each reflecting member position.In addition, control part 12 also can drive the reflecting member drive division.At this moment, accept light at capturing element 20d and generate the timing of image, the reflecting member drive division also can drive the 1st reflecting member 20c-1, makes the 1st reflecting member 20c-1 move to any one reflecting member position.
In the present embodiment, the control part 12 by portable game device 1 makes reflecting member 20c and shutter 20b action, thereby shoot part 20 is taken the reference object object with the frame frequency of regulation, generates reference object object image.
Under the situation that shutter 20b-3 opened above Figure 13 A was illustrated in, watch the summary of the structure of shoot part 20 from the top.In addition, under the situation that shutter 20b-3 opened above Figure 13 B was illustrated in, watch the summary of the structure of shoot part 20 from the place ahead.Shown in Figure 13 A and Figure 13 B, the reflecting surface of the 2nd reflecting member 20c-2 is by relative horizontal direction tilted configuration, and be arranged on than the top center of portable game device 1 left side slightly, make the 2nd reflecting member 20c-2 to reflect towards capturing element 20d through the light of top optical system 20a-3.
Then, generate the example of flow process of the processing of live image in the present embodiment with reference to flowchart text shown in Figure 14.
At first, the reflecting member drive division makes the 1st reflecting member 20c-1 move to reflecting member position, the place ahead (S201).
Then, control part 12 opens and closes the place ahead shutter 20b-1 (S202).
So the 1st reflecting member 20c-1 will reflect towards capturing element 20d through the light of the place ahead optical system 20a-1 and the place ahead shutter 20b-1, capturing element 20d accepts this light, generates image (S203) (with reference to Figure 12 A).
Then, the reflecting member drive division makes the 1st reflecting member 20c-1 move to rear reflection member position (S204).
Then, control part 12 opens and closes rear shutter 20b-2 (S205).
So the light of give out light after the 1st reflecting member 20c-1 will see through 20a-2 of system and rear shutter 20b-2 is towards capturing element 20d reflection, capturing element 20d accepts this light, generates image (S206) (with reference to Figure 12 B).
Then, the reflecting member drive division moves the 1st reflecting member 20c-1, makes the reflecting surface of the 1st reflecting member 20c-1 and the long side direction almost parallel (S207) of portable game device 1.
Then, control part 12 opens and closes top shutter 20b-3 (S208).
So the 2nd reflecting member 20c-2 will reflect towards capturing element 20d through the light of top optical system 20a-3 and top shutter 20b-3, capturing element 20d accepts this light, generates image (S209) (with reference to Figure 13 A and Figure 13 B).
And after the processing that has repeated S201～S209, control part 12 is combined in a series of image that generates in the processing of S203 and generates live image.In addition, control part 12 also is combined in a series of image that generates in the processing of S206 and generates other live image.In addition, control part 12 also is combined in a series of image that generates in the processing of S209, generates other live image.Like this, the portable game device 1 of present embodiment can be taken the reference object object of different directions, gathers to generate reference object object image, therefore, can improve effective usability of the image that is generated by shoot part 20.
And, for example the frame frequency of the shoot part 20 that has at the portable game device 1 of present embodiment is under the situation of 240fps, by the processing shown in the foregoing description, it is three live images (the place ahead live image, rear live image and top live image) of 80fps that portable game device 1 gathers the generation frame frequency.
In addition, above-mentioned processing example only generates an example of the processing of live image, for example, the reflecting member drive division is according to the rule of predesignating beyond the above-mentioned rule, drive the 1st reflecting member 20c-1, it is moved between each reflecting member position, thereby the portable game device 1 of present embodiment can generate the comings and goings image.
Particularly, for example, by repeating the processing shown in S201～S206 in above-mentioned processing example, thereby the frame frequency of the shoot part 20 that has at the portable game device 1 of present embodiment is under the situation of 240fps, and portable game device 1 gathers that to generate frame frequency be two live images (the place ahead live image and rear live image) of 120fps.
In addition, by repeat the processing shown in S201～S203 repeated twice after, with the processing once of the processing execution shown in S204～S206, the frame frequency of the shoot part 20 that has at the portable game device 1 of present embodiment is under the situation of 240fps, and portable game device 1 gathers that to generate frame frequency be the live image (the place ahead live image) of 160fps and the live image (rear live image) that frame frequency is 80fps.
The present invention considers various application examples.For example, consider to show that with the Virtual Space shown in the above-mentioned embodiment processing is combined, show the image that has showed expansion reality.Particularly, for example, at first shoot part 20 is taken the object (for example image or character etc.) of the direction configuration of optical system 20a-2 in the wings.Then, control part 12 generates the virtual object position data of the position of the virtual object 28 of expression based on the object that photographs.Then, Virtual Space data store 40 these virtual object position datas of storage.Then, shoot part 20 is taken the reference object object of the direction of the place ahead optical system 20a-1.Then, the viewpoint data change 56b of portion changes the viewpoint data of storage in viewpoint data store 42 based on this reference object object.Then, display part 56c in Virtual Space will be presented on the display parts 16 such as LCD according to the image of the Virtual Space that the position generated 26 of after changing viewpoint 30.Like this, consider to show the image that has showed expansion reality.
Perhaps, by combined, can easily generate the live image of tracking mobile reference object object on various directions with known mode identification technology.
Like this, according to present embodiment, can gather generation a plurality of images (live image), and can improve effective usability of the image that generates by shoot part 20.
In addition, the scope of application of the present invention is not limited to above-mentioned embodiment.
Particularly, for example, the configuration of optical system 20a, shutter 20b, reflecting member 20c, capturing element 20d is not limited to above-mentioned embodiment, and capturing element 20d accepts to be got final product by the light of reflecting member 20c reflection.
In addition, the number of optical system 20a or shutter 20b is not limited to above-mentioned embodiment, and for example as shown in figure 15, portable game device 1 also can have the optical system 20a and the shutter 20b of 4 directions.Like this, portable game device 1 can gather 4 live images of generation.
In addition, portable game device 1 does not need to have the shutter 20b of physical property.
Claims (10)
1. portable game device is characterized in that having:
Take the unit, the reference object object is taken, generate reference object object image;
Distance measuring unit, the distance between measurement and the described reference object object; And
The information processing performance element is carried out the information processing of the distance of measuring based on described reference object object image and by described distance measuring unit.
2. portable game device as claimed in claim 1 is characterized in that,
Described distance measuring unit is measured described distance successively,
Described information processing performance element is according to the variation of the distance of being measured by described distance measuring unit, the content of the information processing that change will be carried out.
3. portable game device as claimed in claim 1 is characterized in that,
Described information processing performance element will be presented on the display unit based on the image of the distance of being measured by described distance measuring unit.
4. portable game device as claimed in claim 1 is characterized in that,
Described distance measuring unit is measured described distance successively,
Described information processing performance element is according to the position of the viewpoint that disposes in this Virtual Space, generate the image of Virtual Space, the image of the described Virtual Space that generated is presented on the display unit, and according to the variation of the distance of measuring by described distance measuring unit, the position of changing the described viewpoint in the described Virtual Space.
5. portable game device as claimed in claim 4 is characterized in that,
Described shooting unit is taken the reference object object successively, generates reference object object image,
Described information processing performance element is according to the variation by the described reference object object image of described shooting unit photographs, the position of the described viewpoint of change in described Virtual Space or towards at least one side.
6. portable game device as claimed in claim 1 is characterized in that,
Described shooting unit and described distance measuring unit are integrally formed.
7. a portable game device is characterized in that,
Have the shooting unit of the reference object object being taken and generated reference object object image,
Described shooting unit has:
A plurality of lens;
Catoptrical reflecting member; And
Capturing element is accepted the light by described reflecting member reflection, generates described reference object object image,
Described reflecting member will be with can be will be supported through the mode that the light of each described lens moves between the reflecting member position of described capturing element reflection.
8. portable game device as claimed in claim 7 is characterized in that,
Also comprise the reflecting member driver element, drive described reflecting member, it is moved between each described reflecting member position according to the rule of predesignating.
9. the control method of a portable game device is characterized in that, comprising:
Take step, reference object object image is taken and generated to the reference object object;
The range measurement step, the distance between measurement and the described reference object object; And
The information processing execution in step is carried out the information processing of the distance of measuring based on described reference object object image and by described distance measuring unit.
10. the control method of a portable game device is characterized in that,
This portable game device has the shooting unit of the reference object object being taken and generated reference object object image, and described shooting unit has: a plurality of lens; Catoptrical reflecting member; And accept by the light of described reflecting member reflection and generate the capturing element of described reference object object image, described reflecting member will be with can be will be supported through the mode that the light of each described lens moves between the reflecting member position of described capturing element reflection
This control method comprises: the reflecting member actuation step, drive described reflecting member, and it is moved between each described reflecting member position according to the rule of predesignating.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410641351.0A CN104353241B (en) | 2008-06-30 | 2009-06-22 | The control method of portable type game device and portable type game device |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2008171767 | 2008-06-30 | ||
| JP171767/08 | 2008-06-30 | ||
| PCT/JP2009/061324 WO2010001756A1 (en) | 2008-06-30 | 2009-06-22 | Portable type game device and method for controlling portable type game device |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410641351.0A Division CN104353241B (en) | 2008-06-30 | 2009-06-22 | The control method of portable type game device and portable type game device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102076388A true CN102076388A (en) | 2011-05-25 |
| CN102076388B CN102076388B (en) | 2015-04-08 |
Family
ID=41465856
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200980125218.7A Active CN102076388B (en) | 2008-06-30 | 2009-06-22 | Portable type game device and method for controlling portable type game device |
| CN201410641351.0A Active CN104353241B (en) | 2008-06-30 | 2009-06-22 | The control method of portable type game device and portable type game device |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410641351.0A Active CN104353241B (en) | 2008-06-30 | 2009-06-22 | The control method of portable type game device and portable type game device |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US9662583B2 (en) |
| EP (2) | EP2305358B1 (en) |
| JP (1) | JP5174908B2 (en) |
| CN (2) | CN102076388B (en) |
| WO (1) | WO2010001756A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108367198A (en) * | 2016-10-24 | 2018-08-03 | 星捷力有限公司 | Integral type moving game controller |
Families Citing this family (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8588465B2 (en) * | 2009-01-30 | 2013-11-19 | Microsoft Corporation | Visual target tracking |
| US8315443B2 (en) * | 2010-04-22 | 2012-11-20 | Qualcomm Incorporated | Viewpoint detector based on skin color area and face area |
| JP4971483B2 (en) * | 2010-05-14 | 2012-07-11 | 任天堂株式会社 | Image display program, image display apparatus, image display system, and image display method |
| EP2395474A3 (en) | 2010-06-11 | 2014-03-26 | Nintendo Co., Ltd. | Storage medium having image recognition program stored therein, image recognition apparatus, image recognition system, and image recognition method |
| JP5632693B2 (en) * | 2010-09-28 | 2014-11-26 | 任天堂株式会社 | Information processing program, information processing apparatus, information processing method, and information processing system |
| US9507416B2 (en) | 2011-02-22 | 2016-11-29 | Robert Howard Kimball | Providing a corrected view based on the position of a user with respect to a mobile platform |
| JP5261520B2 (en) * | 2011-03-08 | 2013-08-14 | 株式会社コナミデジタルエンタテインメント | GAME SYSTEM AND CONTROL METHOD USED FOR THE SAME |
| JP5829040B2 (en) | 2011-04-11 | 2015-12-09 | 任天堂株式会社 | GAME SYSTEM, GAME DEVICE, GAME PROGRAM, AND IMAGE GENERATION METHOD |
| JP5745340B2 (en) * | 2011-06-02 | 2015-07-08 | 任天堂株式会社 | GAME SYSTEM, GAME DEVICE, GAME PROGRAM, AND IMAGE GENERATION METHOD |
| JP5839220B2 (en) * | 2011-07-28 | 2016-01-06 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
| JP5586545B2 (en) * | 2011-09-09 | 2014-09-10 | 任天堂株式会社 | GAME SYSTEM, PORTABLE GAME DEVICE, INFORMATION PROCESSOR CONTROL METHOD, AND INFORMATION PROCESSOR CONTROL PROGRAM |
| JP6255706B2 (en) | 2013-04-22 | 2018-01-10 | 富士通株式会社 | Display control apparatus, display control method, display control program, and information providing system |
| JP6314394B2 (en) | 2013-09-13 | 2018-04-25 | 富士通株式会社 | Information processing apparatus, setting method, setting program, system, and management apparatus |
| JP6244954B2 (en) | 2014-02-06 | 2017-12-13 | 富士通株式会社 | Terminal apparatus, information processing apparatus, display control method, and display control program |
| JP6217437B2 (en) * | 2014-02-14 | 2017-10-25 | 富士通株式会社 | Terminal apparatus, information processing apparatus, display control method, and display control program |
| US9804667B2 (en) * | 2015-02-10 | 2017-10-31 | Nintendo Co., Ltd. | Electronic apparatus |
| JP6528193B2 (en) * | 2015-02-10 | 2019-06-12 | 任天堂株式会社 | Electronics |
| KR102494681B1 (en) | 2018-04-13 | 2023-02-02 | 삼성전자주식회사 | Camera assembly and Electronic device having the same |
| US10902685B2 (en) * | 2018-12-13 | 2021-01-26 | John T. Daly | Augmented reality remote authoring and social media platform and system |
Family Cites Families (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4681415A (en) * | 1985-11-01 | 1987-07-21 | Rafael Beer | Multiple image photography system |
| JP3558104B2 (en) * | 1996-08-05 | 2004-08-25 | ソニー株式会社 | Three-dimensional virtual object display apparatus and method |
| EP0837418A3 (en) | 1996-10-18 | 2006-03-29 | Kabushiki Kaisha Toshiba | Method and apparatus for generating information input using reflected light image of target object |
| GB2326732B (en) | 1997-06-28 | 2000-06-28 | Malcolm Bailey | Three dimensional imaging |
| AU2211799A (en) | 1998-01-06 | 1999-07-26 | Video Mouse Group, The | Human motion following computer mouse and game controller |
| US7023479B2 (en) * | 2000-05-16 | 2006-04-04 | Canon Kabushiki Kaisha | Image input apparatus having addition and subtraction processing |
| JP2002084552A (en) * | 2000-09-07 | 2002-03-22 | Fuji Xerox Co Ltd | Device and method for displaying stereoscopic image for karaoke |
| JP2002351603A (en) * | 2001-05-25 | 2002-12-06 | Mitsubishi Electric Corp | Portable information processor |
| US7883415B2 (en) | 2003-09-15 | 2011-02-08 | Sony Computer Entertainment Inc. | Method and apparatus for adjusting a view of a scene being displayed according to tracked head motion |
| JP4262017B2 (en) | 2002-09-26 | 2009-05-13 | キヤノン株式会社 | Image generating apparatus and method |
| JP2004274637A (en) | 2003-03-12 | 2004-09-30 | Nec Corp | Portable terminal, light luminance changing method using the same, and its program |
| TWI231050B (en) * | 2003-09-29 | 2005-04-11 | Primax Electronics Ltd | Moveable mirror module for an image capturing apparatus capable of taking multi angle pictures |
| JP3700857B2 (en) | 2004-03-03 | 2005-09-28 | コナミ株式会社 | GAME PROGRAM AND GAME DEVICE |
| US7671916B2 (en) * | 2004-06-04 | 2010-03-02 | Electronic Arts Inc. | Motion sensor using dual camera inputs |
| CN2731484Y (en) * | 2004-08-07 | 2005-10-05 | 鸿富锦精密工业（深圳）有限公司 | Module of digital camera |
| US9030532B2 (en) * | 2004-08-19 | 2015-05-12 | Microsoft Technology Licensing, Llc | Stereoscopic image display |
| JP4559162B2 (en) * | 2004-08-30 | 2010-10-06 | ソフトバンクモバイル株式会社 | Information communication terminal |
| JP4664690B2 (en) | 2005-01-20 | 2011-04-06 | パイオニア株式会社 | Stereoscopic display device and stereoscopic display method |
| GB0505362D0 (en) | 2005-03-15 | 2005-04-20 | Intelligent Earth Ltd | Interface control |
| US20060223635A1 (en) * | 2005-04-04 | 2006-10-05 | Outland Research | method and apparatus for an on-screen/off-screen first person gaming experience |
| JP2008033521A (en) * | 2006-07-27 | 2008-02-14 | Namco Bandai Games Inc | Program, information storage medium and image generation system |
| US20080211771A1 (en) * | 2007-03-02 | 2008-09-04 | Naturalpoint, Inc. | Approach for Merging Scaled Input of Movable Objects to Control Presentation of Aspects of a Shared Virtual Environment |
| US20090002797A1 (en) * | 2007-06-27 | 2009-01-01 | Wah Yiu Kwong | Multi-directional camera for a mobile device |
-
2009
- 2009-06-22 EP EP09773334.9A patent/EP2305358B1/en active Active
- 2009-06-22 JP JP2010518999A patent/JP5174908B2/en active Active
- 2009-06-22 WO PCT/JP2009/061324 patent/WO2010001756A1/en active Application Filing
- 2009-06-22 CN CN200980125218.7A patent/CN102076388B/en active Active
- 2009-06-22 CN CN201410641351.0A patent/CN104353241B/en active Active
- 2009-06-22 US US13/001,862 patent/US9662583B2/en active Active
- 2009-06-22 EP EP12000038.5A patent/EP2457627B1/en active Active
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108367198A (en) * | 2016-10-24 | 2018-08-03 | 星捷力有限公司 | Integral type moving game controller |
Also Published As
| Publication number | Publication date |
|---|---|
| US9662583B2 (en) | 2017-05-30 |
| US20110159957A1 (en) | 2011-06-30 |
| JP5174908B2 (en) | 2013-04-03 |
| EP2305358A4 (en) | 2011-08-03 |
| WO2010001756A1 (en) | 2010-01-07 |
| CN104353241A (en) | 2015-02-18 |
| EP2305358A1 (en) | 2011-04-06 |
| EP2305358B1 (en) | 2019-01-02 |
| CN102076388B (en) | 2015-04-08 |
| CN104353241B (en) | 2017-08-25 |
| JPWO2010001756A1 (en) | 2011-12-15 |
| EP2457627B1 (en) | 2014-06-25 |
| EP2457627A3 (en) | 2012-07-11 |
| EP2457627A2 (en) | 2012-05-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102076388A (en) | Portable type game device and method for controlling portable type game device | |
| JP5891125B2 (en) | Video processing apparatus, video processing method, and video processing system | |
| US9049428B2 (en) | Image generation system, image generation method, and information storage medium | |
| CN105210093B (en) | Apparatus, system and method for capturing and displaying appearance | |
| JP5602618B2 (en) | Image processing program, image processing apparatus, image processing system, and image processing method | |
| US8648871B2 (en) | Storage medium having information processing program stored therein, information processing apparatus, information processing system, and information processing method | |
| JP5627973B2 (en) | Program, apparatus, system and method for game processing | |
| JP5791433B2 (en) | Information processing program, information processing system, information processing apparatus, and information processing method | |
| JP5483761B2 (en) | Video output device, stereoscopic video observation device, video presentation system, and video output method | |
| JP3442270B2 (en) | Image generating apparatus and information storage medium | |
| US9737814B2 (en) | Computer readable medium storing image processing program of synthesizing images | |
| US20130215112A1 (en) | Stereoscopic Image Processor, Stereoscopic Image Interaction System, and Stereoscopic Image Displaying Method thereof | |
| US8749571B2 (en) | Storage medium having information processing program stored therein, information processing apparatus, information processing system, and information processing method | |
| CN108416832B (en) | Media information display method, device and storage medium | |
| EP2565848A2 (en) | Program, information processing apparatus, information processing system, and information processing method | |
| JP6039594B2 (en) | Information processing apparatus and information processing method | |
| JP6161749B2 (en) | Video processing apparatus, video processing method, and video processing system | |
| CN110096144B (en) | Interactive holographic projection method and system based on three-dimensional reconstruction | |
| US9744443B2 (en) | Server, terminal, network system, program and information storage medium | |
| TW201743165A (en) | Interaction method and system in mixed reality free from VR glasses and visual angle constraints and can be popular in life and more realistic | |
| CN111833455B (en) | Image processing method, image processing device, display device and computer storage medium | |
| JP2003203250A (en) | Shooting game device and information storage medium | |
| JP2004152164A (en) | Image processing system and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: SONY COMPUTER ENTERTAINMENT, INC. Free format text: FORMER OWNER: SNE PLATFORM INC. Effective date: 20120828 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| C53 | Correction of patent of invention or patent application | ||
| CB02 | Change of applicant information |
Address after: Tokyo, Japan Applicant after: SNE platform Limited by Share Ltd. Address before: Tokyo, Japan Applicant before: Sony Computer Entertainment Inc. |
|
| COR | Change of bibliographic data |
Free format text: CORRECT: APPLICANT; FROM: SONY COMPUTER ENTERTAINMENT INC. TO: SNE PLATFORM INC. |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20120828 Address after: Tokyo, Japan Applicant after: SONY COMPUTER ENTERTAINMENT Inc. Address before: Tokyo, Japan Applicant before: SNE platform Limited by Share Ltd. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |