JP4912377B2 - Display device, display method, and program - Google Patents

Description

  The present invention relates to a display device, a display method, and a program suitable for allowing a user to easily observe details of an object that is noticed among objects arranged in a virtual space.

  When displaying objects such as enemy characters, bombs, and traps arranged in the virtual space on the game screen, a technology that enlarges and displays these objects and allows the user to observe the details is, for example, It is disclosed in Patent Document 1.

Japanese Patent Laying-Open No. 2005-095347

  However, just by magnifying and displaying an object, it is impossible to observe the state of the back side of the object. Accordingly, there is a strong demand for easily presenting the appearance of an object not drawn on the screen to the user.

  The present invention solves such a problem, and among the objects arranged in the virtual space, a display device, a display method, and a display device suitable for easily observing details of an object that the user pays attention to, As well as providing a program.

In order to achieve the above object, a display device according to a first aspect of the present invention includes a storage unit, a display unit, a selection instruction receiving unit, a direction designation receiving unit, and a rotating unit.
The storage unit stores the position and orientation of the object arranged in the virtual space, the position of the viewpoint, and the position and orientation of the projection plane having a predetermined size.
The display unit generates and displays an image obtained by perspectively projecting the object on the projection plane from the viewpoint.
The selection instruction receiving unit receives a selection instruction input for instructing to select one of objects (hereinafter referred to as a visible object) included in the generated image.
The direction designation receiving unit receives a direction designation input for designating a direction in which the viewpoint is to be moved in the virtual space.
The rotation unit rotates the viewpoint and the projection plane relative to the object arranged in the virtual space in the designated direction around the selected visible object.

  Here, the display unit serves as a window for viewing the virtual space in order to display the virtual space projected onto the projection plane. The user selects one of the objects displayed on the touch panel by touching the object. Further, the direction in which the viewpoint is to be moved is designated by moving the viewpoint while touching the touch panel in the direction in which the viewpoint is to be moved.

  The rotation unit makes the virtual space and the viewpoint relative to the specified direction in order to make it appear as if the virtual space is rotated around the visible object selected by the user according to the direction specified by the user. Rotate. That is, the virtual space itself is rotated around the visible object selected by the user, or the viewpoint and the projection plane are moved around the visible object. Or both of these may be performed simultaneously. Note that the center of the visible object may be, for example, the center of gravity of the object or the position where the user touches the object. Thus, according to the present invention, the user can observe the details of the object of interest from various angles.

In order to achieve the above object, a display device according to another aspect of the present invention includes a storage unit, a display unit, a selection instruction receiving unit, a direction designation receiving unit, and a rotating unit.
The storage unit stores the position and orientation of an object arranged in the virtual space, the position of the viewpoint, and the position and orientation of a surface having a predetermined shape having a transparent area and an opaque area.
The display unit generates an image obtained by projecting an object in which a line segment connecting the position of the object and the position of the viewpoint passes through the transparent area (hereinafter referred to as a visible object) at the intersection of the line segment and the transparent area. indicate.
The selection instruction receiving unit receives a selection instruction input for instructing to select one of the visible objects.
The direction designation receiving unit receives a direction designation input for designating a direction in which the viewpoint is to be moved in the virtual space.
The rotation unit rotates the position and orientation of the object arranged in the virtual space according to the designated direction around the selected object.

  Here, the surface of the predetermined shape corresponds to the projection surface, and is disposed between the viewpoint and the virtual space. A display part displays the part projected on the said transparent area | region among the modes when seeing virtual space from the position of a viewpoint over the surface of a predetermined shape. That is, the transparent area plays a role like a window for viewing the virtual space.

  The user selects one of the objects displayed on the touch panel by touching the object. In addition, the direction in which the viewpoint is to be moved is designated by moving the viewpoint while moving the viewpoint while touching the touch panel. The rotation unit is based on the specified direction with the selected object as the center (for example, the center of gravity of the object or the position where the user touched the object) in order to make it appear as if the viewpoint is moving. To rotate the position and orientation of the object placed in the virtual space. As will be described later, all the objects in the virtual space may be rotated, or a part (that is, a visible object) may be rotated.

  As described above, according to the present invention, the position and orientation of the object arranged in the virtual space is rotated based on the specified direction around the selected object, so that the user can select the object of interest. Details can be observed from various angles.

In the display device,
The object whose rotation and position are rotated by the rotation unit may be a visible object.

  That is, the rotation unit may not rotate all the objects in the virtual space, but may extract a visible object projected on the transparent area before rotation and rotate only the visible object. As a result, the number of objects to be rotated can be reduced, and the calculation load can be reduced.

  In the display device, if the rotation unit rotates the position and orientation of an object other than a visible object (hereinafter referred to as an invisible object), the distance between the invisible object and the viewpoint is determined by the distance between the visible object and the viewpoint. If the line segment that is shorter than the distance and connects the invisible object and the viewpoint passes through the transparent region, the rotation may be stopped.

  That is, according to the present invention, an object arranged in the virtual space is rotated based on the specified direction around the selected object, but after rotation, an object that has not been displayed before the rotation is rotated. The projected object may be projected and displayed on the transparent area of the surface having the predetermined shape to hide the visible object. Since the visible object is an object that the user wants to pay attention to, it is not desirable that the visible object is hidden.

  Therefore, the rotation unit, when the object is rotated based on the specified direction, the distance between any invisible object and the viewpoint among the objects projected onto the transparent area is greater than the distance between any visible object and the viewpoint. If it becomes shorter, stop the rotation. This is to prevent the invisible object from hiding the visible object. As a result, even when the selected object rotates, it is possible to prevent a situation where the object is hidden.

The display device
An area designation receiving unit for receiving an area designation input for designating a transparent area and an opaque area on a surface of a predetermined shape;
May be further provided.

  That is, in the virtual space, the user may be able to specify the position of the transparent area configured on the surface of the predetermined shape so that the part to be noticed can be specified. Typically, the position of the transparent area is specified in a circle so that a closed area can be obtained by using an input device such as a touch pen or a mouse. If the area displayed by rotation is specified to be small, it becomes easier to discriminate the object currently focused on. Furthermore, so-called 3D sickness can be reduced by reducing the rotationally displayed area.

  The display unit projects an object in which a line segment connecting the position of the object whose position and orientation has been rotated and the position of the viewpoint passes through the transparent region to the intersection of the line segment and the transparent region, and the rotation is performed. An object in which the line segment connecting the position of the previous object and the position of the viewpoint that passes through the opaque region is projected to the intersection of the line segment and the opaque region to generate an image. Good.

  That is, the display unit shows the state of the virtual space before the object rotation is performed, the image projected on the opaque region portion of the surface of the predetermined shape, and the state of the virtual space after the object rotation is performed, An image composed of an image projected on a transparent region portion of a surface having a predetermined shape may be generated. Accordingly, for example, both the currently focused part and the part that is not focused are displayed, and it is possible to cope with the user's desire to see a part that is not focused a little. Further, since only the portion of interest is rotated and an image is generated in which the other portions do not change, an effect as if the portion of interest has been raised is obtained, and it becomes easier to discriminate the portion of interest.

Further, the area designation receiving unit may not accept the area designation input when the received transparent area is larger than a predetermined area.
That is, the area designation receiving unit causes the user to designate an area smaller than a predetermined area as a transparent area. Thereby, for example, when only a visible object is rotated, the amount of calculation can be reduced. It is also possible to preset an area for preventing 3D sickness.

In addition, when the area designation receiving unit accepts the area designation input, if the number of visible objects is equal to or greater than a predetermined number, the area designation receiving unit does not accept the area designation input.
You may do it.
That is, the area designation receiving unit accepts the area designation when the user designates the transparent area so that the number of visible objects is smaller than a predetermined number. As a result, similarly to the case where the area of the transparent region is limited, the amount of calculation can be reduced when only the visible object is rotated. It is also possible to preset an area for preventing 3D sickness.

In addition, a display method according to another aspect of the present invention includes:
A display method by a display device comprising a storage unit, a display unit, a selection instruction receiving unit, a direction designation receiving unit, and a rotating unit,
The storage unit stores the position and orientation of the object arranged in the virtual space, the position of the viewpoint, and the position and orientation of the projection plane of a predetermined size,
The display method is
A display step in which the display unit generates and displays an image obtained by perspectively projecting the object on the projection plane from a viewpoint;
A selection instruction receiving step in which a selection instruction receiving unit receives a selection instruction input instructing to select one of objects (hereinafter referred to as a visible object) included in the generated image;
A direction designation accepting step in which a direction designation accepting unit accepts a direction designation input for designating a direction to move the viewpoint in the virtual space;
A rotation step in which the rotation unit rotates the viewpoint and the projection plane relative to the object arranged in the virtual space in the specified direction around the selected visible object;
It is characterized by providing.

In addition, a display method according to another aspect of the present invention includes:
A display method by a display device comprising a storage unit, a display unit, a selection instruction receiving unit, a direction designation receiving unit, and a rotating unit,
The storage unit stores the position and orientation of an object arranged in the virtual space, the position of the viewpoint, and the position and orientation of a surface having a predetermined shape having a transparent region and an opaque region,
The display method is
The display unit generates an image in which an object in which a line segment connecting the position of the object and the position of the viewpoint passes through the transparent area (hereinafter referred to as a visible object) is projected at the intersection of the line segment and the transparent area. Display process to display,
A selection instruction receiving step for receiving a selection instruction input for instructing the selection instruction receiving unit to select one of the visible objects;
A direction designation accepting step in which a direction designation accepting unit accepts a direction designation input for designating a direction to move the viewpoint in the virtual space;
A rotation step in which the rotation unit rotates the position and orientation of the object arranged in the virtual space according to the specified direction around the selected visible object;
It is characterized by providing.

  A program according to another aspect of the present invention is configured to cause a computer to function as the display device.

  The program of the present invention can be recorded on a computer-readable information recording medium such as a compact disk, flexible disk, hard disk, magneto-optical disk, digital video disk, magnetic tape, and semiconductor memory. The above program can be distributed and sold via a computer communication network independently of the computer on which the program is executed. The information recording medium can be distributed and sold independently of the computer.

  According to the display device of the present invention, it is possible to provide a display device, a display method, and a program suitable for easily observing details of an object that is noticed by a user among objects arranged in a virtual space. can do.

  Embodiments of the present invention will be described below. In the following, for ease of understanding, an embodiment in which the present invention is applied to a portable game machine will be described. However, the present invention can be similarly applied to various computers, PDAs, mobile phones, and the like. . That is, the embodiment described below is for explanation, and does not limit the scope of the present invention. Accordingly, those skilled in the art can employ embodiments in which each or all of these elements are replaced with equivalent ones, and these embodiments are also included in the scope of the present invention.

  FIG. 1 is a schematic diagram showing a schematic configuration of a typical portable game machine in which a display device according to an embodiment of the present invention is realized. Hereinafter, a description will be given with reference to FIG.

  The portable game machine 1 includes a processing control unit 10, a connector 11, a cartridge 12, a wireless communication unit 13, a communication controller 14, a sound amplifier 15, a speaker 16, an operation key 17, and a first display. A unit 18, a second display unit 19, and a touch panel 20 are provided.

  The processing control unit 10 includes a CPU (Central Processing Unit) core 10a, an image processing unit 10b, a VRAM (Video Random Access Memory) 10c, a WRAM (Work RAM) 10d, an LCD (Liquid Crystal Display) controller 10e, A touch panel controller 10f.

  The CPU core 10a controls the operation of the entire portable game machine 1 and is connected to each component to exchange control signals and data. Specifically, with the cartridge 12 mounted in the connector 11, a program and data stored in a ROM (Read Only Memory) 12a in the cartridge 12 are read and predetermined processing is executed.

  The image processing unit 10b processes the data read from the ROM 12a in the cartridge 12 and the data processed by the CPU core 10a, and stores the processed data in the VRAM 10c.

The VRAM 10c is a frame memory that stores information for display, and stores image information processed by the image processing unit 10b and the like.
The WRAM 10d stores work data and the like necessary for the CPU core 10a to execute various processes according to the program.

  The LCD controller 10e controls the first display unit 18 and the second display unit 19 to display a predetermined display image. For example, the LCD controller 10 e converts the image information stored in the VRAM 10 c into a display signal at a predetermined synchronization timing and outputs the display signal to the first display unit 18. In addition, the LCD controller 10 e displays a predetermined instruction icon or the like on the second display unit 19.

  The touch panel controller 10f detects a touch (touch) on the touch panel 20 with a touch pen or a user's finger. For example, in the state where a predetermined instruction icon or the like is displayed on the second display unit 19, a contact on the touch panel 20 and its position are detected.

  The connector 11 is a terminal that can be detachably connected to the cartridge 12, and transmits / receives predetermined data to / from the cartridge 12 when the cartridge 12 is connected.

The cartridge 12 includes a ROM 12a and a RAM (Random Access Memory) 12b.
The ROM 12a stores a program for realizing the game and image data, sound data, and the like accompanying the game.
The RAM 12b stores various data indicating the progress of the game.

The wireless communication unit 13 is a unit that performs wireless communication with the wireless communication unit 13 of another portable game machine 1, and transmits and receives predetermined data via an antenna (not shown) (such as a built-in antenna).
The wireless communication unit 13 can also perform wireless LAN communication with a predetermined access point. The wireless communication unit 13 is assigned a unique MAC (Media Access Control) address.

  The communication controller 14 controls the wireless communication unit 13 and mediates communication performed between the process control unit 10 and the process control unit 10 of another portable game machine 1 according to a predetermined protocol.

The sound amplifier 15 amplifies the audio signal generated by the processing control unit 10 and supplies it to the speaker 16.
The speaker 16 is composed of, for example, a stereo speaker, and outputs predetermined music sound, sound effect, and the like according to the audio signal amplified by the sound amplifier 15.

  The operation key 17 includes a plurality of key switches and the like appropriately arranged on the portable game machine 1 and receives a predetermined instruction input according to a user operation.

The 1st display part 18 and the 2nd display part 19 consist of LCD etc., are controlled by LCD controller 10e, and display a game image etc. suitably.
Note that the second display unit 19 displays an instruction icon or the like for inputting an operation instruction from the user by touching the touch panel 20.

The touch panel 20 is arranged so as to be superimposed on the front surface of the second display unit 19 and accepts an input by contact with a touch pen or a user's finger.
The touch panel 20 includes, for example, a pressure-sensitive touch sensor panel and the like, detects the pressure of the user's finger and the like, and detects the contact state and the transition from the contact state to the non-contact state. In addition, the touch panel 20 may detect contact with a user's finger or the like from a change in capacitance or the like.

  FIG. 2 shows an external view of the portable game machine 1.

  The display device according to the present embodiment is realized on the typical portable game machine 1 described above, but can also be realized on a general computer or game device. A general computer or game device includes a CPU core, a VRAM, and a WRAM similarly to the portable game machine 1 described above. In addition, as a communication unit, for example, a NIC (Network Interface Controller) conforming to a standard such as 10BASE-T / 100BASE-T used when configuring a LAN (Local Area Network), a hard disk as a storage device, and a DVD -ROMs, magneto-optical disks, etc. can be used. In addition, a keyboard or a mouse is used as an input device instead of a touch panel. Then, after the program is installed, when the program is executed, it can function as a display device.

  Hereinafter, unless otherwise noted, the display device according to the present embodiment will be described using the portable game machine 1 shown in FIG. The display device can be appropriately replaced with an element of a general computer or a game device as necessary, and these embodiments are also included in the scope of the present invention.

Hereinafter, the configuration of the display device 200 will be described with reference to FIG.
The display device 200 according to the present embodiment includes a storage unit 201, a display unit 202, a selection instruction receiving unit 203, a direction designation receiving unit 204, a rotating unit 205, an area designation receiving unit 206, and the like.

  Here, the memory | storage part 201 memorize | stores the information about the three-dimensional virtual space used as the stage of a game, for example. In this virtual space, for example, as shown in FIG. 4, a predetermined object having an object (for example, 401A, 401B, 401C, etc.), a viewpoint 410 (that is, a camera) for viewing the virtual space, a transparent area 420A, and an opaque area 420B. A shape surface 420 or the like is disposed.

  The surface 420 having a predetermined shape corresponds to a projection surface on which the virtual space is projected. In the present embodiment, the plane is configured, but the shape is not limited to this. The surface 420 having a predetermined shape is typically disposed between the viewpoint 410 and an object (for example, 401A, 401B, 401C, etc.) in the virtual space. The direction of the line-of-sight direction 415 matches the direction of a vector that passes through the center of the surface 420 of the predetermined shape and intersects the surface of the predetermined shape perpendicularly.

  Note that the boundaries of the transparent region 420A and the opaque region 420B arranged on the surface of the predetermined shape are coincident and can be designated by the user as will be described later.

  Data such as the shape, position and orientation of the object, the position of the viewpoint, the position and orientation of the surface of the predetermined shape, which are arranged in the virtual space, are stored in advance in the ROM 12a in the cartridge 12. The processing control unit 10 appropriately reads out these data from the cartridge 12 and stores them in the WRAM 10d or the like. The rotation unit 205 updates data on the shape, position, and orientation of the object in response to an instruction from the user. The processing control unit 10, the connector 11, and the cartridge 12 cooperate to function as the storage unit 201.

  The display unit 202 generates an image having the same size as the surface of the following predetermined shape when an input for designating a transparent region is accepted by the region designation receiving unit 206 described later. That is, in the generated image, a portion of the transparent area of the image in the virtual space projected on the transparent area of the surface having the predetermined shape is drawn at a position corresponding to the transparent area of the surface having the predetermined shape. In addition, an image in which a predetermined color (for example, black) representing darkness is drawn at a position corresponding to an area other than the transparent area (that is, an opaque area) among the generated images is generated. The display unit 202 displays the generated image on the second display unit 19 (or the first display unit 18). In other words, although the surface having the predetermined shape corresponds to the projection surface, in the present embodiment, it is the transparent region of the surface having the predetermined shape that actually functions as the projection surface. The processing control unit 10 and the second display unit 19 (or the first display unit 18) operate in cooperation to function as the display unit 202.

  The selection instruction receiving unit 203 receives a selection instruction input for instructing to select one of the objects displayed on the display unit 202 (hereinafter referred to as a visible object). The user can select, for example, one of the objects displayed on the display unit 202 by touching (touching) the position of the touch panel 20 on which the object to be selected is displayed. Alternatively, an operation equivalent to this may be performed by pressing the operation key 17 to select an object. The selected object received is temporarily stored in, for example, the WRAM 10d. The processing control unit 10, the operation key 17, the touch panel 20, and the like cooperate to function as the selection instruction receiving unit 203.

  The direction designation accepting unit 204 accepts a direction designation input for designating a direction in which a viewpoint arranged in the virtual space is moved in the virtual space. The user can specify the direction by, for example, pressing the operation key 17 corresponding to a predetermined direction or moving the touch panel 20 while pressing. The processing control unit 10, the operation key 17, and the touch panel 20 operate in cooperation to function as the direction designation receiving unit 204.

  The rotation unit 205 rotates the object in the virtual space so that the viewpoint moves in the direction received by the direction designation reception unit 204 around the object received by the selection instruction reception unit 203. That is, the position and orientation of the object arranged in the virtual space are rotated in the direction opposite to the designated direction, and the position and orientation of the object stored in the storage unit 201 are updated. The processing control unit 10 functions as the rotation unit 205.

  The area designation receiving unit 206 receives an area designation input for designating the transparent area and the opaque area on the surface having the predetermined shape. The user can specify the position and shape of the transparent region by drawing a line that becomes the boundary of the region by moving the touch pen while pressing the touch pen on the touch panel 20 so as to obtain a closed region, for example. Alternatively, the user may perform an operation equivalent to this by pressing the operation key 17 and specify the transparent area. The received designated area is temporarily stored in, for example, the WRAM 10d. The processing control unit 10, the operation key 17, and the touch panel 20 operate in cooperation to function as an area designation receiving unit 206.

  Hereinafter, an operation process of the display device 200 according to the present embodiment will be described.

  In the present embodiment, for example, a case where a game having a scene where something must be searched for in the dark is executed will be described. In the game, when the user designates a transparent area, only the inside of the designated area is displayed as if illuminated by a flashlight.

  Further, when the user selects one of the objects displayed in the transparent area and performs an input for designating the direction in which the viewpoint is moved, the display device 200 is based on the designated direction centering on the object. Rotate the object in the virtual space. And the image which shows the mode of the virtual space after rotation is displayed on the said area | region. The user searches for the virtual space displayed in the transparent area designated from various angles.

  In the present embodiment, transitions of input states accepted from the user are summarized in FIG. In the initial state where nothing is accepted (state A), designation of a transparent area can be accepted (state B). Next, an instruction to select an object to be the center of rotation is received (state C), and then designation of the moving direction of the viewpoint is received (state D). As described above, the direction of movement is not accepted unless the object that is the center of rotation is selected, and the selection of the object that is the center of rotation is not accepted unless the transparent area is designated.

  In the states B, C, and D, a specified key can be input to release the designated transparent area (state E) (that is, delete from the WRAM 10d). When cancellation of a transparent area is specified in a state where an object selection instruction has been received (transition from state C to E), the object selected to be the center of rotation is in the released area. Therefore, the selection of the object is also deleted from the WRAM 10d and released.

  In addition, the designated transparent area can be changed in shape by dragging the boundary portion of the area (transition from state B to B), and the designated transparent area in a state where an object selection instruction is accepted. It is also possible to accept an instruction to select another object (transition from state C to C). Alternatively, after the movement direction of the viewpoint is designated, the movement direction may be further designated (transition from state D to D).

  The display process shown in FIG. 6 is a process that is periodically and repeatedly executed at a predetermined timing in cooperation with each unit of the display device 200 of the present embodiment. The display process performed by the display device 200 according to the reception state that transitions as described above will be described next with reference to FIG. First, a state A, that is, a case in an initial state in which the user has not designated a transparent area or selected an object will be described.

  The process control unit 10 first determines whether or not there has been an input for designating the moving direction of the viewpoint (step S101). That is, referring to the WRAM 10d or the like, it is determined whether or not an input for designating the moving direction of the viewpoint is stored. In the initial state, it is determined that there is no input specifying the direction (step S101; N), and the process proceeds to step S103.

  Next, the display unit 202 stores the state of the virtual space projected on the transparent area in the frame memory (VRAM 10c) (step S103). That is, the display unit 202 acquires the position of the viewpoint, the position and orientation of the surface of the predetermined shape, and the shape, position, and orientation of the object with reference to the storage unit 201. And based on the acquired information, the image which projected the object in virtual space on the surface of a predetermined shape is produced | generated. Of these, the image corresponding to the position of the transparent area (acquired with reference to the WRAM 10d) is stored in the position of the frame memory (VRAM 10c) corresponding to the transparent area. However, since no transparent area is designated in the initial state, no image data is stored in the frame memory.

  Subsequently, the display unit 202 writes data indicating a predetermined color (for example, black) at a position corresponding to the opaque region in the frame memory (step S104). In the initial state, only an opaque region exists, and at this time, an image that is painted black is stored in the frame memory.

  The display unit 202 transfers the contents of the frame memory to the first or second display unit (18, 19) at a predetermined timing and displays them (step S105). Therefore, in the initial state, a black image is displayed on the first or second display unit (18, 19). Then, the display process ends.

  Next, the display process in the state B, that is, when the user designates a transparent area will be described. The user performs input for designating the transparent area by operating the operation key 17 or touching the touch panel 20. Then, the area designation receiving unit 206 receives the position and shape of the transparent area designated by the input, and temporarily stores them in the WRAM 10d or the like.

  When step S101 is executed in a state where the user designates a transparent area, the process control unit 10 determines that the viewpoint movement direction designation has not yet been input (step S101; N), and from step S103. S105 is executed.

  As described above, by executing steps S103 to S105, the virtual space of the displayed image is projected at a position corresponding to the transparent region, and the other portion is displayed in black. Displayed by the unit 202.

  For example, FIG. 7A shows a state in which the virtual space shown in FIG. 4 is projected onto the transparent region 420A. As shown in FIG. 7A, what is projected onto the transparent area is a part of the object 401A and the object 401B, and the others are projected onto the opaque area. Therefore, as shown in FIG. 7B, a projected image 401A ′ of the object 401A and a part of the projected image 401B ′ of the object 401B are displayed in a portion corresponding to the transparent area of the screen. The portion corresponding to the opaque region is displayed in black. Thus, a part of the virtual space is displayed in the transparent area designated by the user as if illuminated by a flashlight.

  In this embodiment, as shown in FIG. 7B, each object is perspective-projected by a one-point perspective method, an object far from the viewpoint is small, and an object near is large. However, parallel projection can be adopted instead of the single point perspective method. The display unit 202 renders an image of the virtual space by performing hidden surface processing using, for example, the Z buffer method for each object.

  As described above, the display unit 202 draws an image of a region corresponding to a transparent region on the screen and an image of a region corresponding to an opaque region every time an image is generated. Even if it is made, the change can be reflected.

  Next, a case is considered in which the user inputs an instruction to select one of the displayed objects in a state where the transparent area is selected, and further performs an input for designating the moving direction of the viewpoint (state) B → C → D transition).

  That is, the user touches the position of any object displayed in the area. The selection instruction accepting unit 203 identifies an object projected on the area including the coordinate value at which the contact has been performed, and accepts the identified object as selected (state C).

  For example, the selection instruction receiving unit 203 may store, in the WRAM 10d, an array that stores information for specifying the object projected at the position corresponding to each pixel at the position where the object is projected. Then, information specifying an object stored in association with the detected coordinate value may be extracted, and the object specified by the extracted information may be specified as the selected object. The selection instruction receiving unit 203 temporarily stores information for identifying the selected object in the WRAM 10d or the like for use in later processing.

  Of course, if the detected coordinates are not within the designated transparent area, the selection instruction receiving unit 203 may be configured not to receive the selection instruction input.

  In addition, the moving direction of the viewpoint is specified by the user moving in the specified direction while touching the touch panel 20, for example. In the movement while contacting, the direction designation receiving unit 204 continuously detects the contact coordinates. The direction designation receiving unit 204 compares the previous coordinate value and the current coordinate value among the coordinate values detected in succession, and calculates the distance and direction the touch has moved. When the distance moved is equal to or greater than the predetermined distance, the direction designation receiving unit 204 accepts an operation by the user as a direction designation input, and temporarily stores the movement direction and distance in the WRAM 10d or the like (state D).

  Alternatively, the direction may be designated by operating (pressing) the operation key 17 indicating the up / down / left / right directions. In this case, the direction designation receiving unit 204 may calculate the moving direction and the moving distance of the viewpoint based on the type of the pressed operation key 17 and the pressed time.

  As described above, when step S101 is executed in a state where the user inputs an instruction to select one of the displayed objects and further inputs an instruction for specifying the moving direction of the viewpoint, the process control is performed. The unit 10 determines that there has been an input for designating the moving direction of the viewpoint (step S101; Y). Then, the process proceeds to step S102.

  Subsequently, the rotation unit 205 acquires the selected object from the WRAM 10d, and the object placed in the virtual space based on the designated direction with the object as the center (for example, the center of gravity of the object). Is rotated (step S102). That is, the object in the virtual space is rotated by an angle corresponding to the movement distance in the direction opposite to the accepted designated direction.

  Then, Steps S103 to S105 are executed to display an image of the virtual space projected on the transparent area of the surface having a predetermined shape in the same procedure as described above.

  For example, FIG. 8A shows a case where the object 401A in the transparent area 420A is selected and the direction 701 is designated as the viewpoint movement direction. As shown in FIG. 8B, the rotation unit 205 obtains a vector 720 passing through the viewpoint and the center of the object 401A and an axis 730 perpendicular to the direction 701 and passing through the center of the object 401A. The rotation unit 205 rotates the object in the virtual space with respect to the axis 730 in an opposite direction to the direction 701 (that is, left rotation in FIG. 8B) by an angle corresponding to the movement distance. An example of an image displayed on the screen after rotation is shown in FIG.

  For example, the storage unit 201 may include a table that defines a rotation angle according to the movement distance, and the rotation unit 205 may determine the rotation angle with reference to the table. As the rotation unit 205 rotates the object in the virtual space in this way, the viewpoint moves in the direction specified by the user in the area on the screen corresponding to the transparent area specified by the user. An image showing the state in the virtual space is displayed (see FIG. 9).

  The user may further specify the moving direction of the viewpoint and further rotate the object (transition from state D to D). Alternatively, the designation of the transparent area may be canceled (transition from state B, C, or D to state E). In this embodiment, in order to make it appear as if a part of the virtual space is rotated and observed, when the designation of the transparent area is canceled, the state before the rotation by the rotation unit 205 is performed. Return the virtual space to. Therefore, the rotating unit 205 saves the state (position and orientation of the object) in the virtual space at that time in the WRAM 10d before the rotation. Then, when the transparent area is released, the saved virtual space state is loaded as the current virtual space state.

  Next, when a transparent area is designated and an object selection instruction and a viewpoint movement direction are input by the user, the rotation unit 205 rotates the object from the loaded state.

As described above, in the present embodiment, the display device 200 projects the state of the virtual space after the object has been rotated onto the transparent region portion of the predetermined shape on which the user is focused. The image is displayed at a position corresponding to the transparent area on the screen.
Therefore, according to the present embodiment, it is possible to easily observe details of an object that the user pays attention to among objects arranged in the virtual space.

  Although the present embodiment has been described above, the present invention is not limited to the above-described embodiment, and various modifications and applications are possible. Moreover, it is also possible to freely combine the components of the above-described embodiments.

  For example, in the above embodiment, all the objects arranged in the virtual space are rotated around the specified object. Instead, after the transparent area is designated, only the object projected to the transparent area (hereinafter referred to as the original visible object) before starting the rotation even once is rotated and drawn in the transparent area in step S102. May be. This reduces the number of objects to be rotated and reduces the drawing process.

  The present invention can also be applied to a case where, for example, a part displayed on a game screen is examined in detail, in addition to a game for searching in the dark.

  For example, in order to examine a part displayed on the game image, when the user designates a transparent region so as to surround the part, and subsequently designates an object as a center of rotation and a moving direction of the viewpoint. In the portion corresponding to the transparent area displayed on the screen, the object rotated according to the designated direction projected on the designated transparent area is displayed as described above. On the other hand, in the portion corresponding to the opaque area displayed on the screen, the state of the virtual space projected on the opaque area at the time when the area is designated may be displayed.

  In order to realize this, for example, the display unit generates an image obtained by projecting the state of the virtual space onto a plane having a predetermined shape at the time when the region is designated (and before the rotation is performed). In step S104 described above, the display unit may write a portion of the generated image that matches the opaque region at a position that matches the opaque region of the frame memory.

  For example, when the user performs an input as shown in FIG. 10B while projecting the virtual space shown in FIG. 7A and displaying an image as shown in FIG. Will be described. That is, the user designates the transparent area 420A, selects the object 401A as the object to be rotated, and designates the direction 710 as the direction in which the viewpoint is moved. As a result, as shown in FIG. 10C, the state after being rotated around the object 401A is displayed in the transparent area. On the other hand, in the opaque region, the same image as that displayed in the opaque region is displayed when the transparent region is designated.

  In this way, by displaying other than the part of interest at the same time, it is possible to respond to the user's request to see the part that is not of interest. In addition, since only the designated area portion of interest is rotated and an image is generated in which other portions do not change, an effect as if the attention portion is raised is obtained, and the attention portion can be more easily discriminated. Become.

  In addition, the present invention can be used, for example, in an inference game that solves the mystery of the incident. The image displayed in the opaque region is an on-site photo image showing the current situation. Then, an on-site photo image showing the past situation is projected onto the transparent area. As a result, when the user designates an arbitrary location (transparent area) of the site photograph, the display device displays the past image near the site as if it were “digging a hole in the space-time” as if it was a part of the display device. An image partially synthesized with the image is displayed. The user must rotate and display the state near the past site while thinking where to focus and where to focus, and search for the difference between the current site and the past site, and the reasoning ability is tested. In this way, it is possible to create a game that makes the user think more and a game that uses the head.

  Moreover, in the said embodiment, the restriction | limiting was not given about the angle which a rotation part can rotate the object arrange | positioned in virtual space. However, for example, when the rotating unit rotates the object in the virtual space based on the specified direction, it is not displayed in the transparent area immediately after the transparent area is specified (and before the rotation is performed). Any of the objects (hereinafter referred to as original invisible objects) may be disposed between the original visible object and a surface having a predetermined shape. As a result, the original visible object is hidden by the original invisible object. Since the original visible object is an object that the user is paying attention to, the original visible object is not desirably hidden by the original invisible object.

Therefore, the rotation unit first performs trial rotation on all objects. Then, when any line segment connecting the viewpoint after the trial rotation and the original invisible object passes through the transparent area (that is, when the original invisible object is projected onto the transparent area), the following determination is performed. That is, it is determined whether the length of each line segment connecting the viewpoint and the original invisible object passing through the transparent area after the trial rotation is shorter than the distance between the viewpoint and the original visible object. To do.
If there is a short object, any of the original invisible objects may be closer to the viewpoint than any of the original visible objects, and the original invisible object may hide the original visible object. Therefore, the rotation unit returns the position and orientation of the object to the state before starting the trial rotation without confirming the trial rotation of all the objects. Alternatively, instead of returning to the state before starting the trial rotation, the trial rotation is confirmed at a position immediately before one of the distances between the viewpoint and the original invisible object becomes shorter than the distance between the viewpoint and the original visible object. May be. On the other hand, when there is no short thing, a rotation part finalizes trial rotation.

  For example, a case will be described in which an object arranged as shown in FIG. 11A (A) is rotated clockwise around the axis 1001 by the rotation unit based on the moving direction of the viewpoint specified by the user.

  As shown in FIG. 11A, the object 401C is an original invisible object that is not projected onto the transparent area 420A immediately after the transparent area 420A is designated. On the other hand, the objects 401A and 401B are original visible objects projected onto the transparent area 401A immediately after the designation.

  From FIG. 11A, when the object arrangement as shown in FIG. 11B is obtained by trial rotation, the original invisible object 401C moves to a position projected on the transparent region 420B. If the state of the virtual space is projected onto the transparent area 420A having a predetermined shape in this state, an image as shown in FIG. 11C is obtained. That is, the projected image 401C ′ of the original invisible object 401C partially hides the projected image 401A ′ of the original visible object 401A.

  In order to prevent such a situation, the rotation unit compares the distance between the original invisible object and the viewpoint (for example, distance 1012) with the distance between the original invisible object and the viewpoint (for example, distance 1011).

  In FIG. 11B, since the distance 1012 is shorter than the distance 1011, the rotating unit stops without confirming the trial rotation.

  As a result, it is possible to easily display the original visible object so as not to be hidden without obtaining an overlap of the projected objects.

  Moreover, you may restrict | limit the magnitude | size of the area in the surface of the predetermined shape which can be designated as a transparent area | region. For example, when a transparent area is designated, the area designation receiving unit obtains the maximum horizontal width and vertical width of the transparent area, and either the maximum horizontal width or the maximum vertical width is stored in the storage unit. The area designation may not be accepted if it is not less than or equal to a predetermined threshold stored in the above.

  Thereby, for example, in a modification in which only the original visible object is rotated, it is possible to prevent the number of original visible objects from increasing, and to suppress the calculation amount related to the rotation process. Also, in the case where not only the original visible object is rotated but all the objects in the virtual space are rotated, the area to be rotated and displayed is small, so that so-called 3D sickness can be prevented. Alternatively, in order to obtain the same effect, the region designation receiving unit may not accept the region designation when the number of original visible objects is equal to or greater than a predetermined threshold.

  Further, in the above embodiment, an image as if the viewpoint is moved by rotating an object in the virtual space is displayed at a position corresponding to the transparent area of the screen. Instead, the position of the viewpoint itself (and the surface of the predetermined shape) may be moved in the direction specified by the user according to the calculation accuracy allowed when rotating. Alternatively, both the rotation of the object and the movement of the viewpoint may be performed.

It is a figure which shows schematic structure of the typical portable game machine with which the display apparatus of this invention is implement | achieved. It is a figure which shows the external view of the typical portable game machine with which the display apparatus of this invention is implement | achieved. It is a figure for demonstrating the functional structure of a display apparatus. It is a figure which shows the example of a structure of virtual space. It is a state transition diagram of the input which a display apparatus receives. It is a flowchart for demonstrating a display process. (A) is a figure which shows a mode that the state of virtual space was projected on the surface of predetermined shape, (B) is a figure which shows the example of the image produced | generated as a result. (A) is a figure showing an example in which an object in a transparent area is selected on an image displayed before rotation, and a viewpoint movement direction is designated, and (B) is a movement direction of the designated viewpoint. On the other hand, it is a figure which shows an example of the method for a rotation part to obtain | require the axis and direction which rotate an object. It is a figure which shows the example of the image displayed when an object is rotated based on the moving direction of the viewpoint shown to FIG. 8 (A). In the modified example, (A) is an example of an image displayed before rotation, (B) is an example in which an object in a transparent region is selected and a viewpoint moving direction is specified, and (C) is a rotating unit. FIG. 6 is a diagram illustrating an example of an image displayed after an object is rotated in a movement direction designated by the item (1). (A) is a figure which shows the example of a structure of virtual space, (B) is a figure which shows the mode of the virtual space after rotating (A) clockwise with respect to the axis | shaft 1001, C) is a diagram showing a result of projecting (B).

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Portable game machine 10 Processing control part 11 Connector 12 Cartridge 13 Wireless communication part 14 Communication controller 15 Sound amplifier 16 Speaker 17 Operation key 18 1st display part 19 2nd display part 20 Touch panel 200 Display apparatus 201 Storage part 202 Display Unit 203 Selection instruction receiving unit 204 Direction designation receiving unit 205 Rotating unit 206 Area designation receiving unit

Claims (10)

A storage unit for storing the position and orientation of an object arranged in the virtual space, the position of the viewpoint, and the position and orientation of a surface having a predetermined shape having a transparent region and an opaque region;
Generate and display an image in which an object in which a line segment connecting the position of the object and the position of the viewpoint passes through the transparent area (hereinafter referred to as a visible object) is projected at the intersection of the line segment and the transparent area Display section,
A selection instruction receiving unit for receiving a selection instruction input for instructing to select one of the visible objects;
A direction designation receiving unit for receiving a direction designation input for designating a direction in which the viewpoint is to be moved in the virtual space;
A rotation unit that rotates the position and orientation of an object arranged in the virtual space according to the designated direction, with the selected visible object as a center,
Equipped with a,
If the rotation unit rotates the position and orientation of an object other than the visible object (hereinafter referred to as invisible object), the distance between the invisible object and the viewpoint is shorter than the distance between the visible object and the viewpoint. If the line connecting the invisible object and the viewpoint passes through the transparent area, the rotation is stopped.
Display device comprising a call.   A storage unit for storing the position and orientation of an object arranged in the virtual space, the position of the viewpoint, and the position and orientation of a surface having a predetermined shape having a transparent region and an opaque region;
  Generate and display an image in which an object in which a line segment connecting the position of the object and the position of the viewpoint passes through the transparent area (hereinafter referred to as a visible object) is projected at the intersection of the line segment and the transparent area Display section,
  A selection instruction receiving unit for receiving a selection instruction input for instructing to select one of the visible objects;
  A direction designation receiving unit for receiving a direction designation input for designating a direction in which the viewpoint is to be moved in the virtual space;
  A rotation unit that rotates the position and orientation of an object arranged in the virtual space according to the designated direction, with the selected visible object as a center,
  With
  An area designation receiving unit for receiving an area designation input for designating the transparent area and the opaque area on the surface of the predetermined shape;
  Further comprising
  The display unit projects an object in which a line segment connecting the position of the object whose position and orientation has been rotated and the position of the viewpoint passes through the transparent region to an intersection of the line segment and the transparent region, An object in which a line segment connecting the position of the object before the rotation and the position of the viewpoint passes through the opaque region is projected to the intersection of the line segment and the opaque region to generate the image. ,
  A display device characterized by that. The display device according to claim 1 ,
An area designation receiving unit for receiving an area designation input for designating the transparent area and the opaque area on the surface of the predetermined shape;
The display unit projects an object in which a line segment connecting the position of the object whose position and orientation has been rotated and the position of the viewpoint passes through the transparent region to an intersection of the line segment and the transparent region, An object in which a line segment connecting the position of the object before the rotation and the position of the viewpoint passes through the opaque region is projected to the intersection of the line segment and the opaque region to generate the image. ,
A display device characterized by that. The display device according to claim 2 or 3 ,
The area designation receiving unit does not accept the area designation input when the received transparent area is a predetermined area or more.
A display device characterized by that. The display device according to claim 2 or 3 ,
The area designation receiving unit, when receiving the area designation input, does not accept the area designation input when the number of the visible objects is a predetermined number or more.
A display device characterized by that. A display device according to any one of claims 1 to 5 ,
The object that the rotation unit rotates the position and orientation is the visible object.
A display device characterized by that. A display method by a display device comprising a storage unit, a display unit, a selection instruction receiving unit, a direction designation receiving unit, and a rotating unit,
The storage unit stores the position and orientation of an object arranged in the virtual space, the position of the viewpoint, and the position and orientation of a surface having a predetermined shape having a transparent region and an opaque region,
The display method is:
An image obtained by projecting an object in which a line segment connecting the position of the object and the position of the viewpoint passes through the transparent area (hereinafter referred to as a visible object) to the intersection of the line segment and the transparent area. Display process to generate and display
A selection instruction receiving step for receiving a selection instruction input instructing the selection instruction receiving unit to select one of the visible objects;
A direction designation accepting step in which the direction designation accepting unit accepts a direction designation input for designating a direction to move the viewpoint in the virtual space;
A rotation step in which the rotation unit rotates the position and orientation of an object arranged in the virtual space according to the specified direction, with the selected visible object as a center;
Equipped with a,
In the rotation step, if the rotation unit rotates the position and orientation of an object other than the visible object (hereinafter referred to as invisible object), the distance between the invisible object and the viewpoint is determined by the distance between the visible object and the viewpoint. If the line segment connecting the invisible object and the viewpoint passes through the transparent region, the rotation is stopped.
Display wherein a call.   A display method comprising a storage unit, a display unit, a selection instruction receiving unit, a direction designation receiving unit, a rotating unit, and a region designation receiving unit,
  The storage unit stores the position and orientation of an object arranged in the virtual space, the position of the viewpoint, and the position and orientation of a surface having a predetermined shape having a transparent region and an opaque region,
  The display method is:
  An image obtained by projecting an object in which a line segment connecting the position of the object and the position of the viewpoint passes through the transparent area (hereinafter referred to as a visible object) to the intersection of the line segment and the transparent area. Display process to generate and display
  A selection instruction receiving step for receiving a selection instruction input instructing the selection instruction receiving unit to select one of the visible objects;
  A direction designation accepting step in which the direction designation accepting unit accepts a direction designation input for designating a direction to move the viewpoint in the virtual space;
  A rotation step in which the rotation unit rotates the position and orientation of an object arranged in the virtual space according to the specified direction, with the selected visible object as a center;
  An area designation accepting step in which the area designation accepting unit accepts an area designation input for designating the transparent area and the opaque area on the surface of the predetermined shape;
  With
  In the display step, the display unit detects an object in which a line segment connecting the position of the object whose position and orientation is rotated and the position of the viewpoint passes through the transparent area, and the line segment and the transparent area Projecting to the intersection point between the line segment and the opaque region, projecting the object through which the line segment connecting the position of the object before the rotation and the position of the viewpoint passes through the opaque region. Generating the image,
  A display method characterized by that. Computer
A storage unit for storing the position and orientation of an object arranged in the virtual space, the position of the viewpoint, and the position and orientation of a surface having a predetermined shape having a transparent region and an opaque region;
Generate and display an image in which an object in which a line segment connecting the position of the object and the position of the viewpoint passes through the transparent area (hereinafter referred to as a visible object) is projected at the intersection of the line segment and the transparent area Display section,
A selection instruction receiving unit for receiving a selection instruction input for instructing to select one of the visible objects;
A direction designation receiving unit for receiving a direction designation input for designating a direction in which the viewpoint is to be moved in the virtual space;
A rotation unit that rotates the position and orientation of an object arranged in the virtual space according to the designated direction, with the selected visible object as a center,
To function as,
If the rotation unit rotates the position and orientation of an object other than the visible object (hereinafter referred to as invisible object), the distance between the invisible object and the viewpoint is shorter than the distance between the visible object and the viewpoint. If the line connecting the invisible object and the viewpoint passes through the transparent area, the rotation is stopped.
A program characterized by functioning as follows.   Computer
  A storage unit for storing the position and orientation of an object arranged in the virtual space, the position of the viewpoint, and the position and orientation of a surface having a predetermined shape having a transparent region and an opaque region;
  Generate and display an image in which an object in which a line segment connecting the position of the object and the position of the viewpoint passes through the transparent area (hereinafter referred to as a visible object) is projected at the intersection of the line segment and the transparent area Display section,
  A selection instruction receiving unit for receiving a selection instruction input for instructing to select one of the visible objects;
  A direction designation receiving unit for receiving a direction designation input for designating a direction in which the viewpoint is to be moved in the virtual space;
  A rotation unit that rotates the position and orientation of an object arranged in the virtual space according to the designated direction, with the selected visible object as a center,
  An area designation receiving unit for receiving an area designation input for designating the transparent area and the opaque area on the surface of the predetermined shape;
  Function as
  The display unit projects an object in which a line segment connecting the position of the object whose position and orientation has been rotated and the position of the viewpoint passes through the transparent region to an intersection of the line segment and the transparent region, An object in which a line segment connecting the position of the object before the rotation and the position of the viewpoint passes through the opaque region is projected to the intersection of the line segment and the opaque region to generate the image. ,
  A program characterized by functioning as follows.

Images