JP6714564B2 - Information processing program, information processing apparatus, information processing system, and information processing method - Google Patents

Description

The present invention relates to an information processing program, an information processing device, an information processing system, and an information processing method, and in particular, for example, an information processing program, an information processing device, an information processing system, and information for displaying a part of an image on a portable display. Regarding processing method.

There is a technique for displaying a part of a virtual space on a portable display according to its movement and posture (for example, refer to Patent Document 1).

JP-A-9-305788

However, in the technique described in Patent Document 1, the display range is determined by the movement and posture of the portable display, so that the user has a difficult posture to display the display range desired by the user. It may be necessary to operate the portable display.

Therefore, an object of the present invention is to provide an information processing program, an information processing apparatus, an information processing system, and an information processing method that allow a user to easily move the display range.

In order to achieve the above object, the present invention can employ the following configurations, for example. When interpreting the description of the claims, it is understood that the scope should be interpreted only by the description of the claims, and the description of the claims and the description of this column are inconsistent. In that case, the description in the claims has priority.

One configuration example of the information processing program of the present invention is that at least an image is displayed on the portable display device including a sensor that outputs data according to the movement or posture of the portable display device main body and an operation unit that allows a user operation input. Is executed by a computer included in the information processing apparatus that displays The information processing program causes the computer to function as first display range setting means and first display control means. The first display range setting means displays a part of the display target image on the display device according to the attitude of the portable display device calculated based on the data output from the sensor and the operation on the operation device. Set the first display range to be displayed. The first display control means displays the image within the first display range in the display target image on the portable display device.

The "information processing device" may be configured by a device different from the portable display device, or may be configured by the display device when the display device has an information processing function. Further, in the former case, each processing of the present invention is executed by "another device", and the portable display device may only display the image generated by the "another device". When the device has an information processing function, the information processing function of the display device and the information processing function of “another device” may cooperate with each other. Further, the “separate device” may be a device that performs distributed processing by a plurality of information processing devices.

According to the above, the display range changes in accordance with the movement or posture of the portable display device body, and the display range also changes by an operation on the operation means, so that the display range can be easily moved with respect to the display target image. Can be made.

The first display range setting means may include a posture display range setting means and a display range offset means. The posture display range setting means sets the first display range according to the posture of the portable display device calculated based on the data output from the sensor. The display range offset means offsets the first display range set by the orientation display range setting means with respect to the display target image in response to an operation on the operation means. In this case, the first display control means may display the offset image in the first display range in the display target image on the portable display device.

According to the above, the display range changes in accordance with the movement or posture of the portable display device body, and the display range is offset even when the operation means is operated. Can be moved.

Further, the operating means may include direction indicating means capable of performing direction indicating operations in at least two directions. In this case, the display range offset means may offset the first display range in the direction designated by the direction designating operation on the direction designating means.

According to the above, since the direction in which the display range is offset is set by the operation on the direction indicating means, it is possible to intuitively perform the operation for controlling the direction in which the display range is offset.

Further, the information processing program may cause a computer to function as virtual camera setting means. The virtual camera setting means sets, in the virtual space, a virtual camera in which at least a part of its field of view is set as the first display range. In this case, the attitude display range setting means may set the first display range by changing the attitude of the virtual camera according to the attitude of the portable display device. The display range offset means may offset the first display range by changing the line-of-sight direction of the virtual camera to the direction designated by the direction designating operation on the direction designating means.

Based on the above, the display range can be easily moved by controlling the posture of the virtual camera.

Further, the display range offset means may set the offset amount of the first display range to 0 when the direction indicating operation is not performed on the direction indicating means.

According to the above, by stopping the operation on the direction indicating means, the display range can be moved only by the movement or posture of the portable display device body, and the offset of the display range can be easily invalidated.

Further, the direction indicating means may be capable of simultaneously indicating a direction and a size with respect to the direction when performing a direction indicating operation. In this case, the display range offset means may offset the first display range in the designated direction by an offset amount according to the size designated by the direction designating operation on the direction designating means.

According to the above, when an analog stick, a touch panel, or the like is used as the direction indicating means, the offset direction and amount can be set based on the tilt direction and tilt angle, the touch direction, and the length according to the touch position. Therefore, the offset direction and amount can be easily controlled by an intuitive operation.

Further, the direction indicating means may be capable of simultaneously instructing a tilt direction from the neutral state and a tilt angle from the neutral state by tilting the predetermined member from the neutral state. In this case, the display range offset means may offset the first display range in a direction according to the tilt direction by an offset amount according to the tilt angle.

According to the above, when the analog stick or the like is used as the direction indicating means, the offset direction and the amount can be easily controlled by an intuitive operation. In addition, since the offset amount is set according to the tilt angle from the neutral state, the tilt angle is enlarged or reduced by performing an operation to gradually increase or decrease the tilt angle from the neutral state. The display range can be gradually offset and moved in accordance with.

Further, the display range offset means may offset the first display range in the instructed direction by an offset amount according to the duration time during which the direction instructing operation is performed on the direction instructing means.

According to the above, when a direction indicating key (for example, a cross key, a left button and a right button) or the like is used as the direction indicating means, it is possible to control the offset direction by operating the direction indicating key and at the same time operate the direction indicating key The offset amount can also be controlled depending on the time during which the operation continues. Further, since the offset amount is set according to the operation duration time after the operation is started, the display range can be gradually offset and moved according to the lapse of the operation duration time.

Further, the information processing program may cause a computer to function as the second display range setting means and the second display control means. The second display range setting means sets a second display range in which at least a part of the display target image is displayed on the stationary display device. The second display control means displays the image within the second display range in the display target image on the stationary display device. In this case, the first display range setting means and the second display range setting means are arranged to display the first display range and the second display in accordance with the positional relationship between the stationary display device and the portable display device in the real space. The ranges and may be set respectively.

Based on the above, it is possible to display an image as if the space formed by the display target image is viewed through a plurality of display devices.

Further, the display range offset means may set the offset amount capable of offsetting the first display range to less than 180° in the viewing angle of the display target image.

Based on the above, it is possible that the sense of direction with respect to the displayed image to be displayed is lost by offsetting the display range, but it is possible to prevent loss of sense of direction by limiting the amount of offset of the display range. can do.

Further, the display target image may be an image showing a predetermined virtual space and an image wider than the viewing angle of the first display range.

According to the above, when a part of the virtual world having a relatively wide viewing angle is displayed on the portable display device, the display range displayed on the portable display device can be easily moved.

Further, the display target image may be an image in which the real space is captured and a panoramic image wider than the viewing angle of the first display range.

According to the above, when a part of the panoramic image obtained by capturing the real world is displayed on the portable display device, the display range displayed on the portable display device can be easily moved.

It is preferable that the display target image is a virtual space image or a panoramic image having a viewing angle of 180° or more in one of the vertical direction and the horizontal direction. More preferably, it is a virtual space image or a panoramic image of 360° in one direction. Further, in the other direction, it is preferable that the viewing angle of the image displayed on the portable display device is equal to or more than that, and further, the viewing angle of the image is twice or more, 120° or more, 150° or more, or It is preferably 180°. The panoramic image may be an image captured by the image capturing function of the information processing device, and an image captured by another device having the image capturing function may be captured via a predetermined storage medium or network. It can be a picture.

Further, the first display range setting means sets the first display range in accordance with an operation performed by the holding user when the user holds the portable display device among the operating means. You may set it.

According to the above, the operation for setting the first display range becomes easy.

Further, when the user holds both ends of the portable display device with both hands, the user-operable operation means may be operable with one of the fingers of the holding user.

According to the above, it is possible to easily operate the portable display device with a finger holding the portable display device.

Further, the present invention may be embodied in the form of an information processing apparatus and an information processing system each including the above means, and an information processing method including an operation performed by each of the above means.

According to the present invention, the display range is changed according to the movement or posture of the portable display device body, and the display range is also changed by an operation on the operation means. Can be moved.

Block diagram showing an example of the information processing system 1. The front view which shows an example of the external appearance of the terminal device 2. Rear view showing an example of the appearance of the terminal device 2 The figure which shows an example of the panoramic video (image) displayed in the information processing system 1. The figure which shows an example of the method of determining a display range according to the attitude|position of the terminal device 2 and a direction instruction. The figure which shows an example in which the display range is determined according to the attitude of the terminal device 2. The figure which shows an example in which the display range is determined according to the direction instruction of the terminal device 2. A diagram showing an example of main data and programs stored in the memory 6 of the information processing device 3. The figure which shows the flowchart which shows an example of the first half of the process performed in the information processing apparatus 3. The figure which shows the flowchart which shows an example of the latter half of the process performed in the information processing apparatus 3.

An information processing apparatus that executes an information processing program according to an example of the present embodiment and an information processing system including the information processing apparatus will be described with reference to FIG. 1. 1. FIG. 1 is a block diagram showing an example of the information processing system 1 including the stationary information processing device 3. As an example, the information processing device 3 is a stationary game device, and the information processing system 1 is a game system including the game device.

In FIG. 1, the information processing system 1 includes a terminal device 2, an information processing device 3, and a monitor 4. The information processing system 1 according to the present embodiment generates an image (panoramic image) and displays it on a display device (terminal device 2 and/or monitor 4).

In the information processing system 1, the information processing device 3 executes information processing in response to an input to the terminal device 2, and an image obtained as a result of the execution is displayed on the terminal device 2 and/or the monitor 4. As described above, in the present embodiment, the information processing system 1 has a configuration in which the input function, the information processing function, and the display function are realized by a plurality of devices. In addition, in another embodiment, the information processing system 1 may be configured by a single information processing device (for example, a portable or portable information processing device) having these functions.

The terminal device 2 is a (portable) input device that can be held by a user. The terminal device 2 can communicate with the information processing device 3. The terminal device 2 transmits operation data indicating an operation on the terminal device 2 to the information processing device 3. In addition, in the present embodiment, the terminal device 2 includes a display unit (LCD 11), and the terminal device 2 is also a display device. When the image is transmitted from the information processing device 3, the terminal device 2 displays the image on the LCD 11.

The terminal device 2 also includes a touch panel 12 as an input unit. The touch panel 12 is an example of a position detection unit that detects a position input on a predetermined input surface (screen of the display unit) provided on the housing. Furthermore, the terminal device 2 includes an operation unit 13 as an input unit.

As shown in FIGS. 2A and 2B, as an example, the operation unit 13 of the terminal device 2 includes a direction indicating unit. Specifically, the direction indicating section includes at least one of the left analog stick 13A, the right analog stick 13B, the cross key 13C, the L button 13D, the R button 13E, the ZL button 13F, and the ZR button 13G. For example, the left analog stick 13A and the right analog stick 13B can indicate directions in all directions depending on the direction in which the stick is tilted, and the cross key 13C can indicate directions in eight directions depending on the direction in which the key is pressed. You can give instructions. In addition, the set of the L button 13D and the R button 13E and the set of the ZL button 13F and the ZR button 13G can be used to instruct a direction in the left-right direction by the pressed button. The direction indicating unit may be configured by the touch panel 12 or the touch pad. For example, the touch panel 12 or the touch pad can indicate a reference position on the input surface (for example, the center of the input surface) by the direction in which the touch panel 12 or the touch pad is touch-operated. It is also possible to instruct the sliding direction by touching the sliding surface. Further, the operation unit 13 may include an operation button or the like for an instruction different from the above direction instruction. In addition, when the both ends of the terminal device 2 are held by both hands, the direction indicating unit is preferably an operation unit provided at a position where it can be operated by any one of the holding fingers.

In addition, the terminal device 2 includes an acceleration sensor 14 as an input unit. The acceleration sensor 14 detects acceleration in a predetermined axis direction of the terminal device 2 (three axis directions in the present embodiment, but may be one axis or more). The terminal device 2 also includes a gyro sensor 15 as an input unit. The gyro sensor 15 detects an angular velocity related to rotation about a predetermined axis direction of the terminal device 2 (three axis directions in the present embodiment, but may be one axis or more). The acceleration sensor 14 and the gyro sensor 15 are sensors that detect information for calculating the attitude of the terminal device 2 (information that can calculate or estimate the attitude). Note that in other embodiments, the attitude of the terminal device 2 may be calculated by any method, and the attitude of the terminal device 2 may be calculated by using a sensor other than the above sensor or a camera capable of photographing the terminal device 2. May be calculated.

The information processing device 3 executes various kinds of information processing executed in the information processing system 1, such as a process of generating an image. In the present embodiment, the information processing device 3 has a CPU (control unit) 5 and a memory 6, and the CPU 5 executes a predetermined information processing program using the memory 6 to perform various functions in the information processing device 3. Is realized. The information processing device 3 may have any configuration as long as it can execute the above information processing. In the present embodiment, an image (panoramic image) is generated by the information processing device 3, and the generated image is output to the terminal device 2 and/or the monitor 4 which is a display device.

The monitor 4 is an example of a display device that displays the generated image and outputs the generated sound. The monitor 4 can receive the data transmitted from the information processing device 3. When the image generated by the information processing device 3 is transmitted to the monitor 4, the monitor 4 displays the image.

Next, a process of reproducing a panoramic video, which is executed in the information processing system 1, will be described. FIG. 3 is a diagram showing an example of a panoramic video (image) displayed in the information processing system 1. As shown in FIG. 3, in this embodiment, a panoramic image is displayed on the terminal device 2 and the monitor 4. Note that in other embodiments, the panoramic image may be displayed on at least one display device.

Here, the panoramic image is an image having a wider viewing angle than the viewing angle of the image displayed on the display device. That is, as for the panoramic image, an image of a partial area thereof is basically displayed on the display device (however, when a plurality of display devices are used as in the present embodiment, the panorama image is displayed on some display devices). The entire image may be displayed. It can be said that the panoramic image is an image in which the direction of the line of sight changes as the display range changes. In the present embodiment, a panoramic image having viewing angles in all directions (360°) is used in the up, down, left, and right directions (see FIG. 4 ). However, the panoramic image may have a blind spot, for example, the viewing angle may be about 180°. Further, in the present embodiment, the panoramic image is a real image (real image) taken by the camera, but a part or all of it may be a virtual image (CG image).

In the present embodiment, the display device (the terminal device 2 and the monitor 4) reads out a panoramic image, which is each frame of the stored panoramic video, at predetermined time intervals as the playback of the panoramic video progresses. The panoramic video is reproduced by sequentially displaying the panoramic images on the display device. Specifically, each of the plurality of panoramic images forming the panoramic video is given a frame number, and the panoramic images are displayed in the order of the frame numbers. As an example, when displaying a panoramic video captured while moving the viewpoint in a predetermined space (for example, the real world) over time, a panoramic video in which the viewpoint moves along with the elapsed time of playing the panoramic video is played. It For example, as shown in FIG. 3, a panoramic image of the surroundings viewed from the road is displayed, and a panoramic video moving on the road (the viewpoint moves along the road) is reproduced. As another example, when displaying a panoramic video imaged (that is, fixed-point imaging) without moving in a predetermined space, the state around the viewpoint may change with the passage of time when the panoramic video is played back. The panoramic video is played.

As shown in FIG. 3, each display device (terminal device 2 and monitor 4) displays a partial range of the panoramic image. Below, the range displayed on the display device in the panoramic image is referred to as a “display range”. In FIG. 3, the monitor 4 displays a panoramic image in a display range in which the line-of-sight direction for displaying the panoramic image is the traveling direction (front direction) of the viewpoint when the panoramic image is captured. In the present embodiment, the display range on the monitor 4 is basically fixed to a predetermined range, but the position and size of the display range with respect to the panoramic image may be changed according to a user operation. ..

On the other hand, the display range of the terminal device 2 is changed according to the posture of the terminal device 2. For example, in FIG. 3, the terminal device 2 is in a posture facing to the right with respect to the front direction (direction from the user (terminal device 2) to the monitor 4), and the terminal device 2 is in the above traveling direction. On the other hand, a panoramic image in the display range when the line of sight is directed to the right is displayed. In addition, in the present embodiment, the display range of the terminal device 2 is changed according to the attitude of the terminal device 2 and the offset amount according to the operation on the direction indicator (for example, the left analog stick 13A). As described above, the information processing system 1 determines the display range to be displayed on the display device in the panoramic video based on the input to the input device (terminal device 2), and operates the direction instructing unit. In this case, the display range is offset and determined according to the direction instruction. According to this, the user can freely change the line-of-sight direction (display range) by an operation of changing the posture of the terminal device 2 to view a panoramic video, and further in a situation where the operation of changing the posture is difficult to perform. The display range can be offset and displayed by an operation using the direction indicator.

FIG. 4 is a diagram illustrating an example of a method of determining the display range according to the attitude and the direction instruction of the terminal device 2. In the present embodiment, as shown in FIG. 4, a three-dimensional model is arranged in a virtual space, and a virtual camera is placed at a predetermined position inside the three-dimensional model (in the present embodiment, a position that is substantially the center of the three-dimensional model). Place C1. Then, when the image of the stereo model (the inner surface of the stereo model) viewed from the virtual camera C1 is generated, the panoramic image is generated by drawing the panoramic image as a texture on the inner surface of the stereo model. At this time, in the panoramic image, the field of view of the virtual camera C1 (hatched area A1 shown in FIG. 4) becomes the display range. In the present embodiment, the shape of the three-dimensional model is a cube, but the shape of the three-dimensional model is arbitrary, and may be, for example, a spherical shape or a columnar shape (for example, a cylinder).

In FIG. 4, the virtual camera C1 for generating an image to be displayed on the terminal device 2 has its posture controlled according to the posture of the terminal device 2, and further has its posture controlled according to the direction instruction from the direction indicating unit. To be done. Thereby, the display range can be changed according to the attitude of the terminal device 2, and the display range can be further changed according to the offset amount according to the direction indicating section by the direction indicating section. Hereinafter, an example in which the attitude of the virtual camera C1 is controlled according to the attitude of the terminal device 2 and the direction instruction will be described.

First, as an initial setting, the reference attitude of the terminal device 2 is set. For example, the reference posture of the terminal device 2 is set by the posture of the terminal device 2 at the start of the panoramic video reproduction or at a predetermined timing before the start. Specifically, the attitude of the terminal device 2 at the time of starting the panoramic video reproduction may be set as the reference attitude, or the attitude of the terminal device 2 when the user performs a predetermined operation before starting the panoramic video reproduction. The attitude may be set as the reference attitude, or a predetermined fixed attitude of the terminal device 2 may be set as the reference attitude, or the user may select one of the predetermined fixed attitudes of the terminal apparatus 2 by the user. Good. In the present embodiment, the attitude of the terminal device 2 is calculated based on the output value of the gyro sensor 15, so the setting of the reference attitude is resetting the attitude value calculated by the gyro sensor 15. However, the reference attitude of the terminal device 2 may be set by executing appropriate processing depending on the type of sensor.

Further, as the initial setting, the initial attitude of the virtual camera C1 is set. For example, in the initial posture of the virtual camera C1, the line-of-sight direction (z-axis positive direction) matches the Z-axis positive direction of the virtual space (front direction in the panoramic image), and the left direction (x-axis positive direction) of the virtual space is X. It is arranged so as to match the positive axis direction and the upward direction (the positive y axis direction) to match the positive Y axis direction of the virtual space.

Then, a posture change of the terminal device 2 with respect to the reference posture (xt axis that is the left-right direction of the terminal device 2 in the reference posture, yt axis that is the vertical direction of the terminal device 2, and zt axis that is the front-back direction of the terminal device 2 respectively) The orientation of the virtual camera C1 from the initial orientation (typically, the x-axis, y-axis, and z-axis of the virtual camera C1 in the initial orientation, that is, the X-axis, Y). The same rotation direction and the same amount of rotation about the Z axis and the Z axis). Then, when a direction is instructed by an operation on the direction instructing unit, the posture of the virtual camera C1 is further changed according to an offset amount calculated from the direction instruction (for example, information indicating a direction and an angle according to the direction instruction). Let In addition to the position of the display range, the information processing system 1 may change the size of the display range (zoom in or zoom out) according to an operation on the terminal device 2.

On the other hand, a virtual camera (not shown) for generating an image to be displayed on the monitor 4 has a line-of-sight direction that is basically a predetermined reference direction (here, the front direction that is the traveling direction described above, It is set so as to face the Z-axis positive direction). That is, the display range of the monitor 4 (hatched area A2 shown in FIG. 4) is set at the position in the front direction from the virtual camera. The position of this virtual camera is also fixed to a predetermined position (the center position of the stereo model in this embodiment).

In the present embodiment, the relationship between the line-of-sight direction of the panoramic image displayed on the monitor 4 and the line-of-sight direction of the panoramic image displayed on the terminal device 2 is determined by the depth direction of the display screen on the monitor 4 and the terminal device 2. The line-of-sight direction of the virtual camera C1 is controlled so that it substantially matches the relationship with the depth direction of the LCD 11. Specifically, by setting the reference posture with the depth direction of the LCD 11 of the terminal device 2 facing the monitor 4, in this state, the line-of-sight direction of the virtual camera C1 is the virtual direction for the monitor 4. Initially set to the same direction as the line of sight of the camera. Then, when the attitude of the terminal device 2 changes from the reference attitude, the attitude of the virtual camera C1 changes in the direction corresponding to the changing direction by an amount corresponding to the amount of change. According to this, the user can see the scenery in a desired line-of-sight direction (direction other than the front direction) by changing the direction of the terminal device 2 while viewing the scenery in the certain line-of-sight direction (front direction) on the monitor 4. You can Further, the user can easily display the panoramic image in the front direction on the LCD 11 by directing the depth direction of the LCD 11 of the terminal device 2 toward the monitor 4, and the position of the monitor 4 is displayed as the panoramic image. It can be handled as a reference (a reference for displaying the front direction of the panoramic image). Furthermore, by matching the change in the attitude of the terminal device 2 and the change in the attitude of the virtual camera C1, the orientation of the terminal device 2 in the real space and the line-of-sight direction of the virtual camera C1 in the virtual space match, so that the user Can feel the space represented by the panoramic image more realistically.

Next, with reference to FIGS. 5 and 6, an example of a method of determining the display range in accordance with the attitude and the direction instruction of the terminal device 2 will be described more specifically. FIG. 5 is a diagram showing an example in which the display range is determined according to the attitude of the terminal device 2. FIG. 6 is a diagram showing an example in which the display range is determined according to the direction instruction of the terminal device 2.

In FIG. 5, consider a case where the attitude of the terminal device 2 itself is turned to the right by an angle R1° (that is, the depth direction of the LCD 11 is rotated to the right by a yaw angle R1°). In this case, the display range of the panoramic image displayed on the LCD 11 is changed from the display range A to the display range B by yawing the posture of the virtual camera C1 arranged inside the stereo model to the right by the angle R1°. Change. Here, when the image to be displayed is a panoramic image having a large viewing angle in the left-right direction (for example, 360°), the display range B is the angle R1 at the viewing angle from the display range A in the panoramic image. This is the range moved rightward by +° (+R1° when the rightward direction is indicated by a positive value). Although not shown, the attitude of the terminal device 2 itself is turned upward by an angle R2° (that is, the depth direction of the LCD 11 is rotated upward by a pitch angle R2°), or the terminal is centered in the depth direction. When the posture of the device 2 itself is rotated by the angle R3° (that is, the roll angle is rotated by R3° about the depth direction of the LCD 11), the display range of the panoramic image displayed on the LCD 11 is the panoramic image. It changes to a range that has moved upward (+R2° when the upward direction is a positive value) by the angle R2° in the vertical viewing angle, or the display range of the angle R3° around the gazing point in the panorama image. It rotates and changes. In this way, the user can freely change the line-of-sight direction (display range) by the changed angle (yaw angle, pitch angle, roll angle) by changing the posture of the terminal device 2 vertically or horizontally or by rolling. You can view the panorama image (panoramic video) by changing to.

Next, in FIG. 6, a case is considered in which the user uses the direction indicating unit (for example, the left analog stick 13A) included in the operation unit 13 of the terminal device 2 to give the direction to the right at the angle S1°. As an example, when the user tilts the left analog stick 13A from the neutral state (neutral state) to the right by the angle S1°, the direction of the angle S1° is directed to the right. In this case, the display range of the panoramic image displayed on the LCD 11 is changed from the display range B to the display range C by yawing the attitude of the virtual camera C1 arranged inside the stereo model to the right by the angle S1°. Offset. Specifically, the display range C is a range further offset to the right by +S1° in the viewing angle from the display range B in the panoramic image. When the user stops the direction instruction (that is, when the left analog stick 13A returns to the neutral state), the offset is released and the panoramic image of the display range B is displayed on the LCD 11. Although illustration is omitted, when the user gives an upward direction of an angle S2° using the direction indicating section, the display range of the panoramic image displayed on the LCD 11 is the vertical field of view in the panoramic image. It is offset by +S2° in the corner to the range moved upwards. As described above, the user can display the panoramic image by offsetting the display range in accordance with the operation using the direction indicator in addition to the change in the display range due to the change in the attitude of the terminal device 2. Even in a situation where it is difficult to change the posture of No. 2, it is possible to display a panoramic image in a desired display range.

In the above description, an example in which the viewing angle is set to be the same as the tilt angle when the analog stick is tilted from the neutral state, and the display range is changed so as to be offset by the viewing angle in the tilt direction in which the analog stick is tilted Although used, the display range may be offset in another manner with respect to the direction instruction. As a first example, the display range may be changed so as to be offset in the tilted tilt direction by a viewing angle obtained by multiplying the tilt angle of the analog stick tilted from the neutral state by a predetermined coefficient. .. As a second example, the field of view calculated according to the time when the direction is instructed (for example, the pressing time of the cross key 13C, L button 13D, R button 13E, ZL button 13F, or ZR button 13G). The display range may be changed so that the angle is gradually offset in the direction instructed. As a third example, when the touch panel 12 is touch-operated to direct a direction, only the viewing angle calculated according to the touch position (for example, the length from the reference position to the touch position or the length of the slide operation) is calculated. The display range may be changed so that the direction is gradually offset in the designated direction. In the case of the second example and the third example, the display set before the direction instruction is given by ending the direction instruction (for example, ending the operation of pressing the direction instruction unit or touching off). The panoramic image is immediately returned to the range and displayed on the LCD 11. The angle at which the display range can be offset can be set according to the angle or the length at which the direction can be designated, but for example, the offsettable viewing angle is set within ±45° or ±90°. However, the view angle that can be offset is not limited to these values, and the absolute value of the view angle may be set to less than 180°.

Further, in the above description, a panoramic image (panoramic video) is used as an example of an image displayed on the terminal device 2, but another image may be displayed on the terminal device 2. For example, any image may be used as long as an image in the display range that is a part of the display target image is displayed on the terminal device 2, and a case where a part of the virtual world or virtual space is displayed on the terminal device 2. However, the display range control described above can be similarly applied. As an example, the image displayed on the terminal device 2 is a panoramic image captured while moving in the virtual world, a panoramic image captured at a fixed point in the virtual world, or a panoramic image captured in the real world, and an image of the virtual world combined. It does not matter even if it is an image.

Next, details of the processing performed in the information processing device 3 will be described. First, main data used in the process will be described with reference to FIG. 7. Note that FIG. 7 is a diagram showing an example of main data and programs stored in the memory 6 of the information processing device 3.

As shown in FIG. 7, the data storage area of the memory 6 stores panoramic image file data Da, terminal operation data Db, posture data Dc, offset data Dd, virtual camera data De, virtual space image data Df, and the like. It In addition to the data shown in FIG. 7, the memory 6 may store data necessary for processing, such as data used in an application to be executed. Further, in the program storage area of the memory 6, various program groups Pa forming the information processing program are stored.

The panorama image file data Da includes panorama image data and the like as information for each frame. The panoramic image data includes data indicating a panoramic image In to be pasted as a texture on the inner surface of the above-described stereo model for each frame number n (1, 2, 3,... ). For example, panoramic image data is obtained by decoding a panoramic video encoded and stored in a predetermined storage medium by a predetermined method. The panorama image file data Da is merely an example, and the structure of the data may be changed as long as the same information can be obtained, and another data may be added in addition to and/or in place of each data. It may be stored.

The terminal operation data Db is data indicating the operation content of the terminal device 2, and includes direction indicating data Db1 and angular velocity data Db2. The direction instruction data Db1 is data indicating the operation content of the direction instruction unit provided in the terminal device 2. The angular velocity data Db2 is data indicating the angular velocity generated in the terminal device 2, and is data indicating the angular velocity output from the gyro sensor 15.

The posture data Dc is data indicating the posture of the terminal device 2 in the real space, for example, data indicating the rotation amount of the terminal device 2 from the reference posture.

The offset data Dd is data indicating the amount and direction of the offset calculated according to the direction instruction using the direction instruction unit.

The virtual camera data De is data regarding the virtual camera arranged in the center of the stereo model. For example, the virtual camera data De is data relating to the position, orientation, field of view (viewing angle), etc. of the virtual camera in the virtual space. It should be noted that the virtual camera data De is data relating to a plurality of virtual cameras for displaying images when displaying a panoramic image (panoramic video) on the terminal device 2 and the monitor 4, respectively.

The virtual space image data Df is data indicating a virtual space image of the inner surface of the stereo model viewed from the virtual camera.

Next, details of the processing performed in the information processing device 3 will be described with reference to FIGS. 8 and 9. Note that FIG. 8 is a flowchart showing an example of the first half of the processing executed by the information processing device 3. FIG. 9 is a flowchart showing an example of the latter half of the processing executed by the information processing device 3. Here, in the flowcharts shown in FIGS. 8 and 9, among the processes in the information processing device 3, a process of displaying a panoramic image (panoramic video) on the terminal device 2 and the monitor 4 will be mainly described. Detailed description of other processing that is not directly related is omitted.

The CPU 5 initializes the memory 6 and the like, and reads the information processing program stored in the nonvolatile memory or the optical disk in the information processing device 3 into the memory 6. Then, the CPU 5 starts executing the information processing program. The flowcharts shown in FIGS. 8 and 9 are flowcharts showing the processing performed after the above processing is completed.

It should be noted that the processing of each step in the flowcharts shown in FIGS. 8 and 9 is merely an example, and the processing order of each step may be changed or the processing of each step may be changed as long as the same result is obtained. In addition and/or instead, another process may be performed. In addition, in the present embodiment, the processing of each step of the above flowchart is described as being executed by the CPU 5, but the processing of some or all of the steps in the above flowchart may be executed by a processor other than the CPU or a dedicated circuit. You may

In FIG. 8, the CPU 5 acquires a panoramic image file (step 81). For example, the CPU 5 acquires a panoramic image file from a non-volatile memory in the information processing device 3, a storage medium attached to the information processing device 3, or another device via a network or the like and stores the panoramic image file in the panoramic image file data Da. To do.

Next, the CPU 5 arranges the stereo model for pasting the panoramic image in the virtual space such that its center is located at the origin (step 82) and advances the processing to the next step. For example, when the shape of the three-dimensional model is a cube, the CPU 5 intersects the XYZ axes set in the virtual space with the front of the three-dimensional model perpendicular to the Z axis on the Z axis positive direction side and the back of the Z axis. The negative side intersects perpendicularly with the Z axis, the left side surface intersects with the X axis positive direction side with the X axis perpendicularly, the right side surface intersects with the negative side of the X axis perpendicularly intersects with the X axis, and the top surface has the Y axis positive direction side. The three-dimensional model is arranged so that it intersects with the Y-axis at right angles and the bottom surface intersects with the Y-axis at the Y-axis negative direction side perpendicularly.

Next, the CPU 5 arranges the virtual cameras C1 and C2 at the reference positions in the initial posture (step 83), and advances the processing to the next step. For example, the CPU 5 sets the reference positions of the virtual cameras C1 and C2 as the origin of the virtual space (that is, the center of the stereo model), and the xyz axes of the virtual cameras C1 and C2 (the positive direction of the x axis is the left direction of the virtual camera, y The posture in which the positive axis direction is the upward direction of the virtual camera and the positive z axis direction is the line-of-sight direction of the virtual camera) matches the XYZ axes of the virtual space is the initial posture. Then, the CPU 5 updates the data regarding the positions and orientations of the virtual cameras C1 and C2 in the virtual camera data De using the reference positions and the initial orientations of the virtual cameras C1 and C2.

Next, the CPU 5 prompts the user to adjust the attitude of the terminal device 2 (step 84) and waits for the attitude adjustment to be performed (step 85).

In step 86, the CPU 5 sets the current attitude of the terminal device 2 to the reference attitude, and advances the processing to the next step. For example, the CPU 5 initializes the attitude (rotation amount from the reference attitude) of the terminal device 2 indicated by the attitude data Dc (rotation amount around each axis is 0) and sets the reference attitude of the terminal device 2.

As described above, in the processing of steps 84 to 86, the attitude of the terminal device 2 at the time when the processing of step 84 is performed or after a predetermined time has elapsed from that time may be set as the reference attitude. However, the attitude of the terminal device 2 when the user performs a predetermined operation may be set as the reference attitude, or a fixed fixed attitude of the terminal device 2 may be set as the reference attitude or may be predetermined. The user may select from among a plurality of fixed attitudes of the terminal device 2. As an example, when reproducing and displaying the same panoramic video on the monitor 4, the CPU 5 adjusts the attitude of the terminal device 2 so that the orientation of the LCD 11 of the terminal device 2 and the orientation of the display screen of the monitor 4 are the same. Then, a display prompting the user to perform a predetermined operation of the terminal device 2 when the posture is reached is displayed on the terminal device 2 and/or the monitor 4. Then, when the CPU 5 acquires the operation data indicating that the predetermined operation is performed on the operation unit 13 of the terminal device 2, the CPU 5 determines that the posture adjustment is performed, and the operation is performed. The attitude of the terminal device 2 at that time is set as the reference attitude. In this case, the attitude of the terminal device 2 adjusted by the process of steps 84 to 86 is adjusted so that the orientation of the LCD 11 of the terminal device 2 and the orientation of the display screen of the monitor 4 are the same. It will be set as the reference attitude.

Next, the CPU 5 sets the number of frames n to 1 (step 87), and proceeds to the next step 91 (see FIG. 9).

In FIG. 9, the CPU 5 acquires the panoramic image corresponding to the frame n from the panoramic image data of the panoramic image file data Da (step 91), and advances the processing to the next step.

Next, the CPU 5 pastes the panoramic image acquired in step 91 as a texture on the inner surface of the stereo model (step 92), and proceeds to the next step. For example, as described above with reference to FIG. 4, the panoramic image is pasted as a texture on each inner surface of the stereo model.

Next, the CPU 5 acquires the terminal operation data from the terminal device 2 (step 93) and advances the processing to the next step. In addition, from the terminal device 2, the data indicating the operation content for the operation unit 13 (direction instruction unit) and the data indicating the output value of the gyro sensor 15 are transmitted to the information processing device 3 as the terminal operation data at regular intervals, and the direction information is transmitted. It is stored in the instruction data Db1 and the angular velocity data Db2, respectively.

Next, the CPU 5 calculates the rotation direction and the rotation amount of the terminal device 2 from the reference posture (the rotation direction and the rotation amount after the initialization in step 86) using the data acquired in step 93 (step 86). 94), and proceeds to the next step. For example, in step 94, the rotation direction and the rotation amount about the predetermined axis direction of the terminal device 2 in the reference posture (for example, the directions of the vertical, horizontal, front-rear axes of the terminal device 2 in the reference posture) are calculated, The posture data Dc is updated. Since the rotation direction can be represented by whether the rotation amount is positive or negative, only the data indicating the rotation amount may be stored in the posture data Dc. For example, in step 94, the CPU 5 adds a rotation amount based on the angular velocity data acquired in step 94 of this time to the rotation amount calculated in step 94 in the previous process to calculate a new rotation amount.

Next, the CPU 5 sets the posture of the virtual camera C1 in the virtual space by rotating it from the initial posture by the rotation amount calculated in step 94 (step 95), and advances the processing to the next step. For example, the CPU 5 sets the attitude of the virtual camera C1 from the initial attitude to the X-axis direction of the virtual space (the virtual camera in the initial attitude in the same amount as the rotation amount about the left-right axis direction of the terminal device 2 calculated in step 94). C1 is rotated about the x-axis, and the amount of rotation about the vertical axis of the terminal device 2 calculated in step 94 is the same as the rotation amount of the Y-axis in the virtual space (the virtual camera C1 in the initial posture). The rotation amount is about the y-axis direction, and the amount of rotation about the longitudinal axis direction of the terminal device 2 calculated in step 94 is the same as the Z-axis direction of the virtual space (the z-axis of the virtual camera C1 in the initial posture). The rotation direction is set as an axis and the setting is performed, and the data regarding the posture of the virtual camera C1 in the virtual camera data De is updated.

Next, the CPU 5 determines whether or not the user has given a direction (step 96). For example, the CPU 5 refers to the data acquired in step 93, and when the operation on the direction indicator of the terminal device 2 is performed (for example, the operation of tilting the left analog stick 13A in any direction is performed. If it is), it is determined that the direction is instructed. Then, the CPU 5 advances the processing to step 97 when the direction is instructed. On the other hand, when the direction is not instructed (for example, when the left analog stick 13A is in the neutral state), the CPU 5 advances the process to step 99.

In step 97, the CPU 5 calculates the offset amount and the direction in accordance with the direction instruction using the direction instruction section, and advances the processing to the next step. For example, the CPU 5 calculates the amount and direction of offset of the display range according to the angle and direction in which the left analog stick 13A falls, and updates the offset data Dd using the calculated offset amount and direction. Specifically, the viewing angle that is offset from the angle at which the analog stick is tilted from the neutral state is calculated, and the offset amount and the direction are calculated so that the display range is offset by the viewing angle in the direction in which the analog stick is tilted. The viewing angle to be offset may be the same as the angle at which the analog stick is tilted, or may be the angle obtained by multiplying the angle by a predetermined coefficient.

Next, the CPU 5 further rotates the posture of the virtual camera C1 set in step 95 in the virtual space in the offset direction calculated by the offset amount calculated in step 97 (step 98). , Proceeds to step 100. For example, the CPU 5 uses the vertical and horizontal directions (x-axis and y-axis directions) of the virtual camera C1 set in step 95 as the vertical and horizontal references, and sets the line-of-sight direction (the positive z-axis direction) as the front surface in step 97. The virtual camera C1 is further rotated in the calculated offset direction by the offset amount calculated in step 97 from the posture set in step 95, and the virtual camera data De regarding the posture of the virtual camera C1 is set. Update.

On the other hand, in step 99, the CPU 5 sets the offset amount to 0, sets the posture of the virtual camera C1, and advances the processing to step 100. For example, when the offset amount in the offset data Dd is set to other than 0, the CPU 5 updates the offset data Dd by setting the offset amount to 0. Further, the CPU 5 keeps the attitude of the virtual camera C1 as the attitude set in step 95.

In step 100, the CPU 5 generates an image (virtual space image) of the inner surface of the stereo model viewed from the virtual cameras C1 and C2, and advances the processing to the next step. For example, the CPU 5 updates the virtual space image data De using the data indicating the virtual space images generated based on the virtual cameras C1 and C2, respectively.

Next, the CPU 5 transmits, to the terminal device 2, the virtual space image created based on the virtual camera C1 among the virtual space images indicated by the virtual space image data De (step 101), and proceeds to the next step. .. For example, the virtual space image is received by the terminal device 2 and output to the LCD 11 to display the virtual space image. As a result, the LCD 11 displays an image within the predetermined display range as viewed from the virtual camera C1 among the panoramic images. In addition, when transmitting the virtual space image from the information processing device 3 to the terminal device 2, a predetermined compression process may be performed. In this case, the data of the virtual space image subjected to the compression process is sent to the terminal device 2, and the terminal device 2 performs a predetermined decompression process, and then the virtual space image is displayed.

Next, the CPU 5 outputs the virtual space image created based on the virtual camera C2 among the virtual space images indicated by the virtual space image data De to the monitor 4 (step 102), and advances the processing to the next step. For example, the virtual space image is acquired by the monitor 4 and the virtual space image is displayed. As a result, of the panoramic image, the image within the predetermined display range viewed from the virtual camera C2 is displayed on the monitor 4. Further, in the above-described embodiment, since the virtual camera C2 is fixed and arranged at the reference position while maintaining the initial posture, the display range of the panorama image in which the predetermined direction (for example, the front direction) is fixed as the viewing direction is set. The image is displayed on the monitor 4, and the panoramic video is reproduced on substantially the same time axis and displayed on the terminal device 2 and the monitor 4.

Next, the CPU 5 increments the number of frames n (step 103), and determines whether or not to end the process (step 104). The conditions for ending the processing include, for example, that the reproduction of the image of the last frame in the panoramic video being reproduced has ended, that the user has performed an operation to end the processing, and the like. If the process is not ended, the CPU 5 returns to step 91 to repeat the process, and if the process is ended, the process according to the flowchart is ended. After that, a series of processing from step 91 to step 104 is repeatedly executed until it is determined in step 104 that the processing is to be ended.

In addition, when a panoramic image in a fixed line-of-sight direction (for example, the front direction) is displayed on the monitor 4 and the reference positions and the initial postures of the virtual cameras C1 and C2 are set to be the same, the depth direction of the LCD 11 of the terminal device 2 is changed. By facing the monitor 4, the panoramic image in the line-of-sight direction (front direction) can be displayed on the LCD 11. Further, by matching the change in the attitude of the terminal device 2 and the change in the attitude of the virtual camera C1, the orientation of the terminal device 2 in the real space and the line-of-sight direction of the virtual camera C1 in the virtual space match. That is, the display range to be displayed on the terminal device 2 and the display range to be displayed on the monitor 4 are set in accordance with the positional relationship between the terminal device 2 and the monitor 4 in the real space. By looking at the displayed panoramic image and the panoramic image displayed on the monitor 4, the space represented by these panoramic images can be felt more realistically. Here, when the display range displayed on the terminal device 2 is offset by a direction instruction according to an operation on the direction instruction unit, it is conceivable that the relationship between the above-described positional relationship and each display range is broken. However, by stopping the direction indicating operation using the direction indicating unit, the offset of the display range is canceled and the display range corresponding to only the attitude change of the terminal device 2 is set. It becomes possible to easily return the relationship with the range to the original relationship again.

An image (omnidirectional image) showing the entire panoramic image may be constantly displayed on the monitor 4. For example, the omnidirectional image may be generated by synthesizing images obtained from an imaging camera that captures a panoramic video, or may be generated by synthesizing panoramic images attached to the inner surfaces of the stereo model. However, since the method of generating the omnidirectional image is already known, detailed description thereof is omitted here. Further, the panoramic image displayed on the terminal device 2 may be displayed on the monitor 4 as it is. In this case, the panoramic image displayed on the terminal device 2 may be displayed on the monitor 4 in real time, and when the same panoramic video is reproduced in the past using the terminal device 2, the terminal device is reproduced in the reproduction. Of the panoramic images displayed on the display 2, the panoramic image displayed on the terminal device 2 at the present time may be displayed on the monitor 4 on the panoramic image having substantially the same time axis in the panoramic video reproduction.

Further, in the above-described embodiment, the information processing system 1 has a configuration having only one terminal device 2, but the information processing system 1 may have a configuration having a plurality of terminal devices 2. That is, the information processing device 3 can wirelessly communicate with each of the plurality of terminal devices 2, transmits image data to each terminal device 2, and receives data of the operation unit 13 and the gyro sensor 15 from each terminal device 2. It may be one. Then, the virtual cameras of the respective terminal devices 2 are respectively arranged in the virtual space, the postures of the respective virtual cameras are controlled according to the postures of the respective terminal devices 2 and the direction instruction, and the image of the virtual space seen from the respective virtual cameras is displayed. Should be transmitted to each terminal device 2. Note that the information processing device 3 performs wireless communication with each of the plurality of terminal devices 2, but at this time, the information processing device 3 may perform wireless communication with each terminal device 2 in a time-division manner or frequency. The band may be divided.

Further, the terminal device 2 described above functions as a so-called thin client terminal that does not execute the series of processes described with reference to FIGS. 8 and 9 or the information processing performed by the information processing device 3. However, the terminal device 2 may be a device having a function of executing predetermined information processing (game processing) by a predetermined program (game program), such as a portable game machine. Further, in the above-described embodiment, at least a part of the series of processes executed by the information processing device 3 may be performed by the terminal device 2 or a device other than the terminal device 2. For example, when the information processing device 3 is further configured to be communicable with a device other than the terminal device 2 (for example, another server, another game device, another mobile terminal), the processing steps in the above processing are: Further, it may be executed by the cooperation of the other device. As an example, the other device may generate a virtual world or perform information processing (for example, game processing) using the virtual world, and the result of the information processing may be displayed on the terminal device 2 or the monitor 4. Conceivable. In this way, by performing at least a part of the processing steps in the above processing by another device, the same processing as the above-described processing becomes possible. Further, the above-described processing can be executed by one processor included in an information processing system including at least one information processing device or by cooperation between a plurality of processors. Further, in the above embodiment, the CPU 5 of the information processing apparatus 3 executes a predetermined program to perform the processing according to the above-described flowchart, but a part of the above processing is performed by a dedicated circuit included in the information processing apparatus 3. All may be done.

Here, according to the modified example described above, the present invention can be realized in a so-called cloud computing system form or a distributed wide area network and local network system form. For example, in a distributed local network system configuration, the above-described processing is performed in cooperation between a stationary information processing device (stationary game device) and a portable information processing device (portable game device). It is also possible to do. In these system configurations, it is needless to say that the device that performs the process of each step of the above-described process is not particularly limited, and the present invention can be realized regardless of the process sharing.

Further, it goes without saying that the present embodiment can be realized even if the processing order, the set value, the condition used for the determination, and the like used in the above-described information processing are merely examples and other orders, values, and conditions are used.

The information processing program is not only supplied to the information processing device 3 through an external storage medium such as an optical disc-shaped storage medium or an external memory, but is also supplied to the information processing device 3 through a wired or wireless communication line. Good. The information processing program may be stored in advance in a non-volatile storage device inside the information processing device 3. As the information storage medium for storing the information processing program, a flexible disk, a hard disk, a magneto-optical disk, a magnetic tape in addition to an optical disk-shaped storage medium or a non-volatile memory similar to CD-ROM, DVD or the like. , And so on. Further, the information storage medium that stores the information processing program may be a volatile memory that stores the information processing program. Such a storage medium can be referred to as a computer-readable storage medium. For example, by causing a computer or the like to read and execute the information processing program stored in these storage media, it is possible to provide the various functions described above.

Although the present invention has been described in detail above, the above description is merely an example of the present invention in all respects, and is not intended to limit the scope thereof. It goes without saying that various improvements and modifications can be made without departing from the scope of the present invention. It is understood that the scope of the present invention should be construed only by the scope of the claims. Further, it is understood that those skilled in the art can implement an equivalent range based on the description of the present invention and common general knowledge from the description of the specific embodiments of the present invention. Further, it should be understood that the terms used in the present specification have meanings commonly used in the art, unless otherwise specified. Therefore, unless defined otherwise, all technical and technical terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. In case of conflict, the present specification, including definitions, will control.

As described above, the present invention is useful as, for example, an information processing program, an information processing apparatus, an information processing system, an information processing method, etc., for the purpose of allowing the user to easily move the display range.

1... Information Processing System 2... Terminal Device 3... Information Processing Device 4... Monitor 11... LCD
12... Touch panel 13... Operation part 14... Acceleration sensor 15... Gyro sensor

Claims (27)

An information processing program executed by a computer included in an information processing apparatus including a display unit, an operation unit capable of inputting a user operation, and a sensor that outputs data according to the movement or posture of the own device,
The computer,
Virtual camera placement means for placing a virtual camera at a predetermined position in a three-dimensional virtual space,
Model setting means for setting a model in which a virtual camera in the virtual space is arranged at a predetermined position inside thereof,
A pasting unit that reads out a panoramic image forming a panoramic video and pastes the panoramic image on the model;
A part of the panoramic image is obtained by changing only the posture of the virtual camera according to both the posture of the information processing device calculated based on the data output from the sensor and the user operation input to the operating unit. Display range setting means for setting as the display range,
An information processing program that causes a panoramic image within the display range to function as display control means for displaying on the display means. An information processing program executed by a computer included in an information processing apparatus including a display unit, an operation unit capable of inputting a user operation, and a sensor that outputs data according to the movement or posture of the own device,
The computer,
Virtual camera placement means for placing a virtual camera at a predetermined position in a three-dimensional virtual space,
Model setting means for setting a model in which a virtual camera in the virtual space is arranged at a fixed position inside thereof,
A pasting unit that reads out a panoramic image forming a panoramic video and pastes the panoramic image on the model;
The panorama image is changed by changing the attitude of the virtual camera at the fixed position in accordance with both the attitude of the information processing device calculated based on the data output from the sensor and the user operation input to the operation unit. Display range setting means for setting a part of the display range,
An information processing program that causes a panoramic image within the display range to function as display control means for displaying on the display means. The information processing program according to claim 1 or 2 , wherein the pasting unit sequentially reads the panoramic images forming the panoramic video and sequentially pastes the panoramic images on a surface of the model on the virtual camera side. The display range setting unit, in response to a predetermined user input operation, sets a range including a predetermined direction with respect to the model as the display range, the information processing program according to any one of claims 1 to 3. Based on the posture of the information processing device at a predetermined timing before or at the start of reproduction of the panoramic video, the computer is further caused to function as a reference posture setting means for setting a reference posture of the information processing device,
The display range setting means is responsive to both a rotation direction and a rotation amount of the information processing apparatus from the reference posture calculated based on data output from the sensor, and a user operation input to the operation means. The information processing program according to any one of claims 1 to 4 , wherein a part of the panoramic image attached to the model is set as the display range by changing the posture of the virtual camera. The operation means is capable of user operation input by touching the display screen of the display means,
The display range setting unit, in response to a user operation input is slid by touching the display screen, changing the attitude of the virtual camera based on the length the slide, one of claims 1 to 5 The information processing program described in 1 above. The display range setting unit, in response to said amount of the sum of manipulated variable and using the change amount of the operation means of the posture of the information processing apparatus, changing the attitude of the virtual camera, any of claims 1 to 6 The information processing program described in 1 above. The virtual camera placement means places the virtual camera with a posture of the virtual camera having a range including a predetermined direction with respect to the model as the display range as a reference posture,
The information processing program according to any one of claims 1 to 7 , wherein the display range setting unit changes the posture of the virtual camera with the reference posture as a reference. The pasting means, so that a predetermined direction of the panoramic image in a predetermined direction of the model matches, pasting the panoramic image to the model, the information of any one of claims 1 to 8 Processing program. The information processing program according to claim 9 , wherein the predetermined direction of the panoramic image is a front direction when the panoramic video is captured. The information processing program according to claim 9 , wherein the front direction of the panoramic video is a moving direction in a state of capturing the panoramic video. The display range setting means,
Attitude display range setting means for setting the display range in accordance with the attitude of the information processing device calculated based on the data output from the sensor,
A display range offset means for offsetting the display range set by the posture display range setting means in accordance with a user operation input to the operation means,
It said display control means displays the panorama image in the display range the offset on the display unit, information processing program according to claim 1 or 2. The operation means includes direction indicating means capable of performing direction indicating operations in at least two directions,
The display range offset means, said offset of the display range in the direction indicated by the direction instruction operation with respect to the direction instructing means, information processing program according to claim 1 2. The posture display range setting means sets the display range by changing the posture of the virtual camera according to the posture of the information processing device,
The display range offset means offsets the display range by changing the viewing direction of the virtual camera in the direction indicated by the direction instruction operation with respect to the direction instructing means, information processing program according to claim 1 3. The display range offset means, wherein when the direction instruction operation with respect to the direction instructing means has not been performed, to 0 the amount of offset the display range, the information processing program according to claim 1 3 or 1 4. The direction indicating means, when performing the direction indicating operation, can simultaneously indicate a direction and a size with respect to the direction,
The display range offset means, said offset of the display range by the the indicated direction offset amount corresponding to the magnitude indicated by the direction instruction operation with respect to the direction instructing means, any one of claims 1 3 to 1 5 The information processing program described in 1. The direction indicating means is capable of instructing a tilt direction from the neutral state and a tilt angle from the neutral state at the same time by tilting a predetermined member from the neutral state,
The information processing program according to claim 16 , wherein the display range offset means offsets the display range in a direction according to the tilt direction by an offset amount according to the tilt angle. The display range offset means offsets the display range by the offset amount corresponding to the duration of the direction instruction operation has been performed to the indicated direction with respect to the direction instructing means, one of claims 1 to 3 to 1 5 The information processing program described in 1 above. The display range offset means is the viewing angle of the panoramic image, and less than 180 ° the offset amount that enables the offset of the display range, the information processing according to any one of claims 1 2 to 1 8 program. The display range offset means, when gripping the information processing device among the operating means, offsets the display range in accordance with a user operation input to an operating means operable by a user holding the information processing device, the information processing program according to any one of claims 1 2 to 1 9. 21. The information processing according to claim 20 , wherein when the user holds both ends of the information processing device with both hands, the operation unit operable by the user can be operated with one of the fingers of the holding user. program. Display means,
Operation means capable of user operation input,
A sensor that outputs data according to the movement or posture of the device itself,
Virtual camera placement means for placing a virtual camera at a predetermined position in a three-dimensional virtual space,
Model setting means for setting a model in which a virtual camera in the virtual space is arranged at a predetermined position inside thereof,
A pasting unit that reads out a panoramic image forming a panoramic video and pastes the panoramic image on the model;
A part of the panoramic image is obtained by changing only the posture of the virtual camera according to both the posture of the information processing device calculated based on the data output from the sensor and the user operation input to the operating unit. Display range setting means for setting as the display range,
An information processing apparatus, comprising: a display control unit that displays a panoramic image within the display range on the display unit. Display means,
Operation means capable of user operation input,
A sensor that outputs data according to the movement or posture of the device itself,
Virtual camera placement means for placing a virtual camera at a predetermined position in a three-dimensional virtual space,
Model setting means for setting a model in which a virtual camera in the virtual space is arranged at a fixed position inside thereof,
A pasting unit that reads out a panoramic image forming a panoramic video and pastes the panoramic image on the model;
The panorama image is changed by changing the attitude of the virtual camera at the fixed position in accordance with both the attitude of the information processing device calculated based on the data output from the sensor and the user operation input to the operation unit. Display range setting means for setting a part of the display range,
An information processing apparatus, comprising: a display control unit that displays a panoramic image within the display range on the display unit. Display means,
Operation means capable of user operation input,
A sensor that outputs data according to the movement or posture of the device itself,
Virtual camera placement means for placing a virtual camera at a predetermined position in a three-dimensional virtual space,
Model setting means for setting a model in which a virtual camera in the virtual space is arranged at a predetermined position inside thereof,
A pasting unit that reads out a panoramic image forming a panoramic video and pastes the panoramic image on the model;
A part of the panoramic image is obtained by changing only the posture of the virtual camera according to both the posture of the information processing device calculated based on the data output from the sensor and the user operation input to the operating unit. Display range setting means for setting as the display range,
An information processing system, comprising: a display control unit that displays a panoramic image within the display range on the display unit. Display means,
Operation means capable of user operation input,
A sensor that outputs data according to the movement or posture of the device itself,
Virtual camera placement means for placing a virtual camera at a predetermined position in a three-dimensional virtual space,
Model setting means for setting a model in which a virtual camera in the virtual space is arranged at a fixed position inside thereof,
A pasting unit that reads out a panoramic image forming a panoramic video and pastes the panoramic image on the model;
The panorama image is changed by changing the attitude of the virtual camera at the fixed position in accordance with both the attitude of the information processing device calculated based on the data output from the sensor and the user operation input to the operation unit. Display range setting means for setting a part of the display range,
An information processing system, comprising: a display control unit that displays a panoramic image within the display range on the display unit. One processor or a plurality of processors included in an information processing system including at least one information processing device including a display unit, an operation unit capable of inputting a user operation, and a sensor that outputs data according to the movement or posture of the own device. An information processing method executed by cooperation between processors of
A virtual camera placement step of placing a virtual camera at a predetermined position in a three-dimensional virtual space,
A model setting step for setting a model in which a virtual camera in the virtual space is arranged at a predetermined position inside thereof,
A pasting step of reading a panoramic image forming a panoramic video and pasting the panoramic image to the model;
A part of the panoramic image is obtained by changing only the posture of the virtual camera according to both the posture of the information processing device calculated based on the data output from the sensor and the user operation input to the operating unit. Display range setting step to set as the display range,
A display control step of displaying a panoramic image within the display range on the display means. One processor or a plurality of processors included in an information processing system including at least one information processing device including a display unit, an operation unit capable of inputting a user operation, and a sensor that outputs data according to the movement or posture of the own device. An information processing method executed by cooperation between processors of
A virtual camera placement step of placing a virtual camera at a predetermined position in a three-dimensional virtual space,
A model setting step for setting a model in which the virtual camera in the virtual space is arranged at a fixed position inside thereof,
A pasting step of reading a panoramic image forming a panoramic video and pasting the panoramic image to the model;
The panorama image is changed by changing the attitude of the virtual camera at the fixed position in accordance with both the attitude of the information processing device calculated based on the data output from the sensor and the user operation input to the operation unit. Display range setting step to set a part of
A display control step of displaying a panoramic image within the display range on the display means.

Images