WO2018173286A1 - Information processing system - Google Patents

Abstract

The purpose of the present invention is to provide a screen sharing technique for reducing transmission data amount and achieving higher-speed processing. On the basis of information relating to a movement operation command and the like transmitted from a controller 2, a position/angle identifying unit 121 identifies, as a predetermined position, the standing position (coordinates in a map) of a moving object in a virtual space. On the basis of various sensing information from a sensor unit 17, the position/angle identifying unit 121 identifies, as a predetermined angle, an angle indicating a direction the moving object is facing in the virtual space. An image acquisition unit 104 acquires data of an image corresponding to the predetermined position and the predetermined angle from an image database 600. An HMD display control unit 105 causes a display unit 16 to display an image showing a scene that is visible when the moving object, such as a user, stands at the predetermined position and faces the direction at the predetermined angle in the virtual space. A communication control unit 103 transmits position information, angle information, and the like to a display terminal 3 to achieve sharing the displayed image.

Description

Information processing system

The present invention relates to an information processing system.

In recent years, with the development of information technology, for example, screen sharing technology for sharing screens in a plurality of terminals, such as a video conference and a large-scale symposium, has attracted attention.
Also, for example, when a man and woman who are thinking about marriage choose a wedding hall at a wedding salon, instead of simply looking at the pamphlet, they can experience an image of the actual wedding hall, or adjust the wedding ceremony accordingly. Receiving explanations from salon staff is extremely effective in getting an image of the actual wedding hall.
In this regard, a screen sharing technique for sharing a screen among a plurality of terminals has been proposed (see, for example, Patent Documents 1 and 2).
For example, according to the technique described in Patent Document 1, the image data of each frame is divided into a plurality of blocks, and only the block in which the image data is changed is shared with the other terminal. Furthermore, according to the technique described in Patent Document 2, the transmission control apparatus determines the block size in accordance with the processing capability of the terminal that receives the image data.

JP 2005-269272 A Japanese Patent No. 2009-245254

However, in either case of the technique described in Patent Document 1 or the technique described in Patent Document 2, when there is a change in the image data, the terminal that receives the block whose content has been changed is used. There was a need to send.
Therefore, in either case of the technique described in Patent Document 1 or the technique described in Patent Document 2, the amount of data (image data) transmitted from the transmitting terminal to the receiving terminal has increased. It was.

The present invention has been made in view of such a situation, and an object of the present invention is to provide a screen sharing technique that suppresses the amount of data to be transmitted and realizes faster processing.

In order to achieve the above object, the first terminal (HMD of the consultant in the first and second embodiments. The female HMD in the third embodiment) and the second terminal (first and second embodiments). In the information processing system including the terminal for the staff of the wedding salon (HMD on the male side in the third embodiment),
For each of a plurality of positions in a virtual space (for example, a virtual space corresponding to an actual wedding hall), a data group of a plurality of images indicating the state of the virtual space when the viewpoint is changed at that position is stored. One or more storage devices
The first terminal is
A specifying means for specifying a predetermined position of a predetermined movement target (such as a user or a character) in the virtual space and a predetermined angle with reference to the predetermined position;
First image acquisition means for acquiring data of an image to be displayed on the first terminal side from at least one of the one or more storage devices based on the predetermined position and the predetermined angle specified by the specifying means. When,
First communication control means for performing control to transmit the information that can specify the predetermined position and the predetermined angle specified by the specifying means to the second terminal at least once;
With
The second terminal is
Second communication control means for executing control for receiving the information transmitted from the first terminal;
Based on the predetermined position and the predetermined angle specified by the information received by the control of the second communication control means, image data to be displayed on the second terminal side is stored in the one or more storage devices. Second image acquisition means for acquiring from at least one;
Is provided.

The information processing method and program of one embodiment of the present invention are a method and program corresponding to the information processing system of one embodiment of the present invention.

According to the present invention, it is possible to provide a screen sharing technique that reduces the amount of data to be transmitted and realizes faster processing.

It is a figure which shows the structure of the information processing system which concerns on one Embodiment of this invention. It is a block diagram which shows an example of the hardware constitutions of HMD among the information processing systems of FIG. It is a block diagram which shows an example of the hardware constitutions of a display terminal among the information processing systems of FIG. It is a functional block diagram which shows an example of a functional structure for implement | achieving a screen sharing process among the functional structures of HMD of FIG. 2, and the display terminal of FIG. It is a figure which shows an example of the map of the virtual space utilized in HMD of FIG. 4, and a display terminal. It is a flowchart explaining the flow of the screen sharing process performed by HMD of FIG. It is a flowchart explaining the flow of the screen sharing process performed by the display terminal of FIG. FIG. 5 is a functional block diagram illustrating an example of a functional configuration for realizing screen sharing processing among the functional configurations of the HMD in FIG. 2 and the display terminal in FIG. 3, which is an example different from the example in FIG. 4. It is an example of the structure of the information processing system which concerns on one Embodiment of this invention, and is a figure which shows the example different from the example of FIG.

[First embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram showing an overview of an information processing system according to the first embodiment of the present invention.

First, prior to describing an embodiment of the present invention, a service (hereinafter referred to as “the present service”) to which an information processing system according to an embodiment of the present invention is applied will be briefly described.
That is, this service is a service provided to a consultant U at a wedding salon, for example, and the staff S can appropriately experience from the staff S while migrating in a selectable wedding hall. This service can receive explanations.

Specifically, for example, the consultant U wears an HMD (Head Mounted Display) 1 on the head, so that the scenery seen when standing in a predetermined position in a desired wedding hall and facing a predetermined direction, more accurately Can visually recognize an image such as a photograph of the scenery.
Note that the image is not limited to a photograph actually taken, and a generated image such as a CG image or an AR image may also be included.
In the following, when the term “image” is simply used, it includes both “moving image” and “still image”.
Furthermore, when the consultant U wants to move within the wedding hall, more precisely, when he wants to move within the virtual space corresponding to the wedding hall, the counselor U performs a predetermined operation on the controller 2 (hereinafter referred to as “moving operation”). By doing, the standing position can be changed.
Moreover, the consultant U can change the direction by actually moving his / her head when he / she wants to change the direction in which he / she faces (the direction of the line of sight).
That is, the consultant U moves the head of the controller 2 and actually moves his / her head (HMD1) so that the person in the wedding hall can see when he / she looks in the desired direction at the desired standing position. You can see the scenery.

Here, in order for the staff S to give an appropriate explanation to the counselor U about the wedding hall where the counselor U is experiencing the movement, etc., the scenery that the counselor U is viewing ( It is necessary to grasp the photograph of the scenery). Therefore, the display terminal 3 displays the scenery (photograph showing the scenery) viewed by the consultant U.

As described above, the information processing system of FIG. 1 according to the embodiment of the present invention includes the HMD 1 and the controller 2 used for the consultant U and the display terminal 3 used for the staff S.
The HMD 1, the controller 2, and the display terminal 3 are connected to each other via a predetermined network N. The form of the network N is not particularly limited, and for example, Bluetooth (registered trademark), Wi-Fi, LAN (Local Area Network), the Internet, or the like can be adopted.

The information processing system of FIG. 1 having such a configuration, as described above, is an image that the counselor U is viewing (a scene in the wedding hall where the counselor U is performing a simulated experience such as movement). Photo) can be shared between the HMD 1 and the display terminal 3.

Here, as a method of sharing the image, a method of sharing the image by transmitting data of the image visually recognized by the consultant U from the HMD 1 to the display terminal 3 may be employed. However, the amount of data to be transmitted increases, and high-speed processing becomes difficult. For this reason, it may be difficult to adopt the HMD 1.

Therefore, in the present embodiment, the following method is adopted as a method for sharing an image.
That is, although not shown in FIG. 1, for each of a plurality of positions in the virtual space corresponding to the actual wedding hall, a plurality of images showing the state of the virtual space when the viewpoint is changed at that position. It is assumed that there is one or more storage devices in which data groups are stored.
Each of the HMD 1 and the display terminal 3 is assumed to be able to acquire image data from at least one of the one or more storage devices. Although details will be described later, the storage device 18 (image DB 600) in the HMD 1 of FIG. 4 and the storage unit 49 (image DB 900) of the display terminal 3 of FIG. Yes.
Under such a premise, the HMD 1 specifies the standing position and angle of the consultant U in the virtual space.
Here, the angle is an angle that represents the direction of a vector indicating the viewpoint of the consultant U starting from the standing position of the consultant U.
In the present embodiment, the angle is acquired by various sensors (for example, a sensor unit 17 described later) such as an angle sensor and a viewpoint sensor built in the HMD 1. Therefore, in this embodiment, the posture of the user's head specified by the angle sensor and the direction of the user's line of sight (viewpoint direction) specified by the viewpoint sensor are “angles”.
The relationship between various image data stored in the image DB 600 and the image DB 900 and “angle” will be described in detail with reference to FIG.
Based on the standing position and angle specified in this way, the HMD 1 obtains image data to be displayed on the HMD 1 side from at least one of the one or more storage devices (the image DB 600 in FIG. 4 described later). get.
Further, the HMD 1 transmits information that can specify the standing position and the angle specified in this way to the display terminal 3. The display terminal 3 specifies the standing position and the angle based on the information transmitted from the HMD 1. Based on the standing position and the angle, the display terminal 3 transmits image data to be displayed on the display terminal 3 side from at least one of the above-described one or more storage devices (image DB 900 in FIG. 4 described later). Get from.

In this embodiment, such a method is adopted as a method for sharing an image. Therefore, the amount of data transmitted to the display terminal 3 to be shared is reduced, and high-speed processing of the entire information processing system is possible. Thereby, adoption of HMD1 becomes possible easily.
That is, since the provider of this service can easily adopt the HMD1, the consultant U can experience a more realistic image of a wedding hall.
Note that such an image sharing method is particularly suitable for sharing images in VR (Virtual Reality) display and AR (Augmented Reality) display in the HMD 1.

FIG. 2 is a block diagram showing an example of the hardware configuration of the HMD in the information processing system of FIG.

The HMD 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, a display unit 16, a sensor unit 17, A storage unit 18, a communication unit 19, and a drive 20 are provided.

The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 18 to the RAM 13.
The RAM 13 appropriately stores information necessary for the CPU 11 to execute various processes.

The CPU 11, ROM 12 and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. A display unit 16, a sensor unit 17, a storage unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.

The display unit 16 is composed of various liquid crystal displays and displays various images such as photographs in the wedding hall.
The sensor unit 17 includes various sensors such as an inclination sensor, an acceleration sensor, and an angular velocity sensor, and acquires various detection information related to an angle (direction) in the virtual space, for example.
The storage unit 18 includes various data groups such as a plurality of image data groups each showing the state of the virtual space when the viewpoint is changed at each position in the virtual space corresponding to the actual wedding hall. Store information.
The communication unit 19 communicates with another device (for example, the display terminal 3 in FIG. 1) via the network N, for example.

The controller 2 is also connected to the input / output interface 15.
The controller 2 is an input device that receives an instruction operation (for example, a movement operation) by a user (such as the consultant U in FIG. 1) when the CPU 11 of the HMD 1 executes various processes. In the present embodiment, the controller 2 is connected to the input / output interface 45 of the HMD 1. Connected. Thus, for example, the CPU 11 receives an input from the controller 2 when a movement operation is performed by a user (such as the consultant U in FIG. 1), and acquires a standing position in the virtual space that the user desires to share. be able to.

The drive 20 is provided as necessary. The drive 20 is composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, and a removable medium 21 is appropriately attached. The program read from the removable medium 21 by the drive 20 is installed in the storage unit 18 as necessary. In addition, the removable medium 21 can also store various information stored in the storage unit 18 in the same manner as the storage unit 18.

FIG. 3 is a block diagram showing an example of the hardware configuration of the display terminal 3 in the information processing system of FIG.

The display terminal 3 is composed of a tablet terminal or the like.
The display terminal 3 includes a CPU 41, a ROM 42, a RAM 43, a bus 44, an input / output interface 45, a touch operation input unit 46, a display unit 47, an input unit 48, a storage unit 49, and a communication unit 50. The drive 51 is provided.

The CPU 41 executes various processes according to a program recorded in the ROM 42 or a program loaded from the storage unit 49 to the RAM 43.
The RAM 43 appropriately stores information necessary for the CPU 41 to execute various processes.

The CPU 41, the ROM 42, and the RAM 43 are connected to each other via a bus 44. An input / output interface 45 is also connected to the bus 44. A touch operation input unit 46, a display unit 47, an input unit 48, a storage unit 49, a communication unit 50, and a drive 51 are connected to the input / output interface 45.

The touch operation input unit 46 includes, for example, a capacitance type or resistance film type (pressure sensitive) position input sensor stacked on the display unit 47, and detects the coordinates of the position where the touch operation is performed.
The display unit 27 includes various liquid crystal displays, and in the present embodiment, displays the same image as the image displayed on the display unit 16 (FIG. 2) of the HMD 1 such as various images such as photographs in the wedding hall. .
Thus, in this embodiment, the touch operation input unit 46 and the display unit 47 constitute a touch panel.
The storage unit 49 is configured with a hard disk or the like, and for each of a plurality of positions in the virtual space corresponding to an actual wedding hall, a plurality of images showing the state of the virtual space when the viewpoint is changed at that position Various information such as a data group is stored. That is, in this embodiment, the viewpoint is changed at each position in the virtual space corresponding to the actual wedding hall by the storage unit 18 (FIG. 2) of the HMD 1 and the storage unit 49 of the display terminal 3. In this case, a plurality of image data groups indicating the state of the virtual space are shared.
The communication unit 50 communicates with other devices (for example, the HMD 1 in FIG. 1) via the network N.

The drive 51 is provided as necessary. The drive 51 is composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like, and a removable medium 52 is appropriately attached. The program read from the removable medium 52 by the drive 51 is installed in the storage unit 49 as necessary. The removable medium 52 can also store various information stored in the storage unit 49 in the same manner as the storage unit 49.

The screen sharing process can be executed by the cooperation of the various hardware and software of the HMD 1 and the display terminal 3.
Screen sharing processing refers to data of one or more images indicating the state of each virtual space when the viewpoint is changed at each position in the virtual space corresponding to the actual wedding hall (for example, On the premise that there is one or more storage devices in which one omnidirectional image data or a plurality of image data groups) is stored, between a plurality of hardware (for example, the HMD 1 and the display terminal 3), By identifying the position information (standing position) about the predetermined moving object and the angle information based on the predetermined position, the specified position of the predetermined moving object and the angle from the position are specified. A series of processes for sharing images to be displayed on hardware.
In the first embodiment, the position information and the angle information are transmitted from the HMD 1 to the display terminal 3. However, the present invention is not particularly limited to this.
That is, the HMD 1 and the display terminal 3 have a functional configuration as shown in FIG. 4 when executing the screen sharing process.
FIG. 4 is a functional block diagram showing an example of a functional configuration for realizing the screen sharing process among the functional configurations of the HMD 1 in FIG. 2 and the display terminal 3 in FIG.

As shown in FIG. 4, in the CPU 11 of the HMD 1, a map management unit 101, an icon unit 102, a communication control unit 103, an image acquisition unit 104, and an HMD display control unit 105 function.
A map DB 500 and an image DB 600 are provided in one area of the storage unit 18 of the HMD 1.

The map management unit 101 of the HMD 1 uses a map of a virtual space (for example, the virtual space of the wedding hall in FIG. 5) presented as an image to a user such as the consultant U in FIG. 1 such as a consultant U or a character or the like) in the virtual space.
Map information (information that can identify each position in the virtual space) is stored in the map DB 500 and is used by the map management unit 101. The map information will be described later with reference to FIG.

The map management unit 101 is provided with a position angle specifying unit 121.
The position angle specifying unit 121 specifies a predetermined position (standing position) for a predetermined movement target and a predetermined angle based on the predetermined position in the virtual space corresponding to the wedding hall.
That is, the position angle specifying unit 121 specifies the standing position (coordinates in the map) of the movement target in the virtual space based on information such as a movement operation command transmitted from the controller 2. The position angle specifying unit 121 outputs information indicating the standing position in the movement target virtual space (hereinafter referred to as “position information”).
Further, the position angle specifying unit 121 specifies an angle indicating the direction in which the moving object is facing in the virtual space based on various sensing information of the sensor unit 17. The position angle specifying unit 121 outputs information indicating the angle in the virtual space specified in this way (hereinafter referred to as “angle information”).

The icon unit 102 manages icons displayed in a superimposed manner on an image showing a direction viewed from each position in a map managed by the map management unit 101.
Here, the icon refers to an icon displayed superimposed on an image. For example, a symbol such as an arrow (symbol, character, etc.) is an example of an icon, and a message such as “Please turn right” is also an example of an icon (which does not actually exist but exists only in the virtual space) A signboard is an example of an icon.

The image acquisition unit 104 acquires image data to be displayed on the HMD 1 side from the image DB 600 based on the predetermined position and the predetermined angle specified by the position angle specifying unit 121, that is, based on the position information and angle information described above. To do.
The HMD display control unit 105 performs control for causing the display unit 16 to display an image acquired as data by the image acquisition unit 104. That is, in the virtual space, an image showing a landscape that is seen when a moving object such as a user stands at the standing position specified by the position information described above and faces the angle specified by the angle information described above is displayed. Displayed on the part 16.
Further, when the icon unit 102 provides an icon or information that can identify the icon, the HMD display control unit 105 performs control to superimpose the icon on the display target image and display the icon on the display unit 16.

The communication control unit 103 sends the information that can specify the predetermined position and the predetermined angle specified by the position angle specifying unit 121, that is, the above-described position information and angle information to the display terminal 3 via the communication unit 19 at least once. Execute the control to send.
Although details will be described later, on the display terminal 3 side as well, in this way, in the image displayed on the HMD 1 side, that is, in the virtual space, the moving object such as the user stands at the standing position specified by the position information described above. It is possible to share the display of an image showing a landscape that can be seen when facing the direction of the angle specified by the angle information.
Here, the position information and the angle information may be transmitted at least once. The position information and the angle information may be transmitted every time, but the position information and the angle information are transmitted once, and thereafter, Information indicating the relative position with respect to the predetermined position specified by the position information (that is, difference information, hereinafter referred to as “relative position information”), and information indicating the relative angle with respect to the relative angle specified by the angle information (that is, difference information) (Hereinafter referred to as “relative angle information”), the standing position and angle of the moving object in the virtual space can be specified on the display terminal 3 side. As described above, by transmitting the relative position information and the relative angle information, it is possible to reduce the amount of data at the time of transmission compared to the case of transmitting the position information and the angle information every time.
However, since the error increases when the relative position and the relative angle are transmitted many times, actually, the position information and the angle information are transmitted to the display terminal 3 when an appropriate condition is satisfied. It is good to do so.
Here, an appropriate condition is not particularly limited, and for example, a condition based on the detection result of the sensor unit 17 of the HMD 1, for example, the following condition can be employed.
That is, for example, a condition for transmitting position information or angle information may be when acceleration or angular acceleration is not zero, or when velocity or angular velocity is not zero, respectively.
Further, for example, when the speed is 0, the position information and the relative position information may not be transmitted to the display terminal 3. Similarly, when the angular velocity is 0, the angle information and the relative angle information may not be transmitted to the display terminal 3.

In contrast to such a functional configuration such as the HMD 1, the CPU 41 of the display terminal 3 has a communication control unit 201, a map management unit 202, an icon unit 203, an image acquisition unit 204, and a display display control unit 205. And function.
In one area of the storage unit 49 of the display terminal 3, a map DB 800 and an image DB 900 are provided.

When the HMD 1 transmits information that can specify a predetermined position and a predetermined angle, that is, the above-described position information and angle information, relative position information, or relative angle information, the communication control unit 201 transmits these information to the communication unit 50. To get through.
In addition, when the icon or information that can identify the icon is transmitted from the HMD 1, the communication control unit 201 acquires this via the communication unit 50.

The map management unit 202 uses the same map as the HMD 1 side, that is, a map of a virtual space (for example, the virtual space of the wedding hall in FIG. 5) presented and displayed as an image to a user such as the consultant U in FIG. The standing position (coordinates in the map) of the predetermined movement target (a user such as the consultant U in FIG. 1 or a character) in the virtual space is managed.
Map information (information that can identify each position in the virtual space) is stored in the map DB 800 and is used by the map management unit 202. The map information will be described later with reference to FIG.

The map management unit 202 is provided with a position angle specifying unit 211.
The position angle specifying unit 211 specifies a predetermined position (standing position) for a predetermined movement target and a predetermined angle based on the predetermined position in a virtual space corresponding to the wedding hall.
That is, the position angle specifying unit 211 is based on the information transmitted from the HMD 1 and acquired by the communication control unit 201 via the communication unit 50, that is, the above-described position information and angle information, relative position information, or relative angle information. The standing position (coordinates in the map) of the moving object in the virtual space and the angle indicating the direction in which the moving object is facing in the virtual space are specified.

The icon unit 203 receives from the HMD 1 an icon that should be displayed superimposed on an image showing a direction viewed from each position in the map managed by the map management unit 202, or information that can identify the icon. When acquired by the communication control unit 201 via the communication unit 50, the icon or information that can identify the icon is acquired and managed.

Based on the predetermined position and the predetermined angle specified by the position angle specifying unit 211, the image acquisition unit 204 receives image data to be displayed on the display terminal 3 side, that is, image data to be shared with the HMD 1 side from the image DB 900. get.
The display display control unit 205 executes control for causing the display unit 47 to display an image acquired as data by the image acquisition unit 204. That is, the same image as the image displayed on the HMD 1 side, specifically, for example, in a virtual space, a moving object such as a user stands at the above-mentioned predetermined position (standing position) and in the above-described direction of the predetermined angle. An image showing a landscape seen when facing is displayed on the display unit 47.
Further, when the icon unit 203 manages the icon or information that can identify the icon, the display display control unit 205 performs control to display the icon on the display unit 47 by superimposing the icon on the display target image. .

Next, with reference to FIG. 5, the details of the information shared and stored by the HMD 1 and the display terminal 3 will be described.
FIG. 5 is a diagram illustrating an example of a virtual space map used in the HMD 1 and the display terminal 3 in FIG. 4.

In the example of FIG. 5, a wedding hall is adopted as an example of a virtual space. In other words, the virtual space is a virtual space imitating a wedding hall that a wedding hall staff (for example, staff S in FIG. 1) introduces to a consultant (for example, the consultant U in FIG. 1). A counselor (for example, counselor U in FIG. 1) receives an explanation from the staff of the wedding hall as appropriate while wearing the HMD1 and operating the controller 2 while mimicking the movement in the wedding hall. Can do.
Here, according to the map of FIG. 5, 4 positions “P1”, “P2”, “P3”, and “P4” are positions where movement targets such as a consultant can move in the virtual space. Two positions are set. That is, the map management unit 101 and the map management unit 202 manage the coordinates on the map respectively indicating the four positions “P1”, “P2”, “P3”, and “P4”.
In the image DB 600 of the HMD 1 and the image DB 900 of the display terminal 3, each of the positions when the viewpoint is changed at each position of “P1”, “P2”, “P3”, and “P4”. A plurality of image data groups indicating the state of the virtual space are stored.

More specifically, in the image DB 600 and the image DB 900, a counselor (for example, the counselor U in FIG. 1) has the positions “P1”, “P2”, “P3”, and “P4” at the wedding hall. A plurality of image data groups indicating the state when the 360-degree viewpoint is changed are stored.
Note that the data group of these images is stored in the image DB 600 and the image DB 900 in association with the above-described position (for example, “P1”). In each position (for example, “P1”), an image corresponding to which data in the image data group is displayed (acquired by the image acquisition unit 204) is set for each angle. . That is, the image data group and the angle are associated with each other.

Here, the association between the image data group and the angle will be described. As described above, the angle is an angle that represents the direction of a vector indicating the viewpoint of the moving object starting from the standing position of the moving object (for example, the consultant U in FIG. 1) in the virtual space.
As an angle used for association with the image data group stored in the image DB 600 and the image DB 900, for example, at a predetermined height (for example, 170 cm) at a predetermined position (for example, “P1”), It is assumed that there is a starting point of a vector indicating the viewpoint (hereinafter referred to as a “viewpoint vector”), and the viewpoint vector at each posture of the movement target is set as the reference vector at the reference posture of the movement target, and the reference vector The angle made is adopted. Also, image data seen by the moving object is set for each posture of the moving object. In this way, the angle is associated with the image data.
Various DBs in which the image data groups associated with the respective positions and angles exist in advance in the HMD 1 and the display terminal 3 (in the example of FIG. 4, the image DB 600 of the HMD 1 and the image DB 900 of the display terminal 3). It is assumed that it is stored in Under such a premise, the image sharing between the HMD 1 and the display terminal 3 can be realized only by sharing the position information and the angle information between the HMD 1 and the display terminal 3.

Next, the screen sharing process executed by the HMD 1 in FIG. 4 will be described with reference to FIG.
That is, FIG. 6 is a flowchart for explaining the flow of screen sharing processing on the HMD 1 side in FIG.

In step S <b> 1, the position angle specifying unit 121 specifies a predetermined position for a predetermined movement target (a user such as a consultant U in FIG. 1 or a character) in a virtual space corresponding to the wedding hall.
That is, the position angle specifying unit 121 specifies the standing position (coordinates in the map) of the movement target in the virtual space as a predetermined position based on information such as a movement operation command transmitted from the controller 2. Further, the position angle specifying unit 121 outputs position information indicating the predetermined position specified in this way.

In step S2, the position angle specifying unit 121 specifies a predetermined angle with reference to a predetermined position in the virtual space corresponding to the wedding hall specified in step S2.
That is, the position angle specifying unit 121 specifies an angle indicating a direction in which the moving object is facing in the virtual space as a predetermined angle based on various sensing information of the sensor unit 17. The position angle specifying unit 121 outputs angle information indicating the predetermined angle specified in this way.

In step S3, the image acquisition unit 104 acquires image data corresponding to the predetermined position specified in step S1 and the predetermined angle specified in step S2 from the image DB 600.

In step S4, the HMD display control unit 105 causes the display unit 16 to display the image acquired as data in step S3.
That is, in the virtual space, an image showing a landscape that can be seen when a moving object such as a user stands at the predetermined position described above and faces in the direction of the predetermined angle described above is displayed on the display unit 16.
Note that the HMD display control unit 105 causes the display unit 16 to display an icon superimposed on the display target image as necessary.

In step S5, the communication control unit 103 is information that can specify the predetermined position specified in step S1 and the predetermined angle specified in step S2, that is, position information and angle information or relative position information and relative angle information (hereinafter, referred to as “position information”). (Referred to as “position information and angle information”) is transmitted to the display terminal 3 via the communication unit 19.
Of the position information and the angle information, the position information or the relative position information is hereinafter referred to as “position information or the like”, and the angle information or the relative angle information is hereinafter referred to as “angle information or the like”.

In step S <b> 6, the CPU 11 of the HMD 1 determines whether there is an instruction to end the process.
Here, an instruction to end the process is not particularly limited, but in this embodiment, an instruction to shift the HMD 1 to a so-called sleep state or the like is employed. That is, unless the HMD 1 is instructed to shift to the sleep state or the like, NO is determined in step S6, the process returns to step S1, and the subsequent processes are repeated.
On the other hand, when an instruction to shift to the sleep state or the like is given in the HMD 1, it is determined as YES in Step S6, and the screen sharing process is ended.

Next, a screen sharing process executed by the display terminal 3 will be described with reference to FIG.
That is, FIG. 7 is a flowchart for explaining the flow of screen sharing processing on the display terminal 3 side in FIG.
In this embodiment, information is transferred from the HMD 1 to the display terminal 3 in one direction. In the screen sharing process illustrated in FIG. 7, the display terminal 3 acquires the position information and the angle information transmitted from the HMD 1 in the screen sharing process illustrated in FIG. 6, and based on the position information and the angle information, Share.

In step S21, the communication control unit 201 of the display terminal 3 acquires the position information and the angle information transmitted from the HMD 1 via the communication unit 50.

In step S22, the position angle specifying unit 211 specifies the standing position (coordinates in the map) of the movement target in the virtual space as a predetermined position based on the position information acquired in step S21.

In step S23, the position angle specifying unit 211 specifies, as a predetermined angle, an angle indicating a direction in which the moving object is facing in the virtual space, based on the angle information acquired in step S21.

In step S24, the image acquisition unit 204 acquires, from the image DB 900, image data corresponding to the predetermined position specified in step S22 and the predetermined angle specified in step S23.

In step S25, the display display control unit 205 causes the display unit 47 to display the image acquired as data in step S24.
That is, an image showing a landscape seen when a moving object such as a user who uses the HMD1 stands at the predetermined position described above and faces the predetermined angle described above, in other words, an image displayed on the HMD1 side. Is displayed on the display unit 47 of the display terminal 3.
Note that the display display control unit 205 causes the display unit 47 to display an icon superimposed on an image to be displayed as necessary.

In step S26, the CPU 41 of the display terminal 3 determines whether or not there has been an instruction to end the process. Here, the instruction to end the process is not particularly limited, but in this embodiment, an instruction to shift the display terminal 3 to a so-called sleep state or the like is employed. That is, unless the display terminal 3 is instructed to shift to the sleep state or the like, NO is determined in step S26 and the process returns to step S21, and the subsequent processes are repeated.
On the other hand, when the display terminal 3 is instructed to shift to the sleep state or the like, it is determined as YES in Step S26, and the screen sharing process ends.

[Second Embodiment]
In the first embodiment described above, image sharing is realized by transmitting position information, angle information, and the like from the HMD 1 to the display terminal 3.
However, in realizing image sharing, it is not always necessary to transmit position information, angle information, and the like from the HMD 1 to the display terminal 3. For example, position information and the like can be transmitted from the display terminal 3 to the HMD 1. That is, the second embodiment in which the HMD 1 and the display terminal 3 transmit and receive position information and the like in both directions may be employed.
By adopting the second embodiment, the provider of this service can provide a wider range of screen sharing services.

Here, the system configuration of the second embodiment is the same as the system configuration of the first embodiment of FIG. That is, the information processing system according to the second embodiment also includes the HMD 1, the controller 2, and the display terminal 3. The hardware configurations of the HMD 1 and the display terminal 3 in the second embodiment are the same as those in the first embodiment shown in FIG. 2 and FIG.

FIG. 8 is an example of a functional configuration for realizing the screen sharing process among the functional configurations of the HMD 1 in FIG. 2 and the display terminal 3 in FIG. 3, and shows a different example from the example in FIG. 4. It is a block diagram.

As shown in FIG. 8, in the CPU 11 of the HMD 1, a map management unit 101, an icon unit 102, a communication control unit 103, an image acquisition unit 104, and an HMD display control unit 105 function.
A map DB 500 and an image DB 600 are provided in one area of the storage unit 18 of the HMD 1.
Further, in the CPU 41 of the display terminal 3, a communication control unit 201, a map management unit 202, an icon unit 203, an image acquisition unit 204, and a display display control unit 205 function.
In one area of the storage unit 49 of the display terminal 3, a map DB 800 and an image DB 900 are provided.
Various functional configurations other than the communication control unit 103 and the communication control unit 201 are the same as those in the first embodiment. Therefore, only the communication control unit 103 and the communication control unit 201 will be described here, and description of other functional blocks will be omitted here.

The communication control unit 103 of the HMD 1 performs control for transmitting position information, angle information, and the like to the display terminal 3 as in the first embodiment, and in the second embodiment, is transmitted from the display terminal 3 side. Control is also performed to receive the received position information.
Similarly, the communication control unit 201 of the display terminal 3 performs control for receiving position information, angle information, and the like transmitted from the HMD 1 as in the first embodiment, and further in the second embodiment, in the HMD 1 Control for transmitting position information and the like is also executed.

Here, instead of transmitting position information and angle information from the display terminal 3 to the HMD 1, transmission of only position information and the like is permitted and transmission of angle information is prohibited.
This is because when the display of the image on the HMD 1 side is controlled based on the angle information from the display terminal 3, the display image changes even though the user (consultant or the like) of the HMD 1 does not move his / her head. This is because the display image changes in a direction different from the direction in which its head is moved, resulting in intoxication.
That is, when there is a possibility that the user of the HMD 1 is intoxicated, only the position information from the display terminal 3 is shared on the HMD 1 side and angle information is not shared in order to reduce the sickness. In other words, position information is shared in both directions between the display terminal 3 and the HMD 1, and angle information is shared only in one direction from the HMD 1 to the display terminal 3.

In addition, if the wearer of HMD1 is not intoxicated, the angle information may be shared from the display terminal 3 to the HMD1 side. Here, the state in which the user of HMD1 is hard to get sick is a state in which the head of the wearer of HMD1 is not moving but the display image changes (display images that move in a predetermined direction are sequentially displayed), or In this state, the angle of the display image (screen angle) on the display terminal 3 is moving.
Therefore, if it is determined that the angle of the head of the user of the HMD 1 is not moving based on the detection result of the sensor unit 17 of the HMD 1, or if the angle of the display image on the display terminal 3 side is not moving. If it is determined, it is also possible to transmit position information, angle information, and the like from the display terminal 3 to the HMD 1 (sharing of angle information).

Thus, in 2nd Embodiment, HMD1 and the display terminal 3 have a functional structure which can transmit / receive position information, angle information, etc. mutually. However, in communication from the display terminal 3 to the HMD 1, transmission of angle information is prohibited in principle to prevent sickness of the wearer of the HMD 1.
Thereby, in the image displayed on either the HMD 1 side or the display terminal 3 side, that is, in the virtual space, the movement target of the user or the like stands at the standing position specified by the position information or the like, and the angle information or the like described above. It is possible to share the display of an image showing a landscape that can be seen when facing the direction of the specified angle.
[Third embodiment]
In the first embodiment described above, image sharing is realized by transmitting position information, angle information, and the like from the HMD 1 to the display terminal 3 in one direction. Furthermore, in 2nd Embodiment mentioned above, HMD1 and the display terminal 3 implement | achieved sharing of an image by transmitting / receiving a positional information, angle information, etc. bidirectionally.
However, such image sharing is not necessarily performed only between one HMD 1 and one display terminal 3.
That is, in the third embodiment, between the P terminals (P is an arbitrary integer value of 1 or more) HMD1 and the Q terminals (Q is an arbitrary integer value of 1 or more independent of P). Images are shared.

For example, in the example of FIG. 9, the HMD1-M used by a predetermined consultant M (for example, a man who will be a groom) and the HMD1-M used by another consultant W (for example, a woman who will be a bride). Images are shared between W and the display terminal 3.
FIG. 9 is an example of a configuration of an information processing system according to an embodiment of the present invention, and is a diagram illustrating an example different from the example of FIG.

The information processing system of FIG. 9 according to an embodiment of the present invention includes an HMD 1-M and a controller 2-M used for the consultant M, an HMD 1-W and a controller 2-W used for the consultant W, The display terminal 3 used for the staff S is provided.
1, the HMD 1-M, the controller 2-M, the HMD 1-W, the controller 2-W, and the display terminal 3 are connected to each other via a predetermined network N.

The information processing system of FIG. 9 having such a configuration is an image described by the staff S of the wedding salon (an image showing the scenery in the wedding hall where the consultants M and W have a simulated experience such as movement). Can be shared among the HMD1-M, the HMD1-W, and the display terminal 3.

Here, the image sharing between the HMD 1-M and the display terminal 3 and the image sharing between the HMD 1-W and the display terminal 3 are the same as those in the second embodiment, so the description thereof is omitted here. To do.
When sharing an image between the HMD 1-M and the HMD 1-W, the image can also be shared by transmitting position information, angle information, and the like from one to the other. However, since the HMD 1 is usually worn directly on the head, the user of the HMD 1 (for example, the consultant M in FIG. 9) may get drunk if the display image changes abruptly. That is, when the consultant W moves his / her head and the display image changes in the HMD 1 -W, if the change in the display image is shared on the HMD 1 -M side, the consultant M does not move his / her head. Nevertheless, the display image may change drastically and get drunk.
Therefore, in order to prevent the sickness of the consultant M, the sharing of angle information or the like is prohibited between the HMD 1-M and the HMD 1-W, and only the position information or the like may be shared.

In summary, in the first embodiment and the second embodiment, one HMD 1 functions as the following first terminal, and one display terminal 3 functions as the following second terminal.
That is, for each of a plurality of positions in a virtual space (for example, a virtual space corresponding to an actual wedding hall), data of one or more images showing the state of each virtual space when the viewpoint is changed at that position is obtained. Embodiments according to an information processing system including a first terminal and a second terminal that can acquire image data from at least one of one or more stored storage devices are the first embodiment and the second embodiment. Each of the embodiments.

On the other hand, in the third embodiment (for example, in the example of FIG. 9), the HMD1-W of the consultant W functions as the first terminal, and the HMD1-M of the consultant M functions as the second terminal. In this case, although not shown, the first terminal and the second terminal have the same functional configuration as the HMD 1 in FIG.

Here, in the third embodiment, sharing of position information and the like is indispensable for sharing images between the first terminal and the second terminal, but sharing of angle information and the like may be arbitrary in order to prevent sickness.

For example, the communication control unit 103 of the first terminal permits at least one time transmission of information that can specify the predetermined position specified by the position angle specifying unit 121, that is, position information, to the second terminal. . On the other hand, the communication control unit 103 of the first terminal executes control for prohibiting transmission of information that can specify the predetermined angle specified by the position angle specifying unit 121, that is, angle information, to the second terminal. .
This prevents the user of the second terminal (the consultant M in the example of FIG. 9) from getting drunk because the display image is changed even though his / her head is not moved.

Alternatively, for example, the communication control unit 103 of the first terminal in the third embodiment satisfies a predetermined condition for information that can specify a predetermined angle specified by the position angle specifying unit 121, that is, angle information and the like. In some cases, control may be executed to allow transmission to the second terminal, and otherwise prohibit transmission to the second terminal.
That is, the angle is shared between the first terminal and the second terminal, but not continuously, but intermittently. Also in this case, the user of the second terminal (the consultant M in the example of FIG. 9) is prevented from getting drunk because the display image is changed even though his / her head is not moved.

Here, if the angle of the second terminal does not move, that is, if the head of the user wearing the second terminal (the consultant M in the example of FIG. 9) does not move, the display image due to the change of the angle is displayed. Even if it changes, the user does not get drunk. Therefore, as the above-described predetermined condition for permitting transmission of angle information or the like to the second terminal, a condition for determining that the second terminal is not moving may be employed. That is, the angle is not shared only when the second terminal (HMD1-M in the example of FIG. 9) sharing the information of the first terminal (HMD1-W in the example of FIG. 9) is moving. .

The various technologies that do not share the angles for preventing the above sickness have been described by taking the case where both the first terminal and the second terminal in the third embodiment are HMD1, but the application destination is limited to this. As described above, the present invention is applicable to the case where the first terminal in the second embodiment is the HMD 1 and the second terminal is the display terminal 3, and position information is transmitted from the display terminal 3 to the HMD 1. It is.

Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, and the like within a scope that can achieve the object of the present invention are included in the present invention. is there.

For example, in the above-described embodiment, an example of a wedding salon has been described as the service, but the present invention is not particularly limited thereto. In other words, the information processing system according to an embodiment of the present invention is applied in every scene where a technique for sharing an image seen by a moving object that can move in a virtual space, such as a video conference or a large-scale symposium, can be applied. Is possible.

Further, for example, in the third embodiment, the two HMDs (first terminal and second terminal) do not share angle information or the like at least partially to prevent sickness.
The method of sharing an image between the two HMDs in this case is not particularly limited. For example, for the user of the second terminal (for example, the consultant M in FIG. 9), the user of the first terminal ( For example, a method may be employed in which the consultant W) in FIG. 9 speaks and urges the consultant M to face the angle.
Further, for example, a method of displaying an icon or the like that informs the user of the desired angle on the second terminal side may be adopted.
Further, for example, in order to share the image displayed on the first terminal side on the second terminal side, the direction of the second terminal may be shaken when facing the wrong direction, or the direction that the user of the second terminal does not want Various guidance such as displaying darkly or displaying the direction that the user of the second terminal wants to face if the user moves to the next place (for example, the position P2 is the next place with respect to the current position P1 in the example of FIG. 5). A method of setting a function can also be adopted.
For such various guidance functions, the user of the second terminal (for example, the consultant M in the example of FIG. 9) displays an image (image to be shared) displayed on the first terminal side according to the guidance function instruction. It is also possible to provide a function that feeds back whether or not it is facing the direction. As a result, the other person (the consultant W or the staff S in the example of FIG. 9) recognizes whether the user of the second terminal (the consultant M in the example of FIG. 9) firmly follows the guidance function instruction. Can be easily done.

In addition, for example, when the provider of this service can perform bidirectional transmission / reception of position information, angle information, and the like for image sharing between the first terminal and the second terminal, the first terminal and the second terminal It is also possible to set a priority for which display image to be shared.
For example, when a man (consultant M in the example of FIG. 9) and a woman (consultant W in the example of FIG. 9) simultaneously instruct to change the display image, the instruction on the female side may be given priority. In addition, for example, when a plurality of persons instruct to change the display image at the same time, a button for giving the first priority may be provided on the controller or the like. That is, the instruction of the person who pressed the button is adopted with the first priority, and the display image to be shared by a plurality of people changes.

Further, for example, in the above-described embodiment, the storage device (for example, the storage unit 18 in FIG. 2) that stores data of various images has been described as being incorporated in each hardware of the HMD or the display terminal. It is not limited to this.
That is, a storage device for storing various image data may be provided separately from the hardware of the HMD or the display terminal.

Further, for example, in the above-described embodiment, the provider of this service freely sets the interval for transmitting / receiving position information, angle information, and icon display status between various types of hardware (for example, the display terminal 3 from the HMD 1). be able to. For example, information may be exchanged about 30 times per second, and relative information (difference information) can be used as described above.

Further, for example, in the above-described embodiment, the image is shared between the first terminal and the second terminal, but the image sharing here means that the subject (object) shares the same image. It is. That is, it is only necessary that the user of the first terminal and the user of the second terminal can visually recognize the same scenery in the virtual space.
That is, for example, the resolution of the image displayed on the first terminal and the image displayed on the second terminal may be different.
Further, for example, the icon displayed on the first terminal while being superimposed on the image may be different from the icon displayed on the second terminal while being superimposed on the image. In general, the amount of information, that is, the icon or the like is larger when the staff explaining the consultant visually recognizes the information than when viewed by the consultant (user of the first terminal) moving in the virtual space. A large number is preferable.
In summary, the first terminal executes control for displaying the image on the display device on the first terminal side based on the data of the image of the first data amount, while the second terminal On the basis of the image data of the independent second data amount, control for displaying the image on the display device on the second terminal side may be executed.

Further, for example, in the above-described embodiment, an icon is superimposed on an image shared between the first terminal and the second terminal, but what is displayed together with the image is particularly limited to the icon. Any symbol can be adopted.
Furthermore, in order to share the display of symbols such as icons between the first terminal and the second terminal, in the above-described embodiment, one-way communication from the first terminal to the second terminal of the symbol or information that can identify the symbol is possible. However, the present invention is not particularly limited to this, and it may be one-way communication from the second terminal to the first terminal, or two-way communication between the first terminal and the second terminal.

For example, the series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configurations of FIGS. 4 and 8 are merely examples, and are not particularly limited.
That is, it is sufficient that the information processing system has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function are particularly shown in the examples of FIGS. It is not limited. Further, the location of the functional block is not particularly limited to that shown in FIGS. 4 and 8, and may be arbitrary.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

For example, when a series of processing is executed by software, a program constituting the software is installed in a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware.
Further, the computer may be a computer that can execute various functions by installing various programs, for example, a server, a smartphone, a personal computer, or various devices.

In addition, for example, the recording medium including such a program is not only constituted by a removable medium (not shown) distributed separately from the apparatus main body in order to provide the program to the user, but is also incorporated in the apparatus main body in advance. And a recording medium provided to the user.

In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.
Further, in the present specification, the term “system” means an overall apparatus configured by a plurality of devices, a plurality of means, and the like.

In other words, the information processing system to which the present invention is applied can take various embodiments having the following configurations.
That is, an information processing system to which the present invention is applied is
The first terminal (HMD of the consultant in the first and second embodiments. The female HMD in the third embodiment) and the second terminal (the staff terminal of the wedding salon in the first and second embodiments) In the information processing system including the HMD on the male side in the third embodiment,
For each of a plurality of positions in a virtual space (for example, a virtual space corresponding to an actual wedding hall), a data group of a plurality of images indicating the state of the virtual space when the viewpoint is changed at that position is stored. One or more storage devices (for example, the storage unit 18 in FIG. 2 or the storage unit 49 in FIG. 3),
The first terminal is
A specifying unit (for example, a position angle specifying unit 121 in FIG. 4) that specifies a predetermined position of a predetermined moving object (such as a user or a character) in the virtual space and a predetermined angle with reference to the predetermined position;
First image acquisition means for acquiring data of an image to be displayed on the first terminal side from at least one of the one or more storage devices based on the predetermined position and the predetermined angle specified by the specifying means. (For example, the image acquisition unit 104 in FIG. 4);
First communication control means (for example, the communication control unit 103 in FIG. 4) that executes control to transmit the information that can specify the predetermined position and the predetermined angle specified by the specifying means to the second terminal at least once. )When,
With
The second terminal is
A second communication control means (for example, the communication control unit 201 in FIG. 4) that executes control to receive the information transmitted from the first terminal;
Based on the predetermined position and the predetermined angle specified by the information received by the control of the second communication control means, image data to be displayed on the second terminal side is stored in the one or more storage devices. It suffices to include second image acquisition means (for example, the image acquisition unit 204 in FIG. 4) that acquires from at least one.

As a result, it is possible to provide a screen sharing technique that suppresses the amount of data to be transmitted and realizes faster processing.
That is, the image data itself is not transmitted from the first terminal (for example, HMD 1 in FIG. 1) to the second terminal (for example, display terminal 3 in FIG. 1), and the position information and angle information of the user or the like in the virtual space. By sharing only such limited data and sharing images, it is possible to increase the processing speed.

DESCRIPTION OF SYMBOLS 1 ... HMD, 2 ... Controller, 3 ... Display terminal, 11 ... CPU, 17 ... Sensor part, 41 ... CPU, 101 ... Map management part, 102 ... Icon part 103 ... Communication control part 104 ... Image acquisition part 105 ... HMD display control part 121 ... Position / angle determination part 201 ... Communication control part 202 ... Map management unit 203 ... Icon unit 204 ... Image acquisition unit 205 ... Display display control unit 211 ... Position / angle determination unit 500 ... Map DB 600 ... Image DB, 800 ... map DB, 900 ... image DB

Claims (11)

1. In an information processing system including a first terminal and a second terminal,
   For each of a plurality of positions in the virtual space, the apparatus includes one or more storage devices that store data of one or more images indicating the state of the virtual space when the viewpoint is changed at the position,
   The first terminal is
   A first specifying means for specifying a predetermined position for a predetermined movement target in the virtual space and a predetermined angle with reference to the predetermined position;
   A first image that acquires data of an image to be displayed on the first terminal side from at least one of the one or more storage devices based on the predetermined position and the predetermined angle specified by the first specifying means. Acquisition means;
   First communication control means for executing control to transmit the information specifying the predetermined position and the predetermined angle specified by the first specifying means to the second terminal at least once;
   With
   The second terminal is
   Second communication control means for executing control for receiving the information transmitted from the first terminal;
   Based on the predetermined position and the predetermined angle specified by the information received by the control of the second communication control means, image data to be displayed on the second terminal side is stored in the one or more storage devices. Second image acquisition means for acquiring from at least one;
   Comprising
   Information processing system.
2. The first communication control means of the first terminal is
   Executing control to transmit the predetermined position and the predetermined angle specified by the first specifying means to the second terminal at a timing satisfying a first condition;
   The difference between the predetermined position and the predetermined angle specified by the first specifying means at a timing satisfying the second condition and the predetermined position and the predetermined angle transmitted to the second terminal in the past (that is, relative position and Control to transmit the relative angle) to the second terminal;
   The information processing system according to claim 1.
3. The first terminal further includes detection means for outputting at least one detection amount among speed, acceleration, angular velocity, and angular acceleration,
   The first condition is a condition when the detected amount is not 0,
   The second condition is a condition that the detected amount is 0.
   The information processing system according to claim 2.
4. The first terminal further includes detection means for outputting at least one detection amount among speed, acceleration, angular velocity, and angular acceleration,
   Each of the first condition and the second condition includes at least a condition that the detected amount is not 0,
   The information processing system according to claim 2.
5. The second terminal is
   A second specifying means for specifying a predetermined position of another moving object different from the predetermined moving object in the virtual space and a predetermined angle with reference to the predetermined position;
   The second image acquisition unit of the second terminal further stores data of an image to be displayed on the second terminal side based on the predetermined position and the predetermined angle specified by the second specifying unit. Obtained from at least one of the above storage devices,
   The second communication control unit of the second terminal further transmits at least one time the information specifying the predetermined position and the predetermined angle specified by the second specifying unit to the first terminal. Run
   The first communication control means of the first terminal further executes control to receive the information transmitted from the second terminal;
   The first image acquisition unit of the first terminal is further configured on the first terminal side based on the predetermined position and the predetermined angle specified by the information received by the control of the first communication control unit. Obtaining image data to be displayed from at least one of the one or more storage devices;
   The information processing system according to any one of claims 1 to 4.
6. The first terminal is an HMD;
   The second communication control means of the second terminal permits the information that can specify the predetermined position specified by the second specifying means to be transmitted to the first terminal at least once, and For information that can specify the predetermined angle specified by the second specifying means, further executes control for prohibiting transmission to the first terminal,
   The information processing system according to claim 5.
7. The second communication control unit of the second terminal transmits information that can specify the predetermined angle specified by the second specifying unit to the first terminal when a predetermined condition is satisfied. And execute a control for prohibiting transmission to the first terminal in other cases.
   The information processing system according to claim 6.
8. The predetermined condition is a condition for determining that the first terminal is not moving.
   The information processing system according to claim 7.
9. The first terminal and the second terminal are
   Control for adding a predetermined symbol to the image acquired as data by the first image acquisition unit or the second image acquisition unit and displaying the image on the display device on the first terminal or the second terminal side Further comprising display control means for executing
   The first communication control means of the first terminal and the second communication control means of the second terminal further execute transmission / reception control of the predetermined symbol;
   The information processing system according to any one of claims 1 to 8.
10. The display control means of the first terminal performs control to display the image on the display device on the first terminal side based on the data of the image of the first data amount,
    The display control means of the second terminal executes control to display the image on the display device on the second terminal side based on image data of a second data amount independent of the first data amount. ,
    The information processing system according to claim 9.
11. Each of the first terminal and the second terminal further includes at least one of the one or more storage devices independently of each other,
    The information system according to any one of claims 1 to 10.

Images