JP7007515B2 - Information processing equipment, information processing methods, and programs - Google Patents

Description

The present invention relates to an information processing apparatus, an information processing method, and a program.

In recent years, head-mounted displays (hereinafter referred to as "HMDs") have rapidly developed, and users have the opportunity to observe VR (Virtual Reality) images and AR (Augmented Reality) images using HMDs. It is increasing. For example, Patent Document 1 discloses a technique relating to a shielded HMD in which a user wearing an HMD cannot observe an surrounding image due to the HMD.

Japanese Unexamined Patent Publication No. 2019-10133

When a plurality of users, each wearing an HMD, share and observe the same image, each user observes a virtual image presented on the HMD. When each user wears a shielded HMD, or when each user is at a distant position, it is difficult for each other to recognize which position in the image the other user is observing. .. For example, when using an HMD to display an image of the inside of a property in a remote location to provide a virtual preview, or when providing a virtual museum tour, one user is suitable for another user. It is convenient if you can know the direction you are in.

The present invention has been made in view of these points, and an object of the present invention is to provide a technique for sharing the observation direction of each user when a plurality of users wearing an HMD observe the same image. do.

The first aspect of the present invention is an information processing apparatus. This device acquires information indicating the orientation of each display device from a display device that is a plurality of display devices and each display device can display at least a part of the same virtual celestial sphere image. The orientation information acquisition unit, the orientation information transmission unit that transmits orientation information for specifying the orientation of each display device to each of the plurality of display devices, and an instruction to the other display device among the plurality of display devices. An instruction information receiving unit that receives instruction information indicating an instruction to a display device other than the display device from a display device to which the attribute to be permitted is assigned, and an instruction based on the received instruction information to each of the other display devices. It is provided with an instruction transmission unit for transmitting.

The second aspect of the present invention is also an information processing device. This device is information indicating the line-of-sight direction of the user of each display device from a display device which is a plurality of display devices and each display device can display at least a part of the same virtual celestial sphere image. The orientation information acquisition unit that acquires the orientation information, the orientation information transmission unit that transmits orientation information for specifying the line-of-sight direction of the user of each display device to each of the plurality of display devices, and the other of the plurality of display devices. The instruction information receiving unit that receives instruction information indicating an instruction to a display device other than the display device from the display device to which the attribute permitting the instruction to the display device of the above is assigned, and the instruction based on the received instruction information. It is provided with an instruction transmission unit for transmitting to each of the other display devices.

The information processing device transmits video information to each of the plurality of display devices by transmitting a part of the video cut out from the whole celestial sphere image based on the information acquired from each display device by the orientation information acquisition unit. Further units may be provided.

The information processing device further includes a video information acquisition unit that receives video identification information indicating the type of all-sky video displayed by each of the plurality of display devices from a display device to which an attribute permitting the instruction is assigned. Also, the video information transmitting unit may transmit to each of the plurality of display devices, provided that the attribute assigned to the display device corresponding to the received device identifier is the attribute that permits the instruction. The video may be switched to the video specified by the video identification information.

When the information processing device projects the direction in which each display device is facing to a point on the celestial sphere image based on the orientation information of each of the plurality of display devices, the point in the celestial sphere image. The density information transmission unit may further include information indicating the density of the device to transmit the information indicating the density of the device to the display device of the device identifier to which the attribute permitting the instruction is assigned.

The instruction transmitting unit refers to an attribute database associated with a device identifier for identifying each of the plurality of display devices and attribute information indicating an attribute assigned to each display device, and receives the instruction. When the attribute corresponding to the device identifier of the display device that is the transmission source of the information is the attribute that permits the instruction, the instruction based on the instruction information may be transmitted to each of the other display devices.

The orientation information transmission unit includes a device identifier for identifying each of the plurality of display devices, attribute information indicating attributes assigned to each display device, and orientation information transmission attributes that determine whether or not the orientation information can be transmitted. Of the orientation information of each of the plurality of display devices, the orientation information of the display device of the device identifier to which the orientation information transmission attribute is not associated is transmitted to each of the plurality of display devices by referring to the attribute database associated with the above. Instead of transmitting, the direction information of the display device of the device identifier associated with the direction information transmission attribute may be transmitted to each of the plurality of display devices.

When the information processing apparatus projects the direction in which each display device is facing onto the all-sky image based on the orientation information of each of the plurality of display devices, the distance in the all-sky image is a predetermined threshold. Further, a neighborhood direction specifying unit that specifies a combination of orientation information that is less than a distance may be further provided, and the orientation information transmitting unit may provide information other than the orientation information that constitutes the combination specified by the neighborhood direction specifying unit. It may be transmitted to each of the display devices of.

The information processing device may further include a video management unit that receives the spherical image to be provided to each of the plurality of display devices.

The instruction information may be information that causes the display device to display a point that attracts the user of the display device.

A third aspect of the present invention is an information processing method. In this method, information indicating the orientation of each display device from a display device in which the processor is a plurality of display devices and each display device can display at least a part of the same virtual all-sky image. A step of acquiring orientation information for specifying the orientation of each display device to each of the plurality of display devices, and an attribute permitting instructions to other display devices among the plurality of display devices. From the display device to which is assigned, a step of receiving instruction information indicating an instruction to a display device other than the display device and a step of transmitting an instruction based on the received instruction information to each of the other display devices. Execute.

A fourth aspect of the present invention is also an information processing method. In this method, from a display device in which the processor is a plurality of display devices and each display device can display at least a part of the same virtual celestial sphere image, the line-of-sight direction of the user of each display device. A step of acquiring information indicating the above, a step of transmitting direction information for specifying the line-of-sight direction of the user of each display device to each of the plurality of display devices, and a step of transmitting other display devices among the plurality of display devices. A step of receiving instruction information indicating an instruction to a display device other than the display device from a display device to which an attribute permitting the instruction to the display device is assigned, and an instruction based on the received instruction information to each of the other display devices. Perform the steps to send and.

A fifth aspect of the present invention is a program. This program provides information indicating the orientation of each display device from a display device capable of displaying at least a part of the same virtual all-sky image on a computer, which is a plurality of display devices. A function of acquiring, a function of transmitting orientation information for specifying the orientation of each display device to each of the plurality of display devices, and an attribute permitting instructions to other display devices among the plurality of display devices. From the display device to which is assigned, a function of receiving instruction information indicating an instruction to a display device other than the display device and a function of transmitting an instruction based on the received instruction information to each of the other display devices. make it happen.

A sixth aspect of the present invention is also a program. This program is a line-of-sight direction of a user of each display device from a display device capable of displaying at least a part of the same virtual all-sky image on a computer, which is a plurality of display devices. A function of acquiring information indicating the above, a function of transmitting direction information for specifying the line-of-sight direction of the user of each display device to each of the plurality of display devices, and a function of the plurality of display devices for other display devices. A function of receiving instruction information indicating an instruction to a display device other than the display device from a display device to which an attribute permitting the instruction is assigned, and an instruction based on the received instruction information are transmitted to each of the other display devices. To realize the function to be used.

In order to provide this program or to update a part of the program, a computer-readable recording medium on which the program is recorded may be provided, or the program may be transmitted over a communication line.

It should be noted that any combination of the above components and the conversion of the expression of the present invention between methods, devices, systems, computer programs, data structures, recording media and the like are also effective as aspects of the present invention.

According to the present invention, when a plurality of users wearing an HMD observe the same image, the observation direction of each user can be shared.

It is a figure for demonstrating the outline of the information processing apparatus which concerns on embodiment. It is a figure which shows typically the functional structure of the information processing apparatus which concerns on embodiment. It is a figure which shows the relationship of the whole celestial sphere image, the direction information, and the image schematically. It is a figure which shows typically the data structure of the attribute database which concerns on embodiment. It is a figure which shows an example of the information which shows the density of the point transmitted by the density information transmission part which concerns on embodiment. It is a flowchart for demonstrating the flow of the information processing executed by the information processing apparatus which concerns on embodiment.

<Outline of the embodiment>
The outline of the embodiment will be described. The information processing device according to the embodiment transmits a part of the spherical images cut out from the same spherical image according to the orientation of each display device to the HMDs worn by each of the plurality of users. .. At this time, the information processing apparatus according to the embodiment superimposes information for specifying the orientation of each display device on the image transmitted to each display device. As a result, the user of each display device can grasp which direction of the spherical image the other user is observing.

FIG. 1 is a diagram for explaining an outline of the information processing apparatus 1 according to the embodiment. FIG. 1 shows a display device M (first display device M1) possessed by each of the four users U (first user U1, second user U2, third user U3, and fourth user U4) of the information processing device 1. It is shown that the second display device M2, the third display device M3, and the fourth display device M4) are presented with the image I cut out from the whole celestial sphere image. In the example shown in FIG. 1, the spherical image is an image of the inside of a house. That is, in the example shown in FIG. 1, the information processing apparatus 1 provides a virtual viewing place for each user U.

In FIG. 1, the first user U1 is an explainer, for example, a real estate agent. On the other hand, the second user U2, the third user U3, and the fourth user U4 are viewing applicants. Therefore, each of the second user U2, the third user U3, and the fourth user U4 is equipped with the second display device M2, the third display device M3, and the fourth display device M4, which are HMDs, and is a house. I am observing the VR image inside the house.

On the other hand, the first display device M1 possessed by the first user U1 is a tablet-type PC (Personal Computer), and the first user U1 is not equipped with an HMD. As a result, the first user U1 can explain the inside of the house while observing the states of the second user U2, the third user U3, and the fourth user U4 who wish to view the house.

Although not shown, each HMD is provided with an orientation sensor for specifying the orientation, and can measure the orientation of the face of the user U wearing the HMD. The information processing device 1 acquires the face orientation of each user U from each HMD, and transmits the video I presented to each display device M including the information D indicating the face orientation of each user U. In FIG. 1, information D (second-direction information D2, third-direction information D3, and third direction information D2) indicating the direction in which the faces of the second user U2, the third user U3, and the fourth user U4 who wish to view the view are facing is shown. As the four-direction information D4), each inclined rectangle is superimposed on the image I. As shown in FIG. 1, the orientation information D is superimposed on the video I in a different manner for each user U.

For example, in the case of a house preview, a family member who is considering renting or purchasing the house to be viewed may preview the house. In the example shown in FIG. 1, it is assumed that the second user U2 is a husband, the third user U3 is a wife, and the fourth user U4 is a child. At this time, the first user U1 who is a real estate agent pays attention to the gaze points of the second user U2 and the third user U3 rather than the gaze points of the fourth user U4 who is a child from the viewpoint of sales. It is conceivable to proceed with the story.

Since the information processing apparatus 1 according to the embodiment displays the information D indicating the direction of the face of each user U in the video I, the first user U1 is the gazing point of the second user U2 and the third user U3. Can be grasped. Further, the information processing apparatus 1 displays information D indicating the direction of each user U's face in the video I, so that the communication between the users U (for example, the second user U2 pays attention to the third user U3). Instructions on where you want to go) can also be made smooth.

<Functional configuration of information processing device 1 according to the embodiment>
FIG. 2 is a diagram schematically showing a functional configuration of the information processing apparatus 1 according to the embodiment. The information processing device 1 includes a storage unit 2 and a control unit 3. In FIG. 2, the arrows indicate the main data flows, and there may be data flows not shown in FIG. In FIG. 2, each functional block shows not a hardware (device) unit configuration but a functional unit configuration. Therefore, the functional block shown in FIG. 2 may be mounted in a single device, or may be mounted in a plurality of devices separately. Data can be exchanged between functional blocks via any means such as a data bus, a network, and a portable storage medium.

The storage unit 2 includes a ROM (Read Only Memory) that stores a BIOS (Basic Input Output System) of a computer that realizes the information processing device 1, a RAM (Random Access Memory) that is a work area of the information processing device 1, and an OS (OS). It is a large-capacity storage device such as an HDD (Hard Disk Drive) or SSD (Solid State Drive) that stores an Operating System), an application program, and various information referred to when the application program is executed.

The control unit 3 is a processor such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit) of the information processing device 1, and by executing a program stored in the storage unit 2, the orientation information acquisition unit 30 and orientation information It functions as a transmission unit 31, an instruction information reception unit 32, an instruction transmission unit 33, a density information transmission unit 34, a proximity direction identification unit 35, a video information acquisition unit 36, a video information transmission unit 37, and a video management unit 38.

Note that FIG. 2 shows an example in which the information processing apparatus 1 is composed of a single apparatus. However, the information processing device 1 may be realized by a plurality of processors, memory, and other computational resources, such as a cloud computing system. In this case, each unit constituting the control unit 3 is realized by executing a program by at least one of a plurality of different processors.

The orientation information acquisition unit 30 acquires information indicating the orientation of each display device M from the plurality of display devices M. The information indicating the orientation is, for example, azimuth angle information. Here, each display device M is a device capable of displaying at least a part of the same virtual spherical image I, and is, for example, an HMD, a tablet PC, a smartphone, or the like. The orientation information transmission unit 31 transmits orientation information for specifying the orientation of each display device M to each of the plurality of display devices M. Hereinafter, the information attached to indicate the information indicating the orientation of each display device M in the video I may be referred to as “direction information D”. The information acquired by the orientation information acquisition unit 30 from the display device M and the orientation information D displayed in the video I are different in the form of expression, but are substantially the same information.

FIG. 3 is a diagram schematically showing the relationship between the spherical image O, the orientation information D, and the image I. The spherical image O is a panoramic image of 360 degrees up, down, left and right. Therefore, even if all the spherical images O are displayed on the display device M, which is a two-dimensional display device, at once, it does not mean that the user U is presented with an appropriate image. Therefore, the information processing device 1 cuts out the image of the portion of the spherical image O corresponding to the field of view of the user U as the image I and transmits it to the display device M.

Specifically, the information processing apparatus 1 is centered on the orientation information D (that is, the line-of-sight direction of the user U) for specifying the orientation of the user U, and the portion corresponding to the field of view of the user U is the spherical image O. It is cut out from and used as image I. As shown in FIG. 3, since the image I is a part of the spherical image O, the information processing apparatus 1 acquires the orientation information D of each of the plurality of users U and transmits the orientation information D to each display device M. The video I of each is cut out from the spherical video O.

At this time, the information processing apparatus 1 cuts out when one direction information D and another direction information D are in the vicinity, that is, the image I cut out based on the certain direction information D and another direction information D as a reference. When the video I and the video I share at least the center of the video I, the orientation information D is superimposed on each video. As a result, the information processing apparatus 1 can share the observation direction of each user U when a plurality of users U wearing the HMD observe the same image.

Returning to the description of FIG. The storage unit 2 stores an attribute database in which a device identifier for identifying each of the plurality of display devices M and attribute information indicating an attribute assigned to each display device are associated with each other. The instruction information receiving unit 32 receives instruction information indicating an instruction from the display device M of the plurality of display devices M to the device identifier of the display device M and instructions to other display devices M other than the display device M. Accept.

The instruction transmission unit 33 sends instruction information to each of the other display devices M, provided that the attribute assigned to the display device M corresponding to the received device identifier is the explainer attribute that permits the instruction to the display device M. Send.

FIG. 4 is a diagram schematically showing the data structure of the attribute database according to the embodiment. The attribute database is stored in the storage unit 2 and is managed by the instruction transmission unit 33. As shown in FIG. 4, in the attribute database, the attributes assigned to the display device M are recorded in association with the device identifier for identifying each display device M.

For example, in FIG. 4, the attribute of the display device M whose device identifier is DID00001 is "general", and the attribute of the display device M whose device identifier is DID00002 is "explainer". When the attribute of the display device M that has transmitted the instruction information is "explainer", the instruction transmission unit 33 transmits the instruction information to another display device M. When the attribute of the display device M that has transmitted the instruction information is "general", the instruction transmission unit 33 does not transmit the instruction information to the other display device M even if it receives the instruction information.

In the example of the preview shown in FIG. 1, the explainer attribute is assigned to the first display device M1 used by the first user U1. In this case, only the first user U1 who is a real estate agent can send instruction information to the second user U2, the third user U3, and the fourth user U4 who want to see the property. The instruction information is information that displays, for example, a point that the user U wants to pay attention to in the video I.

As a result, the user U of the display device M having the explainer attribute can show the attention point to the other user U. When the display device M is an HMD, the user U wearing the display device M cannot directly see the explainer. Therefore, the information processing device 1 explains by showing the point of interest in the image I. Can be done smoothly. Further, by discarding the instruction from the display device M other than the display device M having the explainer attribute, the information processing device 1 can suppress the attention points from being mixed up in the video I. The "direction information transmission" attribute in FIG. 4 will be described later.

When the density information transmission unit 34 projects the direction in which each display device M is facing to a point on the spherical image O based on the orientation information of each of the plurality of display devices M, the density information transmission unit 34 is used in the spherical image O. Information indicating the density of points is transmitted to the display device M of the device identifier associated with the explainer attribute.

FIG. 5 is a diagram schematically showing an example of information indicating the density of points transmitted by the density information transmitting unit 34 according to the embodiment. In the example shown in FIG. 5, the density information transmission unit 34 expresses information indicating the density of points in the form of a heat map and transmits the information to the first display device M1 to which the explainer attribute is attached. Specifically, in FIG. 5, the higher the density of the gaze point of each user U, the higher the luminance is represented. By confirming the information indicating the density of points on its display device M, the explainer grasps which place in the spherical image O the user U observing the image I is interested in. be able to.

The case where the directions facing each of the plurality of users U are superimposed on the image I displayed on each display device M has been described above. Here, as the number of users U sharing the same spherical image O increases, the number of orientation information D superimposed on the image I increases. Therefore, if the number of orientation information D superimposed on the image I is too large, it may be difficult to observe the image I that should be originally presented to the user U.

Therefore, when the proximity direction specifying unit 35 projects the direction in which each display device M is facing to the spherical image O based on the orientation information D of each of the plurality of display devices M, the spherical image O is used. A combination of orientation information D whose distance is less than a predetermined threshold distance is specified. The "predetermined threshold distance" is a "neighborhood determination reference" referred to by the neighborhood direction specifying unit 35 in order to determine whether or not the points projected on the spherical image O are in a neighborhood relationship. Distance ". The specific value of the predetermined threshold distance may be determined by an experiment in consideration of the number of users U who are expected to participate, the type of spherical image O, etc., but for example, the length of the short side of the image I The distance corresponds to 10% of the distance.

The orientation information transmission unit 31 transmits information other than the orientation information D constituting the combination specified by the proximity direction identification unit 35 to each of the plurality of display devices M. As a result, the orientation information D having a “neighborhood” relationship is not superimposed on the video I transmitted to each display device M, so that the user U observes the video that should be originally observed without being disturbed by the orientation information D. can do.

Here, for example, consider a case where there is a user U who is in a higher position than another user U among a plurality of users U who observe the image I. At this time, it is convenient for the user U other than the user U standing in the upper position to know the direction in which the user U standing in the upper position is observing.

Therefore, the attribute database may further store the orientation information transmission attribute that determines whether or not the orientation information D can be transmitted in association with the device identifier. In this case, the orientation information transmission unit 31 displays only the orientation information of the display device M of the device identifier associated with the orientation information transmission attribute among the orientation information D of each of the plurality of display devices M. It is transmitted to each of the devices M. As a result, the information processing apparatus 1 can share only the face orientation of the specific user U with the other user U.

The above description has been made on the premise that there is only one type of spherical image O shared by a plurality of users U. However, there may be a plurality of types of spherical images O shared by each user U. For example, when a family considering renting a house uses the information processing device 1 to preview a plurality of houses, there are a number of all-sky images O corresponding to the number of houses to be viewed. In this case, the information processing device 1 transmits the image I to the display device M while switching the spherical image O to be shared by the user U.

Here, if all the users U can freely switch the spherical image O, the image I presented on the display device M may be frequently switched. Therefore, it is convenient to be able to limit the switching of the spherical image O to some extent.

Therefore, first, the video information acquisition unit 36 receives the device identifier of the display device and the spherical image O displayed by each of the plurality of display devices M from the display device M of the plurality of display devices M. Accepts video identification information indicating the type. Subsequently, the video information transmission unit 37 refers to the attribute database and acquires the attribute corresponding to the received device identifier. The video information transmission unit 37 displays the spherical image O to be transmitted to each of the plurality of display devices M, provided that the attribute assigned to the display device M corresponding to the received device identifier is the explainer attribute. The image is switched to the image specified by the image identification information acquired by the information acquisition unit 36.

As a result, switching of the spherical image O presented to the user U is limited to the user U of the display device M having the explainer attribute, so that the image I presented to the display device M is frequently used in the information processing device 1. It is possible to suppress the situation of being switched to.

As described above, if the spherical image O shared by the plurality of users U can be freely changed, it is convenient that the spherical image O held in the information processing apparatus 1 can also be freely changed. This is because the variation of the spherical image O to be shared by a plurality of users U can be increased.

Therefore, the information processing device 1 includes 38 image management units that receive spherical images O to be provided to each of the plurality of display devices M. When the image management unit 38 receives a new spherical image O from the administrator of the information processing device 1, the image management unit 38 stores the spherical image O in the storage unit 2. Further, the image management unit 38 deletes the spherical image O stored in the storage unit 2 according to an instruction from the administrator of the information processing device 1. As a result, the information processing apparatus 1 can add or delete the spherical image O to be shared by the plurality of users U.

<Processing flow of information processing method executed by information processing device 1>
FIG. 6 is a flowchart for explaining the flow of information processing executed by the information processing apparatus 1 according to the embodiment. The process in this flowchart starts, for example, when the information processing apparatus 1 is started.

The orientation information acquisition unit 30 acquires orientation information D for specifying the orientation of each display device M from the plurality of display devices M (S2). The orientation information transmission unit 31 transmits orientation information D for specifying the orientation of each display device M to each of the plurality of display devices M (S4).

The instruction information receiving unit 32 receives instruction information indicating an instruction from the display device M of the plurality of display devices M to the device identifier of the display device M and instructions to other display devices M other than the display device M. Is accepted (S6).

In the attribute database, when the attribute assigned to the display device M corresponding to the device identifier received by the instruction information receiving unit 32 is the explainer attribute permitting the instruction to the display device M (Yes in S8), the instruction transmitting unit 33 Transmits instruction information to each of the other display devices M (S10).

In the attribute database, when the attribute assigned to the display device M corresponding to the device identifier received by the instruction information receiving unit 32 is not the explainer attribute permitting the instruction to the display device M (No in S8), or the instruction transmitting unit. When 33 transmits the instruction information to each of the other display devices M, the process in this flowchart ends.

<Effects of the information processing apparatus 1 according to the embodiment>
As described above, according to the information processing apparatus 1 according to the embodiment, when a plurality of users U wearing the HMD observe the same spherical image O, the observation direction of each user U is shared. be able to.

Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes can be made within the scope of the gist. be. For example, all or part of the device can be functionally or physically distributed / integrated in any unit. Also included in the embodiments of the present invention are new embodiments resulting from any combination of the plurality of embodiments. The effect of the new embodiment produced by the combination has the effect of the original embodiment together.

1 ... Information processing device 2 ... Storage unit 3 ... Control unit 30 ... Direction information acquisition unit 31 ... Direction information transmission unit 32 ... Instruction information reception unit 33 ... Instruction transmission unit 34 ... Density information transmission unit 35 ... Neighborhood direction identification unit 36 ... Video information acquisition unit 37 ... Video information transmission unit 38 ... Video management unit M ... Display device

Claims (14)

Direction information acquisition unit that acquires information indicating the direction of each display device from a display device that is a plurality of display devices and each display device can display at least a part of the same virtual spherical image. When,
An orientation information transmission unit that transmits orientation information for specifying the orientation of each display device to each of the plurality of display devices.
An instruction information receiving unit that receives instruction information indicating an instruction to another display device other than the display device from a display device to which an attribute permitting an instruction to another display device is assigned among the plurality of display devices.
An instruction transmission unit that transmits an instruction based on the received instruction information to each of the other display devices, and an instruction transmission unit.
Information processing device equipped with. Direction to acquire information indicating the user's line-of-sight direction of each display device from a display device having a plurality of display devices and each display device can display at least a part of the same virtual spherical image. Information acquisition department and
A direction information transmitting unit that transmits direction information for specifying the line-of-sight direction of the user of each display device to each of the plurality of display devices.
An instruction information receiving unit that receives instruction information indicating an instruction to another display device other than the display device from a display device to which an attribute permitting an instruction to another display device is assigned among the plurality of display devices.
An instruction transmission unit that transmits an instruction based on the received instruction information to each of the other display devices, and an instruction transmission unit.
Information processing device equipped with. Further provided is a video information transmission unit that transmits a part of the video cut out from the spherical image based on the information acquired from each display device by the orientation information acquisition unit to each of the plurality of display devices.
The information processing apparatus according to claim 1 or 2. Further, it is provided with a video information acquisition unit that receives video identification information indicating the type of spherical image displayed by each of the plurality of display devices from the display device to which the attribute permitting the instruction is assigned.
The video information transmitting unit transmits the spherical image transmitted to each of the plurality of display devices, provided that the attribute assigned to the display device corresponding to the received device identifier is the attribute that permits the instruction. Switch to the video specified by the video identification information,
The information processing apparatus according to claim 3 . Based on the orientation information of each of the plurality of display devices, when the direction in which each display device is directed is projected onto a point on the spherical image, information indicating the density of the point in the spherical image is displayed. Further, a density information transmission unit for transmitting to a display device of a device identifier to which an attribute permitting the instruction is assigned is provided.
The information processing apparatus according to any one of claims 1 to 4. The instruction transmitting unit refers to an attribute database associated with a device identifier for identifying each of the plurality of display devices and attribute information indicating an attribute assigned to each display device, and receives the instruction. When the attribute corresponding to the device identifier of the display device that is the transmission source of the information is the attribute that permits the instruction, the instruction based on the instruction information is transmitted to each of the other display devices.
The information processing apparatus according to any one of claims 1 to 5. The orientation information transmission unit includes a device identifier for identifying each of the plurality of display devices, attribute information indicating attributes assigned to each display device, and orientation information transmission attributes that determine whether or not the orientation information can be transmitted. Of the orientation information of each of the plurality of display devices, the orientation information of the display device of the device identifier to which the orientation information transmission attribute is not associated is transmitted to each of the plurality of display devices by referring to the attribute database associated with. Instead of transmitting, the orientation information of the display device of the device identifier associated with the orientation information transmission attribute is transmitted to each of the plurality of display devices.
The information processing apparatus according to any one of claims 1 to 6. Direction information in which the distance in the spherical image is less than a predetermined threshold distance when the direction in which each display device is facing is projected onto the spherical image based on the orientation information of each of the plurality of display devices. Further equipped with a near-direction identification part that specifies the combination of
The orientation information transmitting unit transmits information other than the orientation information constituting the combination specified by the neighborhood direction specifying unit to each of the plurality of display devices.
The information processing apparatus according to any one of claims 1 to 7. Further, a video management unit for receiving the spherical image to be provided to each of the plurality of display devices is provided.
The information processing apparatus according to any one of claims 1 to 8. The instruction information is information that causes the display device to display a point that attracts the user of the display device.
The information processing apparatus according to any one of claims 1 to 9. The processor,
A step of acquiring information indicating the orientation of each display device from a display device that is a plurality of display devices and each display device can display at least a part of the same virtual spherical image.
A step of transmitting orientation information for specifying the orientation of each display device to each of the plurality of display devices, and
A step of receiving instruction information indicating an instruction to another display device other than the display device from a display device to which an attribute permitting an instruction to another display device is assigned among the plurality of display devices.
A step of transmitting an instruction based on the received instruction information to each of the other display devices, and
Information processing method to execute. The processor,
A step of acquiring information indicating the user's line-of-sight direction of each display device from a display device having a plurality of display devices and each display device can display at least a part of the same virtual spherical image. When,
A step of transmitting direction information for specifying the line-of-sight direction of the user of each display device to each of the plurality of display devices, and
A step of receiving instruction information indicating an instruction to another display device other than the display device from a display device to which an attribute permitting an instruction to another display device is assigned among the plurality of display devices.
A step of transmitting an instruction based on the received instruction information to each of the other display devices, and
Information processing method to execute. On the computer
A function to acquire information indicating the orientation of each display device from a display device that is a plurality of display devices and each display device can display at least a part of the same virtual spherical image.
A function of transmitting orientation information for specifying the orientation of each display device to each of the plurality of display devices, and
A function of receiving instruction information indicating an instruction to another display device other than the display device from a display device to which an attribute permitting an instruction to another display device is assigned among the plurality of display devices.
A function to send an instruction based on the received instruction information to each of the other display devices, and
A program that realizes. On the computer
A function to acquire information indicating the user's line-of-sight direction of each display device from a display device that is a plurality of display devices and each display device can display at least a part of the same virtual spherical image. When,
A function of transmitting direction information for specifying the line-of-sight direction of the user of each display device to each of the plurality of display devices, and
A function of receiving instruction information indicating an instruction to another display device other than the display device from a display device to which an attribute permitting an instruction to another display device is assigned among the plurality of display devices.
A function to send an instruction based on the received instruction information to each of the other display devices, and
A program that realizes.

Images