JP2020086721A - Information processing device, information providing method, and program - Google Patents

Abstract

To improve quality of content to be presented to a user by preventing content progress from being delayed because an inappropriate information processing device is made to be a specific device relating to a plurality of information processing devices sharing an augmented reality space.SOLUTION: According to this technology, an information processing device includes an image generation part for generating an image of content which visually represents an augmented reality space constructed by arranging a virtual object in a real space, and a selection part for selecting a specific device for executing specific processing which only a specific information processing device is allowed to execute among a plurality of information processing devices on the basis of a result obtained by performing state comparison of the plurality of information processing devices including an own device and the other devices sharing the augmented reality space on the basis of state information of the own device and state information of the other devices.SELECTED DRAWING: Figure 5

Description

The present technology relates to an information processing device that generates an image of content that visually represents an augmented reality space that is constructed by arranging virtual objects in a real space, and particularly relates to an information processing device that shares an augmented reality space. The present invention relates to a technique of selecting a specific device that is an execution device of a specific process that only a specific information processing device is permitted to execute.

A VR (Virtual Reality) technology that allows a user to visually recognize an artificially constructed virtual space has been put into practical use. In recent years, AR (Augmented Reality) technology, which is a development of VR technology, is becoming widespread. The AR technique presents the user with an augmented reality space (AR space) constructed by partially modifying the real space. In a typical AR technique, a virtually generated object (virtual object) is superimposed on an image from an imaging device directed to the real space, and it is as if the virtual object exists in the real space shown in the image. A user experience is provided.

Note that as related conventional techniques, the following Patent Documents 1 and 2 can be cited.

Japanese Patent No. 5499762 Patent No. 6281495 gazette

Here, game contents can be mentioned as contents using the AR technology (hereinafter also referred to as “AR game”). Examples of the AR game include contents in which an enemy character (character) as a subjugation target is superimposed and displayed as a virtual object on a captured image obtained by capturing a real space.
When a plurality of people share and enjoy such an AR game, one of the information processing devices used as game devices by each person is set as a specific device (master device) for managing game progress. ing. Alternatively, a server device capable of communicating with each information processing device may be set as the specific device.

In the progress of the game, for example, when a player of a certain information processing device defeats an enemy character or conversely the player is defeated by an enemy character, that state is presented by another information processing device in an AR space. It is necessary to have a mechanism to reflect this in
At this time, if the above-mentioned subdue information is sequentially exchanged between the respective devices, the transmission process frequently occurs in the entire AR game system, resulting in inefficiency. Therefore, information such as the above-mentioned subdue information that should be commonly used by each device in the game progress is acquired by each specific device from each device and collectively managed. A mechanism for transmitting information to the device and sharing information is adopted.
Although the processing load on the specific device is increased by the method in which the specific device collectively manages the game progress in this way, the processing load on the devices other than the specific device is reduced, and thus the processing load on the entire system is reduced. ..

Here, when the server device is the specific device, shared information for progressing the game is exchanged via a network such as the Internet. Therefore, there is a delay in updating the state in each information processing device as the game device. There is a risk that the user experience may be impaired, such as a risk of occurrence and a loss of reality. Therefore, the specific device is preferably selected from a plurality of information processing devices sharing the AR space.

However, each information processing device may have different information processing capabilities that can be spent for game processing depending on, for example, the performance of the CPU itself and the processing load other than the game. If this happens, the update of the shared information may be delayed and the game progress may be interrupted. Further, when the communication between the information processing devices is performed by wireless communication, it is possible that the specific device is out of the communicable range, and in that case, the update of the shared information is delayed and the game progresses. There is a risk of interruption.

The present technology has been made in view of the above circumstances, and for a plurality of information processing apparatuses that share an augmented reality space, it is possible to prevent a delay in content progress due to an inappropriate information processing apparatus being a specific apparatus, and The purpose is to improve the quality of the content presented in.

An information processing apparatus according to an embodiment of the present technology includes an image generation unit that generates an image of content that visually represents an augmented reality space that is constructed by arranging virtual objects in a real space, state information of the own apparatus, and states of other apparatuses. A specific information processing device among the plurality of information processing devices based on a result of a state comparison of a plurality of information processing devices including the own device and the other device sharing the augmented reality space based on information And a selecting unit that selects a specific device that executes a specific process that is permitted to be executed.

By selecting the specific device based on the result of the state comparison of the devices sharing the augmented reality space (AR space) as described above, the information processing device in the state suitable for executing the specific process is specified. It can be defined as a device.

In the above-described information processing device according to the present technology, the content is game content that progresses in the augmented reality space, and the specific process updates information commonly used by the plurality of information processing devices during game progression. It is desirable that the process be a process of transmitting to another information processing device.

As a result, it is possible to set an information processing device in a state suitable for executing the specific process for collectively managing the game progress as the specific device.

In the information processing device according to the present technology described above, the state information is battery remaining amount information, and the selection unit selects the specific device based on a result of comparing battery remaining amounts of the plurality of information processing devices. Is desirable.

As a result, it is possible to determine, as the specific device, an information processing device that is in a state suitable for executing the specific process in terms of the remaining battery level, such as an information processing device having the highest remaining battery level.

In the above-described information processing device according to the present technology, the state information is information indicating information processing capability, and the selection unit selects the specific device based on a result of comparing information processing capabilities of the plurality of information processing devices. It is desirable to select.

As a result, it is possible to determine, as the specific device, an information processing device that is in a state suitable for executing the specific process in terms of information processing capability, such as an information processing device having the highest information processing capability.

In the above-described information processing device according to the present technology, the state information is information indicating a communication state, and the selection unit selects the specific device based on a result of comparing communication states of the plurality of information processing devices. Is desirable.

Accordingly, it is possible to determine, as the specific device, an information processing device in a state suitable for executing the specific process in terms of the communication state, such as an information processing device having the best communication state.

In the information processing device according to the present technology described above, the state information is information indicating the received field intensity in wireless communication, the selection unit, based on the result of comparing the received field intensity of the plurality of information processing device It is desirable to select a specific device.

This makes it possible to determine an information processing device, such as an information processing device having the highest received radio field intensity, in a state suitable for executing the specific process in terms of high received radio field intensity, as the specific device. ..

In the above-described information processing device according to an embodiment of the present technology, the state information is information indicating a packet loss rate for communication packets, and the selection unit is based on a result of comparing packet loss rates of the plurality of information processing devices. It is desirable to select the specific device.

As a result, it is possible to determine an information processing apparatus, such as an information processing apparatus having the lowest packet loss rate, in a state suitable for executing the specific processing in terms of the packet loss rate, as the specific apparatus.

In the above-described information processing apparatus according to the present technology, the state information is information indicating an arrangement relationship with respect to the specific virtual object in the augmented reality space, and the selection unit includes the arrangement of the plurality of information processing apparatuses. It is desirable to select the specific device based on the result of comparing the relationships.

The arrangement relationship of the information processing device (user) with respect to a specific virtual object in the AR space suggests the possibility of leaving the AR space sharing state with other devices. For example, it can be estimated that the further the information processing device is located with respect to a particular virtual object, the lower the interest of the user of the information processing device with respect to the content, and for example, when the presentation operation of the content is finished, AR It can be estimated that there is a high possibility of leaving the space sharing state. Alternatively, even when the user of the information processing device keeps his or her back to a specific virtual object, it is estimated that the user of the information processing device has a low interest in the content and is likely to leave the AR space sharing state. it can.
Therefore, by selecting the specific device based on the result of comparing the arrangement relationship of each device with respect to the specific virtual object as described above, for example, an information processing device having the lowest possibility of leaving the AR space sharing state, such as an AR It is possible to define an information processing device in a state suitable for executing the specific process in terms of the possibility of leaving the space sharing state as the specific device.

In the above-described information processing device according to the present technology, the state information is information indicating a separation distance with respect to the specific virtual object in the augmented reality space, and the selection unit includes the separation information of the plurality of information processing devices. It is desirable to select the specific device based on the result of comparing the distances.

Accordingly, for example, the information processing apparatus estimated to have the smallest separation distance and the lowest possibility of leaving the AR space sharing state performs the specific processing in terms of the possibility of leaving the AR space sharing state. It is possible to define an information processing device in a state suitable for the specific device.

In the above-described information processing device according to the present technology, the selection unit can change the state comparison frequency, which is the frequency of acquiring the state information from the other device and performing state comparison of the plurality of information processing devices. Is desirable.

When the state comparison frequency is low, the execution interval of the specific device selection performed based on the result of the state comparison becomes long, and therefore, between the execution timings of the specific device selection, the information processing device which is the specific device at that time is, for example, There is an increased possibility of leaving the AR space sharing state, such as leaving the communicable range. In other words, the situation where the specific device is absent is likely to occur, and the possibility of delaying the progress of the content increases.
On the other hand, when the state comparison frequency is high, the trackability of the specific device selection for the deterioration of the state of the specific device is increased, and therefore the speed with which the specific device in the deteriorated state is changed to the non-specific device (that is, that It is possible to improve the speed of selection of a device other than the specified device as the specified device), and reduce the possibility that the specified device is absent and the content progress is delayed as described above. It will be possible.
Further, when the state comparison frequency is increased, the processing load of the information processing device is increased by increasing the execution frequency of the process of acquiring and comparing the state information from another device, while the state comparison frequency is decreased. Reduces the processing load on the information processing apparatus.

In the information processing apparatus according to the present technology described above, it is desirable that the selection unit changes the state comparison frequency according to the communication state of the specific apparatus.

Thereby, for example, the state comparison frequency is increased in a situation where the communication state of the specific device is deteriorated, and the state comparison frequency is decreased in a state where the communication state of the specific device is not deteriorated. Is possible.

In the information processing apparatus according to the present technology described above, it is desirable that the selection unit increase the state comparison frequency according to deterioration of the communication state of the specific apparatus.

As a result, the state comparison frequency is increased in a situation where the communication state of the specific device is deteriorated, and is reduced in a situation where the communication state of the specific device is not deteriorated.

In the information processing apparatus according to the present technology described above, it is preferable that the selection unit changes the state comparison frequency according to an arrangement relationship between the specific apparatus and the specific virtual object in the augmented reality space.

As a result, the state comparison frequency is increased in a situation where there is a high possibility that the specific device will leave the AR space sharing state, for example, when the specific device is located far from the specific virtual object. In the situation where the specific device is not likely to leave the AR space sharing state, such as being located close to it, the frequency of state comparison is reduced, etc. It is possible to perform various state comparison frequency adjustments.

In addition, the information processing method according to an embodiment of the present technology generates an image of content that visually represents an augmented reality space constructed by arranging virtual objects in a real space, and uses the status information of the own device and the status information of another device as the status information. On the basis of the result of the state comparison of a plurality of information processing devices including the own device and the other device sharing the augmented reality space, only a specific information processing device among the plurality of information processing devices is This is an information processing method for selecting a specific device that executes a specific process that is permitted to be executed.

Even with such an information processing method, the same operation as that of the light projection control device according to the present technology described above can be obtained.

Furthermore, the program according to the present technology generates an image of content visually representing an augmented reality space constructed by arranging virtual objects in a real space, and based on the state information of the own device and the state information of another device. Then, based on the result of the state comparison of the plurality of information processing apparatuses including the own apparatus and the other apparatus that share the augmented reality space, only a specific information processing apparatus among the plurality of information processing apparatuses executes the information. It is a computer-readable program that causes a computer device to execute a process of selecting a specific device that executes a permitted specific process.

The information processing apparatus according to the present technology described above is realized by such a program.

It is a figure showing an example of composition of an AR game system constituted including an information processor as an embodiment. It is a figure which illustrated the real space. FIG. 3 is a diagram illustrating an AR game image corresponding to the real space shown in FIG. 2. It is the figure which illustrated the hardware constitutions of the information processor as an embodiment. It is a functional block diagram for explaining a function which an information processing device as an embodiment has. It is a figure showing an example of game information in an embodiment. 9 is a flowchart showing an example of processing corresponding to a case where a specific device is selected based on the battery remaining amount information of each device. 9 is a flowchart showing an example of processing corresponding to the case of selecting a specific device based on the information processing capability of each device. It is a flow chart showing an example of processing corresponding to when a specific device is selected based on a communication state of each device. 9 is a flowchart showing an example of processing corresponding to a case where a specific device is selected based on a layout relationship of each device with respect to a specific virtual object. 9 is a flowchart showing a processing example corresponding to a case where the determination process execution condition for selecting a specific device is to maintain the non-notification state of the specific device. 9 is a flowchart showing a processing example corresponding to a case where the determination processing execution condition for selecting a specific device is a communication state deterioration of the specific device. It is the flowchart which showed the processing example corresponding to the case where the state comparison frequency is changed according to the communication state of a specific device. 9 is a flowchart showing a processing example corresponding to a case where the state comparison frequency is changed according to the arrangement relationship of a specific device with respect to a specific virtual object. It is explanatory drawing about a modification. Similarly, it is explanatory drawing about a modification. 9 is a flowchart showing an example of a specific processing procedure to be executed by the information processing device serving as a master candidate in the modified example. 9 is a flowchart showing an example of a specific processing procedure to be executed by an information processing device other than the master candidate in the modification.

Hereinafter, embodiments according to the present technology will be described in the following order with reference to the accompanying drawings.

<1. Outline of AR Game System as Embodiment>
<2. Configuration of information processing device>
[2-1. Hardware configuration]
[2-2. Functional configuration]
<3. Specific Device Selection Method as Embodiment>
[3-1. Overview of selection method]
[3-2. Processing procedure]
<4. Another example of specific device selection>
<5. Adjustment of state comparison frequency>
<6. Modification of Embodiment>
<7. Program>
<8. Summary of Embodiments>
<9. This technology>

<1. Overview of AR game system>

FIG. 1 shows a configuration example of an AR (Augmented Reality) game system 100 including an information processing device 1 which is an embodiment of an information processing device according to the present technology.
The AR game system 100 is configured to include a plurality of information processing devices 1 as illustrated. As will be described later, each information processing device 1 has a camera unit (a stereo camera unit 2 described later) that captures an image of a real space, and a display unit (a display unit 3 described later) that presents image information to the user, An AR image in which a virtually generated object (hereinafter, referred to as “virtual object”) is superimposed on a captured image of the real space obtained by the camera unit is generated and presented to the user by the display unit. That is, each information processing device 1 generates an image of content visually representing the augmented reality space constructed by arranging virtual objects in the real space, and presents it to the user.
In this example, the content presented by each information processing apparatus 1 by the AR image is a game content (AR game content). Specifically, it is assumed that the AR game content in this example is, for example, a game content in which the user of each information processing device 1 collides with and defeats a predetermined game character arranged in the augmented reality space. In the following, a character to be sublimated in such an AR game content is also referred to as an “enemy character”.

In this example, each information processing device 1 is configured as an HMD (head mount display) that is detachably attached to the user's head.
Note that the form of the information processing device 1 is not limited to the form of the HMD, and may take other forms such as a configuration in which the camera unit is externally attached or the display unit is externally attached. ..

The AR game content in this example will be described more specifically with reference to FIGS. 2 and 3.
FIG. 2 exemplifies a real space which is an imaging target of the camera unit.
Here, for convenience of explanation, it is assumed that there are two users P1 and P2 who play the game in the real space that is the basis of the augmented reality space. As shown in the figure, the information processing apparatus 1 attached to the user P1 is represented by a code “1-1”, and the information processing apparatus 1 attached to the user P2 is represented by a code “1-2”.
In the real space in this case, an object Ro such as a rock is arranged near the users P1 and P2.

FIG. 3 shows an example of a game image (AR image) presented by the information processing device 1.
Specifically, FIG. 3 shows an example of a presentation image by the information processing device 1-1 attached to the user P1, but an object Ro existing in the real space is shown in this game image. In addition, the virtual object Vp2 as the avatar of the user P2 (that is, the virtual object of the character selected by the user P2 as his own incarnation), the virtual object Vo as the enemy character, and the user P1 (that is, the user of the own device). A virtual object Vp1 as an avatar is displayed. Further, in the game image, various indicators related to the game, such as an indicator showing the HP (hit points) of the enemy character and an indicator showing the HP of the user Vp1 of the own device, are displayed.

As will be described later, the information processing apparatus 1 is provided with various sensors (sensor unit 5) for estimating the position and orientation of the user, and the user wearing the information processing apparatus 1 can move or change the orientation. In this case, the movement and the change in the direction are reflected in the character as the avatar in the augmented reality space.
Further, in this example, the information on the position and orientation of the user, which is acquired for each information processing device 1, is shared between the information processing devices 1, and each information processing device 1 uses another device based on the shared information. In the same manner, the change of the movement or the direction of the user is reflected as the change of the movement or the direction of the avatar of the user.

In addition, although the number of the enemy characters is singular in FIG. 3, it may be plural.

<2. Configuration of information processing device>
[2-1. Hardware configuration]

FIG. 4 shows the hardware configuration of the information processing device 1.
As illustrated, the information processing device 1 includes a stereo camera unit 2, a display unit 3, an image input unit 4, a sensor unit 5, a sensor information input unit 6, a communication unit 7, a battery 8, a CPU (Central Processing Unit) 9, and a ROM. A (Read Only Memory) 10, a RAM (Random Access Memory) 11, an image output unit 12, and a bus 13 are provided.
As shown in the figure, the image input unit 4, the sensor information input unit 6, the communication unit 7, the CPU 9, the ROM 10, the RAM 11, and the image output unit 12 are connected to each other via a bus 13, and these respective units perform data communication via the bus 13. It is possible to do.

The stereo camera unit 2 includes two image pickup units including an image pickup device such as a CCD (Charged-coupled devices) image sensor or a CMOS (Complementary metal-oxide-semiconductor) image sensor and an image pickup optical system. In this example, as these imaging units, the left-eye imaging unit 2L arranged at a position corresponding to the left eye of the user wearing the information processing apparatus 1 and the right-eye imaging unit arranged at a position corresponding to the right eye of the user. And a section 2R. The left-eye imaging unit 2L obtains a captured image in a visual field corresponding to the visual field of the user's left eye, and the right-eye imaging unit 2R obtains a captured image in a visual field corresponding to the visual field of the user's right eye.
By disposing the left-eye imaging unit 2L and the right-eye imaging unit 2R so as to be separated from each other in the left-right direction, parallax for obtaining distance information can be generated between the captured images. That is, based on the imaged images obtained by the left-eye imaging unit 2L and the right-eye imaging unit 2R, information on the distance to each object to be imaged can be obtained by the stereo method. In other words, it is possible to obtain three-dimensional data representing the position of each object in the real space in each of the X-axis, Y-axis, and Z-axis directions.
The image input unit 4 inputs captured images obtained by the left-eye imaging unit 2L and the right-eye imaging unit 2R, respectively.

The display unit 3 displays the AR image (in this example, the game image illustrated in FIG. 3) and presents it to the user. The display unit 3 of the present example includes a left-eye display unit 3L arranged at a position corresponding to the user's left eye and a right-eye display unit 3R arranged at a position corresponding to the right eye.
As will be described later, depending on the CPU 9 of the present example, a game image is obtained by the right-eye image pickup unit 2R and a left-eye display image obtained by superimposing various virtual objects and the like on the image obtained by the left-eye image pickup unit 2L. A right-eye display image in which various virtual objects and the like are superimposed on the captured image is generated. A left-eye display image is displayed on the left-eye display unit 3L, and a right-eye display image is displayed on the right-eye display unit 3R.
In this way, the image corresponding to the left-eye visual field is displayed for the user's left eye, and the image corresponding to the right-eye visual field is displayed for the right eye, whereby the stereoscopic effect of the image presented to the user is enhanced.

The sensor unit 5 collectively shows various sensors for detecting the position and orientation of the user (the user who wears the information processing apparatus 1 in this example). Specifically, the sensor unit 5 of this example includes at least an acceleration sensor as a sensor for detecting the movement of the user, and a gyro sensor (angular velocity sensor) as a sensor for detecting the orientation of the user.
The sensor information input unit 6 inputs information detected by the sensor unit 5.

The communication unit 7 performs data communication with an external device (in particular, another information processing device 1 in this example). The communication unit 7 of this example is configured to be able to perform wireless data communication with an external device. Examples of the wireless communication method in this case include Wi-Fi (Wireless Fidelity: registered trademark) and Bluetooth (registered trademark).

The battery 8 is a secondary battery used as a power source for each unit included in the information processing device 1.

The CPU 9 executes various processes according to a program stored in the ROM 10 or a program loaded from the ROM 10 into the RAM 11. The RAM 11 appropriately stores data necessary for the CPU 9 to execute various processes.
The CPU 9 executes processing for realizing various functions described later with reference to FIG. 5 based on various programs. For example, based on the captured image input by the image input unit 4 from the stereo camera unit 2, a game image as an AR image illustrated in FIG. 3 (in the present example, the above-described left-eye display image and right-eye display image). And the like for generating.
The CPU 9 in this example executes a process for realizing the specific device selection method as the embodiment described with reference to FIGS. 7 to 12, etc., which will be described later in detail.

The image output unit 12 inputs the game image generated by the CPU 9, that is, the above-described left-eye display image and right-eye display image in this example via the bus 13, and outputs the left-eye display image to the left-eye display unit 3L and the right-eye display image. Display images are output to the right-eye display unit 3R.

Note that the information processing apparatus 1 of the present example is also provided with operation means for enabling various game operations such as an attack instruction operation to an enemy character, but is not directly related to the present technology. Therefore, the illustration is omitted.

[2-2. Functional configuration]

Various functions of the CPU 9 will be described with reference to the functional block diagram of FIG.
As shown in the figure, the CPU 9 is divided by function into a spatial information management unit F1, a game information management unit F2, a game information processing unit F3, an output image generation unit F4, a battery management unit F5, a CPU management unit F6, and a communication state management unit. It can be expressed as having F7 and a master/slave switching control unit F8.

The spatial information management unit F1 includes captured images of the stereo camera unit 2 (the captured images at the left eye position and the right eye position, respectively) input via the image input unit 4 and the sensor unit input via the sensor information input unit 6. The position of each information processing device 1 (each user) sharing the AR space is detected and identified based on the detection information of 5.
Here, sharing the AR space means a relationship between the information processing devices 1 of the users who play the same game content in this example, and the information processing device 1-1 in the examples of FIGS. 2 and 3 described above. And the information processing device 1-2 are applicable.
The spatial information management unit F1 determines the position of the other information processing device 1 based on each of the stereoscopically captured images input via the image input unit 4 as three-dimensional data (data representing the position in three-dimensional coordinates). To detect. Further, the position of the device itself is detected based on the sensor information input from the sensor information input unit 6.
Further, regarding the identification of the other information processing devices 1, in this example, for example, visual information (for each information processing device 1 (or each user wearing the information processing device 1)) for identifying each information processing device 1 ( For example, a mark of a predetermined shape or a mark of a predetermined color is attached, and the spatial information management unit F1 detects the visual information from the captured image to detect the information processing device 1 (user) detected in the captured image. Identify.
The spatial information management unit F1 repeatedly executes the position detection of each information processing device 1 as described above at a predetermined cycle, and constantly updates the information.
Note that, as a method for identifying the information processing device 1, the above-described method is merely an example for description, and each information processing device 1 transmits its own identification information and position information to another information processing device 1. Then, the spatial information management unit F1 identifies the other information processing device 1 by collating the position information received from the other information processing device 1 with the position of the information processing device 1 detected in the captured image. Of course, it is also possible to adopt other methods such as

The game information management unit F2 performs a process of updating the game information and a process of transmitting the updated game information to another information processing device 1 when the own device becomes the master device, and collectively executes the game progress. And manage.
The “game information” here means information commonly used by each information processing device 1 (each information processing device 1 sharing the AR space) in the progress of the game.

FIG. 6 shows an example of the game information.
Examples of the game information of this example include position information of each player, selected character information for each player, game score of each player, appearance position information of enemy characters, and enemy character state information. The “player” here does not mean the user itself, but merely a virtual person in the game content. Further, the position information here is in the AR space. This is information indicating the position.
In this example, the position information of each player includes not only the position information of each player in the AR space, but also the direction information of each player. In each information processing device 1, the information on the orientation of the player of the own device can be obtained based on the detection information of the sensor unit 5.
In addition, the selected character information for each player means identification information of the character selected by the user as his or her avatar before the game starts. Further, the state information of the enemy character means information indicating the state of the enemy character, such as HP of the enemy character.

If the update of the game information is delayed, each information processing device 1 cannot properly advance the game content, and the game is interrupted, which may delay the progress of the game.

In this example, the master device is a device in which only one is selected from the plurality of information processing devices 1 sharing the AR space, and all the information processing devices 1 other than the master device operate as slave devices.
The master device of this example is a device that performs a process of updating the game information as described above and a process of transmitting the updated game information to another information processing device 1. The slave device is a device that receives the game information transmitted from the master device and performs a process of reflecting the game information on the game image presented by itself.

Here, according to the relationship between the master device and the slave device as described above, the process of updating the game information and the process of transmitting the updated game information to another information processing device 1 are performed by the master device. In other words, this is a process in which only the information processing device 1 is permitted to execute. In other words, in other words, these processes are called “specific processes”, and the master device can be said to be a device that executes the specific processes.

Returning to FIG.
The game information processing F3 receives the game information transmitted by the master device and transmits the information to be reflected in the game information to the master device, when the device itself becomes the slave device. As an example of the information to be reflected in the game information from the slave device side, there can be mentioned, for example, the information relating to the enemy character that the player of the own device subjugates (HP is made 0). The defeated enemy character should be eliminated from the game image presented by the other device. In addition, the information that the player of the own device has defeated the enemy character is information that the other device cannot know when the enemy character is defeated. Therefore, when the player of the own device defeats a certain enemy character, the game information processing unit F3 transmits information indicating that fact to the information processing device 1 as the specific device.
The game information management unit F2 in the information processing device 1 as the master device updates the game information described above based on the information transmitted by the other device (slave device) in this way. As a result, the fact that the corresponding enemy character has been subdued is reflected in the game information.
Then, since the game information management unit F2 performs the process of transmitting the game information to the other device as described above, thereafter, the information indicating that the corresponding enemy character has been defeated will be shared among the other devices. , Will be reflected in the game image presented by each device.

The output image generation unit F4 generates an image to be displayed on the display unit 3 based on the captured image input from the image input unit 4 and the game information. That is, in this example, the above-described left-eye display image and right-eye display image are generated.

The battery management unit F5 manages the state of the battery 8. Particularly in this example, the remaining amount of the battery 8 (for example, the charging rate) is managed.

この処理能力評価値Ｚは、ＣＰＵ９の実質的な情報処理能力について、Ｎサンプルあたりの平均処理能力を表す値となる。
なお、ＣＰＵ９の実質的な情報処理能力を表す評価値については、例えばＭＩＰＳ（million instructions per second）に基づく値とする等、ＭＣＰＳ以外の処理能力評価値に基づいた値とすることもできる。 The CPU management unit F6 manages the information processing capability of the CPU 9. The CPU management unit F6 of the present example manages the information processing capacity of the CPU 9, not the processing capacity on the specifications of the CPU 9, but the information processing capacity in consideration of the processing load of the CPU 9 at that time.
Specifically, the CPU management unit F6 calculates a processing capacity evaluation value Z represented by the following [Formula 1] as an evaluation value representing the substantial information processing capacity of the CPU 9 in the current state. In [Equation 1], X is the MCPS (millions of clocks per second: equivalent to the processing capacity on the specifications) of the CPU 9, Y is the average usage rate (%) of the CPU 9 per second, and N is the number of samples ( N is a natural number of 2 or more).

The processing capacity evaluation value Z is a value representing the average processing capacity per N samples of the substantial information processing capacity of the CPU 9.
The evaluation value representing the substantial information processing capacity of the CPU 9 may be a value based on a processing capacity evaluation value other than MCPS, such as a value based on MIPS (million instructions per second).

The communication state management unit F7 manages the communication state of data communication performed by the communication unit 7. Specifically, the communication state management unit F7 of this example manages the received signal strength of the communication unit 7. Here, in this example, there can be a plurality of information processing devices 1 as other devices that share the AR space, and in response to this, the communication state management unit F7 treats each information processing device as a value indicating the received signal strength. A value obtained by averaging the intensity values of the radio waves received from the device 1 is calculated and managed.

The master/slave switching processing unit F8, based on the result of performing a state comparison of each device based on the state information of the own device and the state information of another device, for the plurality of information processing devices 1 sharing the AR space, the own device The operation mode is switched between the master mode and the slave mode. The master mode is a mode in which the self device operates as a master device, and the slave mode is a mode in which the self device operates as a slave device.
Here, switching the operation mode of the own device between the master mode and the slave mode based on the result of the state comparison of the respective devices as described above includes selecting the master device from the respective devices. Can be said to be out.

<3. Specific Device Selection Method as Embodiment>
[3-1. Overview of selection method]

Hereinafter, a specific example of the specific device selection method as the embodiment realized by the master/slave switching processing unit F8 will be described.
First, in this example, when the master mode/slave mode is switched, the remaining battery level information managed by the battery management section F5 and the CPU management section F6 are managed as the above status information (status information of the information processing device 1). At least one of the processing capacity evaluation value Z and the received field intensity managed by the communication status management unit F7 is acquired. Any one of these pieces of state information is acquired for each of the own device and other devices sharing the AR space.
Then, based on the acquired status information of each device, it is determined whether or not the device itself can be the master device. That is, as the determination based on the battery remaining amount information, it is determined whether or not the battery remaining amount of the own device is maximum, and as the determination based on the processing capacity evaluation value Z, the processing capacity evaluation value Z of the own device is determined. It is determined whether or not it is the best (highest information processing capability). Further, if the determination is based on the received radio field intensity, it is determined whether or not the received radio field intensity of the own device is maximum.
Further, when it is determined that the own device can be the master device by at least one of these determinations, the other device is notified that the own device is the master device, and the operation mode of the own device is set to the master mode. Switch.

At this time, the information processing device 1, which was the master device, switches the operation mode to the slave mode in response to the notification that it will be the master device from another device. On the other hand, when the information processing device 1 that has been a slave device is notified by another device that it will be a master device, the information processing device 1 maintains the slave mode without switching the operation mode.
If it is determined that the information processing apparatus 1 that was the master apparatus itself can be the master apparatus, the information processing apparatus 1 does not switch the operation mode. Further, in this case, since it is not necessary to switch the operation mode even in the other device, in the processing of this example described below, the information processing device 1 notifies the other device that it will be the master device. It is assumed that there is none (see step S104).

[3-2. Processing procedure]

Hereinafter, a specific processing procedure to be executed by the CPU 9 in order to realize the specific device selection method according to the above-described embodiment will be described with reference to the flowcharts of FIGS. 7 to 9.
FIG. 7 shows an example of processing corresponding to the case of selecting the master device based on the battery remaining amount information of each device. Note that the processing shown in each drawing up to FIG. 10 including this FIG. 7 is repeatedly executed at a predetermined cycle. The execution cycle of these processes may be, for example, 1 second.

In FIG. 7, first, in step S101, the CPU 9 performs a process of transmitting the battery remaining amount information of its own device. That is, the battery remaining amount information of the own device is transmitted to another device sharing the AR space. The transmission process of step S101 may be terminated on condition that the reception of the transmitted battery remaining amount information by another device is confirmed.

In subsequent step S102, CPU 9 stands by until the battery remaining amount information of the other device is received. That is, it waits until the battery remaining amount information transmitted by the other device in the process of step S101 is received.
In response to the reception of the remaining battery amount information of the other device, the CPU 9 determines in step S103 whether the remaining battery amount of the own device is maximum. If the remaining battery level of the device is maximum, the CPU 9 proceeds to step S104 and determines whether the device is currently a slave device. When the own device is not the slave device (that is, currently the master device), the CPU 9 finishes the series of processes shown in FIG. 7.
That is, when it is determined that the information processing apparatus 1 that was the master apparatus itself can be the master apparatus, the information processing apparatus 1 does not switch the operation mode. Further, in this case, since it is not necessary to switch the operation mode even in the other device, the information processing device 1 does not notify the other device that it will be the master device.

On the other hand, if the own device is currently the slave device, the CPU 9 proceeds to step S105 to notify other devices that it will be the master device, and in step S106, ACK (acknowledgement) from the current master device is received. Wait until. The ACK waiting for reception here is the ACK transmitted by the current master device in step S109 described later.

When the ACK from the current master device is received, the CPU 9 proceeds to step S107 to execute the process of shifting to the master mode, and ends the series of processes shown in FIG.

Further, when it is determined in the previous step S103 that the remaining battery level of the own device is not the maximum, the CPU 9 proceeds to step S108 and waits until the notification from the master candidate is received. The master candidate here means the information processing device 1 that is currently operating as a slave device but has the ability to be a master device. Specifically, the master device determines that it is the master device by the determination processing in step S103. This means the information processing device 1 that has determined that the remaining battery level is maximum (in this case, the remaining battery capacity is maximum) and notified the other device that it will be the master device by the process of step S105.

When the notification from the master candidate is received in step S108, the CPU 9 proceeds to step S109 and transmits ACK to the information processing device 1 as the master candidate.
Then, in subsequent step S110, the CPU 9 determines whether or not the own device is currently the master device. If the own device is not currently the master device, the CPU 9 finishes the series of processes shown in FIG. That is, if the device itself is not a master candidate and is currently a slave device, it is not necessary to change the operation mode and the process ends.
On the other hand, if the own device is currently the master device, the CPU 9 proceeds to step S111 to shift to the slave mode and ends the series of processing shown in FIG.

FIG. 8 shows an example of processing corresponding to the case of selecting the master device based on the information processing capability of each device.
In the following description, the same steps as those already described will be denoted by the same step numbers and will not be described.

In this case, in step S201, the CPU 9 calculates the information processing capability of its own device and sends it to another device. Specifically, in this example, the processing capacity evaluation value Z described above is calculated and transmitted to another device.
In subsequent step S202, CPU 9 waits until the information processing capability information of the other device, that is, the processing capability evaluation value Z transmitted by the other device in the process of step S201 in this example, is received, and the information processing capability information is received. In this case, it is determined in step S203 whether or not the information processing capability of the own device is the highest. That is, it is determined whether or not the processing capacity evaluation value Z of the own device is the highest.
When the CPU 9 determines that the information processing capability of the own device is the highest, the process proceeds to step S104, and when it determines that the information processing capability of the own device is not the highest, the process proceeds to step S108.
It should be noted that the processing from step S104 to step S111 in the figure has already been described, and thus a duplicate description will be omitted.

FIG. 9 shows an example of processing corresponding to the case where the master device is selected based on the communication state of each device.
In this case, the CPU 9 transmits the communication status information of the own device to the other device in step S301. That is, in this example, the information of the above-mentioned received radio wave intensity (average value of the received radio wave intensity from another device) is transmitted to the other device.
In the subsequent step S302, the CPU 9 waits until the communication state information of the other device, that is, the information of the received signal strength transmitted by the other device in the process of step S301 is received in this example, and when the communication state information is received, In step S303, it is determined whether or not the communication state of the own device is the best. That is, it is determined whether or not the received radio field intensity of the device itself is the highest.
The CPU 9 proceeds to step S104 when it determines that the communication state of its own device is the best, and proceeds to step S108 when it determines that the communication state of its own device is not the best.

Here, the communication state information used in determining whether or not the own device can be the master device is not limited to the above-described information on the received radio field intensity, and includes the packet loss rate of the communication packet in the case of performing packet communication. Information can also be used. The packet loss rate represents the ratio of the number of lost packets to the total number of transmitted packets, and can be obtained by the function of Ping (packet communication test program), for example. The Ping function is a function provided in a general OS, and in this case, as the information processing device 1, a device mounted with an OS including the Ping function is used.

In this case, in the process of step S301, the CPU 9 transmits the packet loss rate information (an average value of the numerical values for each other device, like the received signal strength) as communication state information to the other device. Then, in the process of step S303, the packet loss rate of the own device is minimum based on the packet loss rate of the own device and the packet loss rate of the other device (packet loss rate of the other device received in step S302). It is determined whether or not there is, and if it is the minimum, the process proceeds to step S104, and if it is not the minimum, the process proceeds to step S108.

The master device may be selected based on the average arrival time (TTL) instead of the packet loss rate. Specifically, in the determination process of step S303, it is determined whether or not the TTL of the own device is the shortest, and if it is the shortest, the process proceeds to step S104, and if it is not the shortest, the process proceeds to step S108. Note that the TTL information can also be acquired by the Ping function.

Here, the determination as to whether or not the own device can be the master device can also be made based on information indicating the arrangement relationship of each device with respect to a specific virtual object in the AR space. As the information indicating the layout relationship with respect to such virtual objects, for example, a separation distance (hereinafter referred to as “separation distance Do”) with respect to a specific enemy character can be cited.
The separation distance Do indicates the possibility of leaving the AR space sharing state with another device. In this example, the possibility of leaving the AR space sharing state means the possibility of the player leaving the game, for example, when the user finishes playing the game.
It can be estimated that the further the information processing device 1 is located with respect to a specific virtual object (the longer the distance Do is), the less interest the user of the information processing device 1 has in the content, and the sharing of the AR space. It can be estimated that there is a high possibility of leaving the state.
Therefore, by selecting the master device based on the result of comparing the arrangement relationship of each device with respect to a specific virtual object, the AR space sharing state such as the information processing device 1 having the lowest possibility of leaving the AR space sharing state. The information processing apparatus 1 suitable for executing the specific process in terms of the possibility of leaving the device can be defined as the specific device.

FIG. 10 shows an example of processing corresponding to the case where the master device is selected based on the information on the arrangement relationship with respect to a specific virtual object.
In this case, the CPU 9 transmits the distance information for the specific object of the own device to another device in step S401. That is, the information on the distance Do of the own device with respect to the specific virtual object is transmitted to the other device. Here, the information on the separation distance Do for a specific virtual object in the AR space can be obtained based on the game information illustrated in FIG. 6.

In step S402 following step S401, the CPU 9 waits until the distance information for the specific object of the other device, that is, the information of the separation distance Do transmitted by the other device in the process of step S401 is received, and the information is received. If so, it is determined in step S403 whether or not the own device is the closest to the specific object. That is, it is determined whether or not the separation distance Do of the device itself is the shortest.
In this case, the CPU 9 proceeds to step S104 when it determines that its own device is closest to the specific object, and proceeds to step S108 when it determines that its own device is not closest to the specific object.

Note that the arrangement relationship with respect to the specific virtual object may include, for example, information on the orientation with respect to the specific virtual object, in addition to the above-described separation distance Do. For example, when the user of the information processing device 1 continues to turn his/her back on a specific virtual object, the user of the information processing device 1 is less interested in the content and is likely to leave the AR space sharing state. It can be estimated that Therefore, by using the information of the orientation with respect to a specific virtual object as the selection criterion of the master device, for example, the information processing device 1 having the lowest possibility of leaving the AR space sharing state, the possibility of leaving the AR space sharing state. Therefore, the information processing apparatus 1 suitable for executing the specific processing can be defined as the specific apparatus.

Note that, in the above, an example in which only one type of state information is used for selecting the master device has been described, but the master device may be selected based on a plurality of types of state information.
For example, if the master device has a selection condition that the remaining battery level is maximum and the communication state is the best, it is possible to determine whether or not the device itself can be the master device by using a determination condition based on a plurality of types of state information. It can be done depending on whether or not it is satisfied.
In addition, when another device having the same judgment evaluation value exists when a judgment is made based on a judgment condition based on a single state information (for example, the received signal strength is maximum) (another device having the same received signal strength is (If they exist), the determination conditions are changed and the determination is performed again between the devices having the same determination evaluation value (for example, it is determined whether or not the remaining battery capacity is the maximum). You can also

<4. Another example of specific device selection>

In the above, for example, the determination process for selecting the master device, such as step S103 or step S203, is repeatedly executed in a constant cycle. However, the determination process for selecting the master device is It can also be executed on condition that it has deteriorated.
As an example, for example, in the case where it is premised that the master device notifies another device of a fixed period, the master device is selected on the condition that the fixed period of notification is delayed for a predetermined time or more. The determination process may be executed.

FIG. 11 shows a processing example corresponding to the case where the determination processing execution condition for selecting the master device is to keep the master device in the non-notification state.
Here, the main body of the processing described below with reference to FIGS. 11 and 12 is the CPU 9 in the slave device.
In addition, in FIG. 11, an example in which the determination based on the battery remaining amount information as illustrated in FIG. 7 is performed as the determination process for selecting the master device will be described. However, instead of this, in FIGS. It is of course possible to make the determination based on at least one of the information processing capability, the communication state, and the arrangement relationship with respect to the specific object as illustrated.

First, in step S501, the CPU 9 in this case waits until the master non-notification state continues for a predetermined time or more. That is, with respect to the notification that the master device should make to other devices sharing the AR space in a certain cycle, the master device waits until a state without the notification continues for a predetermined time or more.
Then, when the master non-notification state continues for a predetermined time or more, the CPU 9 advances the process to step S101. That is, as a result, the determination process (S103) for selecting the master device based on the remaining battery amount is executed on condition that the master non-notification state continues for a predetermined time or longer.
Since the process shown in FIG. 11 is executed by the slave device, the process of step S104 (the process of determining whether or not the self device is currently the slave device) is omitted. Similarly, step S110 (determination process as to whether or not the own device is currently the master device) and step S111 (slave mode transition process) are also omitted.
Further, in this case, as a process of determining whether or not to execute the process (S107) of shifting to the master mode, the process of step S502 is replaced with the process of step S502, that is, an ACK from another slave device (transmitted in step S109). ACK) is received. In this way, the condition for the transition to the master mode is that the ACK is received from another slave device (that is, the ACK is not received from the master device). In this case, the master device leaves the AR space sharing state. This is because there is a high possibility that

Further, the determination process execution condition for selecting the master device may be the deterioration of the communication state of the master device.
FIG. 12 shows a specific processing example.
In this case, the CPU 9 first requests the master device to transmit the communication state information in step S601. In this example, it is assumed that the communication state information is the above-mentioned received radio wave intensity information. Then, in subsequent step S602, the CPU 9 waits until it receives the communication state information from the master device.
Further, in step S603 following step S602, the CPU 9 determines whether the communication state of the master device is bad. Specifically, in this example, it is determined whether the received radio wave intensity is equal to or lower than a predetermined value. If the received signal strength is not less than the predetermined value and it is determined that the communication state of the master device is not bad, the CPU 9 returns to step S601.

On the other hand, if the received signal strength is less than or equal to the predetermined value and it is determined that the communication status of the master device is poor, the CPU 9 proceeds to step S604, and communicates the communication status information to all other slave devices (also in this case, the received signal strength information. If the communication state information is received, it waits until the communication state information from another slave device is received in step S605. Determine whether or not. That is, in this example, it is determined whether or not the received radio wave intensity of the device itself is the highest.

In step S606, when the received signal strength of the own device is the highest and the communication state of the own device is determined to be the best, the CPU 9 advances the process to step 105 and notifies the other device that it will be the master device. On the other hand, when the received signal strength of the own device is not the highest and the communication state of the own device is not the best, the CPU 9 advances the process to step 108 and waits until the notification from the master candidate is received.
Note that steps S502, S107, and S109 in the figure have already been described, and thus redundant description will be omitted.

Note that, in the above, the information on the received signal strength is illustrated as an example of the communication state information, but in this case as well, the information indicating the communication state may be the packet loss rate or the TTL information.

<5. Adjustment of state comparison frequency>

In the description so far, it is assumed that the frequency of performing the processes shown in FIGS. 7 to 10 is constant. That is, an example has been given in which the status information is acquired from another device and the frequency with which the status of each device is compared (hereinafter referred to as “status comparison frequency”) is constant. However, the frequency of state comparison may be variable instead of being constant.

Here, when the state comparison frequency is low, the execution interval of the master device selection performed based on the result of the state comparison becomes long. Therefore, between the execution timings of the master device selection, the information processing that is the master device at that time is performed. There is an increased possibility that the device 1 will leave the AR space sharing state, for example, it will leave the communicable range. In other words, the situation in which the master device is absent is likely to occur, and the possibility of delaying the progress of the game increases.
On the other hand, when the state comparison frequency is high, the master device selection can follow the deterioration of the state of the master device more quickly, and thus the speed with which the master device in the deteriorated state is changed to the slave device (that is, It is possible to improve the speed of selection of a device other than the master device up to the master device), and reduce the possibility that the master device is absent and the game progress is delayed as described above. It will be possible.
When the state comparison frequency is increased, the processing load of the information processing device 1 is increased by increasing the execution frequency of the process of acquiring and comparing the state information from another device, while the state comparison frequency is decreased. Therefore, the processing load on the information processing device 1 can be reduced.
In this way, by making the state comparison frequency variable, it is possible to adjust the processing load reduction effect of the information processing device 1 and the game progress delay prevention effect.

FIG. 13 shows a processing example corresponding to the case where the state comparison frequency is changed according to the communication state of the master device.
In this case, the CPU 9 first executes a process of acquiring the communication state information of the master device in step S701. Specifically, the CPU 9 in the slave device requests the master device to transmit the communication state information of the master device, and acquires the communication state information. Here, the CPU 9 of the master device acquires the communication state information of its own device in step S701.
In this example, as the communication state information, the above-mentioned information on the received signal strength is acquired. However, the communication state information may be information based on the packet loss rate or the TTL described above.

In step S702 following step S701, the CPU 9 determines whether or not the communication state of the master device is bad, specifically, in this example, whether or not the received radio wave intensity of the master device is equal to or less than a predetermined value. When the received electric field intensity of the master device is less than or equal to the predetermined value and it is determined that the received electric field intensity of the master device is bad, the CPU 9 sets the high frequency mode in step S703. That is, the processing for increasing the execution frequency of the processing shown in FIGS. 7 to 10 is performed. On the other hand, when the received electric field intensity of the master device is not less than the predetermined value and it is determined that the received electric field intensity of the master device is not bad, the CPU 9 sets the low frequency mode in step S704, that is, shown in FIGS. The processing is performed so that the execution frequency of the processing is lower than that in the high-frequency mode.
As a result, when it is estimated that the master device will leave the AR space sharing state due to the deterioration of the communication state, the state comparison frequency can be increased and the delay of the game progress can be prevented. Further, when the communication state of the master device is good, the state comparison frequency is lowered, so that the processing load of the information processing device 1 can be reduced.

In this case, the CPU 9 returns to step S701 in response to the execution of any one of steps S703 and S704.

FIG. 14 shows a processing example corresponding to the case where the state comparison frequency is changed according to the arrangement relationship of the master device with respect to a specific virtual object.
Note that, here, as an example of using the information of the orientation with respect to the specific virtual object as the information of the layout relationship with respect to the specific virtual object, the present invention is not limited to this, and of course, the information of the above-mentioned separation distance Do can also be used. Is.

In this case, the CPU 9 first waits in step S801 until the player of the master device turns his back to the specific object. Whether or not the player of the master device has turned his/her back to a particular virtual object is determined based on the information on the direction of the player, but the information on the direction of the player can be acquired from the game information shown in FIG. it can.

Then, when the player of the master device turns his back to the specific object, the CPU 9 starts time counting in step S802, and in the following step S803, the player turns his back (the player of the master device turns his back to the specific object). It is determined whether or not is continuing.
If the back-facing state is continuing, the CPU 9 proceeds to step S803 to determine whether or not a predetermined time has passed, that is, whether or not the value of the time count started in step S802 is equal to or more than the predetermined value, If the predetermined time has not elapsed, the process returns to step S803. That is, depending on steps S803 and S804, processing for determining whether or not the back-facing state has continued for a predetermined time or more is formed.
If the predetermined time has elapsed in step S804, the CPU 9 proceeds to step S703 to perform the process of setting the high frequency mode, and then returns to step S803. That is, when the player's back-facing information of the master device continues for a predetermined time or more, the state comparison frequency is increased.

If it is determined in step S803 that the back-facing state is not continuing, the CPU 9 proceeds to step S704 to perform processing of setting the low frequency mode, and then resets the time count in step S805, and then step S801. Return to. In other words, when the player of the master device is turned back, but that state is resolved within a predetermined time, or when the player's back face of the master device is eliminated during the high-frequency mode, the state comparison is performed. Frequency is reduced.

By the above processing, the state comparison frequency is increased when the master device is estimated to leave the AR space sharing state based on the arrangement relationship of the master device with respect to the specific virtual object, and the delay of the game progress is prevented. Can be set. Further, in terms of the layout relationship of the master device with respect to a specific virtual object, when it is estimated that there is a low possibility of leaving from the AR space sharing state of the master device, the state comparison frequency is lowered and the information processing device 1 The processing load can be reduced.

In the above, the example of determining whether to change the state comparison frequency is based on the state information of any one of the communication state of the master device and the arrangement relationship with respect to the specific object of the master device. The determination of whether or not to change the frequency can also be made based on a plurality of state information.
For example, the determination based on the communication state and the determination based on the arrangement relationship with respect to the specific object are performed, and a positive result is obtained in both determinations, or a positive result is obtained in either one of the determinations. Alternatively, a method of changing the state comparison frequency can be adopted.

<6. Modification of Embodiment>

The embodiment is not limited to the specific examples described above, and various modified configurations can be adopted.
For example, consider an example in which the AR game system 100 according to the embodiment is applied to an amusement facility.

In this case, the AR game is started when a plurality of users as game participants are gathered in a predetermined area in the facility such as the game start area Sa illustrated in FIG.
It is assumed that a user who wants to participate in the game is waiting in a place other than the game start area Sa, such as a waiting room (not shown). It is assumed that these users who wish to participate in the game have not been given a clear notification of the game start area Sa. However, it is assumed that each information processing device 1 holds the position information of the game start area Sa.

The user as a candidate for participation is notified of the movement to the game start area Sa by some kind of signal. At this time, the information processing device 1 of the user who first enters the game start area Sa is set as the information processing device 1 as a master candidate (see the notation “Mc” in FIG. 15).

As shown in FIG. 16, the information processing device 1 that has been selected as a master candidate causes other devices outside the game start area Sa to display guidance information to the game start area Sa. Then, in response to all the other devices having entered the game start area Sa, the information processing device 1 as a master candidate notifies the other devices that they are master devices, and shifts to the master mode. On the other hand, the information processing device 1 as the other device that has received the notification shifts itself to the slave mode.
As a result, the grouping of the information processing apparatuses 1 sharing the AR game and the distribution of the master device/slave device within the group can be automatically performed without depending on the user's operation input.

Note that the master candidate is, for example, a device that first exits the waiting room, or a predetermined device (for example, information used by a user as an instructor) other than the device that first enters the game start area Sa. Processing device 1).

FIG. 17 shows a procedure example of processing to be executed in the information processing device 1 as a master candidate.
As shown in the figure, the CPU 9 of the information processing device 1 as a master candidate first acquires the position information of other devices in step S901, and determines in step S902 whether all the other devices have entered the game start area Sa. When it is determined that all the other devices have not entered the game start area Sa yet, the CPU 9 proceeds to step S903, and instructs the other device not entered (the other device not entered in the game start area Sa) to display the guidance information. After that, the process returns to step S901. Here, as the guide information, for example, a message such as characters as illustrated in FIG. 16 may be displayed. At this time, it is desirable that the guidance information be information indicating a direction to proceed in consideration of the orientation of another device, as in the message illustrated in FIG. The guidance information is not limited to visual information, and can be auditory information or tactile information (information by tactile stimulation such as vibration).

On the other hand, if it is determined in step S902 that all the other devices have entered the game start area Sa, the CPU 9 proceeds to step S904 to notify the other devices that they will be the master device, and in the subsequent step S905, the ACK ( 18) is received, and in response to the reception of the ACK, the process of shifting to the master mode is executed in step S906, and the series of processes shown in FIG. 17 ends.

FIG. 18 shows a procedure example of processing to be executed in the information processing device 1 other than the master candidate.
In this case, the CPU 9 waits until the notification from the master candidate (the notification in step S904) is received in step S1001, and when the notification is received, the CPU 9 transmits ACK to the master candidate in step S1002, and the subsequent step S1003. Then, the slave mode is entered, and then the series of processes shown in FIG. 18 ends.

Here, in the above description, a distance measuring method using a stereo camera (a distance measuring method by a stereo method) has been exemplified as a distance measuring method for obtaining distance information used for generating AR contents. As the method, for example, an STL (Structured Light) method or a ToF (Time of Flight) method may be used.

<7. Program>

Although the information processing apparatus 1 as the embodiment has been described above, the program of the embodiment is a program that causes a computer device such as a CPU to execute the processing as the information processing apparatus 1.

The program of the embodiment generates an image of content that visually represents an augmented reality space constructed by arranging virtual objects in a real space, and expands the image based on the status information of its own device and the status information of another device. Based on the result of the status comparison of multiple information processing devices including the own device and other devices that share the physical space, only a specific information processing device of the multiple information processing devices executes a specific process A program for causing a computer device to execute a process of selecting a specific device to be executed.
That is, this program corresponds to, for example, a program that causes a computer device to execute the processes described with reference to FIGS. 7 to 9 to 12.

Such a program can be stored in advance in a computer-readable storage medium, such as a ROM, an SSD (Solid State Drive), or an HDD (Hard Disk Drive). Alternatively, it can be temporarily or permanently stored (stored) in a removable storage medium such as a semiconductor memory, a memory card, an optical disc, a magneto-optical disc, or a magnetic disc. Further, such a removable storage medium can be provided as so-called package software.
In addition to installing such a program from a removable storage medium to a personal computer or the like, download from a download site to a required information processing device such as a smartphone via a network such as a LAN (Local Area Network) or the Internet. You can also

<8. Summary of Embodiments>

As described above, the information processing apparatus (same as 1) according to the embodiment is an image generation unit (output image generation) that generates an image of content visually representing an augmented reality space constructed by arranging virtual objects in a real space. Based on the result of the state comparison of the plurality of information processing devices including the own device and the other device that share the augmented reality space, based on the unit F4) and the state information of the own device and the state information of the other device. A selection unit (master/slave switching control unit F8) that selects a specific device (master device) that executes a specific process that is permitted to be executed by only a specific information processing device among the above information processing devices. is there.

By selecting the specific device based on the result of the state comparison of the devices sharing the augmented reality space (AR space) as described above, the information processing device in the state suitable for executing the specific process is specified. It can be defined as a device.
Therefore, it is possible to prevent the delay of the progress of the content due to the inappropriate information processing device being the specific device, and it is possible to improve the quality of the content presented to the user.

Further, in the information processing device as the embodiment, the content is a game content that progresses in the augmented reality space, and the specific process updates information commonly used by a plurality of information processing devices in the game progression, and other information. It is supposed to be a process of transmitting to the processing device.

As a result, it is possible to set an information processing device in a state suitable for executing the specific process for collectively managing the game progress as the specific device.
Therefore, it is possible to prevent the delay of the game progress due to the inappropriate information processing device being the specific device, and to improve the quality of the content presented to the user.

Further, in the information processing device as the embodiment, the state information is the battery remaining amount information, and the selection unit selects the specific device based on the result of comparing the battery remaining amounts of the plurality of information processing devices.

As a result, it is possible to determine, as the specific device, an information processing device that is in a state suitable for executing the specific process in terms of the remaining battery level, such as an information processing device having the highest remaining battery level.
Therefore, it is possible to prevent the information processing device, which has a low battery level and is inappropriate for executing the specific process, from being set as the specific device and delaying the progress of the content. The quality can be improved.

Furthermore, in the information processing device as the embodiment, the state information is information indicating the information processing capability, and the selection unit selects the specific device based on the result of comparing the information processing capabilities of the plurality of information processing devices. There is.

As a result, it is possible to determine, as the specific device, an information processing device in a state suitable for executing the specific process in terms of the information processing capability, such as an information processing device having the highest information processing capability.
Therefore, it is possible to prevent the information processing device, which has low information processing ability and is inappropriate for executing the specific process, from being the specific device and delays the progress of the content, and the content to be presented to the user can be prevented. The quality can be improved.

Further, in the information processing device as the embodiment, the state information is information indicating the communication state, and the selection unit selects the specific device based on a result of comparing the communication states of the plurality of information processing devices.

Accordingly, it is possible to determine, as the specific device, an information processing device in a state suitable for executing the specific process in terms of the communication state, such as an information processing device having the best communication state.
Therefore, it is possible to prevent the information processing apparatus, which has a poor communication state and is inappropriate for executing the specific processing, from being the specific apparatus and delaying the progress of the content, and the quality of the content presented to the user. It is possible to improve.

Further, in the information processing apparatus as the embodiment, the state information is information indicating the received field strength in wireless communication, and the selection unit selects the specific apparatus based on the result of comparing the received field strengths of the plurality of information processing apparatuses. is doing.

This makes it possible to determine an information processing device, such as an information processing device having the highest received radio field intensity, in a state suitable for executing the specific process in terms of high received radio field intensity, as the specific device. ..
Therefore, it is possible to prevent the information processing device, which has a low received radio wave intensity and is unsuitable for executing the specific process, from being the specific device and delaying the progress of the content, and the content presented to the user can be prevented. The quality can be improved.

Furthermore, in the information processing apparatus as the embodiment, the state information is information indicating the packet loss rate of the communication packet, and the selection unit determines the specific apparatus based on the result of comparing the packet loss rates of the plurality of information processing apparatuses. Is selected.

As a result, it is possible to determine an information processing apparatus, such as an information processing apparatus having the lowest packet loss rate, in a state suitable for executing the specific processing in terms of the packet loss rate, as the specific apparatus.
Therefore, it is possible to prevent the information processing device, which has a high packet loss rate and is inappropriate for executing the specific process, from being set as the specific device and delaying the progress of the content. The quality can be improved.

Further, in the information processing device as the embodiment, the state information is information indicating a layout relationship with respect to a specific virtual object in the augmented reality space, and the selection unit displays the layout relationship of the plurality of information processing devices as a result. The specific device is selected based on this.

The arrangement relationship of the information processing device (user) with respect to a specific virtual object in the AR space suggests the possibility of leaving the AR space sharing state with other devices. For example, it can be estimated that the further the information processing device is located with respect to a specific virtual object, the lower the interest of the user of the information processing device with respect to the content is. It can be estimated that there is a high possibility of leaving the space sharing state. Alternatively, even when the user of the information processing device keeps his or her back to a specific virtual object, it is estimated that the user of the information processing device has a low interest in the content and is likely to leave the AR space sharing state. it can.
Therefore, by selecting the specific device based on the result of comparing the arrangement relationship of each device with respect to the specific virtual object as described above, for example, an information processing device having the lowest possibility of leaving the AR space sharing state, such as an AR It is possible to define an information processing device in a state suitable for executing the specific process in terms of the possibility of leaving the space sharing state as the specific device.
Therefore, it is possible to prevent the information processing apparatus that is highly likely to leave the AR space sharing state and is inappropriate for executing the specific processing from being the specific apparatus and delaying the progress of the content. It is possible to improve the quality of the content presented to the user.

Further, in the information processing device as the embodiment, the state information is information indicating a distance to a specific virtual object in the augmented reality space, and the selection unit displays the result of comparing the distances of the plurality of information processing devices. The specific device is selected based on this.

Accordingly, for example, the information processing apparatus estimated to have the smallest separation distance and the lowest possibility of leaving the AR space sharing state performs the specific processing in terms of the possibility of leaving the AR space sharing state. It is possible to define an information processing device in a state suitable for the specific device.
Therefore, it is possible to prevent the information processing apparatus that is highly likely to leave the AR space sharing state and is inappropriate for executing the specific processing from being the specific apparatus and delaying the progress of the content. It is possible to improve the quality of the content presented to the user.

Furthermore, in the information processing apparatus as the embodiment, the selection unit is capable of changing the state comparison frequency, which is the frequency with which the state information is acquired from another apparatus and the states of a plurality of information processing apparatuses are compared.

When the state comparison frequency is low, the execution interval of the specific device selection performed based on the result of the state comparison becomes long, and therefore, between the execution timings of the specific device selection, the information processing device which is the specific device at that time is, for example, There is an increased possibility of leaving the AR space sharing state, such as leaving the communicable range. In other words, the situation where the specific device is absent is likely to occur, and the possibility of delaying the progress of the content increases.
On the other hand, when the state comparison frequency is high, the trackability of the specific device selection for the deterioration of the state of the specific device is increased, and therefore the speed with which the specific device in the deteriorated state is changed to the non-specific device (that is, that It is possible to improve the speed of selection of a device other than the specified device as the specified device), and reduce the possibility that the specified device is absent and the content progress is delayed as described above. It will be possible.
Further, when the state comparison frequency is increased, the processing load of the information processing device is increased by increasing the execution frequency of the process of acquiring and comparing the state information from another device, while the state comparison frequency is decreased. Reduces the processing load on the information processing apparatus.
Therefore, by making it possible to change the status comparison frequency as described above, it is possible to adjust the processing load reduction effect of the information processing apparatus and the delay prevention effect of the content progress.

Further, in the information processing apparatus as the embodiment, the selection unit changes the state comparison frequency according to the communication state of the specific apparatus.

Thereby, for example, the state comparison frequency is increased in a situation where the communication state of the specific device is deteriorated, and the state comparison frequency is decreased in a state where the communication state of the specific device is not deteriorated. Is possible.
Therefore, it is possible to reduce the processing load on the information processing apparatus while preventing the delay of the progress of the content corresponding to the case where the specific apparatus is estimated to leave the AR space sharing state due to the deterioration of the communication state. it can.

Further, in the information processing device as the embodiment, the selection unit increases the frequency of state comparison according to the deterioration of the communication state of the specific device.

As a result, the state comparison frequency is increased in a situation where the communication state of the specific device is deteriorated, and is reduced in a situation where the communication state of the specific device is not deteriorated.
Therefore, it is possible to reduce the processing load on the information processing apparatus while preventing the delay of the progress of the content corresponding to the case where the specific apparatus is estimated to leave the AR space sharing state due to the deterioration of the communication state. it can.

Furthermore, in the information processing apparatus as the embodiment, the selection unit changes the state comparison frequency according to the arrangement relationship of the specific apparatus with respect to the specific virtual object in the augmented reality space.

As a result, the state comparison frequency is increased in a situation where there is a high possibility that the specific device will leave the AR space sharing state, for example, when the specific device is located far from the specific virtual object. In the situation where the specific device is not likely to leave the AR space sharing state, such as being located close to it, the frequency of state comparison is reduced, etc. It is possible to perform various state comparison frequency adjustments.
Therefore, the processing load of the information processing apparatus can be prevented while preventing the delay of the content progress corresponding to the case where the specific apparatus is estimated to leave the AR space sharing state in terms of the layout relationship with respect to the specific virtual object. Can be reduced.

Further, the information processing method as the embodiment generates an image of content visually representing an augmented reality space constructed by arranging virtual objects in a real space, and uses the status information of the own device and the status information of another device as the status information. Based on the result of comparing the states of a plurality of information processing devices including the own device and other devices sharing the augmented reality space, only a specific information processing device among the plurality of information processing devices is permitted to execute. This is an information processing method for selecting a specific device that executes a specific process.

With the information processing method as such an embodiment, the same operation and effect as those of the information processing apparatus as the above-described embodiment can be obtained.

Further, the program of the embodiment generates an image of content visually representing an augmented reality space constructed by arranging virtual objects in a real space, and based on the status information of the own device and the status information of another device. , A specific process in which only a specific information processing device of the plurality of information processing devices is permitted to execute based on a result of a state comparison of a plurality of information processing devices including its own device and another device sharing the augmented reality space Is a computer-readable program that causes a computer device to execute a process of selecting a specific device for executing the process.

With such a program, the information processing apparatus as the above-described embodiment can be realized.

It should be noted that the effects described in the present specification are merely examples and are not limited, and may have other effects.

<9. This technology>

Note that the present technology can also take the following configurations.
(1)
An image generation unit that generates an image of contents visually representing an augmented reality space constructed by arranging virtual objects in a real space,
On the basis of the status information of the own apparatus and the status information of the other apparatus, based on the result of the status comparison of the plurality of information processing apparatuses including the own apparatus and the other apparatus sharing the augmented reality space, the plurality of information processing apparatuses An information processing apparatus, comprising: a selection unit that selects a specific apparatus that executes a specific process that is permitted to be executed by only a specific information processing apparatus among the information processing apparatuses.
(2)
The content is game content that progresses in the augmented reality space,
The information processing device according to (1), wherein the identification process is a process of updating information commonly used by the plurality of information processing devices in a game progress and transmitting the information to another information processing device.
(3)
The status information is battery level information,
The selection unit,
The information processing apparatus according to (1) or (2), wherein the specific apparatus is selected based on a result of comparing remaining battery levels of the plurality of information processing apparatuses.
(4)
The state information is information indicating information processing ability,
The selection unit,
The information processing device according to any one of (1) to (3), wherein the specific device is selected based on a result of comparison of information processing capabilities of the plurality of information processing devices.
(5)
The state information is information indicating a communication state,
The selection unit,
The information processing apparatus according to any one of (1) to (4), wherein the specific apparatus is selected based on a result of comparing communication states of the plurality of information processing apparatuses.
(6)
The state information is information indicating the strength of received radio waves in wireless communication,
The selection unit,
The information processing device according to (5), wherein the specific device is selected based on a result of comparison of received field strengths of the plurality of information processing devices.
(7)
The state information is information indicating a packet loss rate for communication packets,
The selection unit,
The information processing apparatus according to (5), wherein the specific apparatus is selected based on a result of comparing packet loss rates of the plurality of information processing apparatuses.
(8)
The state information is information indicating an arrangement relationship with respect to the specific virtual object in the augmented reality space,
The selection unit,
The information processing apparatus according to any one of (1) to (7), wherein the specific apparatus is selected based on a result of comparing the arrangement relationships of the plurality of information processing apparatuses.
(9)
The state information is information indicating a distance to the specific virtual object in the augmented reality space,
The selection unit,
The information processing apparatus according to (8), wherein the specific apparatus is selected based on a result of comparing the separation distances of the plurality of information processing apparatuses.
(10)
The selection unit,
The information processing device according to any one of (1) to (9), wherein the state comparison frequency, which is a frequency of performing the state comparison of the plurality of information processing devices by acquiring the state information from the other device, is changeable. .
(11)
The selection unit,
The information processing device according to (10), wherein the state comparison frequency is changed according to a communication state of the specific device.
(12)
The selection unit,
The information processing apparatus according to (11), wherein the state comparison frequency is increased according to deterioration of a communication state of the specific apparatus.
(13)
The selection unit,
The information processing apparatus according to any one of (10) to (12), wherein the state comparison frequency is changed according to an arrangement relationship of the specific apparatus with respect to the specific virtual object in the augmented reality space.

1 Information processing device, 2 Stereo camera unit, 2L left-eye imaging unit, 2R right-eye imaging unit, 3 display unit, 3L left-eye display unit, 3R right-eye display unit, 4 image input unit, 5 sensor unit, 7 communication unit , 8 battery, 9 CPU, 12 image output unit, P1, P2 user, Ro object, Vp1, Vp2, Vo virtual object, F1 spatial information management unit, F2 game information management unit, F3 game information processing unit, F4 output image generation Section, F5 battery management section, F6 CPU management section, F7 communication status management section, F8 master/slave switching control section

Claims (15)

An image generation unit that generates an image of contents visually representing an augmented reality space constructed by arranging virtual objects in a real space,
On the basis of the status information of the own apparatus and the status information of the other apparatus, based on the result of the status comparison of the plurality of information processing apparatuses including the own apparatus and the other apparatus sharing the augmented reality space, the plurality of information processing apparatuses An information processing apparatus, comprising: a selection unit that selects a specific apparatus that executes a specific process that is permitted to be executed by only a specific information processing apparatus among the information processing apparatuses. The content is game content that progresses in the augmented reality space,
The information processing device according to claim 1, wherein the identification process is a process of updating information commonly used by the plurality of information processing devices during game progress and transmitting the information to another information processing device. The status information is battery level information,
The selection unit,
The information processing device according to claim 1, wherein the specific device is selected based on a result of comparing remaining battery levels of the plurality of information processing devices. The state information is information indicating information processing ability,
The selection unit,
The information processing device according to claim 1, wherein the specific device is selected based on a result of comparison of information processing capabilities of the plurality of information processing devices. The state information is information indicating a communication state,
The selection unit,
The information processing apparatus according to claim 1, wherein the specific apparatus is selected based on a result of comparing communication states of the plurality of information processing apparatuses. The state information is information indicating the strength of received radio waves in wireless communication,
The selection unit,
The information processing device according to claim 5, wherein the specific device is selected based on a result of comparison of received field strengths of the plurality of information processing devices. The state information is information indicating a packet loss rate for communication packets,
The selection unit,
The information processing apparatus according to claim 5, wherein the specific apparatus is selected based on a result of comparing packet loss rates of the plurality of information processing apparatuses. The state information is information indicating an arrangement relationship with respect to the specific virtual object in the augmented reality space,
The selection unit,
The information processing apparatus according to claim 1, wherein the specific apparatus is selected based on a result of comparing the arrangement relationships of the plurality of information processing apparatuses. The state information is information indicating a distance to the specific virtual object in the augmented reality space,
The selection unit,
The information processing apparatus according to claim 8, wherein the specific apparatus is selected based on a result of comparing the separation distances of the plurality of information processing apparatuses. The selection unit,
The information processing apparatus according to claim 1, wherein a state comparison frequency, which is a frequency of acquiring the state information from the other apparatus and performing state comparison of the plurality of information processing apparatuses, is changeable. The selection unit,
The information processing device according to claim 10, wherein the state comparison frequency is changed according to a communication state of the specific device. The selection unit,
The information processing device according to claim 11, wherein the state comparison frequency is increased according to deterioration of the communication state of the specific device. The selection unit,
The information processing apparatus according to claim 10, wherein the state comparison frequency is changed according to an arrangement relationship of the specific apparatus with respect to the specific virtual object in the augmented reality space. Generates an image of content that visually represents an augmented reality space constructed by placing virtual objects in the real space,
On the basis of the status information of the own apparatus and the status information of the other apparatus, based on the result of the status comparison of the plurality of information processing apparatuses including the own apparatus and the other apparatus sharing the augmented reality space, the plurality of information processing apparatuses An information processing method for selecting a specific device that executes a specific process of which only a specific information processing device is permitted to execute among the information processing devices. Generates an image of content that visually represents an augmented reality space constructed by placing virtual objects in the real space,
On the basis of the status information of the own apparatus and the status information of the other apparatus, based on the result of the status comparison of the plurality of information processing apparatuses including the own apparatus and the other apparatus sharing the augmented reality space, the plurality of information processing apparatuses A computer-readable program that causes a computer device to execute a process of selecting a specific device that executes a specific process of which only a specific information processing device is permitted to execute among the information processing devices.

Images