WO2019225115A1

WO2019225115A1 - Information processing device, information processing method, and program

Info

Publication number: WO2019225115A1
Application number: PCT/JP2019/008845
Authority: WO
Inventors: 文彦飯田; 宇津木　慎吾
Original assignee: ソニー株式会社
Priority date: 2018-05-24
Filing date: 2019-03-06
Publication date: 2019-11-28
Also published as: JP2021140194A

Abstract

[Problem] To provide an information processing device, an information processing method, and a program that are capable of restricting content to be provided to a real space in accordance with a real environment. [Solution] This information processing device comprises: an output control unit that performs output control on content, on the basis of content information including information relating to a content area in a real space to which the content is to be provided; and an environment information acquisition unit that acquires environment information relating to the real space to which the content is provided. The output control unit changes the provided content details if the environment information satisfies a first condition, and if the environment information satisfies a second condition different from the first condition.

Description

Information processing apparatus, information processing method, and program

The present disclosure relates to an information processing apparatus, an information processing method, and a program.

Recently, a technology called AR (Augmented Reality) that expands the real environment perceived by humans by superimposing additional information in real space has been widely used, and information presentation using AR technology has been performed. ing. Information presented to the user is visualized using various forms of virtual objects such as text, icons, images, and 3D models.

In AR technology, an optical transmission display is a display device that has recently been used as a display that superimposes and displays a virtual 3D object or the like in the real world. The optical transmission display is suitable for AR outdoors because it can see the virtual world while viewing the real world with the naked eye, and it can be further spread as a device that enjoys AR content outdoors. The nature is great. As AR contents to be enjoyed outdoors, in addition to information presentation and navigation, a competitive game using the actual environment is also provided.

Here, for example, in Patent Document 1 below, in an apparatus that enjoys the VR (Virtual Reality) world by wearing a non-transparent HMD (Head Mounted Display), it is impossible to see the outside world. A technique is disclosed in which a collision with a real world obstacle can be avoided by replacing the virtual object with the virtual object and arranging the virtual object in the VR space.

JP 2013-257716 A

With the spread of wearable display devices (for example, glasses-type HMDs) using the optical transmission type display as described above, provision of AR contents indoors and outdoors has also become widespread. Regarding the provision of AR content, the affinity between the AR content and the real environment (the real space environment) greatly affects the sense of immersion in the content.

On the other hand, there are various obstacles (artifacts, natural objects) such as signboards, utility poles, fences, installations, steps, passers-by, and dangerous places in the real space, so it is necessary to consider safety There is.

Therefore, the present disclosure proposes an information processing apparatus, an information processing method, and a program that can restrict content provided to a real space according to a real environment.

According to the present disclosure, an output control unit that performs output control regarding the content based on content information including information regarding a content area in the real space where the content is provided, and an environment regarding the real space where the content is provided An environment information acquisition unit configured to acquire information, and the output control unit includes the content when the environment information satisfies a first condition and when the second condition is different from the first condition. Proposes an information processing device that changes the content provided.

According to the present disclosure, the processor performs output control regarding the content based on content information including information regarding a content area in the real space where the content is provided, and relates to the real space where the content is provided. Acquiring environmental information; changing the content provided by the content when the environmental information satisfies a first condition; and when satisfying a second condition different from the first condition; An information processing method is proposed.

According to the present disclosure, the computer controls an output control unit that performs output control on the content based on content information including information on a content area in a real space where the content is provided, and the actual information on which the content is provided. The output control unit functions as an environment information acquisition unit that acquires environment information related to space, and the output control unit satisfies a second condition different from the first condition when the environmental information satisfies the first condition In some cases, a program is proposed for changing the contents provided.

As described above, according to the present disclosure, it is possible to limit the content provided to the real space according to the real environment.

Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

It is a figure explaining an outline of an information processing system by one embodiment of this indication. It is a figure which shows an example of the whole structure of the information processing system by this embodiment. It is a block diagram which shows an example of a structure of the information processing apparatus by this embodiment. It is a flowchart which shows an example of the flow of the operation | movement process of the content provision control by this embodiment. It is a flowchart which shows an example of the flow of a provision control process of the tennis game content by the 1st Example of this embodiment. It is a figure which shows an example of the map information referred by the 1st Example of this embodiment. It is a figure which shows an example of the map information with the play performance to refer by the 1st Example of this embodiment. It is a figure which shows an example of the information of the user who exists in the candidate play area vicinity by the 1st Example of this embodiment. It is a figure which shows the example of a display in the case of notifying a user that the game participation by the 1st Example of this embodiment is possible. It is a figure which shows an example of the notification to the user at the time of the play area setting by the 1st Example of this embodiment. It is a figure which shows an example of the notification of the game content by the 1st Example of this embodiment. It is a figure which shows an example of the notification induced | guided | derived to the other candidate area by the 1st Example of this embodiment. It is a flowchart which shows an example of the flow of a judgment process of the play area setting availability by the 1st Example of this embodiment. It is a flowchart which shows an example of the flow of a judgment process of the play area setting availability by the 1st Example of this embodiment. It is a figure explaining the case where a watching area is provided around the play area by the 1st Example of this embodiment. It is a figure explaining the case where a spacer area is set between the play area and the watching area according to the first example of the present embodiment. It is a flowchart which shows an example of the flow of the rule change process by the 1st Example of this embodiment. It is a figure which shows the example of a display in the case of notifying a user that the game participation by the 2nd Example of this embodiment is possible. It is a figure which shows the example of a display in the case of notifying a user that he can participate in the game by the 2nd Example of this embodiment on the way. It is a flowchart which shows an example of the flow of a judgment process of the play area setting availability by 2nd Example of this embodiment. It is a flowchart which shows an example of the flow of a judgment process of the play area setting availability by 2nd Example of this embodiment. It is a figure explaining the case where the play area setting is impossible by the 2nd example of this embodiment. It is a figure explaining the case where the shortage of the real obstacle by the 2nd Example of this embodiment is compensated with a virtual object. It is a figure explaining the play area containing the real obstacle more than the fixed prescribed | regulated by the ideal environment information by the 2nd Example of this embodiment. It is a flowchart which shows an example of the flow of the rule change process by the 2nd Example of this embodiment. It is a figure which shows an example of the notification of the meeting place in the survival game by the 2nd Example of this embodiment. It is a figure explaining the case where the participation decision | availability to the game by the 2nd Example of this embodiment is determined from a user action. It is a figure explaining the indoor game matching by the 3rd Example of this embodiment. It is a figure explaining the setting of the play area which considered the indoor obstacle by the 3rd Example of this embodiment.

Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

The description will be made in the following order.
1. 1. Overview of information processing system according to an embodiment of the present disclosure Configuration example 2-1. System configuration example 2-2. 2. Configuration example of information processing apparatus Operation processing Example 4-1. First Example: Provision Example of Tennis Game Content 4-2. Second Example: Provision of Survival Game Content 4-3. Third embodiment: Provision example of table tennis game contents Summary

<< 1. Overview of Information Processing System According to One Embodiment of Present Disclosure >>
FIG. 1 is a diagram illustrating an overview of an information processing system according to an embodiment of the present disclosure. As shown in FIG. 1, the information processing system according to the present embodiment displays a virtual object superimposed at an arbitrary position in the real space using an optically transmissive display (information processing apparatus 10) worn by the user on the head. Provide AR content such as information and games.

Here, as described above, regarding the provision of AR content, the affinity between the AR content and the actual environment greatly affects the sense of immersion in the content, while the real space includes walls, utility poles, signboards, fences, etc. There are various obstacles (artifacts, natural objects) such as various installations and passers-by, and dangerous places such as steps, so it is necessary to consider safety. In particular, in game content that is assumed to move around outdoors, such as a competitive AR game, consideration of the actual environment (the presence or absence of obstacles, etc.) in the content providing area (content area) is important for safety. However, it is possible to make the user recognize the obstacle by performing warning display on the obstacle or making the obstacle conspicuous, but such display control is not preferable from the viewpoint of the affinity with the content. , Impedes the sense of immersion in the content.

Therefore, in the information processing system according to the present embodiment, the content to be provided in the real space depends on the real environment (the real space environment, for example, the presence or absence of an obstacle, the size of the flat area, a dangerous place such as a step). It is possible to limit and realize safety without impeding immersive feeling.

Specifically, for example, by limiting the content area and rules to be provided, or by using obstacles for the content, a sense of immersion in the content is realized while maintaining safety.

For example, in the example illustrated in FIG. 1,

obstacles

60 a and 60 b that exist in real space when tennis game content is provided on the display unit 120 (optical transmission display) of the information processing apparatus 10 worn by the user. , 60c, a virtual object used in the AR game content to be provided, for example, a tennis net image 401 is superimposed and displayed. Then, the tennis court image 400 is displayed on the road according to the position of the tennis net image 401.

As described above, the

obstacles

60a, 60b, and 60c are collided with each other by controlling the arrangement of the virtual objects and the setting of the game content provision area so that the virtual objects are used (partially superimposed). It is possible to realize a sense of immersion in the content while avoiding danger in the real space.

Subsequently, the information processing apparatus 10 according to the present embodiment that provides AR content will be described. As shown in FIG. 1, the information processing apparatus 10 is realized by, for example, a glasses-type head mounted display (HMD) that is attached to the user's head. The display unit 120 corresponding to the spectacle lens portion positioned in front of the user's eyes when worn may be a so-called optical see-through display having optical transparency. The information processing apparatus 10 can present the virtual object in the user's field of view by displaying the virtual object on the display unit 120. Moreover, HMD which is an example of the information processing apparatus 10 is not limited to what displays an image to both eyes, You may show an image only to one eye. For example, the HMD may be a one-eye type provided with a display unit 120 that presents an image to one eye.

Also, the information processing apparatus 10 is provided with an outward camera 111 that captures the user's line-of-sight direction, that is, the user's field of view when worn. Further, although not shown in FIG. 1, the information processing apparatus 10 may be provided with various sensors such as an inward camera and a microphone (hereinafter referred to as “microphone”) that captures the user's eyes when worn. . A plurality of outward cameras 111 and inward cameras may be provided.

The shape of the information processing apparatus 10 is not limited to the example shown in FIG. For example, the information processing apparatus 10 is an HMD of a headband type (a type that is worn by a band that goes around the entire circumference of the head, or a band that passes through the top of the head as well as the temporal region) or a helmet type. HMD of the helmet (the visor part of the helmet corresponds to the display unit 120) may be used.

The information processing apparatus 10 can perform control that makes the user feel as if a virtual object to be superimposed and displayed in the real space exists in the real space. For example, the arrangement and shape of the virtual object may be controlled based on real space information obtained by imaging with the outward camera 111, for example, information on the position and shape of the real object existing in the real space.

The information processing system according to an embodiment of the present disclosure has been described above. Next, the configuration and operation processing of the information processing system according to the present embodiment will be described.

<< 2. Configuration example >>
<2-1. System configuration example>
FIG. 2 is a diagram illustrating an example of the overall configuration of the information processing system according to the present embodiment. As shown in FIG. 2, for example, the information processing system 1 according to the present embodiment includes an information processing apparatus 10 that provides content to each user, and a server 20. The information processing apparatus 10 and the server 20 are connected via a network 30 and can transmit and receive data.

The information processing apparatus 10 is a wearable device that provides a user with AR content that adds information to the real space and expands the real environment. For example, the information processing apparatus 10 may be a handheld type such as a smartphone or the user's head It may be an HMD attached to the earphone, an earphone shape attached to the ear, or a neck-shaped device attached to the neck. Further, the content to be provided is assumed to be various information that stimulates human perception, such as an image, sound, or vibration. The information processing apparatus 10 acquires content data from the server 20 and appropriately performs virtual object presentation control based on the content data according to the actual environment.

The server 20 accumulates content data and provides the content data to the information processing apparatuses 10 (10a to 10c...) Of each user. Further, when providing the game content to the user, the server 20 acquires position information of a plurality of users from the information processing apparatus 10 possessed by each user, and selects a player or invites the user to a game. Good.

The system configuration shown in FIG. 2 is an example, and the present embodiment is not limited to this. For example, the information processing apparatus 10 may search for opponents that exist in the vicinity, and may invite the device of the opponent to the game.

<2-2. Configuration of Information Processing Device 10>
FIG. 3 is a block diagram illustrating an example of the configuration of the information processing apparatus 10 according to the present embodiment. As illustrated in FIG. 3, the information processing apparatus 10 includes a sensor unit 110, a control unit 100, a display unit 120, a speaker 130, a communication unit 140, an operation input unit 150, and a storage unit 160.

(Sensor unit 110)
The sensor unit 110 has a function of acquiring (sensing) various information related to the user or the surrounding environment. For example, the sensor unit 110 includes an outward camera 111, an inward camera 112, a microphone 113, a gyro sensor 114, an acceleration sensor 115, an azimuth sensor 116, a position positioning unit 117, and a biological sensor 118. In addition, the specific example of the sensor mentioned here is an example, Comprising: This embodiment is not limited to this. For example, an environmental sensor such as an illuminance sensor or a temperature sensor, an ultrasonic sensor, an infrared sensor, or the like may be included. Moreover, each sensor may be plural.

The outward camera 111 and the inward camera 112 are obtained by a lens system including an imaging lens, a diaphragm, a zoom lens, a focus lens, and the like, a drive system that causes the lens system to perform a focus operation and a zoom operation, and a lens system. Each has a solid-state image sensor array that photoelectrically converts captured image light to generate an image signal. The solid-state imaging device array may be realized by a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array, for example.

In this embodiment, it is desirable that the outward camera 111 is set to have an angle of view and an orientation so as to capture an area corresponding to the user's field of view in real space. A plurality of outward cameras 111 may be provided. Further, the outward camera 111 may include a depth camera that can acquire depth information (depth map) of the surrounding environment. The imaging wavelength may be in the visible light range, may include from the ultraviolet to the infrared range, and may be limited to a part of the wavelength. Further, the outward camera 111 may be used in combination with a distance measuring sensor (ultrasonic wave, ToF, etc.) that measures the distance to the object.

Also, the inward camera 112 can capture the user's eyes and acquire the user's line-of-sight information. The imaging wavelength of the inward camera 112 may be in the visible light region, may include from the ultraviolet region to the infrared region, and may be limited to some wavelengths.

The microphone 113 collects the user's voice and surrounding environmental sound, and outputs it to the control unit 100 as voice data. Further, the microphone 113 may be used for communication through sound waves in the inaudible range, and the principle such as a condenser microphone is not specified. The microphone 113 may be an array microphone.

The gyro sensor 114 is realized by a three-axis gyro sensor, for example, and detects an angular velocity (rotational speed).

The acceleration sensor 115 is realized by, for example, a three-axis acceleration sensor, and detects acceleration during movement.

The direction sensor 116 is realized by, for example, a three-axis geomagnetic sensor (compass), and detects an absolute direction (direction).

The position positioning unit 117 calculates the self-position of the information processing apparatus 10. For example, the position measurement unit 117 may use so-called SLAM (simultaneous localization and mapping) as a self-position estimation technique. The SLAM algorithm is not particularly limited. For example, a Landmark based SLAM that uses landmarks expressed in point coordinates on a map may be used. The Landmark based SLAM recognizes a characteristic object as a landmark, generates a map of the landmark, and feeds back to the self-position estimation using the coordinate information of the landmark.

Further, the position positioning unit 117 may detect the current position of the information processing apparatus 10 based on an externally acquired signal. Specifically, for example, the position positioning unit 117 is realized by a GPS (Global Positioning System) positioning unit, receives a radio wave from a GPS satellite, detects a position where the information processing apparatus 10 exists, and detects the position. The position information is output to the control unit 100. In addition to GPS, the position measurement unit 117 detects the position by, for example, Wi-Fi (registered trademark), Bluetooth (registered trademark), transmission / reception with a mobile phone / PHS / smartphone, or short distance communication. There may be.

The biosensor 118 is a detection unit that detects biometric information of the user, and senses, for example, body temperature, veins, pulse, heartbeat, sweating, blood pressure, brain waves, electrooculogram, myoelectric value, and the like.

(Control unit 100)
The control unit 100 functions as an arithmetic processing unit and a control unit, and controls overall operations in the information processing apparatus 10 according to various programs. The control unit 100 is realized by an electronic circuit such as a CPU (Central Processing Unit) and a microprocessor, for example. The control unit 100 may include a ROM (Read Only Memory) that stores programs to be used, calculation parameters, and the like, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate. In addition, the control unit 100 according to the present embodiment has various information processing functions and an output control function.

Further, as shown in FIG. 3, the control unit 100 according to the present embodiment includes a user physical information acquisition unit 101, a user situation determination unit 102, an environment information acquisition unit 103, a conformity determination unit 104, a content content change unit 105, and It functions as the output control unit 106.

The user physical information acquisition unit 101 performs aggregation and management of information (sensing data) acquired from the sensor unit 110. The user physical information acquisition unit 101 may accumulate the collected sensing data in the storage unit 160.

The user situation determination unit 102 analyzes the sensing data aggregated by the user physical information acquisition unit 101 and determines the user situation. For example, based on the captured image of the user's eye acquired by the inward camera 112, the user situation determination unit 102 determines the position of the eye reference point (eye and corneal reflection) and moving point (iris, pupil, etc.). User's gaze information (gaze direction) is acquired. The line-of-sight detection method is not limited to this. For example, a method of detecting from the detection result of an electrooculogram sensor, or a method of detecting infrared rays (IR) on the eyeball and detecting the reflected light (corneal reflection method or A scleral reflection method, etc.). Further, the user status determination unit 102 may acquire biological information such as the number of blinks based on the captured image of the user's eye acquired by the inward camera 112, and the environmental illuminance state based on the size of the pupil. Etc. can also be estimated. The user status determination unit 102 determines whether the user is focused on the object to be watched, the user is focused on something, the tension state, the relaxed state, the leisure time, or the like based on information on the user's line of sight, blinking, etc. It is possible to determine whether the state is correct.

In addition, the user situation determination unit 102 analyzes the audio data detected by the microphone 113, and the surrounding environment (whether it is a quiet place, a noisy place, whether there are many people in the vicinity, whether a car is passing, etc.) And the user's utterance status (whether chatting or being alone).

Also, the user situation determination unit 102 can grasp the movement situation, posture, position, etc. of the user from the sensing data of the gyro sensor 114, the acceleration sensor 115, and the direction sensor 116.

Also, the user situation determination unit 102 can estimate the environment around the user and the user situation from the position information of the position measurement unit 117.

In addition, the user situation determination unit 102 can grasp the user's activity state, tension state, concentration state, and the like based on the biological information acquired by the biological sensor 118.

The user situation determination unit 102 can determine various situations of the user by combining various sensing data as described above. For example, whether the user is commuting, going home, on the way to the station, on a walk, having a lot of luggage, empty-handed, or rushing home It is possible to determine various situations that may occur in daily life, such as whether or not shopping.

The environment information acquisition unit 103 acquires environment information around the user based on the sensing data of the sensor unit 110. For example, the environment information acquisition unit 103 can acquire the presence / absence or location of an obstacle around the user, the illuminance environment, and the like based on the captured image captured by the outward camera 111. In addition, the environment information acquisition unit 103 acquires known environment information (for example, facility information, location information such as private land, road, area, environment attributes (lawn, sand, etc.)) from a database such as map information. May be.

Also, the environment information acquisition unit 103 recognizes the surrounding three-dimensional spatial information based on the sensing data acquired by the sensor unit 110 and accumulates the three-dimensional spatial information in the storage unit 160.

The conformity determination unit 104 determines suitability for content in the surrounding environment based on the environment information (actual environment information) acquired by the environment information acquisition unit 103. At this time, the conformity determination unit 104 calls ideal environment information stored in the storage unit 160 indicating ideal environment conditions (recommended conditions) for content provision, and compares them with the actual environment to determine conformity. May be. The ideal environment information is included in the content data acquired from the server 20 (application data for executing content provision), and more specifically, for example, when experiencing the size (dimension) / shape of the content area and the content. The size, shape, number, and arrangement of (virtual) tools and equipment to be used, weather, ground conditions (for example, soil, lawn, concrete, gravel, presence of slope, flat area) are assumed. The ideal environment information may also define conditions for a lower limit value and an upper limit value that are assumed to be able to provide content, such as ensuring game characteristics, in addition to ideal environment conditions. The conformity determination unit 104 determines whether the content conforms to the actual environment, whether the actual environment satisfies the recommended condition (first condition), or at least the lower limit or upper limit condition (second condition). Judge whether to satisfy.

Also, the conformity determination unit 104 can refer to the user situation determined by the user situation determination unit 102 and determine whether or not the situation is suitable for providing content to the user. For example, in the case of competitive game content, whether to participate in the game (whether or not it is possible to participate) is determined according to the user situation. For example, the suitability determination unit 104 determines that it is not possible to participate in the game when the user is commuting or in a hurry.

The content content changing unit 105 changes the content to be provided based on the determination result of the conformity determining unit 104. For example, the content content changing unit 105 determines that the actual environment satisfies the recommended conditions (for example, conditions regarding the area, shape, and presence / absence of obstacles of the content area) and the conditions for the lower limit or upper limit (for example, the lower limit of the area of the content area). Content, the condition of the size, the number of obstacles, the upper limit value of the number, etc.) are satisfied. More specifically, when the actual environment satisfies the recommended condition, the content content changing unit 105 provides the predetermined content content without any limitation, while the actual environment does not satisfy the recommended condition but the lower limit value or When the condition of the upper limit value is satisfied, the contents are limited and provided. For example, when the actual environment does not satisfy the recommended condition but satisfies the lower limit value or the upper limit value, the content content changing unit 105 provides the content area with a limited shape and area. Accordingly, the content content changing unit 105 can change the default rule so that the content can be provided even when the shape and area are limited. In addition, the content content changing unit 105 does not satisfy the recommended condition for the number of players for the content area. Rule changes can be made. Further, the content content changing unit 105 may change the content of the content to be provided according to the user situation. For example, the content content changing unit 105 may appropriately limit the content to be provided according to the age, sex, experience value, and the like of the user.

The output control unit 106 controls information notification from the display unit 120 and the speaker 130 to the user. The information notification content may relate to content to be provided such as notification (image, text, sound) related to operations such as start of game content, display of game content play area, rule display, and the like. Further, the output control unit 106 can perform generation, display (AR display), and the like of a virtual object in accordance with the provision of content. For example, the output control unit 106 is based on the environment information acquired by the environment information acquisition unit 103. In this specification, the “obstacle” is not limited to an object existing outdoors, but is present indoors. The virtual object used in the content is superimposed on the object to be played (for example, furniture, daily necessities, etc.), or the virtual object that clearly indicates the range of the play area in the real space is superimposed (play area boundary line) Display and field decoration display).

(Display unit 120)
The display unit 120 has optical transparency, and is realized by, for example, a lens unit that performs display using a hologram optical technique, a liquid crystal display (LCD) device, an organic light emitting diode (OLED) device, or the like. The optical transparency of the display unit 120 may be controlled by the control unit 100. The display unit 120 may be a video transmission type display. The video transmission type display displays a virtual object superimposed on an image of the real world.

(Speaker 130)
The speaker 130 reproduces an audio signal according to the control of the control unit 100. The speaker 130 may be a directional speaker. The speaker 130 may be realized by a pair of earphones.

(Communication unit 140)
The communication unit 140 is a communication module for transmitting / receiving data to / from other devices by wire / wireless. The communication unit 140 is a system such as a wired LAN (Local Area Network), a wireless LAN, Wi-Fi (registered trademark) (Wireless Fidelity), infrared communication, Bluetooth (registered trademark), short-range / non-contact communication, and the like. Wirelessly communicate with the device directly or via a network access point. For example, the communication unit 140 can communicate with a device used by another user, a device group worn by the user itself, or the server 20 on the network to transmit and receive data.

(Operation input unit 150)
The operation input unit 150 is realized by an operation member having a physical structure such as a switch, a button, or a lever.

(Storage unit 160)
The storage unit 160 is realized by a ROM (Read Only Memory) that stores programs and calculation parameters used for the processing of the control unit 100 described above, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate. .

The storage unit 160 according to the present embodiment includes, for example, real environment information such as three-dimensional space information acquired by the environment information acquisition unit 103, sensing data aggregated by the user physical information acquisition unit 101, and user status determination unit 102 The determined user situation, content data (including ideal environment information), and the like are accumulated.

The configuration of the information processing apparatus 10 according to the present embodiment has been specifically described above. The configuration of the information processing apparatus 10 is not limited to the example illustrated in FIG. For example, at least a part of the configuration of the information processing apparatus 10 may be in the external apparatus, and at least a part of each function of the control unit 100 may be in the server 20.

<< 3. Action processing >>
Next, an operation process of the information processing system according to the present embodiment will be described with reference to FIG.

FIG. 4 is a flowchart showing an example of the flow of operation processing for content provision control according to the present embodiment. As shown in FIG. 4, first, the environment information acquisition unit 103 of the information processing apparatus 10 acquires environment information around the user based on the sensing data of the sensor unit 110 (step S103). In addition, the environment information acquisition unit 103 acquires the location of the user and location information within a predetermined range from map information (such as a database on the network) based on the location information of the user as environment information around the user. May be. The environment information acquisition unit 103 may acquire weather information, weather forecast information, and the like from the network based on the user position information. Further, the information processing apparatus 10 may prompt the user to look around and acquire the surrounding information by the sensor unit 110. Further, the environment information acquisition unit 103 may recognize the position of another user and the distance between the user and another user based on sensing data and communication with a device worn by another user around.

Next, the user status determination unit 102 of the information processing apparatus 10 determines the user status based on the sensing data from the sensor unit 110 (step S106). In addition, the user situation determination unit 102 is not limited to sensing data, and acquires user schedule information, usual action history, contents posted to a social network, and the like, and based on these, the user situation is more detailed. It is also possible to judge.

Next, the control unit 100 of the information processing apparatus 10 determines matching content (step S109). The control unit 100 may determine upper content based on, for example, priority (recommended ranking, ranking according to user preference, etc.). In addition, the control unit 100 may select from applications (contents) installed in the information processing apparatus 10 or may select from contents desired (registered) by the user in advance. Further, the control unit 100 may determine the content to be matched depending on whether the user is indoors or outdoors.

Next, the conformity determination unit 104 of the information processing apparatus 10 determines whether or not the determined content can be provided to the user (step S112). For example, the suitability determining unit 104 determines the suitability of content matching according to the environment information acquired by the environment information acquiring unit 103 and the user situation determined by the user situation determining unit 102. For example, when matching outdoors, in the case of stormy weather such as rainy weather or typhoon, or when the time zone is late, such as late at night, the provision of the content is stopped because the risk is high (low suitability). The weather forecast data may be acquired to take into account detailed weather. On the other hand, when matching indoors such as a shopping center, the weather need not be considered. In addition, while the user is on the way to work or waiting for a meeting, since the user cannot participate in the game content (low compatibility), the provision is stopped.

Subsequently, when the content can be provided to the user (step S112 / Yes), the conformity determination unit 104 determines whether the real environment matches the ideal environment condition of the content (the condition indicated by the ideal environment information). It is determined whether or not (step S115). For example, the conformity determination unit 104 can ensure the content area indicated by the ideal environment information, and if an actual object is used for the content, consider whether the predetermined actual object exists, and the conditions of the ideal environment It is determined whether or not it matches. At the same time, the conformity determination unit 104 determines that the content area is safe based on the actual environment (there is no road or private land, there are no dangerous places in the vicinity, or there is a possibility that many people will collide. If it is not safe (it can be said that the risk is high and the suitability is low), the provision of the content may be stopped.

Next, when the real environment does not match the condition of the ideal environment of the content (step S115 / No), the content content changing unit 105 of the information processing apparatus 10 restricts the content content according to the real environment (step S118). Specifically, the content content changing unit 105 matches the actual environment by limiting the size and shape of the content area from the conditions of the ideal environment, or in the case of competitive AR game content, By matching the number of people and rules, it will be matched to the real environment. At this time, the content content changing unit 105 changes the content according to the lower limit value or the upper limit value included in the ideal environment conditions, and if the content cannot be matched even if the content is changed, the content is provided. May be canceled and another content may be determined again in step S109. A specific example of changing the content content according to the present embodiment will be described later using an example.

Then, the output control unit 106 of the information processing apparatus 10 provides content from the display unit 120 and the speaker 130 (step S121). The output control unit 106 provides the restricted content when the content content is restricted in step S118, and if the real environment matches the ideal environment condition of the content (step S115 / Yes), no content is provided. The content is controlled to be provided in an ideal environment without changing the content. As content provision control, for example, notification related to an operation such as start of provision of content, display of a content area, display of a rule, display of a virtual object, output of content audio, and the like can be performed.

The content provision control process of the information processing system according to this embodiment has been described above. Note that the operation processing shown in FIG. 4 is an example, and the present embodiment is not limited to this. For example, the process shown in step S103 and the process shown in step S106 may be processed in parallel or in the reverse order.

<< 4. Example >>
Next, the information processing system according to the present embodiment will be described using specific content provision as an example.

<4-1. First Example: Provision Example of Tennis Game Content>
As an example of outdoor game content, matching (with the actual environment) when providing tennis game content will be specifically described below with reference to FIGS. Tennis is a ball game in which a ball (hard ball or soft ball) is hit with a racket over the net in a one-to-one (single) or two-to-two (doubles).

FIG. 5 is a flowchart showing an example of the flow of the tennis game content provision control process according to the present embodiment.

As shown in FIG. 5, first, the control unit 100 of the information processing apparatus 10 determines the type of game (content) (step S203). Here, as an example, “tennis game” is determined. The control unit 100 acquires information on the determined tennis game content from the server 20 or calls it from the storage unit 160 if it is already recorded in the storage unit 160.

Next, the control unit 100 acquires the weather information of the current position based on the position information of the user by the environment information acquisition unit 103, and determines whether the weather is appropriate by the conformity determination unit 104 (step S104). Such judgment of the weather may be mainly taken into consideration when matching outdoors. In the case of an environment where play is not possible, such as rainy weather, the provision of content will be stopped.

Next, when the weather is appropriate (step S206 / Yes), the suitability determination unit 104 determines candidate position information (candidates where a play area can be set) from the map information based on the position information of the user. Location information). The map information may be acquired from a database on the network or may be acquired from the server 20. Here, FIG. 6 shows an example of map information to be referred to. For example, among the areas 70a to 70d around the current location of the user, the suitability determination unit 104 includes private land (

areas

70a, 70b, 70e), roads (area 70c), swamps (area 70d), etc. In addition to these places where setting is not possible, for example, a park (area 70f), a plaza, a vacant land, a home site, etc. are determined as places where a play area can be set. In addition, in a case where a result of matching in the past, a review regarding suitability for the play area, or the like is given to the map information, the conformity determination unit 104 may refer to this. FIG. 7 is a diagram illustrating an example of map information with a play record to be referred to. As shown in FIG. 7, for example, an area 70f has been matched with a tennis game in the past (“There is a record of playing”), suitability to the play area of the environment (for example, the number of star marks), and an inclination Many reviews are given (detailed data such as slopes and steps are obtained when the environment is measured at that location for implementation).

Next, the matching determination unit 104 sets the number of players according to each candidate play area (step S212). In the present embodiment, a plurality of players can be set in order to match a tennis game that is an example of a competitive game content. For example, if the play area is compatible with a doubles game, four players are set, and if the play area is compatible with a singles game, two players are set.

Next, the suitability determination unit 104 grasps information on users (player candidates) existing near each candidate play area (within a certain range) (step S215), and determines whether the set number of players is sufficient (step S215). Step S218). The set number of players is the recommended number of participants of the game content, and can be acquired in advance as information related to the content. In addition, for example, a user who can be a player is assumed to be a user who can handle a game, such as a user who is registered for the content to be matched this time (in this case, a tennis game) or a user who has installed the content on the device. Is done. In addition, the user information may include position information and information indicating whether or not the player is ready to play (participation propriety). Whether or not it is in a playable state is determined based on the user situation. For example, in the case of taking a group action such as commuting, staying at a station, or being with a friend (the situation is based on location information, moving direction, camera image, voice, date, action history, schedule information, etc.) Can be recognized), it is determined that play is not possible.

These user information can be determined by the user situation determination unit 102 based on the sensing data acquired by the sensor unit 110 for the user who possesses the information processing apparatus 10. Further, information on other users in the vicinity can be acquired from the server 20. The server 20 can acquire the position and status of each user who uses this system from each information processing apparatus 10 continuously or when necessary. Here, FIG. 8 shows an example of user information existing in the vicinity of the candidate play area.

In the example shown in FIG. 8, there are five users U1 to U5 in the vicinity of the candidate play area (area 70f) of the tennis game. Four U4 players are play candidate users. In addition, even if it does not satisfy the set number of people, the suitability determining unit 104 may change the threshold value as long as the number of people can be changed.

Next, when the set number of players is sufficient (step S218 / Yes), the output control unit 106 of the control unit 100 notifies the user that a tennis game can be played (step S221). Here, FIG. 9 shows a display example when notifying the user that the game participation is possible. As shown in FIG. 9, for example, the output control unit 106 displays, on the display unit 120, a game notification image 410 such as “There is a place where a tennis game can be found nearby”, and a guidance image 411 indicating the direction and route to the play area. And AR are displayed. Thereby, the user can recognize that the tennis game can be performed and can move to the play area. At this time, the information processing apparatus 10 may notify (invite) the game to other player candidates directly or via the server 20. Further, the information processing apparatus 10 may confirm the intention to participate in the user together with the notification that the game is possible. Note that confirmation of intention to participate may be stepped by creating a status indicating that the game can be participated in advance as the user status.

On the other hand, when the set number of players is insufficient (step S218 / No), the information processing apparatus 10 may continue to search for player candidates until the set number of players is sufficient, or the game is performed because the number of participants is small. It may be notified to the user who has indicated that he / she can participate. Further, for example, when the number of players is one, the information processing apparatus 10 may provide game practice (volley practice, service practice, return practice, etc.) until an opponent appears.

Next, when the user moves to the play area, the control unit 100 recognizes the environment around the user with the outward camera 111 or the like (step S224). As described above, the play area candidates are acquired from the map information, but here, the actual state of the play area candidates is sensed. The information processing apparatus 10 may prompt the user to acquire the surrounding environment (for example, walking or looking around the area). Thereby, for example, the actual state such as the size, shape, and number of obstacles present in the play area candidate, a step, a place where entry is prohibited, and the area of the flat ground can be acquired.

If another user (play candidate) has already arrived and has acquired the actual environment of the play area candidate site, the environment recognition acquisition process may be skipped. The information processing apparatus 10 can acquire environment information acquired by another user directly from a device used by the other user or via the server 20. Further, when the environment information of the play area candidate site has been acquired in the past, the information processing apparatus 10 may call a past acquisition result from the database (the storage unit 160 or the server 20).

Next, the conformity determination unit 104 determines whether or not a play area can be set based on the acquired actual environment (step S227). For example, the matching determination unit 104 refers to the ideal environment information of the tennis game and determines whether or not the play area candidate site can be set as a play area. Details of whether or not the play area can be set will be described later with reference to FIGS. 13A and 13B.

Subsequently, if it is determined that the play area can be set (step S227 / Yes), the control unit 100 causes the content content changing unit 105 to perform rule change processing (content content changing processing) as necessary. This is performed (step S230). For example, the content content changing unit 105 performs a process of restricting rules according to the actual environment of the set play area. In this specification, “rule” is a rule for providing content. For example, in the case of a tennis game, the number of games in one set (usually 6 games, but can be changed to 4 games preemption / digestion, etc.) Widely means setting of ball speed, racket or ball size, bounce size, etc. The content content changing unit 105, in particular, when the play area is set under conditions different from the conditions of the ideal environment information, the game characteristics may not be ensured with the default rules. Guarantee the game. Details of the rule change processing will be described later with reference to FIG.

Note that when the information processing apparatus 10 determines that the play area can be set, the information processing apparatus 10 may notify the user of the play area setting. FIG. 10 shows an example of notification to the user when setting the play area. As shown in FIG. 10, for example, when the user moves to the play area according to the guidance and the play determining unit 104 sets the play area, the output control unit 106 displays “determine the game location” on the display unit 120. A notification image 413 with a play area setting such as “Masu” is displayed as an AR.

Then, the information processing apparatus 10 notifies the user of the game content (step S233). FIG. 11 is a diagram illustrating an example of a game content notification. As shown in FIG. 11, the output control unit 106 displays the notification image 415 indicating the game contents such as “tennis court, singles game, one set match” on the display unit 120 in an AR display. Further, as shown in FIG. 11, the output control unit 106 displays the tennis court image 400 and the tennis net image 401 in an AR display on the set play area on the display unit 120.

On the other hand, when the play area cannot be set (step S227 / No), the output control unit 106 of the information processing apparatus 10 notifies the user that play is not possible. At this time, if there are other play area candidates in the vicinity, guidance to them may be performed. FIG. 12 shows an example of a notification that leads to another candidate area. As shown in FIG. 12, the output control unit 106 displays, on the display unit 120, a notification image 417 for guiding to other candidate areas such as “Matched but there is a play area over there” and other play The guidance image 418 showing the direction to the area and the route is displayed in AR.

In the foregoing, an example of provision control processing in the case of tennis game content has been described. Note that the operation processing according to the present embodiment is not limited to the example shown in FIG. For example, the determination of the number of players shown in step S212 is performed when the play area shown in step S227 is set, and other users (player candidates) existing in the vicinity are invited to participate in the game. Good.

Further, for example, the server 20 has the functions of the user situation determination unit 102, the conformity determination unit 104, the content content change unit 105, and the output control unit 106 of the control unit 100, and the server 20 executes the operation process illustrated in FIG. May be.

(Judgment of play area setting availability)
13A and 13B are flowcharts showing an example of the flow of determination processing for determining whether or not a play area can be set according to the present embodiment.

As shown in FIG. 13A, first, the suitability determining unit 104 of the information processing apparatus 10 calls (from the storage unit 160) the peripheral information (that is, the actual environment of the play area candidate place) acquired by the environment information acquiring unit 103 ( Step S253). Further, if there is a map database, the peripheral information may be called from there.

Next, the conformity determination unit 104 determines whether or not the ambient light is more than the illuminance that can be displayed by the AR (step S256). This is because when the AR display is performed, if the external illuminance is a condition in which the AR display is not possible, the game performance is reduced. Note that the AR display method is not an optical transmissive display, but a method that displays an environment such as a video see-through (video transmissive display) (a method that displays a real object in real time by superimposing a virtual object on a video). ), Since the environment display can be changed, this step may be passed. Further, the conformity determination unit 104 may determine whether or not the environment (illuminance) is AR display by referring to weather information, weather forecast, and the like from an external database.

Next, if the illuminance environment is at a level that is not suitable for AR display (such as when it is too bright) (step S256 / No), the game determination cannot be ensured, so the suitability determination unit 104 determines that the play area cannot be set (step S310). ).

Next, the conformity determination unit 104 calls the ideal environment information of the provided content (step S259). As the ideal environment information of the tennis game content, for example, a size such as an area size of 10 m × 24 m, a net in the center of the area, an area that is mainly flat, and the like are assumed. The area size may be set to an upper limit value / lower limit value.

Next, the conformity determination unit 104 determines whether there is an obstacle in the area used by the player (that is, the play area) from the actual environment of the play area candidate (step S262). Specifically, in order to search for a flat area similar to the play area size indicated by the ideal environment information from the periphery, the conformity determination unit 104 first grasps the presence or absence of a peripheral obstacle. Obstacles can be detected by analyzing camera images and distance sensor data.

Next, when there is no obstacle (step S262 / Yes), the conformity determination unit 104 adopts the play area size of the ideal environment information (step S265). Specifically, the conformity determination unit 104 performs plane estimation or the like on a region where there is no detected obstacle, and estimates a dimension that can be set as a play area.

On the other hand, when there is an obstacle (step S262 / No), the suitability determining unit 104 determines whether or not the obstacle matches the position of the equipment used for the game (step S268). For example, as shown in FIG. 1, when the obstacles 60a to 60c are arranged in a horizontal line at the center of the play area candidates, it can be determined that the position matches the net position of the tennis game content.

Next, it is determined whether or not the obstacle is smaller than the equipment used for the game (step S271).

Next, when the obstacle coincides with the position of the equipment used for the game (step S268 / Yes) and has a dimension equal to or smaller than the equipment used for the game (step S271 / Yes), the conformity determination unit 104 determines that the obstacle Is set to match the position of the equipment in the game (step S274). Thus, for example, when trying to set up a play area avoiding obstacles, even if the dimensions are insufficient, the obstacle is regarded as equipment and it is defined as ideal environment information by making it an area containing obstacles. There is a high possibility that the dimension (or lower limit value) can be secured. Furthermore, in order to make the obstacles 60a-60c look like equipment in a game such as a tennis net, a virtual object of the equipment (tennis net 401, etc.) is displayed superimposed on the obstacles 60a-60c, thereby providing a sense of immersion in the content. Without hindering, danger such as collision with an obstacle can be avoided.

On the other hand, when the obstacle does not match the position of the equipment used for the game (step S268 / No), or when the obstacle is not the size of the equipment used for the game (step S271 / No), the conformity determination unit 104 The playable area is calculated again within the range not including the obstacle (detection of a flat region) (step S277).

Next, when the recalculated play area is larger than the minimum size (lower limit value) for playing a game (step S280 / Yes), the suitability determining unit 104 sets a play area based on the recalculated area ( Step S283).

On the other hand, when the recalculated play area is smaller than the minimum size (lower limit value) for playing the game (step S280 / No), the game determination cannot be ensured, so the suitability determining unit 104 determines that the play area cannot be set (step S310). At this time, the conformity determination unit 104 may provide game practice (volley practice, service practice, return practice, etc.) that can be played in a play area smaller than the minimum size, or change to a similar sport (eg squash). You may do it.

Subsequently, as shown in FIG. 13B, the conformity determination unit 104 confirms whether the set play area includes a high-risk area such as a road or a step (step S286). In addition, you may make it exclude a high risk area | region from the search of a play area previously.

In addition, the conformity determination unit 104 checks whether there is a person other than the player in the set play area (step S289).

Next, when there is a person other than the player in the set play area (step S289 / No), the suitability determining unit 104 determines whether all the persons other than the player are moving and pass the play area within a predetermined time. Is determined (step S292). The conformity determination unit 104 analyzes people from the outward camera 111. When walking in the play area or riding a bicycle, it can be determined that the user has passed the play area within a certain time because it is moving. On the other hand, when sitting down or chatting in a group, it can be determined that the possibility of moving immediately is low.

Next, when it can be determined that all persons other than the player are moving and pass the play area within a certain time (step S292 / Yes), the conformity determination unit 104 waits until it passes (step S295).

On the other hand, when the set play area includes a high-risk area such as a road or a step (step S286 / No), or when a person other than the player remains in the play area (step S292 / No), the conformity determination unit 104 sets again a play area excluding roads (highly dangerous places), people, and the like (step S298). It should be noted that the exclusion of dangerous places and passersby may be performed in parallel with the obstacle presence / absence determination shown in step S262.

Next, when the play area set again is smaller than the minimum size for playing the game (No in step S301), the suitability determination unit 104 determines that the play area cannot be set (step S310) because the game performance cannot be secured.

Next, when the set play area does not include a high-risk area such as a road or a step (step S286 / Yes), or when a person other than the player is not in the play area (step S292 / Yes). Alternatively, when a person other than the player disappears from the play area (step S295), the conformity determination unit 104 determines whether or not the color tone of the set play area can be overlaid with AR (preferably as the background of the AR display). Whether or not) (step S304). If the color tone of the play area is not preferable for AR display, it may be dealt with by changing the color tone on the AR side.

Then, when the color tone of the set play area can be superimposed with AR (step S304 / Yes), the conformity determination unit 104 determines the play area (step S307).

On the other hand, when the color tone of the set play area is not AR superimposable (step S304 / No), the game determination cannot be ensured, so the suitability determining unit 104 determines that the play area cannot be set (step S310).

The play area setting determination process according to the present embodiment has been specifically described above. Note that the flows shown in FIGS. 13A and 13B are examples, and the play area setting determination process according to the present embodiment is not limited to this. For example, the order of the determination processing is not limited to the example illustrated in FIGS. 13A and 13B, and may be in parallel or different order. Further, the processing may be appropriately passed depending on the situation.

When the game is being executed at the same place until immediately before, the information processing apparatus 10 performs the previous environmental evaluation (detection of a flat area that can be used as a play area, the position of each obstacle and equipment in the content, (Comparison with size) may be obtained and these processes may be passed.

In addition to the play area, the conformity determination unit 104 may set a spectator area for watching the game content player near the play area as the content providing area. A spectator is a user who is prohibited from direct interaction with the content but can view the content. The number of users who want to watch AR content is expected to increase in the future, but there will be an area for spectators so that the number of watching users will increase and go out to dangerous places such as roads and will not interfere with passers-by. This makes it possible to enjoy AR content more safely. When the user is notified that the game is possible, he / she can also display his intention to watch the game without participating. Further, according to the rank of the application installed in the user's device, the registration state in the game, or the like, a status that the game cannot be played but the game can be watched may be set. Further, for example, the server 20 may regard a user located in the set watching area as a watching person and allow output control (viewing only) of content. Further, the server 20 may prohibit the provision of content to a user who is neither in the watching area nor in the play area.

Here, FIG. 14 shows a diagram for explaining the case where the watching area 421 is provided around the play area 420. As illustrated in FIG. 14, for example, the matching determination unit 104 may determine a content area by providing a watching area 421 around the play area 420. At this time, the matching determination unit 104 causes the watching area 421 to include a dangerous place such as a road. When the content area size of the ideal environment information cannot be secured, the watching area 421 is restricted (narrower) than the play area 420. Furthermore, the conformity determination unit 104 may set a spacer area 422 between the play area 420 and the watching area 421 as shown in FIG. As a result, it is possible to avoid a collision between the player and the spectator and ensure safety. The information processing apparatus 10 may prevent the player from interacting with the game content in the spacer area 422.

The arrangement of the watching area is not limited to the arrangement surrounding the play area 420 as shown in FIGS. 14 and 15, and may be an area along a part of the play area 420, or within the play area 420. It may be provided, or the watching area may be divided into a plurality.

In addition, the information processing apparatus 10 causes the display unit 120 to display an AR and an image in which the play area 420, the watching area 421, and the spacer area 422 are clearly displayed and superimposed on the real space. Also good.

(Change rules according to the actual environment of the play area)
Next, the rule changing process shown in step S230 of FIG. 5 described above will be specifically described with reference to FIG.

FIG. 16 is a flowchart showing an example of the flow of rule change processing according to the present embodiment. As shown in FIG. 16, first, the set play area is the same size as the size of the play area in the ideal environment information (step S313 / Yes), and the number of participants is equal to the specified number of players in the set play area. If so (step S316 / Yes), the control unit 100 determines that the existing rule is applied (step S319). The existing rule is a recommended rule for the content set in the content data (predetermined basic rule for experiencing the content). For example, in the case of tennis game content, one set of games In addition to rules relating to progression of numbers, rules relating to content provision such as rules relating to display control such as the speed of a sphere are widely included.

Since game characteristics may vary greatly depending on the size of the play area, which is the area that provides the content, in this embodiment, it is determined whether or not the set play area is the same size as specified in the ideal environment information. Is going. In addition, since game characteristics may vary greatly depending on the number of participants in the game (the number of users who use content simultaneously), in this embodiment, it is also determined whether or not the number of players corresponds to the set play area size. doing. The specified number of persons corresponding to the size of the play area can be set as appropriate according to the area of the play area with reference to content data (ideal environment information or the like). For example, the smaller the play area, the smaller the number of participants.

As described above, in this embodiment, as an example, whether or not the rule needs to be changed (change in content contents) is determined based on the size of the play area and whether the number of participants matches the conditions. However, the present invention is not limited to this, and the rules may be changed as appropriate so as to ensure the game characteristics according to the shape of the play area, the age, sex, experience value, etc. of the participants.

On the other hand, when the set play area is not the same size as the size of the play area specified by the ideal environment information (step S313 / No), or when the number of participants is not equal to the specified number of players in the set play area (Step S316 / No), the content content changing unit 105 determines to change the rule as appropriate (Step S322). For example, in the case of tennis game content, the content content changing unit 105 reduces the ball speed when the number of players is smaller (than the prescribed number) relative to the size of the play area or when the play area is larger (than the prescribed size). Change as follows. Since the ball hits too quickly at the normal hitting speed, the game performance is maintained by reducing the ball speed. In addition, the content content changing unit 105 may change the ball speed so as to increase the speed when the number of players is larger (than the prescribed number) relative to the area of the content area or when the play area is smaller (less than the prescribed size). Good.

In addition, when the play area is small, the content content changing unit 105 may display an avatar or the like having a size corresponding to the play area so that the play area is relatively wide. Further, the content content changing unit 105 may change the size of the racket, the size of the ball, the number of balls, and the like according to the size of the play area and the number of participants. In addition, the content content changing unit 105 may relax the ball hitting determination (determination of whether the ball is hitting the center) according to the size of the play area and the number of participants, and may maintain the game characteristics. The content content changing unit 105 may increase or decrease the coefficient of restitution when the ball rebounds on the court surface according to the size of the play area and the number of participants.

Next, when there is a game waiting user in the vicinity (step S325 / Yes), the content content changing unit 105 changes the rule so as to shorten the play time (step S331). For example, in the case of tennis game content, the content content changing unit 105 reduces the number of games in one set, uses only one set, adopts a no-advantage system, eliminates tie breaks (ends with a draw), etc. Thus, the play time can be shortened. Note that the reduction in play time is not limited to the case where there are users waiting for the game, and the rules are changed so as to shorten the play time even when the time until sunset is short or when the user has a future plan It is possible.

On the other hand, if there is no game waiting user in the vicinity (step S325 / No), the control unit 100 determines that the existing rule is applied (step S328).

Then, the content content changing unit 105 determines a rule and a play time (step S334).

The rule change processing according to this embodiment has been specifically described above. Note that the operation processing shown in FIG. 16 is an example, and the present embodiment is not limited to this. For example, the case where tennis game content is provided has been described as the first embodiment, but various rules such as the ball speed, the number of balls, relaxation of the hit determination, the number of games, etc., depending on the size of the play area and the number of participants. The process of changing can also be applied to other ball games (eg, futsal, soccer, table tennis, badminton, volleyball, baseball, basketball, lacrosse, handball, etc.).

<4-2. Second Embodiment: Provision of Survival Game Content>
Next, as an example of outdoor competitive game content, matching (with the actual environment) when providing survival game content will be specifically described below with reference to FIGS. The survival game is a game that simulates a battle using a firearm, and is a field game in which a plurality of teams shoot each other and be disqualified when hit by a bullet. In the survival game, the player decides on winning or losing by taking the other team's flag, etc., and the player advances while avoiding attacks by hiding himself in many obstacles.

The basic operation process of this embodiment is the same as the operation process described with reference to FIG. 5 in the first embodiment. However, weather conditions may be implemented even in rainy environments.

Further, when notifying the user that the game can be participated, for example, a notification as shown in FIG. 17 is performed. For example, as shown in FIG. 17, the output control unit 106 displays, on the display unit 120, a game notification image 430 such as “There is a possibility of a battle nearby” and a guidance image 431 indicating the direction and route to the play area. , AR is displayed. Thus, the user can recognize that a survival game can be performed and move to the play area.

Also, in the case of a survival game, it is possible to participate in the game from the middle. In that case, for example, as shown in FIG. 18, the current game situation may be notified together. For example, as shown in FIG. 18, the output control unit 106 displays, on the display unit 120, a notification image 433 of a game “currently in battle”, a guidance image 434 that shows the direction and route to the play area, and a user in battle A description image 435 showing the profile, the type of weapon used, the battle situation, and the like are displayed in an AR display.

Next, the play area setting process shown in step S227 of FIG. 5 and the rule change process shown in step S230 when applied to survival game content will be described more specifically.

(Judgment of play area setting availability)
19A and 19B are flowcharts illustrating an example of the flow of determination processing for determining whether or not a play area can be set according to the second embodiment.

As shown in FIG. 19A, first, the suitability determining unit 104 of the information processing apparatus 10 calls (from the storage unit 160) the peripheral information (that is, the actual environment of the play area candidate place) acquired by the environment information acquiring unit 103 ( Step S403). Further, if there is a map database, the peripheral information may be called from there.

Next, the conformity determination unit 104 determines whether or not the ambient light is more than the illuminance that can be displayed by the AR (step S406).

Next, when the illuminance environment is at a level that is not suitable for AR display (such as when it is too bright) (step S406 / No), the game determination cannot be ensured, so the suitability determination unit 104 determines that the play area cannot be set (step S460). ).

Next, the conformity determination unit 104 calls the ideal environment information of the content to be provided (step S409). As the ideal environment information of the survival game content, for example, an area size corresponding to the number of participants, the number / size of obstacles, and the like are set. For example, in the case of 3 to 3 people, recommended conditions such as an area size of 15 m × 15 m and the number of participants × 4 or more obstacles are assumed. An upper limit value / lower limit value may be set for the area size and the number of obstacles.

Next, the conformity determination unit 104 determines whether or not a play area having the same size as the ideal environment information can be set based on the acquired peripheral information (step S412). At this time, the suitability determining unit 104 determines steps, stairs, slopes (inclined areas), etc. that are excluded as dangerous places or obstacles in the setting of the play area of the tennis game content from the area within a range that does not affect the play of the survival game. It may not be excluded.

Next, when a play area having the same size as the ideal environment information cannot be set (step S412 / No), the suitability determining unit 104 sets a play area that can be used (step S415), and the play area is used as usage environment data. It is determined whether or not the playable minimum area size (lower limit value) is equal to or greater than (step S418).

Next, when the playable minimum area size is below (step S418 / No), the game determination cannot be ensured, so the suitability determining unit 104 determines that the play area cannot be set (step S460). For example, in the example shown in FIG. 20, the area 445 that is avoided such as sitting people is the play area, but is smaller than the minimum playable area size defined by the ideal environment information, so it is determined that the play area cannot be set. .

On the other hand, when a play area having the same size as the ideal environment information can be set (step S412 / Yes), or when a play area larger than the minimum size (lower limit value) for playing a game can be set (step S418 / Yes) The determination unit 104 determines whether or not there are more than a certain number of obstacles that can be used in the game (more than the number recommended in the ideal environment information) in the set play area (step S421). The “obstacle” used in the survival game is assumed to be an obstacle of a size that can be used for the game, such as hiding itself (ie, a shield). Such a size (recommended value / upper limit value / lower limit value) can also be defined by the ideal environment information. Here, it is determined whether or not there are more obstacles than the number recommended in the ideal environment information. However, the determination of the recommended conditions regarding the obstacles is not limited to this. Is set, it is determined whether there are a certain number of obstacles or less.

Next, when there is no obstacle above a certain level (step S421 / No), the conformity determination unit 104 calculates the number of obstacles that can be generated by the virtual object (step S427). This is because it is assumed that the feeling of use is reduced (delay etc.) when a large number of virtual objects are generated due to the spec restrictions of the information processing apparatus 10 which is a display device. The conformity determination unit 104 determines the number that can be generated based on the specifications of the information processing apparatus 10.

Next, when there are more than a certain number of virtual obstacles (virtual objects) and real obstacles (real objects) that can be generated (step S430 / Yes), the conformity determination unit 104 determines the play area based on the calculated area. Setting is made (step S433). The placement of the virtual obstacle is set in consideration of the position of the actual obstacle. For example, a virtual obstacle is superimposed on an obstacle (real object) that cannot be used as a shield for a survival game because it is small enough to hide a person, thereby compensating for the number of obstacles (obstacles) and obstacles ( It is possible to avoid a collision with a real object. Of course, the virtual obstacle (shielding object) may be arranged (space orientation) in a place where there is no actual obstacle. The example illustrated in FIG. 21 is a diagram illustrating a case where a shortage of real obstacles (shielding objects) is compensated for by virtual objects (virtual obstacles). As shown in FIG. 21, for example, in the play area 450, there is one actual obstacle 63a that can be used as a shield for a survival game, but this is not enough. Therefore, the information processing apparatus 10 arranges

virtual obstacles

452a and 452b based on virtual objects. At this time, the information processing apparatus 10 may superimpose and display the virtual obstacle 452a on the real obstacle 636b, or may be arranged in a place where there is no actual obstacle like the virtual obstacle 452b.

On the other hand, when there are more than a certain number of obstacles (step S421 / Yes), the conformity determination unit 104 sets an area including the above-mentioned certain number of actual obstacles as a play area (step S424). For example, as shown in FIG. 22, when the area 460 includes more than a certain number of real obstacles 65a to 65g that can be used as obstacles (shields) for the survival game, the conformity determination unit 104 sets the area 460 to the survival game. To play area.

The processing shown in steps S436 to S460 shown in FIG. 19B is the same as the processing shown in steps 286 to S310 shown in FIG. 13B according to the first embodiment.

The play area setting determination process according to the present embodiment has been specifically described above. Note that the flows shown in FIGS. 19A and 19B are examples, and the play area setting determination process according to the present embodiment is not limited to this. For example, the order of the determination processing is not limited to the example illustrated in FIGS. 19A and 19B, and may be in parallel or different order. Further, the processing may be appropriately passed depending on the situation.

If the game has been executed at the same place until immediately before, the information processing apparatus 10 acquires the immediately preceding environmental evaluation (detection of an area that can be used as a play area, the number of obstacles, etc.), and performs these processes. May be passed.

Similarly to the first embodiment, the conformity determination unit 104 may set, as the content providing area, a spectator area for watching the game content player around the play area in addition to the play area. . In addition, the matching determination unit 104 may set a spacer area between the play area and the watching area. As a result, it is possible to avoid a collision between the player and the spectator and ensure safety.

(Change rules according to the actual environment of the play area)
FIG. 23 is a flowchart illustrating an exemplary flow of a rule change process. As shown in FIG. 23, first, the content content changing unit 105 grasps the number of participants (step S473). The number of participants may be acquired from the server 20 or may be grasped by directly communicating with the participant's device.

Next, when the set play area is the same size as the size of the play area in the ideal environment information (step S476 / Yes), the content content changing unit 105 makes use of a large area such as a flag battle or a general battle. A rule is selected (step S479). At this time, the content content changing unit 105 may consider whether or not the number of participants for the size of the play area is a recommended number.

On the other hand, when the set play area is not the same size as the play area in the ideal environment information (it is assumed that the play area is smaller than the recommended value and larger than the lower limit value) (step S476 / No), the content content changing unit 105, based on whether or not an obstacle is unevenly distributed in the play area (arrangement of the obstacle), changes the rule so as to secure the game characteristics (steps S482 to S488).

Specifically, for example, when an obstacle is unevenly distributed in the play area (step S482 / Yes), the content content changing unit 105 selects an offense / defense battle that forms a team by attack and defense (step S485). .

On the other hand, when the obstacle is not unevenly distributed in the play area (step S482 / No), the content content changing unit 105 secures the game performance by restricting the type of weapon such as a hand gun battle (step S488). The handgun battle is limited to handguns with short range, and the play area is small and obstacles are not unevenly distributed compared to using a rifle with a long range, which is used in normal survival games. Even in this case, the game can be maintained. Note that the rule change is not limited to these. For example, when the play area is smaller than the recommended value, the parameter for determining the hit between the ball and the user may be tightened. In addition to the size of the play area and the number of participants, the rules may be changed as appropriate so as to ensure the game characteristics according to the age, sex, experience value, etc. of the participants.

Next, when there is a game waiting user in the vicinity (step S491 / Yes), the content content changing unit 105 changes the rule so as to shorten the play time (step S497). For example, the content content changing unit 105 performs a change such as eliminating the restoration rule.

On the other hand, when there is no game waiting user in the vicinity (step S491 / No), the control unit 100 determines that the existing rule is applied (step S494).

Then, the content content changing unit 105 determines a rule and a play time (step S450).

The rule change processing according to this embodiment has been specifically described above. Note that the operation processing shown in FIG. 23 is an example, and the present embodiment is not limited to this. For example, it is not limited to the example shown in FIG. Further, the processing may be appropriately passed depending on the situation.

Further, each process according to the second embodiment may be executed by the server 20.

(Notification to user)
When the play area and the rules are determined in this way, the information processing apparatus 10 notifies the user of the game contents (play area settings, rules, and the like). Further, for example, when it is necessary to prepare for a strategy meeting or the like in the team before the game starts, the meeting place may be notified as shown in FIG. As shown in FIG. 24, the output control unit 106 displays a notification image 440 indicating the set play area on the display unit 120, and “3-3 general war. Start briefing at the position of the arrow”. A notification image 442 of the game content and an arrow image 441 that clearly shows the meeting place are AR-displayed.

In addition, the information processing apparatus 10 may determine whether or not to participate in the game by an action such as leaving from the play area, in addition to voice and gesture, or in the UI. For example, as shown in FIG. 25, the output control unit 106, when the first game is to be ended on the display unit 120, “Your victory! If you want to fight again, stay in this area. End. If you do, please get out of this area. ”A notification image 443 asking whether or not to participate in the game and a notification image 444 indicating the area are displayed in an AR display.

<4-3. Third Example: Provision Example of Table Tennis Game Content>
In addition, the information processing system according to the present embodiment is not limited to the matching to the actual outdoor environment as described above, and can naturally be matched to the actual indoor environment. When matching indoors, unlike the outdoors, there is no need to consider the weather conditions.

Also, what is set as a play area is not limited to the ground or floor, but includes areas such as the top of the table and walls.

Here, indoor game content matching will be described with reference to FIGS. 26 and 27. FIG. For example, when matching a table tennis game indoors, as shown in the left side of FIG. 26, the information processing apparatus 10 uses a recommended size or a recommended shape (for example, a plane area detected from the table top 70 of the table defined by ideal environment information). If it matches (rectangle), it is set as a play area. Then, as shown on the left in FIG. 26, the information processing apparatus 10 arranges the table tennis court image 470 and the table tennis net image 471 in the set play area on the display unit 120 and displays the AR.

Further, as shown in the right of FIG. 26, even if the planar area detected from the table top 71 is a shape (for example, a circle) different from the shape (here, a rectangle) defined by the ideal environment information, the area of the play area Is equal to or greater than the lower limit, the information processing apparatus 10 may be set as a play area. In this case, as shown in the right of FIG. 26, the information processing apparatus 10 arranges the table tennis court image 473 and the table tennis net image 474 on the display unit 120 in accordance with the shape of the set play area, and displays the AR.

As shown in FIG. 27, when there are obstacles 67a to 67c such as cups and books on the table top 72, the information processing apparatus 10 can use the obstacles as equipment used for content. Judge whether the size or arrangement. For example, in the case of table tennis game content, it is defined as an ideal environment that a net having a height of about 10 cm is arranged at the center of the play area. In this case, for example, the information processing apparatus 10 determines whether the arrangement and size of the obstacles 67a to 67c shown in FIG. 27 correspond to the table tennis net. If the conditions are met, the net image 477 (virtual object) Is superimposed on the obstacles 67a to 67c, and the play area is set in accordance with the position of the obstacles 67a to 67c (the table tennis court image 476 is arranged), so that the sense of immersion in the content is not hindered. It becomes possible to set a play area including an obstacle. Also, in the case where it is difficult to move obstacles, the contact between the obstacles and the table tennis ball is excluded from the calculation in the game, and the contact with the plane with the obstacles is made effective. It may be expressed that a sphere passes through an obstacle. Such an expression is also useful when priority is given to effectiveness.

In addition, the information processing apparatus 10 changes the game rules according to the size of the table, the number of players participating, and the like (for example, the number of points of one game, the speed of a ball, the display of an avatar, etc.) to ensure game performance. It may be.

<< 5. Summary >>
As described above, in the information processing system according to the embodiment of the present disclosure, it is possible to limit the content provided to the real space according to the real environment.

In addition, the information processing system according to the present embodiment presents a notification of participation in the game (invitation) to the user together with a notification prompting the installation of the application, for example, when the application needs to be installed on the device in order to participate in the game. It may be.

In addition, the information processing system according to the present embodiment matches a plurality of contents to the same real environment, and gives priority to contents with high adaptability (that is, contents that can be provided in an environment closer to the ideal environment). You may make it notify.

The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present technology is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

For example, it is possible to create a computer program for causing the information processing apparatus 10 or the server 20 to perform the functions of the information processing apparatus 10 or the server 20 on hardware such as a CPU, ROM, and RAM incorporated in the information processing apparatus 10 or the server 20 described above. . A computer-readable storage medium storing the computer program is also provided.

In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

In addition, this technique can also take the following structures.
(1)
An output control unit that performs output control on the content based on content information including information on a content area in the real space where the content is provided;
An environment information acquisition unit that acquires environment information about the real space in which the content is provided;
The information processing apparatus, wherein the output control unit changes the content provided by the environment information when the environment information satisfies a first condition and when the environment information satisfies a second condition different from the first condition.
(2)
The output control unit restricts at least one of the shape and area of the content area to be set when the environmental information satisfies the second condition, compared to when the environmental information satisfies the first condition. The information processing apparatus according to (1).
(3)
The second condition is a condition that the content area includes an obstacle that prevents provision of the content,
The information processing apparatus according to (2), wherein the output control unit restricts at least one of a shape and an area of the content area to be set when the environment information satisfies the second condition.
(4)
When the environmental information satisfies the second condition, the output control unit avoids the obstacle from the real space and restricts at least one of the shape and area of the content area and has the shape and area. The information processing apparatus according to (3), wherein an area candidate is detected and set as the content area.
(5)
The information processing apparatus according to (4), wherein the output control unit sets the content area candidate as the content area when a shape and an area of the detected content area candidate satisfy a predetermined lower limit value.
(6)
The second condition is a condition that the content area includes an obstacle that prevents provision of the content,
The information processing unit according to (1), wherein when the environment information satisfies the second condition, the output control unit sets the content area so that a virtual object used for the content is arranged on the obstacle. apparatus.
(7)
The first condition and the second condition are each related to weather,
The information processing apparatus according to (1), wherein the output control unit prohibits the provision of the content when the content area satisfies the second condition.
(8)
The output control unit permits output control related to the content even when the real space is an indoor environment and the environment information satisfies the second condition. Information processing device.
(9)
The first condition and the second condition are related to the area and shape of the content area to be set, or the number of simultaneous users of the content,
The output control unit changes the provision rule of the content when the content area satisfies the second condition and when the content area satisfies the first condition, according to (1). Information processing device.
(10)
The information processing apparatus according to (9), wherein the change of the content provision rule is at least one of a change of a progress rule, a rule change for shortening a content provision time, and a display control rule change.
(11)
The output control unit determines a candidate site that may be set as the content area based on the position information of the user, and performs a notification for guiding to the candidate site. Any one of (1) to (10) The information processing apparatus according to claim 1.
(12)
The environment information acquisition unit acquires environment information of the candidate site when the user moves to the candidate site,
The information processing apparatus according to (11), wherein the output control unit notifies the user of the content area set based on the environment information.
(13)
The information processing apparatus according to (1), wherein the content provision restriction is a restriction on a number of users who can use the content simultaneously.
(14)
The information processing apparatus according to (13), wherein the number of users who can simultaneously use the content is determined according to the set area or shape of the content area.
(15)
The information processing apparatus according to (14), wherein the smaller the set area of the content area, the smaller the number of users who can use the content simultaneously.
(16)
The content area includes a play area where the content can be interacted with, and a watching area where only the content area can be viewed,
The information processing apparatus according to any one of (1) to (15), wherein the output control unit preferentially restricts the watching area when the second condition is satisfied.
(17)
The watching area is located outside the play area,
The output control unit permits output control of the content to a user who is located in the watching area and is prohibited from direct interaction with the content, and can be placed in either the watching area or the play area. The information processing apparatus according to (16), wherein provision of the content is prohibited for a user who is not located.
(18)
The information processing apparatus according to (17), wherein a non-content area in which no content is provided to any user is set between the play area and the watching area.
(19)
Processor
Performing output control on the content based on content information including information on a content area in the real space where the content is provided;
Obtaining environmental information about the real space in which the content is provided;
Changing the provided content of the content when the environmental information satisfies a first condition and when satisfying a second condition different from the first condition;
Including an information processing method.
(20)
Computer
An output control unit that performs output control on the content based on content information including information on a content area in the real space where the content is provided;
An environment information acquisition unit that acquires environment information about the real space in which the content is provided;
Function as
The said output control part is a program which changes the provision content of the said content, when the said environment information satisfy | fills 1st conditions, and when satisfy | filling 2nd conditions different from the said 1st conditions.

DESCRIPTION OF SYMBOLS 1 Information processing system 10 Information processing apparatus 100 Control part 101 User physical information acquisition part 102 User condition judgment part 103 Environmental information acquisition part 104 Conformity judgment part 105 Content content change part 106 Output control part 110 Sensor part 111 Outward camera 112 Inward Camera 113 Microphone 114 Gyro sensor 115 Acceleration sensor 116 Direction sensor 117 Position positioning unit 120 Display unit 130 Speaker 140 Communication unit 150 Operation input unit 160 Storage unit 20 Server 30 Network

Claims

An output control unit that performs output control on the content based on content information including information on a content area in the real space where the content is provided;
An environment information acquisition unit that acquires environment information about the real space in which the content is provided;
The information processing apparatus, wherein the output control unit changes the content provided by the environment information when the environment information satisfies a first condition and when the environment information satisfies a second condition different from the first condition.
The output control unit restricts at least one of the shape and area of the content area to be set when the environmental information satisfies the second condition, compared to when the environmental information satisfies the first condition. The information processing apparatus according to claim 1.
The second condition is a condition that the content area includes an obstacle that prevents provision of the content,
The information processing apparatus according to claim 2, wherein the output control unit limits at least one of a shape and an area of the content area to be set when the environment information satisfies the second condition.
When the environmental information satisfies the second condition, the output control unit avoids the obstacle from the real space and restricts at least one of the shape and area of the content area and has the shape and area. The information processing apparatus according to claim 3, wherein an area candidate is detected and set as the content area.
The information processing apparatus according to claim 4, wherein the output control unit sets the content area candidate as the content area when the shape and area of the detected content area candidate satisfy a predetermined lower limit value.
The second condition is a condition that the content area includes an obstacle that prevents provision of the content,
The information processing apparatus according to claim 1, wherein the output control unit sets the content area so that a virtual object used for the content is arranged on the obstacle when the environment information satisfies the second condition. .
The first condition and the second condition are each related to weather,
The information processing apparatus according to claim 1, wherein the output control unit prohibits the provision of the content when the content area satisfies the second condition.
The information according to claim 7, wherein the output control unit permits output control related to the content even when the real space is an indoor environment and the environmental information satisfies the second condition. Processing equipment.
The first condition and the second condition are related to the area and shape of the content area to be set, or the number of simultaneous users of the content,
2. The output control unit according to claim 1, wherein when the content area satisfies the second condition, the output control unit changes the provision rule of the content when the content area satisfies the first condition. Information processing device.
10. The information processing apparatus according to claim 9, wherein the change of the content provision rule is at least one of a change of a progress rule, a rule change for shortening a content provision time, and a display control rule change.
The information processing apparatus according to claim 1, wherein the output control unit determines a candidate site that may be set as the content area based on a user's position information, and performs a notification for guiding to the candidate site.
The environment information acquisition unit acquires environment information of the candidate site when the user moves to the candidate site,
The information processing apparatus according to claim 11, wherein the output control unit notifies the user of the content area set based on the environment information.
2. The information processing apparatus according to claim 1, wherein the limitation on the provision of the content is a limitation on the number of users who can use the content simultaneously.
The information processing apparatus according to claim 13, wherein the number of users who can use the content at the same time is determined according to the set area or shape of the content area.
15. The information processing apparatus according to claim 14, wherein the smaller the set area of the content area, the smaller the number of users who can use the content simultaneously.
The content area includes a play area where the content can be interacted with, and a watching area where only the content area can be viewed,
The information processing apparatus according to claim 1, wherein the output control unit preferentially restricts the watching area when the second condition is satisfied.
The watching area is located outside the play area,
The output control unit permits output control of the content to a user who is located in the watching area and is prohibited from direct interaction with the content, and can be placed in either the watching area or the play area. The information processing apparatus according to claim 16, wherein a user who is not located is prohibited from providing the content.
The information processing apparatus according to claim 17, wherein a non-content area in which no content is provided to any user is set between the play area and the watching area.
Processor
Performing output control on the content based on content information including information on a content area in the real space where the content is provided;
Obtaining environmental information about the real space in which the content is provided;
Changing the provided content of the content when the environmental information satisfies a first condition and when satisfying a second condition different from the first condition;
Including an information processing method.
Computer
An output control unit that performs output control on the content based on content information including information on a content area in the real space where the content is provided;
An environment information acquisition unit that acquires environment information about the real space in which the content is provided;
Function as
The said output control part is a program which changes the provision content of the said content, when the said environment information satisfy | fills 1st conditions, and when satisfy | filling 2nd conditions different from the said 1st conditions.