WO2019225115A1 - Dispositif de traitement d'informations, procédé de traitement d'informations et programme - Google Patents

Dispositif de traitement d'informations, procédé de traitement d'informations et programme Download PDF

Info

Publication number
WO2019225115A1
WO2019225115A1 PCT/JP2019/008845 JP2019008845W WO2019225115A1 WO 2019225115 A1 WO2019225115 A1 WO 2019225115A1 JP 2019008845 W JP2019008845 W JP 2019008845W WO 2019225115 A1 WO2019225115 A1 WO 2019225115A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
area
information
information processing
condition
Prior art date
Application number
PCT/JP2019/008845
Other languages
English (en)
Japanese (ja)
Inventor
文彦 飯田
宇津木　慎吾
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2019225115A1 publication Critical patent/WO2019225115A1/fr

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A63F13/537—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen
    • A63F13/5375—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/60—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor
    • A63F13/65—Generating or modifying game content before or while executing the game program, e.g. authoring tools specially adapted for game development or game-integrated level editor automatically by game devices or servers from real world data, e.g. measurement in live racing competition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70—Game security or game management aspects
    • A63F13/79—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories
    • A63F13/795—Game security or game management aspects involving player-related data, e.g. identities, accounts, preferences or play histories for finding other players; for building a team; for providing a buddy list
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80—Special adaptations for executing a specific game genre or game mode
    • A63F13/812—Ball games, e.g. soccer or baseball
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/85—Providing additional services to players
    • A63F13/86—Watching games played by other players
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics

Definitions

  • the present disclosure relates to an information processing apparatus, an information processing method, and a program.
  • AR Augmented Reality
  • Information presented to the user is visualized using various forms of virtual objects such as text, icons, images, and 3D models.
  • an optical transmission display is a display device that has recently been used as a display that superimposes and displays a virtual 3D object or the like in the real world.
  • the optical transmission display is suitable for AR outdoors because it can see the virtual world while viewing the real world with the naked eye, and it can be further spread as a device that enjoys AR content outdoors. The nature is great. As AR contents to be enjoyed outdoors, in addition to information presentation and navigation, a competitive game using the actual environment is also provided.
  • Patent Document 1 in an apparatus that enjoys the VR (Virtual Reality) world by wearing a non-transparent HMD (Head Mounted Display), it is impossible to see the outside world.
  • a technique is disclosed in which a collision with a real world obstacle can be avoided by replacing the virtual object with the virtual object and arranging the virtual object in the VR space.
  • the present disclosure proposes an information processing apparatus, an information processing method, and a program that can restrict content provided to a real space according to a real environment.
  • an output control unit that performs output control regarding the content based on content information including information regarding a content area in the real space where the content is provided, and an environment regarding the real space where the content is provided
  • An environment information acquisition unit configured to acquire information, and the output control unit includes the content when the environment information satisfies a first condition and when the second condition is different from the first condition.
  • the processor performs output control regarding the content based on content information including information regarding a content area in the real space where the content is provided, and relates to the real space where the content is provided. Acquiring environmental information; changing the content provided by the content when the environmental information satisfies a first condition; and when satisfying a second condition different from the first condition; An information processing method is proposed.
  • the computer controls an output control unit that performs output control on the content based on content information including information on a content area in a real space where the content is provided, and the actual information on which the content is provided.
  • the output control unit functions as an environment information acquisition unit that acquires environment information related to space, and the output control unit satisfies a second condition different from the first condition when the environmental information satisfies the first condition.
  • a program is proposed for changing the contents provided.
  • FIG. 1 is a diagram illustrating an overview of an information processing system according to an embodiment of the present disclosure.
  • the information processing system according to the present embodiment displays a virtual object superimposed at an arbitrary position in the real space using an optically transmissive display (information processing apparatus 10) worn by the user on the head.
  • an optically transmissive display information processing apparatus 10
  • Provide AR content such as information and games.
  • the affinity between the AR content and the actual environment greatly affects the sense of immersion in the content, while the real space includes walls, utility poles, signboards, fences, etc.
  • various obstacles such as various installations and passers-by, and dangerous places such as steps, so it is necessary to consider safety.
  • game content that is assumed to move around outdoors, such as a competitive AR game
  • consideration of the actual environment (the presence or absence of obstacles, etc.) in the content providing area (content area) is important for safety.
  • the content to be provided in the real space depends on the real environment (the real space environment, for example, the presence or absence of an obstacle, the size of the flat area, a dangerous place such as a step). It is possible to limit and realize safety without impeding immersive feeling.
  • a sense of immersion in the content is realized while maintaining safety.
  • 60c a virtual object used in the AR game content to be provided, for example, a tennis net image 401 is superimposed and displayed. Then, the tennis court image 400 is displayed on the road according to the position of the tennis net image 401.
  • the obstacles 60a, 60b, and 60c are collided with each other by controlling the arrangement of the virtual objects and the setting of the game content provision area so that the virtual objects are used (partially superimposed). It is possible to realize a sense of immersion in the content while avoiding danger in the real space.
  • the information processing apparatus 10 is realized by, for example, a glasses-type head mounted display (HMD) that is attached to the user's head.
  • the display unit 120 corresponding to the spectacle lens portion positioned in front of the user's eyes when worn may be a so-called optical see-through display having optical transparency.
  • the information processing apparatus 10 can present the virtual object in the user's field of view by displaying the virtual object on the display unit 120.
  • HMD which is an example of the information processing apparatus 10 is not limited to what displays an image to both eyes, You may show an image only to one eye.
  • the HMD may be a one-eye type provided with a display unit 120 that presents an image to one eye.
  • the information processing apparatus 10 is provided with an outward camera 111 that captures the user's line-of-sight direction, that is, the user's field of view when worn. Further, although not shown in FIG. 1, the information processing apparatus 10 may be provided with various sensors such as an inward camera and a microphone (hereinafter referred to as “microphone”) that captures the user's eyes when worn. . A plurality of outward cameras 111 and inward cameras may be provided.
  • the shape of the information processing apparatus 10 is not limited to the example shown in FIG.
  • the information processing apparatus 10 is an HMD of a headband type (a type that is worn by a band that goes around the entire circumference of the head, or a band that passes through the top of the head as well as the temporal region) or a helmet type.
  • HMD of the helmet (the visor part of the helmet corresponds to the display unit 120) may be used.
  • the information processing apparatus 10 can perform control that makes the user feel as if a virtual object to be superimposed and displayed in the real space exists in the real space.
  • the arrangement and shape of the virtual object may be controlled based on real space information obtained by imaging with the outward camera 111, for example, information on the position and shape of the real object existing in the real space.
  • FIG. 2 is a diagram illustrating an example of the overall configuration of the information processing system according to the present embodiment.
  • the information processing system 1 includes an information processing apparatus 10 that provides content to each user, and a server 20.
  • the information processing apparatus 10 and the server 20 are connected via a network 30 and can transmit and receive data.
  • the information processing apparatus 10 is a wearable device that provides a user with AR content that adds information to the real space and expands the real environment.
  • the information processing apparatus 10 may be a handheld type such as a smartphone or the user's head It may be an HMD attached to the earphone, an earphone shape attached to the ear, or a neck-shaped device attached to the neck.
  • the content to be provided is assumed to be various information that stimulates human perception, such as an image, sound, or vibration.
  • the information processing apparatus 10 acquires content data from the server 20 and appropriately performs virtual object presentation control based on the content data according to the actual environment.
  • the server 20 accumulates content data and provides the content data to the information processing apparatuses 10 (10a to 10c%) Of each user. Further, when providing the game content to the user, the server 20 acquires position information of a plurality of users from the information processing apparatus 10 possessed by each user, and selects a player or invites the user to a game. Good.
  • the system configuration shown in FIG. 2 is an example, and the present embodiment is not limited to this.
  • the information processing apparatus 10 may search for opponents that exist in the vicinity, and may invite the device of the opponent to the game.
  • FIG. 3 is a block diagram illustrating an example of the configuration of the information processing apparatus 10 according to the present embodiment.
  • the information processing apparatus 10 includes a sensor unit 110, a control unit 100, a display unit 120, a speaker 130, a communication unit 140, an operation input unit 150, and a storage unit 160.
  • the sensor unit 110 has a function of acquiring (sensing) various information related to the user or the surrounding environment.
  • the sensor unit 110 includes an outward camera 111, an inward camera 112, a microphone 113, a gyro sensor 114, an acceleration sensor 115, an azimuth sensor 116, a position positioning unit 117, and a biological sensor 118.
  • the specific example of the sensor mentioned here is an example, Comprising: This embodiment is not limited to this.
  • an environmental sensor such as an illuminance sensor or a temperature sensor, an ultrasonic sensor, an infrared sensor, or the like may be included.
  • each sensor may be plural.
  • the outward camera 111 and the inward camera 112 are obtained by a lens system including an imaging lens, a diaphragm, a zoom lens, a focus lens, and the like, a drive system that causes the lens system to perform a focus operation and a zoom operation, and a lens system.
  • a lens system including an imaging lens, a diaphragm, a zoom lens, a focus lens, and the like, a drive system that causes the lens system to perform a focus operation and a zoom operation, and a lens system.
  • Each has a solid-state image sensor array that photoelectrically converts captured image light to generate an image signal.
  • the solid-state imaging device array may be realized by a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array, for example.
  • the outward camera 111 is set to have an angle of view and an orientation so as to capture an area corresponding to the user's field of view in real space.
  • a plurality of outward cameras 111 may be provided.
  • the outward camera 111 may include a depth camera that can acquire depth information (depth map) of the surrounding environment.
  • the imaging wavelength may be in the visible light range, may include from the ultraviolet to the infrared range, and may be limited to a part of the wavelength.
  • the outward camera 111 may be used in combination with a distance measuring sensor (ultrasonic wave, ToF, etc.) that measures the distance to the object.
  • a distance measuring sensor ultrasonic wave, ToF, etc.
  • the inward camera 112 can capture the user's eyes and acquire the user's line-of-sight information.
  • the imaging wavelength of the inward camera 112 may be in the visible light region, may include from the ultraviolet region to the infrared region, and may be limited to some wavelengths.
  • the microphone 113 collects the user's voice and surrounding environmental sound, and outputs it to the control unit 100 as voice data. Further, the microphone 113 may be used for communication through sound waves in the inaudible range, and the principle such as a condenser microphone is not specified. The microphone 113 may be an array microphone.
  • the gyro sensor 114 is realized by a three-axis gyro sensor, for example, and detects an angular velocity (rotational speed).
  • the acceleration sensor 115 is realized by, for example, a three-axis acceleration sensor, and detects acceleration during movement.
  • the direction sensor 116 is realized by, for example, a three-axis geomagnetic sensor (compass), and detects an absolute direction (direction).
  • the position positioning unit 117 calculates the self-position of the information processing apparatus 10.
  • the position measurement unit 117 may use so-called SLAM (simultaneous localization and mapping) as a self-position estimation technique.
  • SLAM simultaneous localization and mapping
  • the SLAM algorithm is not particularly limited.
  • a Landmark based SLAM that uses landmarks expressed in point coordinates on a map may be used.
  • the Landmark based SLAM recognizes a characteristic object as a landmark, generates a map of the landmark, and feeds back to the self-position estimation using the coordinate information of the landmark.
  • the position positioning unit 117 may detect the current position of the information processing apparatus 10 based on an externally acquired signal.
  • the position positioning unit 117 is realized by a GPS (Global Positioning System) positioning unit, receives a radio wave from a GPS satellite, detects a position where the information processing apparatus 10 exists, and detects the position. The position information is output to the control unit 100.
  • the position measurement unit 117 detects the position by, for example, Wi-Fi (registered trademark), Bluetooth (registered trademark), transmission / reception with a mobile phone / PHS / smartphone, or short distance communication. There may be.
  • the biosensor 118 is a detection unit that detects biometric information of the user, and senses, for example, body temperature, veins, pulse, heartbeat, sweating, blood pressure, brain waves, electrooculogram, myoelectric value, and the like.
  • the control unit 100 functions as an arithmetic processing unit and a control unit, and controls overall operations in the information processing apparatus 10 according to various programs.
  • the control unit 100 is realized by an electronic circuit such as a CPU (Central Processing Unit) and a microprocessor, for example.
  • the control unit 100 may include a ROM (Read Only Memory) that stores programs to be used, calculation parameters, and the like, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
  • the control unit 100 according to the present embodiment has various information processing functions and an output control function.
  • control unit 100 includes a user physical information acquisition unit 101, a user situation determination unit 102, an environment information acquisition unit 103, a conformity determination unit 104, a content content change unit 105, and It functions as the output control unit 106.
  • the user physical information acquisition unit 101 performs aggregation and management of information (sensing data) acquired from the sensor unit 110.
  • the user physical information acquisition unit 101 may accumulate the collected sensing data in the storage unit 160.
  • the user situation determination unit 102 analyzes the sensing data aggregated by the user physical information acquisition unit 101 and determines the user situation. For example, based on the captured image of the user's eye acquired by the inward camera 112, the user situation determination unit 102 determines the position of the eye reference point (eye and corneal reflection) and moving point (iris, pupil, etc.). User's gaze information (gaze direction) is acquired.
  • the line-of-sight detection method is not limited to this. For example, a method of detecting from the detection result of an electrooculogram sensor, or a method of detecting infrared rays (IR) on the eyeball and detecting the reflected light (corneal reflection method or A scleral reflection method, etc.).
  • the user status determination unit 102 may acquire biological information such as the number of blinks based on the captured image of the user's eye acquired by the inward camera 112, and the environmental illuminance state based on the size of the pupil. Etc. can also be estimated.
  • the user status determination unit 102 determines whether the user is focused on the object to be watched, the user is focused on something, the tension state, the relaxed state, the leisure time, or the like based on information on the user's line of sight, blinking, etc. It is possible to determine whether the state is correct.
  • the user situation determination unit 102 analyzes the audio data detected by the microphone 113, and the surrounding environment (whether it is a quiet place, a noisy place, whether there are many people in the vicinity, whether a car is passing, etc.) And the user's utterance status (whether chatting or being alone).
  • the user situation determination unit 102 can grasp the movement situation, posture, position, etc. of the user from the sensing data of the gyro sensor 114, the acceleration sensor 115, and the direction sensor 116.
  • the user situation determination unit 102 can estimate the environment around the user and the user situation from the position information of the position measurement unit 117.
  • the user situation determination unit 102 can grasp the user's activity state, tension state, concentration state, and the like based on the biological information acquired by the biological sensor 118.
  • the user situation determination unit 102 can determine various situations of the user by combining various sensing data as described above. For example, whether the user is commuting, going home, on the way to the station, on a walk, having a lot of luggage, empty-handed, or rushing home It is possible to determine various situations that may occur in daily life, such as whether or not shopping.
  • the environment information acquisition unit 103 acquires environment information around the user based on the sensing data of the sensor unit 110. For example, the environment information acquisition unit 103 can acquire the presence / absence or location of an obstacle around the user, the illuminance environment, and the like based on the captured image captured by the outward camera 111. In addition, the environment information acquisition unit 103 acquires known environment information (for example, facility information, location information such as private land, road, area, environment attributes (lawn, sand, etc.)) from a database such as map information. May be.
  • known environment information for example, facility information, location information such as private land, road, area, environment attributes (lawn, sand, etc.
  • the environment information acquisition unit 103 recognizes the surrounding three-dimensional spatial information based on the sensing data acquired by the sensor unit 110 and accumulates the three-dimensional spatial information in the storage unit 160.
  • the conformity determination unit 104 determines suitability for content in the surrounding environment based on the environment information (actual environment information) acquired by the environment information acquisition unit 103. At this time, the conformity determination unit 104 calls ideal environment information stored in the storage unit 160 indicating ideal environment conditions (recommended conditions) for content provision, and compares them with the actual environment to determine conformity. May be.
  • the ideal environment information is included in the content data acquired from the server 20 (application data for executing content provision), and more specifically, for example, when experiencing the size (dimension) / shape of the content area and the content.
  • the size, shape, number, and arrangement of (virtual) tools and equipment to be used, weather, ground conditions (for example, soil, lawn, concrete, gravel, presence of slope, flat area) are assumed.
  • the ideal environment information may also define conditions for a lower limit value and an upper limit value that are assumed to be able to provide content, such as ensuring game characteristics, in addition to ideal environment conditions.
  • the conformity determination unit 104 determines whether the content conforms to the actual environment, whether the actual environment satisfies the recommended condition (first condition), or at least the lower limit or upper limit condition (second condition). Judge whether to satisfy.
  • the conformity determination unit 104 can refer to the user situation determined by the user situation determination unit 102 and determine whether or not the situation is suitable for providing content to the user. For example, in the case of competitive game content, whether to participate in the game (whether or not it is possible to participate) is determined according to the user situation. For example, the suitability determination unit 104 determines that it is not possible to participate in the game when the user is commuting or in a hurry.
  • the content content changing unit 105 changes the content to be provided based on the determination result of the conformity determining unit 104. For example, the content content changing unit 105 determines that the actual environment satisfies the recommended conditions (for example, conditions regarding the area, shape, and presence / absence of obstacles of the content area) and the conditions for the lower limit or upper limit (for example, the lower limit of the area of the content area). Content, the condition of the size, the number of obstacles, the upper limit value of the number, etc.) are satisfied.
  • the recommended conditions for example, conditions regarding the area, shape, and presence / absence of obstacles of the content area
  • the lower limit or upper limit for example, the lower limit of the area of the content area.
  • the content content changing unit 105 when the actual environment satisfies the recommended condition, the content content changing unit 105 provides the predetermined content content without any limitation, while the actual environment does not satisfy the recommended condition but the lower limit value or When the condition of the upper limit value is satisfied, the contents are limited and provided.
  • the content content changing unit 105 when the actual environment does not satisfy the recommended condition but satisfies the lower limit value or the upper limit value, the content content changing unit 105 provides the content area with a limited shape and area. Accordingly, the content content changing unit 105 can change the default rule so that the content can be provided even when the shape and area are limited.
  • the content content changing unit 105 does not satisfy the recommended condition for the number of players for the content area. Rule changes can be made.
  • the content content changing unit 105 may change the content of the content to be provided according to the user situation. For example, the content content changing unit 105 may appropriately limit the content to be provided according to the age, sex, experience value, and the like of the user.
  • the output control unit 106 controls information notification from the display unit 120 and the speaker 130 to the user.
  • the information notification content may relate to content to be provided such as notification (image, text, sound) related to operations such as start of game content, display of game content play area, rule display, and the like.
  • the output control unit 106 can perform generation, display (AR display), and the like of a virtual object in accordance with the provision of content.
  • the output control unit 106 is based on the environment information acquired by the environment information acquisition unit 103.
  • the “obstacle” is not limited to an object existing outdoors, but is present indoors.
  • the virtual object used in the content is superimposed on the object to be played (for example, furniture, daily necessities, etc.), or the virtual object that clearly indicates the range of the play area in the real space is superimposed (play area boundary line) Display and field decoration display).
  • the display unit 120 has optical transparency, and is realized by, for example, a lens unit that performs display using a hologram optical technique, a liquid crystal display (LCD) device, an organic light emitting diode (OLED) device, or the like.
  • the optical transparency of the display unit 120 may be controlled by the control unit 100.
  • the display unit 120 may be a video transmission type display.
  • the video transmission type display displays a virtual object superimposed on an image of the real world.
  • the speaker 130 reproduces an audio signal according to the control of the control unit 100.
  • the speaker 130 may be a directional speaker.
  • the speaker 130 may be realized by a pair of earphones.
  • the communication unit 140 is a communication module for transmitting / receiving data to / from other devices by wire / wireless.
  • the communication unit 140 is a system such as a wired LAN (Local Area Network), a wireless LAN, Wi-Fi (registered trademark) (Wireless Fidelity), infrared communication, Bluetooth (registered trademark), short-range / non-contact communication, and the like. Wirelessly communicate with the device directly or via a network access point.
  • the communication unit 140 can communicate with a device used by another user, a device group worn by the user itself, or the server 20 on the network to transmit and receive data.
  • the operation input unit 150 is realized by an operation member having a physical structure such as a switch, a button, or a lever.
  • the storage unit 160 is realized by a ROM (Read Only Memory) that stores programs and calculation parameters used for the processing of the control unit 100 described above, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate. .
  • ROM Read Only Memory
  • RAM Random Access Memory
  • the storage unit 160 includes, for example, real environment information such as three-dimensional space information acquired by the environment information acquisition unit 103, sensing data aggregated by the user physical information acquisition unit 101, and user status determination unit 102 The determined user situation, content data (including ideal environment information), and the like are accumulated.
  • the configuration of the information processing apparatus 10 has been specifically described above.
  • the configuration of the information processing apparatus 10 is not limited to the example illustrated in FIG.
  • at least a part of the configuration of the information processing apparatus 10 may be in the external apparatus, and at least a part of each function of the control unit 100 may be in the server 20.
  • FIG. 4 is a flowchart showing an example of the flow of operation processing for content provision control according to the present embodiment.
  • the environment information acquisition unit 103 of the information processing apparatus 10 acquires environment information around the user based on the sensing data of the sensor unit 110 (step S103).
  • the environment information acquisition unit 103 acquires the location of the user and location information within a predetermined range from map information (such as a database on the network) based on the location information of the user as environment information around the user. May be.
  • the environment information acquisition unit 103 may acquire weather information, weather forecast information, and the like from the network based on the user position information.
  • the information processing apparatus 10 may prompt the user to look around and acquire the surrounding information by the sensor unit 110.
  • the environment information acquisition unit 103 may recognize the position of another user and the distance between the user and another user based on sensing data and communication with a device worn by another user around.
  • the user status determination unit 102 of the information processing apparatus 10 determines the user status based on the sensing data from the sensor unit 110 (step S106).
  • the user situation determination unit 102 is not limited to sensing data, and acquires user schedule information, usual action history, contents posted to a social network, and the like, and based on these, the user situation is more detailed. It is also possible to judge.
  • control unit 100 of the information processing apparatus 10 determines matching content (step S109).
  • the control unit 100 may determine upper content based on, for example, priority (recommended ranking, ranking according to user preference, etc.).
  • control unit 100 may select from applications (contents) installed in the information processing apparatus 10 or may select from contents desired (registered) by the user in advance. Further, the control unit 100 may determine the content to be matched depending on whether the user is indoors or outdoors.
  • the conformity determination unit 104 of the information processing apparatus 10 determines whether or not the determined content can be provided to the user (step S112).
  • the suitability determining unit 104 determines the suitability of content matching according to the environment information acquired by the environment information acquiring unit 103 and the user situation determined by the user situation determining unit 102. For example, when matching outdoors, in the case of stormy weather such as rainy weather or typhoon, or when the time zone is late, such as late at night, the provision of the content is stopped because the risk is high (low suitability).
  • the weather forecast data may be acquired to take into account detailed weather. On the other hand, when matching indoors such as a shopping center, the weather need not be considered.
  • the user is on the way to work or waiting for a meeting, since the user cannot participate in the game content (low compatibility), the provision is stopped.
  • the conformity determination unit 104 determines whether the real environment matches the ideal environment condition of the content (the condition indicated by the ideal environment information). It is determined whether or not (step S115). For example, the conformity determination unit 104 can ensure the content area indicated by the ideal environment information, and if an actual object is used for the content, consider whether the predetermined actual object exists, and the conditions of the ideal environment It is determined whether or not it matches. At the same time, the conformity determination unit 104 determines that the content area is safe based on the actual environment (there is no road or private land, there are no dangerous places in the vicinity, or there is a possibility that many people will collide. If it is not safe (it can be said that the risk is high and the suitability is low), the provision of the content may be stopped.
  • the content content changing unit 105 of the information processing apparatus 10 restricts the content content according to the real environment (step S118). Specifically, the content content changing unit 105 matches the actual environment by limiting the size and shape of the content area from the conditions of the ideal environment, or in the case of competitive AR game content, By matching the number of people and rules, it will be matched to the real environment. At this time, the content content changing unit 105 changes the content according to the lower limit value or the upper limit value included in the ideal environment conditions, and if the content cannot be matched even if the content is changed, the content is provided. May be canceled and another content may be determined again in step S109. A specific example of changing the content content according to the present embodiment will be described later using an example.
  • the output control unit 106 of the information processing apparatus 10 provides content from the display unit 120 and the speaker 130 (step S121).
  • the output control unit 106 provides the restricted content when the content content is restricted in step S118, and if the real environment matches the ideal environment condition of the content (step S115 / Yes), no content is provided.
  • the content is controlled to be provided in an ideal environment without changing the content.
  • content provision control for example, notification related to an operation such as start of provision of content, display of a content area, display of a rule, display of a virtual object, output of content audio, and the like can be performed.
  • step S103 and the process shown in step S106 may be processed in parallel or in the reverse order.
  • FIG. 5 is a flowchart showing an example of the flow of the tennis game content provision control process according to the present embodiment.
  • the control unit 100 of the information processing apparatus 10 determines the type of game (content) (step S203).
  • the type of game content
  • “tennis game” is determined.
  • the control unit 100 acquires information on the determined tennis game content from the server 20 or calls it from the storage unit 160 if it is already recorded in the storage unit 160.
  • the control unit 100 acquires the weather information of the current position based on the position information of the user by the environment information acquisition unit 103, and determines whether the weather is appropriate by the conformity determination unit 104 (step S104).
  • Such judgment of the weather may be mainly taken into consideration when matching outdoors. In the case of an environment where play is not possible, such as rainy weather, the provision of content will be stopped.
  • the suitability determination unit 104 determines candidate position information (candidates where a play area can be set) from the map information based on the position information of the user.
  • Location information may be acquired from a database on the network or may be acquired from the server 20.
  • FIG. 6 shows an example of map information to be referred to.
  • the suitability determination unit 104 includes private land (areas 70a, 70b, 70e), roads (area 70c), swamps (area 70d), etc. In addition to these places where setting is not possible, for example, a park (area 70f), a plaza, a vacant land, a home site, etc.
  • FIG. 7 is a diagram illustrating an example of map information with a play record to be referred to. As shown in FIG. 7, for example, an area 70f has been matched with a tennis game in the past (“There is a record of playing”), suitability to the play area of the environment (for example, the number of star marks), and an inclination Many reviews are given (detailed data such as slopes and steps are obtained when the environment is measured at that location for implementation).
  • the matching determination unit 104 sets the number of players according to each candidate play area (step S212).
  • a plurality of players can be set in order to match a tennis game that is an example of a competitive game content. For example, if the play area is compatible with a doubles game, four players are set, and if the play area is compatible with a singles game, two players are set.
  • the suitability determination unit 104 grasps information on users (player candidates) existing near each candidate play area (within a certain range) (step S215), and determines whether the set number of players is sufficient (step S215). Step S218).
  • the set number of players is the recommended number of participants of the game content, and can be acquired in advance as information related to the content.
  • a user who can be a player is assumed to be a user who can handle a game, such as a user who is registered for the content to be matched this time (in this case, a tennis game) or a user who has installed the content on the device. Is done.
  • the user information may include position information and information indicating whether or not the player is ready to play (participation propriety). Whether or not it is in a playable state is determined based on the user situation. For example, in the case of taking a group action such as commuting, staying at a station, or being with a friend (the situation is based on location information, moving direction, camera image, voice, date, action history, schedule information, etc.) Can be recognized), it is determined that play is not possible.
  • These user information can be determined by the user situation determination unit 102 based on the sensing data acquired by the sensor unit 110 for the user who possesses the information processing apparatus 10. Further, information on other users in the vicinity can be acquired from the server 20.
  • the server 20 can acquire the position and status of each user who uses this system from each information processing apparatus 10 continuously or when necessary.
  • FIG. 8 shows an example of user information existing in the vicinity of the candidate play area.
  • the suitability determining unit 104 may change the threshold value as long as the number of people can be changed.
  • FIG. 9 shows a display example when notifying the user that the game participation is possible.
  • the output control unit 106 displays, on the display unit 120, a game notification image 410 such as “There is a place where a tennis game can be found nearby”, and a guidance image 411 indicating the direction and route to the play area. And AR are displayed. Thereby, the user can recognize that the tennis game can be performed and can move to the play area.
  • the information processing apparatus 10 may notify (invite) the game to other player candidates directly or via the server 20. Further, the information processing apparatus 10 may confirm the intention to participate in the user together with the notification that the game is possible. Note that confirmation of intention to participate may be stepped by creating a status indicating that the game can be participated in advance as the user status.
  • the information processing apparatus 10 may continue to search for player candidates until the set number of players is sufficient, or the game is performed because the number of participants is small. It may be notified to the user who has indicated that he / she can participate. Further, for example, when the number of players is one, the information processing apparatus 10 may provide game practice (volley practice, service practice, return practice, etc.) until an opponent appears.
  • game practice volley practice, service practice, return practice, etc.
  • the control unit 100 recognizes the environment around the user with the outward camera 111 or the like (step S224).
  • the play area candidates are acquired from the map information, but here, the actual state of the play area candidates is sensed.
  • the information processing apparatus 10 may prompt the user to acquire the surrounding environment (for example, walking or looking around the area). Thereby, for example, the actual state such as the size, shape, and number of obstacles present in the play area candidate, a step, a place where entry is prohibited, and the area of the flat ground can be acquired.
  • the information processing apparatus 10 can acquire environment information acquired by another user directly from a device used by the other user or via the server 20. Further, when the environment information of the play area candidate site has been acquired in the past, the information processing apparatus 10 may call a past acquisition result from the database (the storage unit 160 or the server 20).
  • the conformity determination unit 104 determines whether or not a play area can be set based on the acquired actual environment (step S227).
  • the matching determination unit 104 refers to the ideal environment information of the tennis game and determines whether or not the play area candidate site can be set as a play area. Details of whether or not the play area can be set will be described later with reference to FIGS. 13A and 13B.
  • the control unit 100 causes the content content changing unit 105 to perform rule change processing (content content changing processing) as necessary.
  • rule change processing content content changing processing
  • the content content changing unit 105 performs a process of restricting rules according to the actual environment of the set play area.
  • “rule” is a rule for providing content.
  • the number of games in one set usually 6 games, but can be changed to 4 games preemption / digestion, etc.
  • Widely means setting of ball speed, racket or ball size, bounce size, etc.
  • the content content changing unit 105 in particular, when the play area is set under conditions different from the conditions of the ideal environment information, the game characteristics may not be ensured with the default rules. Guarantee the game. Details of the rule change processing will be described later with reference to FIG.
  • FIG. 10 shows an example of notification to the user when setting the play area.
  • the output control unit 106 displays “determine the game location” on the display unit 120.
  • a notification image 413 with a play area setting such as “Masu” is displayed as an AR.
  • FIG. 11 is a diagram illustrating an example of a game content notification.
  • the output control unit 106 displays the notification image 415 indicating the game contents such as “tennis court, singles game, one set match” on the display unit 120 in an AR display. Further, as shown in FIG. 11, the output control unit 106 displays the tennis court image 400 and the tennis net image 401 in an AR display on the set play area on the display unit 120.
  • the output control unit 106 of the information processing apparatus 10 notifies the user that play is not possible. At this time, if there are other play area candidates in the vicinity, guidance to them may be performed.
  • FIG. 12 shows an example of a notification that leads to another candidate area. As shown in FIG. 12, the output control unit 106 displays, on the display unit 120, a notification image 417 for guiding to other candidate areas such as “Matched but there is a play area over there” and other play The guidance image 418 showing the direction to the area and the route is displayed in AR.
  • the operation processing according to the present embodiment is not limited to the example shown in FIG.
  • the determination of the number of players shown in step S212 is performed when the play area shown in step S227 is set, and other users (player candidates) existing in the vicinity are invited to participate in the game. Good.
  • the server 20 has the functions of the user situation determination unit 102, the conformity determination unit 104, the content content change unit 105, and the output control unit 106 of the control unit 100, and the server 20 executes the operation process illustrated in FIG. May be.
  • FIGS. 13A and 13B are flowcharts showing an example of the flow of determination processing for determining whether or not a play area can be set according to the present embodiment.
  • the suitability determining unit 104 of the information processing apparatus 10 calls (from the storage unit 160) the peripheral information (that is, the actual environment of the play area candidate place) acquired by the environment information acquiring unit 103 ( Step S253). Further, if there is a map database, the peripheral information may be called from there.
  • the conformity determination unit 104 determines whether or not the ambient light is more than the illuminance that can be displayed by the AR (step S256). This is because when the AR display is performed, if the external illuminance is a condition in which the AR display is not possible, the game performance is reduced.
  • the AR display method is not an optical transmissive display, but a method that displays an environment such as a video see-through (video transmissive display) (a method that displays a real object in real time by superimposing a virtual object on a video). ), Since the environment display can be changed, this step may be passed. Further, the conformity determination unit 104 may determine whether or not the environment (illuminance) is AR display by referring to weather information, weather forecast, and the like from an external database.
  • step S256 / No if the illuminance environment is at a level that is not suitable for AR display (such as when it is too bright) (step S256 / No), the game determination cannot be ensured, so the suitability determination unit 104 determines that the play area cannot be set (step S310). ).
  • the conformity determination unit 104 calls the ideal environment information of the provided content (step S259).
  • the ideal environment information of the tennis game content for example, a size such as an area size of 10 m ⁇ 24 m, a net in the center of the area, an area that is mainly flat, and the like are assumed.
  • the area size may be set to an upper limit value / lower limit value.
  • the conformity determination unit 104 determines whether there is an obstacle in the area used by the player (that is, the play area) from the actual environment of the play area candidate (step S262). Specifically, in order to search for a flat area similar to the play area size indicated by the ideal environment information from the periphery, the conformity determination unit 104 first grasps the presence or absence of a peripheral obstacle. Obstacles can be detected by analyzing camera images and distance sensor data.
  • the conformity determination unit 104 adopts the play area size of the ideal environment information (step S265). Specifically, the conformity determination unit 104 performs plane estimation or the like on a region where there is no detected obstacle, and estimates a dimension that can be set as a play area.
  • the suitability determining unit 104 determines whether or not the obstacle matches the position of the equipment used for the game (step S268). For example, as shown in FIG. 1, when the obstacles 60a to 60c are arranged in a horizontal line at the center of the play area candidates, it can be determined that the position matches the net position of the tennis game content.
  • step S271 it is determined whether or not the obstacle is smaller than the equipment used for the game.
  • the conformity determination unit 104 determines that the obstacle Is set to match the position of the equipment in the game (step S274).
  • the obstacle is regarded as equipment and it is defined as ideal environment information by making it an area containing obstacles. There is a high possibility that the dimension (or lower limit value) can be secured.
  • a virtual object of the equipment (tennis net 401, etc.) is displayed superimposed on the obstacles 60a-60c, thereby providing a sense of immersion in the content. Without hindering, danger such as collision with an obstacle can be avoided.
  • the conformity determination unit 104 calculates the playable area again within the range not including the obstacle (detection of a flat region) (step S277).
  • the suitability determining unit 104 sets a play area based on the recalculated area (Ste S283).
  • the suitability determining unit 104 determines that the play area cannot be set (step S310).
  • the conformity determination unit 104 may provide game practice (volley practice, service practice, return practice, etc.) that can be played in a play area smaller than the minimum size, or change to a similar sport (eg squash). You may do it.
  • the conformity determination unit 104 confirms whether the set play area includes a high-risk area such as a road or a step (step S286). In addition, you may make it exclude a high risk area
  • the conformity determination unit 104 checks whether there is a person other than the player in the set play area (step S289).
  • the suitability determining unit 104 determines whether all the persons other than the player are moving and pass the play area within a predetermined time. Is determined (step S292).
  • the conformity determination unit 104 analyzes people from the outward camera 111. When walking in the play area or riding a bicycle, it can be determined that the user has passed the play area within a certain time because it is moving. On the other hand, when sitting down or chatting in a group, it can be determined that the possibility of moving immediately is low.
  • step S292 when it can be determined that all persons other than the player are moving and pass the play area within a certain time (step S292 / Yes), the conformity determination unit 104 waits until it passes (step S295).
  • the conformity determination unit 104 sets again a play area excluding roads (highly dangerous places), people, and the like (step S298). It should be noted that the exclusion of dangerous places and passersby may be performed in parallel with the obstacle presence / absence determination shown in step S262.
  • the suitability determination unit 104 determines that the play area cannot be set (step S310) because the game performance cannot be secured.
  • the conformity determination unit 104 determines whether or not the color tone of the set play area can be overlaid with AR (preferably as the background of the AR display). Whether or not) (step S304). If the color tone of the play area is not preferable for AR display, it may be dealt with by changing the color tone on the AR side.
  • the conformity determination unit 104 determines the play area (step S307).
  • step S304 when the color tone of the set play area is not AR superimposable (step S304 / No), the game determination cannot be ensured, so the suitability determining unit 104 determines that the play area cannot be set (step S310).
  • the play area setting determination process according to the present embodiment has been specifically described above. Note that the flows shown in FIGS. 13A and 13B are examples, and the play area setting determination process according to the present embodiment is not limited to this.
  • the order of the determination processing is not limited to the example illustrated in FIGS. 13A and 13B, and may be in parallel or different order. Further, the processing may be appropriately passed depending on the situation.
  • the information processing apparatus 10 When the game is being executed at the same place until immediately before, the information processing apparatus 10 performs the previous environmental evaluation (detection of a flat area that can be used as a play area, the position of each obstacle and equipment in the content, (Comparison with size) may be obtained and these processes may be passed.
  • the conformity determination unit 104 may set a spectator area for watching the game content player near the play area as the content providing area.
  • a spectator is a user who is prohibited from direct interaction with the content but can view the content.
  • the number of users who want to watch AR content is expected to increase in the future, but there will be an area for spectators so that the number of watching users will increase and go out to dangerous places such as roads and will not interfere with passers-by. This makes it possible to enjoy AR content more safely.
  • the user is notified that the game is possible, he / she can also display his intention to watch the game without participating.
  • the server 20 may regard a user located in the set watching area as a watching person and allow output control (viewing only) of content. Further, the server 20 may prohibit the provision of content to a user who is neither in the watching area nor in the play area.
  • FIG. 14 shows a diagram for explaining the case where the watching area 421 is provided around the play area 420.
  • the matching determination unit 104 may determine a content area by providing a watching area 421 around the play area 420. At this time, the matching determination unit 104 causes the watching area 421 to include a dangerous place such as a road. When the content area size of the ideal environment information cannot be secured, the watching area 421 is restricted (narrower) than the play area 420. Furthermore, the conformity determination unit 104 may set a spacer area 422 between the play area 420 and the watching area 421 as shown in FIG. As a result, it is possible to avoid a collision between the player and the spectator and ensure safety. The information processing apparatus 10 may prevent the player from interacting with the game content in the spacer area 422.
  • the arrangement of the watching area is not limited to the arrangement surrounding the play area 420 as shown in FIGS. 14 and 15, and may be an area along a part of the play area 420, or within the play area 420. It may be provided, or the watching area may be divided into a plurality.
  • the information processing apparatus 10 causes the display unit 120 to display an AR and an image in which the play area 420, the watching area 421, and the spacer area 422 are clearly displayed and superimposed on the real space. Also good.
  • FIG. 16 is a flowchart showing an example of the flow of rule change processing according to the present embodiment.
  • the set play area is the same size as the size of the play area in the ideal environment information (step S313 / Yes), and the number of participants is equal to the specified number of players in the set play area. If so (step S316 / Yes), the control unit 100 determines that the existing rule is applied (step S319).
  • the existing rule is a recommended rule for the content set in the content data (predetermined basic rule for experiencing the content). For example, in the case of tennis game content, one set of games
  • rules relating to content provision such as rules relating to display control such as the speed of a sphere are widely included.
  • game characteristics may vary greatly depending on the size of the play area, which is the area that provides the content
  • game characteristics may vary greatly depending on the number of participants in the game (the number of users who use content simultaneously)
  • the specified number of persons corresponding to the size of the play area can be set as appropriate according to the area of the play area with reference to content data (ideal environment information or the like). For example, the smaller the play area, the smaller the number of participants.
  • whether or not the rule needs to be changed is determined based on the size of the play area and whether the number of participants matches the conditions.
  • the present invention is not limited to this, and the rules may be changed as appropriate so as to ensure the game characteristics according to the shape of the play area, the age, sex, experience value, etc. of the participants.
  • the content content changing unit 105 determines to change the rule as appropriate (Step S322). For example, in the case of tennis game content, the content content changing unit 105 reduces the ball speed when the number of players is smaller (than the prescribed number) relative to the size of the play area or when the play area is larger (than the prescribed size). Change as follows. Since the ball hits too quickly at the normal hitting speed, the game performance is maintained by reducing the ball speed. In addition, the content content changing unit 105 may change the ball speed so as to increase the speed when the number of players is larger (than the prescribed number) relative to the area of the content area or when the play area is smaller (less than the prescribed size). Good.
  • the content content changing unit 105 may display an avatar or the like having a size corresponding to the play area so that the play area is relatively wide. Further, the content content changing unit 105 may change the size of the racket, the size of the ball, the number of balls, and the like according to the size of the play area and the number of participants. In addition, the content content changing unit 105 may relax the ball hitting determination (determination of whether the ball is hitting the center) according to the size of the play area and the number of participants, and may maintain the game characteristics. The content content changing unit 105 may increase or decrease the coefficient of restitution when the ball rebounds on the court surface according to the size of the play area and the number of participants.
  • the content content changing unit 105 changes the rule so as to shorten the play time (step S331). For example, in the case of tennis game content, the content content changing unit 105 reduces the number of games in one set, uses only one set, adopts a no-advantage system, eliminates tie breaks (ends with a draw), etc. Thus, the play time can be shortened. Note that the reduction in play time is not limited to the case where there are users waiting for the game, and the rules are changed so as to shorten the play time even when the time until sunset is short or when the user has a future plan It is possible.
  • step S328 determines that the existing rule is applied.
  • the content content changing unit 105 determines a rule and a play time (step S334).
  • the rule change processing according to this embodiment has been specifically described above.
  • the operation processing shown in FIG. 16 is an example, and the present embodiment is not limited to this.
  • various rules such as the ball speed, the number of balls, relaxation of the hit determination, the number of games, etc., depending on the size of the play area and the number of participants.
  • the process of changing can also be applied to other ball games (eg, futsal, soccer, table tennis, badminton, volleyball, baseball, basketball, lacrosse, handball, etc.).
  • the survival game is a game that simulates a battle using a firearm, and is a field game in which a plurality of teams shoot each other and be disqualified when hit by a bullet.
  • the player decides on winning or losing by taking the other team's flag, etc., and the player advances while avoiding attacks by hiding himself in many obstacles.
  • the basic operation process of this embodiment is the same as the operation process described with reference to FIG. 5 in the first embodiment.
  • weather conditions may be implemented even in rainy environments.
  • a notification as shown in FIG. 17 is performed.
  • the output control unit 106 displays, on the display unit 120, a game notification image 430 such as “There is a possibility of a battle nearby” and a guidance image 431 indicating the direction and route to the play area. , AR is displayed.
  • a survival game can be performed and move to the play area.
  • the output control unit 106 displays, on the display unit 120, a notification image 433 of a game “currently in battle”, a guidance image 434 that shows the direction and route to the play area, and a user in battle A description image 435 showing the profile, the type of weapon used, the battle situation, and the like are displayed in an AR display.
  • step S227 of FIG. 5 the play area setting process shown in step S227 of FIG. 5 and the rule change process shown in step S230 when applied to survival game content will be described more specifically.
  • FIGS. 19A and 19B are flowcharts illustrating an example of the flow of determination processing for determining whether or not a play area can be set according to the second embodiment.
  • the suitability determining unit 104 of the information processing apparatus 10 calls (from the storage unit 160) the peripheral information (that is, the actual environment of the play area candidate place) acquired by the environment information acquiring unit 103 ( Step S403). Further, if there is a map database, the peripheral information may be called from there.
  • the conformity determination unit 104 determines whether or not the ambient light is more than the illuminance that can be displayed by the AR (step S406).
  • step S406 / No when the illuminance environment is at a level that is not suitable for AR display (such as when it is too bright) (step S406 / No), the game determination cannot be ensured, so the suitability determination unit 104 determines that the play area cannot be set (step S460). ).
  • the conformity determination unit 104 calls the ideal environment information of the content to be provided (step S409).
  • the ideal environment information of the survival game content for example, an area size corresponding to the number of participants, the number / size of obstacles, and the like are set. For example, in the case of 3 to 3 people, recommended conditions such as an area size of 15 m ⁇ 15 m and the number of participants ⁇ 4 or more obstacles are assumed. An upper limit value / lower limit value may be set for the area size and the number of obstacles.
  • the conformity determination unit 104 determines whether or not a play area having the same size as the ideal environment information can be set based on the acquired peripheral information (step S412). At this time, the suitability determining unit 104 determines steps, stairs, slopes (inclined areas), etc. that are excluded as dangerous places or obstacles in the setting of the play area of the tennis game content from the area within a range that does not affect the play of the survival game. It may not be excluded.
  • step S412 when a play area having the same size as the ideal environment information cannot be set (step S412 / No), the suitability determining unit 104 sets a play area that can be used (step S415), and the play area is used as usage environment data. It is determined whether or not the playable minimum area size (lower limit value) is equal to or greater than (step S418).
  • step S460 determines that the play area cannot be set.
  • the area 445 that is avoided such as sitting people is the play area, but is smaller than the minimum playable area size defined by the ideal environment information, so it is determined that the play area cannot be set. .
  • the determination unit 104 determines whether or not there are more than a certain number of obstacles that can be used in the game (more than the number recommended in the ideal environment information) in the set play area (step S421).
  • the “obstacle” used in the survival game is assumed to be an obstacle of a size that can be used for the game, such as hiding itself (ie, a shield).
  • Such a size (recommended value / upper limit value / lower limit value) can also be defined by the ideal environment information.
  • the determination of the recommended conditions regarding the obstacles is not limited to this. Is set, it is determined whether there are a certain number of obstacles or less.
  • the conformity determination unit 104 calculates the number of obstacles that can be generated by the virtual object (step S427). This is because it is assumed that the feeling of use is reduced (delay etc.) when a large number of virtual objects are generated due to the spec restrictions of the information processing apparatus 10 which is a display device.
  • the conformity determination unit 104 determines the number that can be generated based on the specifications of the information processing apparatus 10.
  • the conformity determination unit 104 determines the play area based on the calculated area. Setting is made (step S433).
  • the placement of the virtual obstacle is set in consideration of the position of the actual obstacle. For example, a virtual obstacle is superimposed on an obstacle (real object) that cannot be used as a shield for a survival game because it is small enough to hide a person, thereby compensating for the number of obstacles (obstacles) and obstacles ( It is possible to avoid a collision with a real object.
  • the virtual obstacle (shielding object) may be arranged (space orientation) in a place where there is no actual obstacle.
  • FIG. 21 is a diagram illustrating a case where a shortage of real obstacles (shielding objects) is compensated for by virtual objects (virtual obstacles).
  • the information processing apparatus 10 arranges virtual obstacles 452a and 452b based on virtual objects.
  • the information processing apparatus 10 may superimpose and display the virtual obstacle 452a on the real obstacle 636b, or may be arranged in a place where there is no actual obstacle like the virtual obstacle 452b.
  • the conformity determination unit 104 sets an area including the above-mentioned certain number of actual obstacles as a play area (step S424). For example, as shown in FIG. 22, when the area 460 includes more than a certain number of real obstacles 65a to 65g that can be used as obstacles (shields) for the survival game, the conformity determination unit 104 sets the area 460 to the survival game. To play area.
  • steps S436 to S460 shown in FIG. 19B is the same as the processing shown in steps 286 to S310 shown in FIG. 13B according to the first embodiment.
  • the play area setting determination process according to the present embodiment has been specifically described above. Note that the flows shown in FIGS. 19A and 19B are examples, and the play area setting determination process according to the present embodiment is not limited to this.
  • the order of the determination processing is not limited to the example illustrated in FIGS. 19A and 19B, and may be in parallel or different order. Further, the processing may be appropriately passed depending on the situation.
  • the information processing apparatus 10 acquires the immediately preceding environmental evaluation (detection of an area that can be used as a play area, the number of obstacles, etc.), and performs these processes. May be passed.
  • the conformity determination unit 104 may set, as the content providing area, a spectator area for watching the game content player around the play area in addition to the play area. .
  • the matching determination unit 104 may set a spacer area between the play area and the watching area. As a result, it is possible to avoid a collision between the player and the spectator and ensure safety.
  • FIG. 23 is a flowchart illustrating an exemplary flow of a rule change process.
  • the content content changing unit 105 grasps the number of participants (step S473).
  • the number of participants may be acquired from the server 20 or may be grasped by directly communicating with the participant's device.
  • the content content changing unit 105 makes use of a large area such as a flag battle or a general battle. A rule is selected (step S479). At this time, the content content changing unit 105 may consider whether or not the number of participants for the size of the play area is a recommended number.
  • step S476 / No when the set play area is not the same size as the play area in the ideal environment information (it is assumed that the play area is smaller than the recommended value and larger than the lower limit value) (step S476 / No), the content content changing unit 105, based on whether or not an obstacle is unevenly distributed in the play area (arrangement of the obstacle), changes the rule so as to secure the game characteristics (steps S482 to S488).
  • the content content changing unit 105 selects an offense / defense battle that forms a team by attack and defense (step S485). .
  • the content content changing unit 105 secures the game performance by restricting the type of weapon such as a hand gun battle (step S488).
  • the handgun battle is limited to handguns with short range, and the play area is small and obstacles are not unevenly distributed compared to using a rifle with a long range, which is used in normal survival games. Even in this case, the game can be maintained.
  • the rule change is not limited to these. For example, when the play area is smaller than the recommended value, the parameter for determining the hit between the ball and the user may be tightened.
  • the rules may be changed as appropriate so as to ensure the game characteristics according to the age, sex, experience value, etc. of the participants.
  • the content content changing unit 105 changes the rule so as to shorten the play time (step S497). For example, the content content changing unit 105 performs a change such as eliminating the restoration rule.
  • step S494 determines that the existing rule is applied (step S494).
  • the content content changing unit 105 determines a rule and a play time (step S450).
  • the rule change processing according to this embodiment has been specifically described above. Note that the operation processing shown in FIG. 23 is an example, and the present embodiment is not limited to this. For example, it is not limited to the example shown in FIG. Further, the processing may be appropriately passed depending on the situation.
  • each process according to the second embodiment may be executed by the server 20.
  • the information processing apparatus 10 notifies the user of the game contents (play area settings, rules, and the like). Further, for example, when it is necessary to prepare for a strategy meeting or the like in the team before the game starts, the meeting place may be notified as shown in FIG. As shown in FIG. 24, the output control unit 106 displays a notification image 440 indicating the set play area on the display unit 120, and “3-3 general war. Start briefing at the position of the arrow”. A notification image 442 of the game content and an arrow image 441 that clearly shows the meeting place are AR-displayed.
  • the information processing apparatus 10 may determine whether or not to participate in the game by an action such as leaving from the play area, in addition to voice and gesture, or in the UI. For example, as shown in FIG. 25, the output control unit 106, when the first game is to be ended on the display unit 120, “Your victory! If you want to fight again, stay in this area. End. If you do, please get out of this area. ”A notification image 443 asking whether or not to participate in the game and a notification image 444 indicating the area are displayed in an AR display.
  • the information processing system is not limited to the matching to the actual outdoor environment as described above, and can naturally be matched to the actual indoor environment. When matching indoors, unlike the outdoors, there is no need to consider the weather conditions.
  • what is set as a play area is not limited to the ground or floor, but includes areas such as the top of the table and walls.
  • FIG. 26 For example, when matching a table tennis game indoors, as shown in the left side of FIG. 26, the information processing apparatus 10 uses a recommended size or a recommended shape (for example, a plane area detected from the table top 70 of the table defined by ideal environment information). If it matches (rectangle), it is set as a play area. Then, as shown on the left in FIG. 26, the information processing apparatus 10 arranges the table tennis court image 470 and the table tennis net image 471 in the set play area on the display unit 120 and displays the AR.
  • a recommended size or a recommended shape for example, a plane area detected from the table top 70 of the table defined by ideal environment information. If it matches (rectangle), it is set as a play area. Then, as shown on the left in FIG. 26, the information processing apparatus 10 arranges the table tennis court image 470 and the table tennis net image 471 in the set play area on the display unit 120 and displays the AR.
  • the information processing apparatus 10 may be set as a play area.
  • the information processing apparatus 10 arranges the table tennis court image 473 and the table tennis net image 474 on the display unit 120 in accordance with the shape of the set play area, and displays the AR.
  • the information processing apparatus 10 can use the obstacles as equipment used for content. Judge whether the size or arrangement. For example, in the case of table tennis game content, it is defined as an ideal environment that a net having a height of about 10 cm is arranged at the center of the play area. In this case, for example, the information processing apparatus 10 determines whether the arrangement and size of the obstacles 67a to 67c shown in FIG. 27 correspond to the table tennis net.
  • the net image 477 (virtual object) Is superimposed on the obstacles 67a to 67c, and the play area is set in accordance with the position of the obstacles 67a to 67c (the table tennis court image 476 is arranged), so that the sense of immersion in the content is not hindered. It becomes possible to set a play area including an obstacle. Also, in the case where it is difficult to move obstacles, the contact between the obstacles and the table tennis ball is excluded from the calculation in the game, and the contact with the plane with the obstacles is made effective. It may be expressed that a sphere passes through an obstacle. Such an expression is also useful when priority is given to effectiveness.
  • the information processing apparatus 10 changes the game rules according to the size of the table, the number of players participating, and the like (for example, the number of points of one game, the speed of a ball, the display of an avatar, etc.) to ensure game performance. It may be.
  • the information processing system presents a notification of participation in the game (invitation) to the user together with a notification prompting the installation of the application, for example, when the application needs to be installed on the device in order to participate in the game. It may be.
  • the information processing system matches a plurality of contents to the same real environment, and gives priority to contents with high adaptability (that is, contents that can be provided in an environment closer to the ideal environment). You may make it notify.
  • a computer program for causing the information processing apparatus 10 or the server 20 to perform the functions of the information processing apparatus 10 or the server 20 on hardware such as a CPU, ROM, and RAM incorporated in the information processing apparatus 10 or the server 20 described above.
  • a computer-readable storage medium storing the computer program is also provided.
  • this technique can also take the following structures.
  • An output control unit that performs output control on the content based on content information including information on a content area in the real space where the content is provided;
  • An environment information acquisition unit that acquires environment information about the real space in which the content is provided;
  • the information processing apparatus wherein the output control unit changes the content provided by the environment information when the environment information satisfies a first condition and when the environment information satisfies a second condition different from the first condition.
  • the output control unit restricts at least one of the shape and area of the content area to be set when the environmental information satisfies the second condition, compared to when the environmental information satisfies the first condition.
  • the second condition is a condition that the content area includes an obstacle that prevents provision of the content
  • the information processing apparatus according to (2) wherein the output control unit restricts at least one of a shape and an area of the content area to be set when the environment information satisfies the second condition.
  • the output control unit avoids the obstacle from the real space and restricts at least one of the shape and area of the content area and has the shape and area.
  • the information processing apparatus according to (3) wherein an area candidate is detected and set as the content area.
  • the second condition is a condition that the content area includes an obstacle that prevents provision of the content
  • the information processing unit according to (1) wherein when the environment information satisfies the second condition, the output control unit sets the content area so that a virtual object used for the content is arranged on the obstacle. apparatus.
  • the first condition and the second condition are each related to weather, The information processing apparatus according to (1), wherein the output control unit prohibits the provision of the content when the content area satisfies the second condition.
  • the output control unit permits output control related to the content even when the real space is an indoor environment and the environment information satisfies the second condition.
  • Information processing device is a condition that the content area includes an obstacle that prevents provision of the content
  • the first condition and the second condition are related to the area and shape of the content area to be set, or the number of simultaneous users of the content
  • the output control unit changes the provision rule of the content when the content area satisfies the second condition and when the content area satisfies the first condition, according to (1).
  • Information processing device (10) The information processing apparatus according to (9), wherein the change of the content provision rule is at least one of a change of a progress rule, a rule change for shortening a content provision time, and a display control rule change.
  • the output control unit determines a candidate site that may be set as the content area based on the position information of the user, and performs a notification for guiding to the candidate site.
  • the environment information acquisition unit acquires environment information of the candidate site when the user moves to the candidate site, The information processing apparatus according to (11), wherein the output control unit notifies the user of the content area set based on the environment information.
  • the content provision restriction is a restriction on a number of users who can use the content simultaneously.
  • the information processing apparatus according to (13), wherein the number of users who can simultaneously use the content is determined according to the set area or shape of the content area.
  • the information processing apparatus according to (14) wherein the smaller the set area of the content area, the smaller the number of users who can use the content simultaneously.
  • the content area includes a play area where the content can be interacted with, and a watching area where only the content area can be viewed,
  • the watching area is located outside the play area,
  • the output control unit permits output control of the content to a user who is located in the watching area and is prohibited from direct interaction with the content, and can be placed in either the watching area or the play area.
  • the information processing apparatus according to (16) wherein provision of the content is prohibited for a user who is not located.
  • the information processing apparatus according to (17), wherein a non-content area in which no content is provided to any user is set between the play area and the watching area.
  • Computer An output control unit that performs output control on the content based on content information including information on a content area in the real space where the content is provided;
  • An environment information acquisition unit that acquires environment information about the real space in which the content is provided;
  • Function as The said output control part is a program which changes the provision content of the said content, when the said environment information satisfy
  • Information processing apparatus 100 Control part 101 User physical information acquisition part 102 User condition judgment part 103 Environmental information acquisition part 104 Conformity judgment part 105 Content content change part 106 Output control part 110 Sensor part 111 Outward camera 112 Inward Camera 113 Microphone 114 Gyro sensor 115 Acceleration sensor 116 Direction sensor 117 Position positioning unit 120 Display unit 130 Speaker 140 Communication unit 150 Operation input unit 160 Storage unit 20 Server 30 Network

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Business, Economics & Management (AREA)
  • Computer Security & Cryptography (AREA)
  • General Business, Economics & Management (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

Le problème à résoudre par la présente invention est de fournir un dispositif de traitement d'informations, un procédé de traitement d'informations et un programme étant capables de restreindre un contenu à fournir à un espace réel conformément à un environnement réel. La solution selon l'invention porte sur un dispositif de traitement d'informations qui comprend : une unité de commande de sortie qui effectue une commande de sortie sur un contenu, sur la base d'informations de contenu comprenant des informations relatives à une zone de contenu dans un espace réel auquel le contenu doit être fourni ; et une unité d'acquisition d'informations d'environnement qui acquiert des informations d'environnement relatives à l'espace réel auquel le contenu est fourni. L'unité de commande de sortie change les détails de contenu fournis si les informations d'environnement satisfont une première condition, et si les informations d'environnement satisfont une seconde condition différente de la première condition.
PCT/JP2019/008845 2018-05-24 2019-03-06 Dispositif de traitement d'informations, procédé de traitement d'informations et programme WO2019225115A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018099507A JP2021140194A (ja) 2018-05-24 2018-05-24 情報処理装置、情報処理方法、およびプログラム
JP2018-099507 2018-05-24

Publications (1)

Publication Number Publication Date
WO2019225115A1 true WO2019225115A1 (fr) 2019-11-28

Family

ID=68615733

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/008845 WO2019225115A1 (fr) 2018-05-24 2019-03-06 Dispositif de traitement d'informations, procédé de traitement d'informations et programme

Country Status (2)

Country Link
JP (1) JP2021140194A (fr)
WO (1) WO2019225115A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102021105535A1 (de) 2020-03-12 2021-09-16 Honda Motor Co., Ltd. Information-Verarbeitungsvorrichtung, Information-Bereitstellungssystem und Information-Verarbeitungsverfahren
JP2021189695A (ja) * 2020-05-28 2021-12-13 株式会社Spacial 方法、プログラム、情報処理装置
WO2023002793A1 (fr) * 2021-07-21 2023-01-26 株式会社ソニー・インタラクティブエンタテインメント Dispositif de traitement d'informations, procédé de traitement d'informations et programme informatique
WO2023002792A1 (fr) * 2021-07-21 2023-01-26 株式会社ソニー・インタラクティブエンタテインメント Dispositif de traitement d'informations, procédé de traitement d'informations et programme informatique

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7081860B1 (ja) 2021-09-22 2022-06-07 シンメトリー・ディメンションズ・インク ３次元モデル生成システム、３次元モデル生成サーバ、位置情報ゲームサーバ、および３次元モデル生成方法

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015116336A (ja) * 2013-12-18 2015-06-25 マイクロソフト コーポレーション 複合現実感アリーナ
JP2018013901A (ja) * 2016-07-20 2018-01-25 株式会社Ａｂａｌ 仮想空間体感システム

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015116336A (ja) * 2013-12-18 2015-06-25 マイクロソフト コーポレーション 複合現実感アリーナ
JP2018013901A (ja) * 2016-07-20 2018-01-25 株式会社Ａｂａｌ 仮想空間体感システム

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102021105535A1 (de) 2020-03-12 2021-09-16 Honda Motor Co., Ltd. Information-Verarbeitungsvorrichtung, Information-Bereitstellungssystem und Information-Verarbeitungsverfahren
US11538226B2 (en) 2020-03-12 2022-12-27 Honda Motor Co., Ltd. Information processing device, information providing system, and information processing method
JP2021189695A (ja) * 2020-05-28 2021-12-13 株式会社Spacial 方法、プログラム、情報処理装置
WO2023002793A1 (fr) * 2021-07-21 2023-01-26 株式会社ソニー・インタラクティブエンタテインメント Dispositif de traitement d'informations, procédé de traitement d'informations et programme informatique
WO2023002792A1 (fr) * 2021-07-21 2023-01-26 株式会社ソニー・インタラクティブエンタテインメント Dispositif de traitement d'informations, procédé de traitement d'informations et programme informatique

Also Published As

Publication number Publication date
JP2021140194A (ja) 2021-09-16

Similar Documents

Publication Publication Date Title
WO2019225115A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme
US20230302359A1 (en) Reconfiguring reality using a reality overlay device
US9779633B2 (en) Virtual reality system enabling compatibility of sense of immersion in virtual space and movement in real space, and battle training system using same
US10715759B2 (en) Athletic activity heads up display systems and methods
US9599821B2 (en) Virtual reality system allowing immersion in virtual space to consist with actual movement in actual space
Adhanom et al. The effect of a foveated field-of-view restrictor on VR sickness
US11748959B2 (en) Device for simulating a virtual fitness partner and methods for use therewith
US10183220B2 (en) Image generation device and image generation method
CN108292040B (zh) 优化头戴式显示器屏幕上的内容定位的方法
US10809530B2 (en) Information processing apparatus and information processing method
US20170076503A1 (en) Method for generating image to be displayed on head tracking type virtual reality head mounted display and image generation device
CN108292490B (zh) 显示控制装置和显示控制方法
US20060223635A1 (en) method and apparatus for an on-screen/off-screen first person gaming experience
CN110689941A (zh) 信息处理设备和存储介质
JP2023075136A (ja) 表示制御プログラム、表示制御装置、及び表示制御方法
CN109069903A (zh) 用于监测体育事件中的对象的系统和方法
US11460696B2 (en) Head-mountable apparatus and methods
Silva et al. An indoor navigation system for live-action virtual reality games
JP6875029B1 (ja) 方法、プログラム、情報処理装置
JP7462591B2 (ja) 表示制御装置及び表示制御方法
JP2024018447A (ja) 仮想空間移動装置、仮想空間移動方法、及び仮想空間移動プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19807558

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19807558

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP