EP2886171A1 - Expérience de réalité augmentée multiplate-forme - Google Patents

Expérience de réalité augmentée multiplate-forme Download PDF

Info

Publication number
EP2886171A1
EP2886171A1 EP13198221.7A EP13198221A EP2886171A1 EP 2886171 A1 EP2886171 A1 EP 2886171A1 EP 13198221 A EP13198221 A EP 13198221A EP 2886171 A1 EP2886171 A1 EP 2886171A1
Authority
EP
European Patent Office
Prior art keywords
display
see
user
gaming session
computing device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP13198221.7A
Other languages
German (de)
English (en)
Inventor
Stephen Latta
Daniel MCCULLOCH
Jason Scott
Kevin Geisner
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Priority to EP13198221.7A priority Critical patent/EP2886171A1/fr
Publication of EP2886171A1 publication Critical patent/EP2886171A1/fr
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/24—Constructional details thereof, e.g. game controllers with detachable joystick handles
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A63F2300/301—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device using an additional display connected to the game console, e.g. on the controller
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082—Virtual reality

Definitions

  • Massively multiplayer online games are frequently configured to operate on a single platform. Users typically participate in a massively multiplayer online game by selecting a server and viewing a virtual representation of the game on a stationary display, such as a high definition television.
  • Embodiments are disclosed herein for providing a cross-platform, augmented reality online experience in a computing system.
  • a server system may host a plurality of multiplayer gaming sessions and join computing devices to the multiplayer gaming sessions.
  • the server system may provide augmentation information to see-through display devices and/or experience information to computing systems operating on different platforms from the see-through display devices.
  • the see-through display devices may provide an augmented reality experience with the augmentation information.
  • the computing systems operating on different platforms may provide a cross-platform representation of the augmented reality experience with the experience information.
  • Massively multiplayer online games are often implemented as two- or three-dimensional virtual environments on a single platform, such as a gaming console, a personal computer, or a mobile computing device.
  • Previous cross-platform massively multiplayer online games only utilize platforms with the same type of game display (e.g., two- or three-dimensional graphics and/or animations rendered and displayed on a conventional display, such as a television, computer monitor, and/or mobile phone screen. Accordingly, players are only able to participate in games with other players having platforms that utilize the same types of displays, thereby limiting the amount and variety of players encountered in such multiplayer online games.
  • the disclosed embodiments are directed to a cross-platform, massively multiplayer online experience that allows users with augmented reality, see-through displays to participate in an augmented reality game.
  • users of a see-through display device may participate in an augmented reality experience.
  • Users of a computing device operating on a different platform may participate in a cross-platform representation of the augmented reality experience.
  • the cross-platform representation may thereby bring the appearance of the augmented reality experience to a user of a computing device that is typically incapable of providing such an augmented reality experience.
  • FIG. 1 schematically shows an example communication diagram of a cross-platform, augmented reality massively multiplayer online gaming system 100 including a plurality of multiplayer gaming sessions 101 hosted by a game server 102.
  • Cross-platform, augmented reality massively multiplayer online gaming system 100 may accommodate a variety of cross-platform computing devices, such as see-through display devices, gaming systems connected to a stationary display device, personal computing devices connected to an external display device, mobile computing devices such as laptops, smart phones, tablets, etc.
  • augmented reality massively multiplayer online gaming system 100 may include see-through display devices 104, 106, and 108 and home entertainment system 110 including gaming system 112 connected to stationary display device 114.
  • Each computing device may participate in a massively multiplayer online game by connecting to game server 102 through network 116 (e.g., the Internet).
  • network 116 e.g., the Internet
  • FIG. 2 a method 200 of hosting a plurality of multiplayer gaming sessions is shown.
  • game server 102 of FIG. 1 may perform the steps of method 200 to host a plurality of cross-platform multiplayer gaming sessions.
  • game server 102 joins a first computing device to a first multiplayer gaming session.
  • the first computing device may include a see-through display.
  • the first computing device may correspond to see-through display device 104 of FIG. 1 .
  • the game server sends augmentation information to the first computing device.
  • the augmentation information may correspond to a virtual environment of the multiplayer gaming session. Augmentation information may include image data corresponding to the virtual environment or game space of the multiplayer gaming session and location information for placement of the image data.
  • the location information may be provided relative to other image data. For example, an augmentation for a tree may be described in relation to an augmentation for a building. In some embodiments, the location information may be provided relative to physical locations. For example, an augmentation for a tree may be described in relation to a location of the tree in the physical world.
  • the see-through display device may display this augmentation at a particular location of the see-through display based on a known or detected location of the tree in the physical world.
  • the see-through display of the first computing device may utilize the augmentation information to present an augmented reality experience by representing the multiplayer gaming session as an augmentation of the physical environment viewable through the see-through display.
  • An illustration of an example augmented reality experience is shown in FIG. 3 and FIG. 4 .
  • physical environment 300 may include a plurality of real-world objects 302.
  • Real-world objects may include virtually any object that exists in the real world, including, but not limited to, trees, buildings, landmarks, people, vehicles, etc.
  • Physical environment 300 may also include a plurality of computing devices participating in a multiplayer gaming session, such as see-through display devices 304 and 306 controlled by a first user 308 and a second user 310, respectively.
  • see-through display devices 304 and 306 may correspond to see-through display devices 104 and 106 of FIG. 1 and physical environment 300 may correspond to Location 1 of FIG. 1 .
  • FIG. 4 illustrates an example augmented reality experience for a multiplayer gaming session.
  • Augmented view 400 of physical environment 300 is depicted as seen through see-through display device 304.
  • Augmented view 400 may provide an augmented reality experience to user 308 by presenting an altered appearance of one or more objects in the real world when the objects are viewed through a see-through display.
  • see-through display device 304 may display virtual objects 402 as an augmentation of real-world objects 302 in order to provide an augmented reality environment corresponding to a multiplayer gaming session.
  • An appearance of user 310 may also be augmented to provide an augmented reality version of a character controlled by user 310.
  • sec-through display device 304 may display virtual character-based objects 404, such as armor and weaponry, in a location corresponding to relevant portions of user 310.
  • a virtual sword 404a may be displayed in a location corresponding to a right hand of user 310.
  • Character-based items may include any suitable virtual item associated with a character and positioned on a see-through display to augment an appearance of a user.
  • character information 406 may also be displayed near a location of a character presented in the augmented view.
  • Character information may include virtually any information about a character and/or a user, such as character name, user name, stats, gear, contact information, etc.
  • Character information may be displayed in any suitable format, such as text, icons, images, etc.
  • virtual items such as pets or companions belonging to a character of a user may be displayed near a location of the user.
  • character information 406a includes a user name and a character name corresponding to user 310 displayed as a popup above user 310.
  • Augmentations of real-world objects may be configured to hide associated real-world objects. In some embodiments, this may be achieved by obscuring an object with one or more images that depict a background. For example, a tree that appears in front of a portion of sky when viewed through a see-through display may be augmented by displaying an image of the sky in a location of the see-through display corresponding to the location of the tree. In this example, the augmented tree appears as sky when viewed through the see-through display, giving the illusion that the tree has disappeared.
  • An augmented view of a physical environment may also include virtual objects that do not directly correspond to a real-world object in the physical environment.
  • virtual character 408 may be displayed to represent a user of a remotely located computing device participating in the multiplayer gaming session.
  • Character information 406 may also be displayed for virtual characters of remote users.
  • character information 406b is shown as a popup including a user name and a character name corresponding to a user represented by character 408.
  • a second computing device is joined to the first multiplayer gaming session.
  • the second computing device may be remotely located and/or may operate on a different platform than the first computing device.
  • the game server sends experience information to the second computing device.
  • the experience information may provide a cross-platform representation of the augmented reality experience provided to the first computing device.
  • FIG. 5 illustrates an example cross-platform representation of the augmented reality experience depicted in FIG. 4 .
  • Gaming system 502 may be joined to a multiplayer gaming session based on virtually any suitable criteria.
  • gaming system 502 may be joined to a multiplayer gaming session in response to a user 506 opting into and/or selecting the multiplayer gaming session.
  • gaming system 502 may be joined to a multiplayer gaming session automatically based on criteria such as location, session population, technical specifications of the gaming system, preference settings, and/or any other suitable criteria.
  • the multiplayer gaming session may be presented to user 506 by displaying experience 508 on display device 504 as a cross-platform representation of an augmented reality experience.
  • user 506 may see a virtual representation of the game space in which one or more other players with see-through display devices are participating in the multiplayer gaming session.
  • FIG. 5 depicts a first person mode, in which display device 504 displays a virtual representation of users 308 and 310 from a first-person perspective of virtual character 408 shown in FIG. 4 .
  • a third-person perspective may be used.
  • perspective may be dynamically altered, by selection or automatically, to show experience 508 in a third-person mode and/or from any other suitable perspective.
  • Experience 508 may be a cross-platform representation of the augmented reality experience that is configured for visual presentation via display device 504.
  • experience 508 may be presented in response to receiving experience information from a game server, such as game server 102.
  • experience information may include aspects of a physical environment corresponding to the multiplayer gaming session.
  • Experience information may additionally or alternatively include augmentation information or a representation of augmentation information corresponding to a virtual environment of the multiplayer gaming session.
  • aspects of the physical environment may be provided in any suitable manner and may include any information about the physical environment, such as topographical features, depth information of objects in the physical environment, landmark locations, transportation routes, time of day, weather conditions, etc.
  • the aspects of the physical environment may be used to configure, alter, and/or enhance gameplay by incorporating the aspects and/or elements related to the aspects into the multiplayer gaming session. For example, gameplay may be different at night versus during the day.
  • the game server may store aspects of the physical environment, receive information about the physical environment from a third-party database, and/or receive information from participants of a multiplayer gaming session.
  • a see-through display device may detect aspects of the physical environment via one or more sensors of the see-through display device and send the detected aspects to the server and/or other computing devices participating in a multiplayer gaming session.
  • the game server may identify all information relating to a game space for a multiplayer game session and configure the information for a particular platform.
  • Game space information may describe a multiplayer gaming session by including information such as physical environment information and corresponding virtual environment information.
  • the game server may send experience information to a computing device, such as gaming system 502, in the form of a two- or three-dimensional representation of the game space, so that it may be displayed on display device 504.
  • the cross-platform representation of an augmented reality experience may provide an experience corresponding to a multiplayer gaming session to a user having a different computing device than other users in the multiplayer gaming session.
  • the augmented reality experience and cross-platform representation of the augmented reality experience may allow a plurality of users of a plurality of computing devices operating on different platforms to participate in a multiplayer gaming session of a massively multiplayer online game.
  • a game space for a multiplayer gaming session may be provided to a see-through display device in a different manner than a gaming system.
  • augmentation information may be provided to a see-through display device, such as see-through display device 304 of FIG. 3
  • experience information may be provided to a computing device operating on a different, platform, such as gaming system 502 of FIG. 5 .
  • augmentation information may be a different data format, include different data structures, have different data sources, and/or differ in any suitable manner from experience information in order to configure the experience for presentation on a display device of a respective platform.
  • the computing devices may also perform cross-platform communication to provide a social aspect to the game.
  • communication information may be sent between a first and second computing device, such as see-through display device 104 and gaming system 112 of FIG. 1 .
  • Communication information may include text and/or speech input from the users of the computing devices.
  • the communication information may be sent directly between the computing devices, through a game server, and/or through any third-party computing device.
  • the computing devices and/or the game server may include text-to-speech and/or speech-to-text conversion capabilities.
  • speech output may be derived from text input and text output may be derived from speech input.
  • FIG. 3 may provide a speech input to see-through display device 304 to communicate with user 506 of FIG. 5 .
  • the see-through display device 304, game server 102, and/or gaming system 502 may convert the speech input to text output to be displayed on display device 504 depicted in FIG. 5 .
  • Communication may be provided between any group of computing devices, including a private conversation between selected computing devices, across an entire game session, across all game sessions, etc.
  • a user may provide user input to control an associated user character and/or to interact with the experience. For example, a user may provide user input in order to create, delete, and/or otherwise alter one or more elements within a multiplayer gaming session.
  • User input may be detected by any suitable user input device or combination of input devices, such as gesture detection devices, microphones, inertial measurement units, etc.
  • user 308 of FIG. 3 may point at a target, such as virtual character 408 depicted in FIG. 4 , and perform a gesture corresponding to an attack in order to control an associated character to attack the target.
  • the gesture may be captured by one or more sensors of see-through display device 304, such as an image sensor, and matched to a corresponding command in order to cause the character associated with user 308 to perform the requested attack.
  • a user may also combine user input, for example, by pointing at a target and speaking an attack command in order to perform the associated attack on the target.
  • an inertial measurement unit connected to see-through display device 304 of FIG. 3 may detect a gesture from user 308 while a microphone of see-through display device 304 detects a voice command from user 308.
  • User input may also allow a user to interact with menu items of an experience.
  • user 308 of FIG. 3 may point at a second user, such as user 506 of FIG. 5 , or a virtual representation of a remote user, such as virtual character 408 of FIG. 4 , to display additional information about the corresponding user and/or character.
  • an experience may include a map of a multiplayer gaming session as an overlay and/or augmentation of a map of the physical environment associated with the multiplayer gaming session.
  • the map may provide a location of a representation of a user of a computing system that is dynamically updated to correspond to a current location of the computing system. Put another way, real world travel may be automatically updated in the experience.
  • the map may provide a location of virtually any item of the experience and/or real world, such as locations of other users, quests, virtual objects, real-world objects, etc.
  • the map may be customizable by a user. For example, the map may be filtered to show only friends of the users, enemies, selected quests, etc.
  • the map may be viewable when logged out of a multiplayer gaming session and/or game server. For example, a user may view the map to identify an in-game status of a physical location of the user.
  • a multiplayer gaming session may have features that are location-dependent.
  • a multiplayer gaming session may correspond to a particular region or regions of the real world.
  • quests or other in-game events may be tied to a real-world landmark, such that the in-game event is activated when a user is within a proximity threshold of the real-world landmark.
  • In-game events may also be triggered when a number of users in a particular real-world location and/or virtual location within a multiplayer gaming session exceeds a threshold.
  • in-game events may be created, deleted, and/or otherwise altered by a user. For example, a user may create a virtual object to be placed within a gamespace of the multiplayer gaming session. In response to the creation of the virtual object, another user may receive a quest related to the virtual object. The created virtual object may remain and be viewed as part of the related quest.
  • FIG. 6 shows an example method 600 of joining two computing devices to multiplayer gaming sessions based on the locations of the two computing devices.
  • a game server such as game server 102 of FIG. 1
  • the first computing device may include a first see-through display, such as see-through display device 104 of FIG. 1 .
  • the location of a computing device may be determined in any suitable manner. For example, the location of the first computing device may be determined by detecting aspects of the physical environment via one or more sensors of the first computing device.
  • the first computing device is joined to a first multiplayer gaming session.
  • the first multiplayer gaming session may be selected based on the location of the first computing device. Virtually any suitable criteria related to location may direct the selection of a multiplayer gaming session as described at 608. For example, a plurality of multiplayer gaming sessions may each correspond to a different real-world region.
  • a computing device may be placed in a multiplayer gaming session corresponding to a real-world region in which the computing device is located.
  • location may be one of a plurality of criteria for selecting a multiplayer gaming session for a computing device. For example, a computing device may be joined to a multiplayer gaming session corresponding to the nearest real-world region that has a population above or below a population threshold. As another example, a computing device may be joined to a multiplayer gaming session corresponding to the nearest real-world region having one or more friends of a user of the computing device.
  • augmentation information for the first multiplayer gaming session may be sent to the first computing device at 610.
  • Such augmentation information may be used by the see-through display to augment the reality of the physical environment viewed through the see-through display.
  • the game server receives a location of a second computing device.
  • the second computing device may include a second see-through display, such as see-through display device 106 or 108 of FIG. 1 .
  • the game server determines whether the location of the second computing device is within a proximity threshold of the location of the first computing device.
  • the proximity threshold may defme a maximum and/or minimum distance between the first and second computing devices.
  • the proximity threshold may defme a game boundary (e.g., downtown Seattle).
  • the proximity threshold may be one of a plurality of criteria for joining a second computing device to a multiplayer gaming session.
  • the game server joins the second computing device to the first multiplayer gaming session at 618.
  • the second computing device may correspond to see-through display device 106 of FIG. 1 .
  • the dashed box representing Location 1 may illustrate that see-through display devices 104 and 106 are within a proximity threshold of one another. Therefore, these devices may be joined to the same multiplayer gaming session.
  • the game server joins the second computing device to a second multiplayer gaming session, different from the first multiplayer gaming session, at 620.
  • the second computing device may correspond to see-through display device 108, which is at Location 2 in FIG. 1 .
  • see-through display device 108 may be joined to a different multiplayer gaming session than see-through display device 104.
  • a first multiplayer gaming session may correspond to a first location (e.g., Seattle) and include quests tied to landmarks of the first location (e.g., taking pictures of specific Seattle landmarks).
  • a second multiplayer gaming session may correspond to a second location (e.g., Portland) and include quests tied to landmarks of the second location (e.g., a scavenger hunt for virtual objects hidden near specific Portland landmarks).
  • the second computing device may be joined to the first multiplayer gaming session if the second computing device moves to a location within the proximity threshold of the location of the first computing device. For example, the second computing device may log out of the game server and/or the second multiplayer gaming session and move to a new physical location within the proximity threshold of the first computing device. Upon logging back into the game server and/or the second multiplayer gaming session, the second computing device may be joined to the first multiplayer gaming session. In another example, the second computing device may move within the proximity threshold of the location of the first computing device without disconnecting from the multiplayer gaming session. In response, the second computing device may be automatically joined to the first multiplayer gaming session.
  • FIG. 7 shows a nonlimiting example of a see-through display device 104 including a see-through display 702.
  • see-through display device 104 may be a head-mounted see-through display device.
  • a see-through display device such as see-through display device 104 may be integrated as depicted in FIG. 7 .
  • the see-through display device may be a modular computing system.
  • the computing system may include a see-through display and one or more other components communicatively coupled to the see-through display.
  • See-through display 702 is at least partially transparent, thus allowing light to pass through the see-through display to the eyes of a user.
  • the see-through display is configured to visually augment an appearance of a physical space to a user viewing the physical space through the see-through display.
  • the see-through display may display virtual objects that the user can see when the user looks through the see-through display. As such, the user is able to view the virtual objects that do not exist within the physical space at the same time that the user views the physical space. This creates the illusion that the virtual objects are part of the physical space.
  • See-through display device 104 also includes a virtual reality engine 704.
  • the virtual reality engine 704 may be configured to cause the see-through display to visually present one or more virtual objects as an augmentation of real-world objects.
  • the virtual objects can simulate the appearance of real world objects.
  • the virtual objects and/or other images displayed via the see through display may be positioned relative to the eyes of a user such that the displayed virtual objects and/or images appear, to the user, to occupy particular locations within the physical space. In this way, the user is able to view objects that are not actually present in the physical space.
  • Virtual reality engine may include software, hardware, firmware, or any combination thereof.
  • See-through display device 104 may include a speaker subsystem 706 and a sensor subsystem 708.
  • the sensor subsystem may include a variety of different sensors in different embodiments.
  • a sensor subsystem may include a microphone 710, one or more forward-facing (away from user) infrared and/or visible light cameras 712, and/or one or more rearward-facing (towards user) infrared and/or visible light cameras 714.
  • the forward-facing camera(s) may include one or more depth cameras, and/or the rearward-facing cameras may include one or more eye-tracking cameras.
  • an onboard sensor subsystem may communicate with one or more off-board sensors that send observation information to the onboard sensor subsystem.
  • a depth camera used by a gaming console may send depth maps and/or modeled virtual skeletons to the sensor subsystem of the head-mounted display.
  • See-through display device 104 may also include one or more features that allow the see-through display device to be worn on the head of a user.
  • see-through display device 104 takes the form of eye glasses and includes a nose rest 716 and ear rests 718a and 718b.
  • a head-mounted display may include a hat or helmet with an in-front-of-the-face see-through visor.
  • the concepts described herein may be applied to see-through displays that are not head mounted (e.g., a windshield) and to displays that are not see-through (e.g., an opaque display that renders real objects observed by a camera with virtual objects not within the camera's field of view).
  • See-through display device 104 may also include a communication subsystem 720.
  • Communication subsystem 720 may be configured to communicate with one or more off-board computing devices.
  • the communication subsystem may be configured to wirelessly receive a video stream, audio stream, coordinate information, virtual object descriptions, and/or other information to render augmentation information as an augmented reality experience.
  • the methods and processes described above may be tied to a computing system of one or more computing devices.
  • such methods and processes may be implemented as a computer-application program or service, an application-programming interface (API), a library, and/or other computer-program product.
  • API application-programming interface
  • FIG. 8 schematically shows a non-limiting embodiment of a computing system 800 that can enact one or more of the methods and processes described above.
  • Computing system 800 is shown in simplified form. It will be understood that virtually any computer architecture may be used without departing from the scope of this disclosure.
  • computing system 800 may take the form of a head-mounted see-through display device (e.g., see-through display device 104), gaming device (e.g., gaming system 502), mobile computing device, mobile communication device (e.g., smart phone), desktop computer, laptop computer, tablet computer, home-entertainment computer, network computing device, mainframe computer, server computer, etc.
  • gaming device e.g., gaming system 502
  • mobile computing device e.g., mobile communication device
  • desktop computer laptop computer
  • tablet computer tablet computer
  • home-entertainment computer e.g., smart phone
  • Computing system 800 includes a logic subsystem 802 and a storage subsystem 804.
  • Computing system 800 may optionally include a display subsystem 806 (e.g., a see-through display), input subsystem 808, communication subsystem 810, and/or other components not shown in FIG. 8 .
  • display subsystem 806 e.g., a see-through display
  • input subsystem 808 communication subsystem 810
  • other components not shown in FIG. 8 .
  • Logic subsystem 802 includes one or more physical devices configured to execute instructions.
  • the logic subsystem may be configured to execute instructions that are part of one or more applications, services, programs, routines, libraries, objects, components, data structures, or other logical constructs. Such instructions may be implemented to perform a task, implement a data type, transform the state of one or more components, or otherwise arrive at a desired result.
  • the logic subsystem may include one or more processors configured to execute software instructions. Additionally or alternatively, the logic subsystem may include one or more hardware or firmware logic machines configured to execute hardware or firmware instructions.
  • the processors of the logic subsystem may be single-core or multi-core, and the programs executed thereon may be configured for sequential, parallel or distributed processing.
  • the logic subsystem may optionally include individual components that are distributed among two or more devices, which can be remotely located and/or configured for coordinated processing. Aspects of the logic subsystem may be virtualized and executed by remotely accessible, networked computing devices configured in a cloud-computing configuration.
  • Storage subsystem 804 includes one or more physical, non-transitory, devices configured to hold data and/or instructions executable by the logic subsystem to implement the methods and processes described herein. When such methods and processes are implemented, the state of storage subsystem 804 may be transformed-e.g., to hold different data.
  • Storage subsystem 804 may include removable media and/or built-in devices.
  • Storage subsystem 804 may include optical memory devices (e.g., CD, DVD, HD-DVD, Blu-Ray Disc, etc.), semiconductor memory devices (e.g., RAM, EPROM, EEPROM, etc.) and/or magnetic memory devices (e.g., hard-disk drive, floppy-disk drive, tape drive, MRAM, etc.), among others.
  • Storage subsystem 804 may include volatile, nonvolatile, dynamic, static, read/write, read-only, random-access, sequential-access, location-addressable, file-addressable, and/or content-addressable devices.
  • storage subsystem 804 includes one or more physical, non-transitory devices.
  • aspects of the instructions described herein may be propagated in a transitory fashion by a pure signal (e.g., an electromagnetic signal, an optical signal, etc.) that is not held by a physical device for a finite duration.
  • a pure signal e.g., an electromagnetic signal, an optical signal, etc.
  • data and/or other forms of information pertaining to the present disclosure may be propagated by a pure signal.
  • aspects of logic subsystem 802 and of storage subsystem 804 may be integrated together into one or more hardware-logic components through which the functionally described herein may be enacted.
  • Such hardware-logic components may include field-programmable gate arrays (FPGAs), program- and application-specific integrated circuits (PASIC / ASICs), program- and application-specific standard products (PSSP / ASSPs), system-on-a-chip (SOC) systems, and complex programmable logic devices (CPLDs), for example.
  • FPGAs field-programmable gate arrays
  • PASIC / ASICs program- and application-specific integrated circuits
  • PSSP / ASSPs program- and application-specific standard products
  • SOC system-on-a-chip
  • CPLDs complex programmable logic devices
  • program and engine may be used to describe an aspect of computing system 800 implemented to perform a particular function.
  • program or engine may be instantiated via logic subsystem 802 executing instructions held by storage subsystem 804. It will be understood that different programs and/or engines may be instantiated from the same application, service, code block, object, library, routine, API, function, etc. Likewise, the same program and/or engine may be instantiated by different applications, services, code blocks, objects, routines, APIs, functions, etc.
  • program and engine may encompass individual or groups of executable files, data files, libraries, drivers, scripts, database records, etc.
  • a “service”, as used herein, is an application program executable across multiple user sessions.
  • a service may be available to one or more system components, programs, and/or other services.
  • a service may run on one or more server-computing devices.
  • display subsystem 806 may be used to present a visual representation of data held by storage subsystem 804. This visual representation may take the form of images that appear to augment a physical space, thus creating the illusion of an augmented reality. As the herein described methods and processes change the data held by the storage subsystem, and thus transform the state of the storage subsystem, the state of display subsystem 806 may likewise be transformed to visually represent changes in the underlying data.
  • Display subsystem 806 may include one or more display devices utilizing virtually any type of technology. Such display devices may be combined with logic subsystem 802 and/or storage subsystem 804 in a shared enclosure (e.g., a head-mounted display), or such display devices may be peripheral display devices.
  • input subsystem 808 may comprise or interface with one or more user-input devices such as a game controller, gesture input detection device, voice recognizer, inertial measurement unit, keyboard, mouse, or touch screen.
  • user-input devices such as a game controller, gesture input detection device, voice recognizer, inertial measurement unit, keyboard, mouse, or touch screen.
  • the input subsystem may comprise or interface with selected natural user input (NUI) componentry.
  • NUI natural user input
  • Such componentry may be integrated or peripheral, and the transduction and/or processing of input actions may be handled on- or off-board.
  • Example NUI componentry may include a microphone for speech and/or voice recognition; an infrared, color, stereoscopic, and/or depth camera for machine vision and/or gesture recognition; a head tracker, eye tracker, accelerometer, and/or gyroscope for motion detection and/or intent recognition; as well as electric-field sensing componentry for assessing brain activity.
  • communication subsystem 810 may be configured to communicatively couple computing system 800 with one or more other computing devices.
  • Communication subsystem 810 may include wired and/or wireless communication devices compatible with one or more different communication protocols.
  • the communication subsystem may be configured for communication via a wireless telephone network, or a wired or wireless local- or wide-area network.
  • the communication subsystem may allow computing system 800 to send and/or receive messages to and/or from other devices via a network such as the Internet.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
EP13198221.7A 2013-12-18 2013-12-18 Expérience de réalité augmentée multiplate-forme Withdrawn EP2886171A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP13198221.7A EP2886171A1 (fr) 2013-12-18 2013-12-18 Expérience de réalité augmentée multiplate-forme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP13198221.7A EP2886171A1 (fr) 2013-12-18 2013-12-18 Expérience de réalité augmentée multiplate-forme

Publications (1)

Publication Number Publication Date
EP2886171A1 true EP2886171A1 (fr) 2015-06-24

Family

ID=49841568

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13198221.7A Withdrawn EP2886171A1 (fr) 2013-12-18 2013-12-18 Expérience de réalité augmentée multiplate-forme

Country Status (1)

Country Link
EP (1) EP2886171A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110711385A (zh) * 2019-10-23 2020-01-21 北京达佳互联信息技术有限公司 游戏在线交互方法、装置、电子设备以及存储介质
US11403823B2 (en) 2019-02-14 2022-08-02 Lego A/S Toy system for asymmetric multiplayer game play

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001065358A2 (fr) * 2000-02-17 2001-09-07 Acclim Entertainment, Inc. Systeme et methode de jeu informatique a plusieurs joueurs
US20060116185A1 (en) * 2004-05-06 2006-06-01 Curtis Krull Sport development system
US20080081701A1 (en) * 2006-10-03 2008-04-03 Shuster Brian M Virtual environment for computer game
US20080268947A1 (en) * 2006-11-28 2008-10-30 Verizon Services Organization Inc. Cross platform gaming
US20130072308A1 (en) * 2011-09-15 2013-03-21 Qonqr, Llc Location-Based Multiplayer Game System and Method
US20130117377A1 (en) * 2011-10-28 2013-05-09 Samuel A. Miller System and Method for Augmented and Virtual Reality

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001065358A2 (fr) * 2000-02-17 2001-09-07 Acclim Entertainment, Inc. Systeme et methode de jeu informatique a plusieurs joueurs
US20060116185A1 (en) * 2004-05-06 2006-06-01 Curtis Krull Sport development system
US20080081701A1 (en) * 2006-10-03 2008-04-03 Shuster Brian M Virtual environment for computer game
US20080268947A1 (en) * 2006-11-28 2008-10-30 Verizon Services Organization Inc. Cross platform gaming
US20130072308A1 (en) * 2011-09-15 2013-03-21 Qonqr, Llc Location-Based Multiplayer Game System and Method
US20130117377A1 (en) * 2011-10-28 2013-05-09 Samuel A. Miller System and Method for Augmented and Virtual Reality

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11403823B2 (en) 2019-02-14 2022-08-02 Lego A/S Toy system for asymmetric multiplayer game play
US11978166B2 (en) 2019-02-14 2024-05-07 Lego A/S Toy system for asymmetric multiplayer game play
CN110711385A (zh) * 2019-10-23 2020-01-21 北京达佳互联信息技术有限公司 游戏在线交互方法、装置、电子设备以及存储介质

Similar Documents

Publication Publication Date Title
US20140128161A1 (en) Cross-platform augmented reality experience
EP3491781B1 (fr) Communication privée par observation d'un avatar
US11968475B2 (en) Remote collaborations with volumetric space indications
US20140125698A1 (en) Mixed-reality arena
EP3137982B1 (fr) Transitions de la réalité augmentée entre un mode body locked et un mode world locked
US10373392B2 (en) Transitioning views of a virtual model
EP3137976B1 (fr) Renvoi d'informations sur la qualité d'un affichage verrouillé sur le monde environnant
US20140240351A1 (en) Mixed reality augmentation
US8894484B2 (en) Multiplayer game invitation system
EP3782015B1 (fr) Notification de poussée tridimensionnelle
US9956487B2 (en) Variable audio parameter setting
US10546426B2 (en) Real-world portals for virtual reality displays
JP2015116336A (ja) 複合現実感アリーナ
CN103760972A (zh) 跨平台的增强现实体验
US20240312097A1 (en) Computing system and method for rendering avatars
US10391408B2 (en) Systems and methods to facilitate user interactions with virtual objects depicted as being present in a real-world space
EP2886172A1 (fr) Arène à réalité mixte
EP2886171A1 (fr) Expérience de réalité augmentée multiplate-forme
KR20150071824A (ko) 교차 플랫폼 증강 현실 체험 제공 방법
JP2015116339A (ja) 相互プラットフォーム拡張現実体験
KR20150071611A (ko) 합성 현실 경기장

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140116

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17Q First examination report despatched

Effective date: 20170307

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20180703