US20180345144A1 - Multiple Frame Distributed Rendering of Interactive Content - Google Patents
Multiple Frame Distributed Rendering of Interactive Content Download PDFInfo
- Publication number
- US20180345144A1 US20180345144A1 US16/006,523 US201816006523A US2018345144A1 US 20180345144 A1 US20180345144 A1 US 20180345144A1 US 201816006523 A US201816006523 A US 201816006523A US 2018345144 A1 US2018345144 A1 US 2018345144A1
- Authority
- US
- United States
- Prior art keywords
- interactive
- interactive object
- frame
- content
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000002452 interceptive effect Effects 0.000 title claims abstract description 156
- 238000009877 rendering Methods 0.000 title claims abstract description 31
- 230000000007 visual effect Effects 0.000 claims abstract description 85
- 238000000034 method Methods 0.000 claims abstract description 56
- 238000012545 processing Methods 0.000 claims description 52
- 230000033001 locomotion Effects 0.000 claims description 23
- 230000003993 interaction Effects 0.000 claims description 10
- 230000004044 response Effects 0.000 abstract description 5
- 230000009471 action Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000000605 extraction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000004043 responsiveness Effects 0.000 description 3
- 238000012800 visualization Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/50—Controlling the output signals based on the game progress
- A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/35—Details of game servers
- A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
- A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/02—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
- G09G5/026—Control of mixing and/or overlay of colours in general
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/14—Display of multiple viewports
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/80—Special adaptations for executing a specific game genre or game mode
- A63F13/833—Hand-to-hand fighting, e.g. martial arts competition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/16—Determination of a pixel data signal depending on the signal applied in the previous frame
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
Definitions
- visual content is typically rendered according to a particular frame rate, such as determined in frames per second (FPS), hertz (Hz), and so on. Determining which frame rate to use for a particular instance of visual content involves a number of considerations, such as graphic resolution, responsiveness, and so on.
- FPS frames per second
- Hz hertz
- interactive content includes various types of visual content, such as video games, interactive videos, interactive applications, and so forth.
- Interactive content includes scene objects, such as graphical renderings of visual scenery and background images.
- Interactive content also includes interactive objects, such as avatars and/or other visuals that can be displayed in the context of scene objects and that can be manipulated in response to user input.
- scene objects can be rendered over multiple frames of interactive content prior to being displayed, and interactive objects can be rendered and displayed more frequently, e.g., with each frame.
- FIG. 1 is an illustration of an environment in an example implementation that is operable to employ techniques discussed herein.
- FIG. 2 illustrates an example implementation scenario in accordance with one or more embodiments.
- FIG. 3 illustrates an example implementation scenario in accordance with one or more embodiments.
- FIG. 4 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 6 illustrates an example system and computing device as described with reference to FIG. 1 , which are configured to implement embodiments of techniques described herein.
- interactive content includes various types of visual content, such as video games, interactive videos, interactive applications, and so forth.
- Interactive content includes scene objects, such as graphical renderings of visual scenery and background images.
- Interactive content also includes interactive objects, such as avatars and/or other visuals that can be displayed in the context of scene objects and that can be manipulated in response to user input.
- scene objects can be rendered over multiple frames of interactive content prior to being displayed, and interactive objects can be rendered and displayed more frequently, e.g., with each frame.
- a video game scenario that includes an avatar that a user can manipulate to participate in gameplay.
- the avatar can be displayed and can be manipulated in the context of a scene object, such as a gameplay arena.
- visual processing of the scene object can be distributed over multiple frames, such as over two or more frames of the interactive content.
- a visual display of the scene object can be updated intermittently during gameplay, such as in every other frame.
- the avatar can be rendered and visually updated more frequently, such as on a frame-by-frame basis.
- the video game is rendered at 60 hertz (Hz), e.g., visual frames are updated at a frequency of 60 Hz.
- the avatar can be rendered and visually updated at 60 Hz, e.g., with each frame of the video game during gameplay.
- Scene objects can be rendered at 30 Hz, e.g., with every two frames of the video game during gameplay.
- the scene objects can be visually updated at 30 Hz, with the intervening frame providing additional time for visual rendering.
- This implementation is provided for purpose of example only, and a wide variety of different frame rates and rendering patterns can be employed within the spirit and scope of the claimed embodiments.
- Example Environment is first described that is operable to employ techniques for multiple frame distributed rendering of interactive content described herein.
- Example Implementation Scenarios describes example implementation scenarios in accordance with one or more embodiments.
- Example Procedures describes some example procedures for implementation of multiple frame distributed rendering of visual objects in accordance with one or more embodiments.
- an example system and device are described that are operable to employ techniques discussed herein in accordance with one or more embodiments.
- FIG. 1 is an illustration of an environment 100 in an example implementation that is operable to implement techniques for multiple frame distributed rendering of interactive content discussed herein.
- the illustrated environment 100 includes a computing device 102 .
- the computing device 102 is illustrated as a game console, the computing device 102 may be configured in a variety of other ways.
- the computing device 102 may be configured as a desktop computer, a mobile station, an entertainment appliance, a set-top box communicatively coupled to a display device, a mobile communication device (e.g., a tablet, a smartphone), and so forth.
- a mobile communication device e.g., a tablet, a smartphone
- the computing device 102 may range from full resource devices with substantial memory and processor resources (e.g., personal computers, game consoles) to low-resource devices with limited memory and/or processing resources (e.g., traditional set-top boxes, hand-held game consoles). Additionally, although a single computing device 102 is shown, the computing device 102 may be representative of a plurality of different devices, such as a user-wearable helmet and game console, multiple servers utilized by a business to perform operations that provide a cloud-based platform, a remote control and set-top box combination, and so on. One of a variety of different examples of a computing device 102 is shown and described below in FIG. 6 .
- interactive content 104 includes various types of visual content (as well as other forms of content) with which a user can interact.
- the interactive content 104 include video games, video content (e.g., pre-recorded and/or interactive video content), web content (e.g., web pages), and so forth.
- the interactive content 104 can be stored locally on the computing device 102 , and/or can be stored on some form of removable computer-readable storage media.
- the interactive content 104 can be stored on a digital versatile disc (DVD) that can be read by the computing device 102 .
- DVD digital versatile disc
- the interactive content 104 can be stored on a network resource, such as a cloud resource discussed below with reference to FIG. 6 .
- the interactive content 104 can be embodied as cloud-based content that can be streamed to the computing device 102 from a remote resource.
- the computing device 102 further includes a rendering module 106 , which is representative of functionality for performing various tasks related to the techniques for multiple frame distributed rendering of interactive content discussed herein.
- the rendering module 106 can include and/or leverage rendering engine functionality to process the interactive content 104 for display via a display device 108 coupled to the computing device 102 .
- An input/output module 110 is further included, which is representative of functionality to receive and recognize various forms of input for the computing device 102 .
- the input/output module 110 can be configured to receive input generated by an input device, such as a keyboard, a mouse, a touchpad, a game controller, an optical scanner, and so on.
- the input/output module 110 can also be configured to receive and/or interpret input received via a touchless mechanism, such as via voice recognition, gesture-based input, detected body poses and body motions, object scanning, and so on.
- an NUI device 112 is configured to receive a variety of touchless input, such as via visual recognition of human gestures, object scanning, voice recognition, color recognition, and so on.
- the NUI device 112 is configured to recognize gestures, poses, body movements, objects, images, and so on, via cameras.
- An example camera for instance, can be configured with lenses, light sources, and/or light sensors such that a variety of different phenomena can be observed and captured as input.
- the camera can be configured to sense movement in a variety of dimensions, such as vertical movement, horizontal movement, and forward and backward movement, e.g., relative to the NUI device 112 .
- the NUI device 112 can capture information about image composition, movement, and/or position.
- the input/output module 110 can utilize this information to perform a variety of different tasks, such as interaction with the interactive content 104 .
- the input/output module 110 can leverage the NUI device 112 to perform skeletal mapping along with feature extraction with respect to particular points of a human body (e.g., different skeletal points) to track one or more users (e.g., four users simultaneously) to perform motion analysis.
- feature extraction refers to the representation of the human body as a set of features that can be tracked to generate input.
- the skeletal mapping can identify points on a human body that correspond to a right hand 114 of a user 116 .
- the input/output module 110 can use feature extraction techniques to recognize the points as a right hand and to characterize the points as a feature that can be tracked and used to generate input.
- the NUI device 112 can capture images that can be analyzed by the input/output module 110 to recognize one or more motions and/or positioning of body parts or other objects made by a user, such as what body part is used to make a motion, a position (e.g., angle) of a body part relative to other body parts, which user made a motion, and so on.
- a variety of different types of gestures may be recognized, such as gestures that are recognized from a single type of input as well as gestures combined with other types of input, e.g., a hand gesture and voice input.
- the input/output module 110 can support a variety of different gestures and/or gesturing techniques by recognizing and leveraging a division between inputs. It should be noted that by differentiating between inputs of the NUI device 112 , a particular gesture can be interpreted in a variety of different ways when combined with another type of input. For example, although a gesture may be the same, different parameters and/or commands may be indicated when the gesture is combined with different types of inputs.
- a sequence in which gestures are received by the NUI device 112 can cause a particular gesture to be interpreted as a different parameter and/or command For example, a gesture followed in a sequence by other gestures can be interpreted differently than the gesture alone.
- GUI graphical user interface
- the GUI 118 displays visual attributes of the interactive content 104 , and can reflect user interaction with the interactive content 104 .
- the interactive object 120 can be an animated version of the user 116 , such as an avatar that is generated using computer animation and/or CGI techniques.
- the interactive object 120 can be a real-time video image of the user 116 , e.g., as captured by a video camera such as utilized by the NUI device 112 .
- the interactive object 120 can be generated by enhancing a live video image of the user 116 using 2-dimensional (2D) and/or 3-dimensional (3D) computer graphics techniques.
- the interactive object 120 can move along with the user 116 such that movements of the user 116 are reflected in similar movements of the interactive object 120 , e.g., in real time.
- the interactive content 104 includes a boxing video game
- the interactive object 120 is an avatar that the user 116 can control to compete with an opponent avatar 122 as part of a boxing match.
- the opponent avatar 122 can be controlled by another user.
- the opponent avatar 122 can be controlled automatically via logic executing on the computing device 102 , such as logic included as part of the interactive content 104 .
- the scene objects 124 are representative of further visual aspects of the interactive content 104 .
- the scene objects 124 can include visual scenery in which the interactive object 120 can be displayed, such as background visuals, visual props, and so forth.
- the scene objects 124 include visual elements of a boxing ring in which the interactive object 120 and the opponent avatar 122 can be displayed and interact as part of the video game.
- the scene objects 124 further include visuals of spectators viewing the boxing match.
- ways in which the interactive object 120 is visually rendered can differ from ways in which the scene objects 124 are rendered, to enable the interactive object 120 to be responsive to user input, while enabling the scene objects 124 to be rendered with high visual detail and/or resolution.
- FIG. 2 illustrates an example implementation scenario in accordance with one or more embodiments, generally at 200 .
- the scenario 200 illustrates an example rendering and display of visual elements of the interactive content 104 , such as during playback and/or gameplay of the interactive content.
- a frame sequence 202 which corresponds to a sequence of frames that can be rendered and displayed during playback of the interactive content 104 .
- the interactive content 104 may not itself consist of discrete frames, but the frames are representative of discrete render and/or display events during playback of the interactive content 104 .
- each frame can correspond to 1/60 of a second of rendering and/or display time.
- an initialization frame 204 of the frame sequence 202 is displayed.
- the initialization frame 204 can be displayed in response to an initialization of the interactive content 104 , such as a user starting play of a video game.
- the initialization frame 204 includes a scene object 206 , which can be an image that is stored as part of the interactive content 104 , such as a pre-rendered image that can be retrieved and displayed without rendering. Additionally or alternatively, aspects of the scene object 206 can be rendered when the interactive content 104 is initialized.
- various types of visual processing and/or rendering can be performed during display of the initialization frame 204 .
- Examples of such processing include visual depth information processing, color processing, visual texture processing, and so forth.
- the initialization frame 204 can correspond to 1/60 of a second of playback time.
- 1/60 of a second of background visual processing can occur during display of the initialization frame 204 .
- the visual processing can be performed for visualizations that will be displayed as part of subsequent frames.
- a content frame 208 is displayed.
- the content frame 208 corresponds to a display frame that occurs subsequent to the initialization frame 204 during playback of the interactive content 104 .
- the content frame 208 includes the scene object 206 , as well as the interactive object 120 and the opponent avatar 122 .
- visual processing that was performed during display of the initialization frame 204 can be applied to the content frame 208 .
- color, depth, and/or texture processing can be applied to display of the scene object 206 .
- the scene object 206 in the content frame 208 can be visually enhanced when compared to display of the scene object 206 in the initialization frame 204 .
- Display of the interactive object 120 in the content frame 208 reflects user interaction, such as input from a user as part of gameplay for the interactive content 104 .
- user interaction such as input from a user as part of gameplay for the interactive content 104 .
- gestures and/or movements of a user can be reflected in similar gestures and/or movements of the interactive object 120 .
- user input causes interaction with the interactive object 120 as part of gameplay of a boxing game.
- various types of visual processing can be performed during display of the content frame 208 .
- visual processing for visualizations that are to be displayed in subsequent frames can be performed.
- the content frame 210 corresponds to a display frame that occurs subsequent to the content frame 208 during playback of the interactive content 104 .
- the content frame 210 includes the scene object 206 , as well as additional scene objects 212 .
- the additional scene objects 212 are visualizations that were processed and/or rendered during previous frames, such as during display of the initialization frame 204 and/or the content frame 208 .
- the additional scene objects 212 include visuals of spectators that appear to be viewing the interactive object 120 and the opponent avatar 122 .
- Display of the interactive object 120 is updated in the content frame 210 to reflect user input, such as user input provided during display of the content frame 208 .
- scenario 200 illustrates that in at least some embodiments, scene objects can be visually updated intermittently, whereas interactive objects can be visually updated more frequently, e.g., in each frame of a frame sequence.
- FIG. 3 illustrates an example implementation scenario in accordance with one or more embodiments, generally at 300 .
- the scenario 300 illustrates an example continuation of the scenario 200 , discussed above.
- a content frame 302 of the frame sequence 202 is displayed.
- the content frame 302 includes the scene object 206 , as well as the interactive object 120 , the opponent avatar 122 , and the additional scene objects 212 .
- various visual aspects of the content frame 302 e.g., the scene object 206 and/or the additional scene objects 212
- the scene object 206 and/or the additional scene objects 212 are displayed the same as in a previous frame, e.g., as in the content frame 210 discussed above.
- the scene object 206 and/or the additional scene objects 212 can be cached during display of the content frame 210 , and can be re-displayed as part of the content frame 302 .
- user interaction with the interactive object 120 during display of a previous frame can be reflected in the display of the interactive object 120 in the content frame 302 .
- various types of visual processing is performed, e.g., as background processes that are not visually evident in the content frame 302 .
- a content frame 304 is displayed. Illustrated in the content frame 304 is that visual processing that was previously performed (e.g., during display of the content frame 302 ) is applied to the display of the content frame 304 . In this example, visual texture that was previously rendered is applied to the scene object 206 , as shown in the portions 306 a, 306 b, 306 c, and 306 d.
- display of the interactive object 120 is updated from the content frame 302 based on user input. For example, the position and/or action of the interactive object 120 is visually updated from the content frame 302 .
- various types of visual processing is performed, e.g., as background processes that are not visually evident in the content frame 304 .
- a content frame 308 is displayed.
- display of some visual aspects is the same as in the content frame 304 .
- the scene object 206 and/or the additional scene objects 212 are visually the same as in the content frame 304 .
- the scene object 206 and the additional scene objects 212 can be cached during display of the content frame 304 for subsequent display as part of the content frame 308 .
- display of the interactive object 120 is updated from the content frame 304 based on user input. For example, the position and/or action of the interactive object 120 is visually updated from the content frame 304 .
- various types of visual processing is performed, e.g., as background processes that are not visually evident in the content frame 308 .
- a content frame 310 is displayed.
- various visual aspects are updated based on previously-performed processing, such as processing performed during display of the content frame 308 .
- the additional scene objects 212 are visually augmented to include more scene objects. Visual rendering of the additional scene objects 212 , for instance, may have occurred during display of the content frame 308 .
- display of the interactive object 120 is updated from the content frame 308 based on user input. For example, the position and/or action of the interactive object 120 is visually updated from the content frame 308 .
- various types of visual processing can be performed during display of the content frame 310 , such as visual processing for visual aspects that will be displayed in subsequent frames.
- various types of visual processing can be distributed among multiple frames during playback of content.
- visual processing for some visual aspects e.g., the scene object 206 and/or the additional scene objects 212
- the visual processing of such visual aspects can be applied intermittently to visually update the visual aspects, such as every other frame, every third frame, and so forth. This can provide increased time for visual processing to enable the visual aspects to be rendered with increased detail, resolution, depth, and so forth.
- Other visual aspects e.g., the interactive object 120 and/or the opponent avatar 122
- FIG. 4 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- Step 400 updates display of scene objects intermittently based on visual processing performed during a previous frame.
- a scene object can include background visuals, such as a visual environment in which an interactive object can be displayed.
- a scene object refers to a non-interactive object, such as a visual object that does not directly respond to user input.
- display of a scene object can be updated according to a variety of different update patterns, such as every other frame in a sequence, every third frame, every fourth frame, and so forth.
- scene objects can be visually updated according to shifting update pattern.
- scene objects can be updated every other frame for a specific number of frames and/or a specific period of playback time. After this, the scene objects can be updated according to a different update pattern, such as every third frame, every fourth frame, and so forth.
- Step 402 updates display of an interactive object every frame. For instance, user input can be detected and used to update the display of the interactive object on a frame-by-frame basis, such as through movement of the interactive object and/or causing the interactive object to perform an action.
- FIG. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments. The method is illustrated as steps being distributed over two frames of interactive content.
- Step 500 displays a previously-rendered version of a scene object.
- the previously-rendered version can be a stored image, such as a pre-rendered image of an object.
- the previously-rendered version can be an image that was rendered during a previous frame.
- Step 502 performs visual processing for the scene object.
- various types of visual processing can be performed, such as color processing, texture processing, shadowing, depth processing, light processing, and so on.
- a variety of other types of visual processing are contemplated within the spirit and scope of the claimed embodiments.
- Step 504 updates a display of an interactive object.
- an interactive object e.g., an avatar
- step 506 applies the visual processing to update the display of the scene object.
- the various visual processing performed during frame 1 can be applied to enhance and/or alter the display of the scene object.
- Step 508 updates the display of the interactive object. For instance, user input provided during frame 1 can be processed and used to update the display of the interactive object.
- the method can repeat during playback of the interactive content to enable scene objects to be visually updated intermittently, and interactive objects to be updated on a frame-by-frame basis.
- embodiments are discussed with reference to two frames for purpose of example only, and embodiments can be employed according to wide variety of different frame patterns and/or sequences.
- embodiments are discussed herein with reference to video game interactive content, embodiments may be implemented utilizing a wide variety of different types of content. For example, embodiments can be employed in rendering and displaying interactions with other types of content, such as web content, applications, and so forth.
- FIG. 6 illustrates an example system generally at 600 that includes an example computing device 602 that is representative of one or more computing systems and/or devices that may implement various techniques described herein.
- the computing device 602 may be, for example, a server of a service provider, a device associated with the client (e.g., a client device), an on-chip system, and/or any other suitable computing device or computing system.
- the example computing device 602 as illustrated includes a processing system 604 , one or more computer-readable media 606 , and one or more I/O Interfaces 608 that are communicatively coupled, one to another.
- the computing device 602 may further include a system bus or other data and command transfer system that couples the various components, one to another.
- a system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures.
- a variety of other examples are also contemplated, such as control and data lines.
- the processing system 604 is representative of functionality to perform one or more operations using hardware. Accordingly, the processing system 604 is illustrated as including hardware element 610 that may be configured as processors, functional blocks, and so forth. This may include implementation in hardware as an application specific integrated circuit or other logic device formed using one or more semiconductors.
- the hardware elements 610 are not limited by the materials from which they are formed or the processing mechanisms employed therein.
- processors may be comprised of semiconductor(s) and/or transistors (e.g., electronic integrated circuits (ICs)).
- processor-executable instructions may be electronically-executable instructions.
- the computer-readable media 606 is illustrated as including memory/storage 612 .
- the memory/storage 612 represents memory/storage capacity associated with one or more computer-readable media.
- the memory/storage 612 may include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth).
- RAM random access memory
- ROM read only memory
- Flash memory optical disks
- magnetic disks magnetic disks, and so forth
- the memory/storage 612 may include fixed media (e.g., RAM, ROM, a fixed hard drive, and so on) as well as removable media (e.g., Flash memory, a removable hard drive, an optical disc, and so forth).
- the computer-readable media 606 may be configured in a variety of other ways as further described below.
- Input/output interface(s) 608 are representative of functionality to allow a user to enter commands and information to computing device 602 , and also allow information to be presented to the user and/or other components or devices using various input/output devices.
- input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, touch functionality (e.g., capacitive or other sensors that are configured to detect physical touch), a camera (e.g., which may employ visible or non-visible wavelengths such as infrared frequencies to detect movement that does not involve touch as gestures), and so forth.
- Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, tactile-response device, and so forth.
- the computing device 602 may be configured in a variety of ways as further described below to support user interaction.
- modules include routines, programs, objects, elements, components, data structures, and so forth that perform particular tasks or implement particular abstract data types.
- module generally represent software, firmware, hardware, or a combination thereof.
- the features of the techniques described herein are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.
- Computer-readable media may include a variety of media that may be accessed by the computing device 602 .
- computer-readable media may include “computer-readable storage media” and “computer-readable signal media.”
- Computer-readable storage media may refer to media and/or devices that enable persistent and non-transitory storage of information in contrast to mere signal transmission, carrier waves, or signals per se. Thus, computer-readable storage media does not include transitory signal bearing media.
- the computer-readable storage media includes hardware such as volatile and non-volatile, removable and non-removable media and/or storage devices implemented in a method or technology suitable for storage of information such as computer readable instructions, data structures, program modules, logic elements/circuits, or other data.
- Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, hard disks, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or other storage device, tangible media, or article of manufacture suitable to store the desired information and which may be accessed by a computer.
- Computer-readable signal media may refer to a signal-bearing medium that is configured to transmit instructions to the hardware of the computing device 602 , such as via a network.
- Signal media typically may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier waves, data signals, or other transport mechanism.
- Signal media also include any information delivery media.
- modulated data signal means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal.
- communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media.
- hardware elements 610 and computer-readable media 606 are representative of instructions, modules, programmable device logic and/or fixed device logic implemented in a hardware form that may be employed in some embodiments to implement at least some aspects of the techniques described herein.
- Hardware elements may include components of an integrated circuit or on-chip system, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations in silicon or other hardware devices.
- ASIC application-specific integrated circuit
- FPGA field-programmable gate array
- CPLD complex programmable logic device
- a hardware element may operate as a processing device that performs program tasks defined by instructions, modules, and/or logic embodied by the hardware element as well as a hardware device utilized to store instructions for execution, e.g., the computer-readable storage media described previously.
- software, hardware, or program modules and other program modules may be implemented as one or more instructions and/or logic embodied on some form of computer-readable storage media and/or by one or more hardware elements 610 .
- the computing device 602 may be configured to implement particular instructions and/or functions corresponding to the software and/or hardware modules. Accordingly, implementation of modules as an module that is executable by the computing device 602 as software may be achieved at least partially in hardware, e.g., through use of computer-readable storage media and/or hardware elements 610 of the processing system.
- the instructions and/or functions may be executable/operable by one or more articles of manufacture (for example, one or more computing devices 602 and/or processing systems 604 ) to implement techniques, modules, and examples described herein.
- the example system 600 enables ubiquitous environments for a seamless user experience when running applications on a personal computer (PC), a television device, and/or a mobile device. Services and applications run substantially similar in all three environments for a common user experience when transitioning from one device to the next while utilizing an application, playing a video game, watching a video, and so on.
- PC personal computer
- television device a television device
- mobile device a mobile device. Services and applications run substantially similar in all three environments for a common user experience when transitioning from one device to the next while utilizing an application, playing a video game, watching a video, and so on.
- multiple devices are interconnected through a central computing device.
- the central computing device may be local to the multiple devices or may be located remotely from the multiple devices.
- the central computing device may be a cloud of one or more server computers that are connected to the multiple devices through a network, the Internet, or other data communication link.
- this interconnection architecture enables functionality to be delivered across multiple devices to provide a common and seamless experience to a user of the multiple devices.
- Each of the multiple devices may have different physical requirements and capabilities, and the central computing device uses a platform to enable the delivery of an experience to the device that is both tailored to the device and yet common to all devices.
- a class of target devices is created and experiences are tailored to the generic class of devices.
- a class of devices may be defined by physical features, types of usage, or other common characteristics of the devices.
- the computing device 602 may assume a variety of different configurations, such as for computer 614 , mobile 616 , and television 618 uses. Each of these configurations includes devices that may have generally different constructs and capabilities, and thus the computing device 602 may be configured according to one or more of the different device classes. For instance, the computing device 602 may be implemented as the computer 614 class of a device that includes a personal computer, desktop computer, a multi-screen computer, laptop computer, netbook, and so on.
- the computing device 602 may also be implemented as the mobile 616 class of device that includes mobile devices, such as a mobile phone, portable music player, portable gaming device, a tablet computer, a multi-screen computer, and so on.
- the computing device 602 may also be implemented as the television 618 class of device that includes devices having or connected to generally larger screens in casual viewing environments. These devices include televisions, set-top boxes, gaming consoles, and so on.
- the techniques described herein may be supported by these various configurations of the computing device 602 and are not limited to the specific examples of the techniques described herein. This is illustrated through inclusion of the rendering module 106 on the computing device 602 .
- the functionality of the rendering module 106 and/or other modules described with reference to FIG. 1 may also be implemented all or in part through use of a distributed system, such as over a “cloud” 620 via a platform 622 as described below.
- the cloud 620 includes and/or is representative of a platform 622 for resources 624 .
- the platform 622 abstracts underlying functionality of hardware (e.g., servers) and software resources of the cloud 620 .
- the resources 624 may include applications and/or data that can be utilized while computer processing is executed on servers that are remote from the computing device 602 .
- Resources 624 can also include services provided over the Internet and/or through a subscriber network, such as a cellular or Wi-Fi network.
- the platform 622 may abstract resources and functions to connect the computing device 602 with other computing devices.
- the platform 622 may also serve to abstract scaling of resources to provide a corresponding level of scale to encountered demand for the resources 624 that are implemented via the platform 622 .
- implementation of functionality described herein may be distributed throughout the system 600 .
- the functionality may be implemented in part on the computing device 602 as well as via the platform 622 that abstracts the functionality of the cloud 620 .
- aspects of the methods may be implemented in hardware, firmware, or software, or a combination thereof.
- the methods are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the orders shown for performing the operations by the respective blocks. Further, an operation shown with respect to a particular method may be combined and/or interchanged with an operation of a different method in accordance with one or more implementations. Aspects of the methods can be implemented via interaction between various entities discussed above with reference to the environment 100 .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
- This application is a continuation of and claims priority to U.S. patent application Ser. No. 15/625,748, filed Jun. 16, 2017, entitled “Multiple Frame Distributed Rendering of Interactive Content” which is a continuation of U.S. patent application Ser. No. 13/528,627, filed Jun. 20, 2012, entitled “Multiple Frame Distributed Rendering of Interactive Content”, the entire disclosures of which are hereby incorporated by reference herein in their entirety.
- Today's digital environment offers a tremendous array of visual content, such as videos, video games, web content (e.g., web pages), and so forth. Further, users can often interact with many types of visual content. For example, a user can control an interactive object, such as an avatar, as part of playing a video game.
- To enable visual content to be displayed, visual content is typically rendered according to a particular frame rate, such as determined in frames per second (FPS), hertz (Hz), and so on. Determining which frame rate to use for a particular instance of visual content involves a number of considerations, such as graphic resolution, responsiveness, and so on.
- This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
- Techniques for multiple frame distributed rendering of interactive content are described. In implementations, interactive content includes various types of visual content, such as video games, interactive videos, interactive applications, and so forth. Interactive content includes scene objects, such as graphical renderings of visual scenery and background images. Interactive content also includes interactive objects, such as avatars and/or other visuals that can be displayed in the context of scene objects and that can be manipulated in response to user input. In at least some embodiments, scene objects can be rendered over multiple frames of interactive content prior to being displayed, and interactive objects can be rendered and displayed more frequently, e.g., with each frame.
- The detailed description is described with reference to the accompanying figures. In the figures, the left-most digit(s) of a reference number identifies the figure in which the reference number first appears. The use of the same reference numbers in different instances in the description and the figures may indicate similar or identical items.
-
FIG. 1 is an illustration of an environment in an example implementation that is operable to employ techniques discussed herein. -
FIG. 2 illustrates an example implementation scenario in accordance with one or more embodiments. -
FIG. 3 illustrates an example implementation scenario in accordance with one or more embodiments. -
FIG. 4 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 6 illustrates an example system and computing device as described with reference toFIG. 1 , which are configured to implement embodiments of techniques described herein. - Techniques for multiple frame distributed rendering of interactive content are described. In implementations, interactive content includes various types of visual content, such as video games, interactive videos, interactive applications, and so forth. Interactive content includes scene objects, such as graphical renderings of visual scenery and background images. Interactive content also includes interactive objects, such as avatars and/or other visuals that can be displayed in the context of scene objects and that can be manipulated in response to user input. In at least some embodiments, scene objects can be rendered over multiple frames of interactive content prior to being displayed, and interactive objects can be rendered and displayed more frequently, e.g., with each frame.
- For example, consider a video game scenario that includes an avatar that a user can manipulate to participate in gameplay. The avatar can be displayed and can be manipulated in the context of a scene object, such as a gameplay arena. To provide increased time for visual processing of the scene object, visual processing of the scene object can be distributed over multiple frames, such as over two or more frames of the interactive content. Thus, a visual display of the scene object can be updated intermittently during gameplay, such as in every other frame. To provide increased responsiveness of the avatar to user input, the avatar can be rendered and visually updated more frequently, such as on a frame-by-frame basis.
- For instance, consider an example implementation where the video game is rendered at 60 hertz (Hz), e.g., visual frames are updated at a frequency of 60 Hz. In such a scenario, the avatar can be rendered and visually updated at 60 Hz, e.g., with each frame of the video game during gameplay. Scene objects, however, can be rendered at 30 Hz, e.g., with every two frames of the video game during gameplay. Thus, the scene objects can be visually updated at 30 Hz, with the intervening frame providing additional time for visual rendering. This implementation is provided for purpose of example only, and a wide variety of different frame rates and rendering patterns can be employed within the spirit and scope of the claimed embodiments.
- In the following discussion, an example environment is first described that is operable to employ techniques for multiple frame distributed rendering of interactive content described herein. Next, a section entitled “Example Implementation Scenarios” describes example implementation scenarios in accordance with one or more embodiments. Following this, a section entitled “Example Procedures” describes some example procedures for implementation of multiple frame distributed rendering of visual objects in accordance with one or more embodiments. Finally, an example system and device are described that are operable to employ techniques discussed herein in accordance with one or more embodiments.
-
FIG. 1 is an illustration of anenvironment 100 in an example implementation that is operable to implement techniques for multiple frame distributed rendering of interactive content discussed herein. The illustratedenvironment 100 includes acomputing device 102. Although thecomputing device 102 is illustrated as a game console, thecomputing device 102 may be configured in a variety of other ways. For instance, thecomputing device 102 may be configured as a desktop computer, a mobile station, an entertainment appliance, a set-top box communicatively coupled to a display device, a mobile communication device (e.g., a tablet, a smartphone), and so forth. - Accordingly, the
computing device 102 may range from full resource devices with substantial memory and processor resources (e.g., personal computers, game consoles) to low-resource devices with limited memory and/or processing resources (e.g., traditional set-top boxes, hand-held game consoles). Additionally, although asingle computing device 102 is shown, thecomputing device 102 may be representative of a plurality of different devices, such as a user-wearable helmet and game console, multiple servers utilized by a business to perform operations that provide a cloud-based platform, a remote control and set-top box combination, and so on. One of a variety of different examples of acomputing device 102 is shown and described below inFIG. 6 . - Included as part of the
computing device 102 isinteractive content 104, which includes various types of visual content (as well as other forms of content) with which a user can interact. Examples of theinteractive content 104 include video games, video content (e.g., pre-recorded and/or interactive video content), web content (e.g., web pages), and so forth. In implementations, theinteractive content 104 can be stored locally on thecomputing device 102, and/or can be stored on some form of removable computer-readable storage media. For example, theinteractive content 104 can be stored on a digital versatile disc (DVD) that can be read by thecomputing device 102. Alternatively or additionally, theinteractive content 104 can be stored on a network resource, such as a cloud resource discussed below with reference toFIG. 6 . For example, theinteractive content 104 can be embodied as cloud-based content that can be streamed to thecomputing device 102 from a remote resource. - The
computing device 102 further includes arendering module 106, which is representative of functionality for performing various tasks related to the techniques for multiple frame distributed rendering of interactive content discussed herein. Therendering module 106, for instance, can include and/or leverage rendering engine functionality to process theinteractive content 104 for display via adisplay device 108 coupled to thecomputing device 102. - An input/
output module 110 is further included, which is representative of functionality to receive and recognize various forms of input for thecomputing device 102. For example, the input/output module 110 can be configured to receive input generated by an input device, such as a keyboard, a mouse, a touchpad, a game controller, an optical scanner, and so on. The input/output module 110 can also be configured to receive and/or interpret input received via a touchless mechanism, such as via voice recognition, gesture-based input, detected body poses and body motions, object scanning, and so on. - Further included as part of the
computing device 102 is anNUI device 112, which is configured to receive a variety of touchless input, such as via visual recognition of human gestures, object scanning, voice recognition, color recognition, and so on. In at least some embodiments, theNUI device 112 is configured to recognize gestures, poses, body movements, objects, images, and so on, via cameras. An example camera, for instance, can be configured with lenses, light sources, and/or light sensors such that a variety of different phenomena can be observed and captured as input. For example, the camera can be configured to sense movement in a variety of dimensions, such as vertical movement, horizontal movement, and forward and backward movement, e.g., relative to theNUI device 112. Thus, in at least some embodiments, theNUI device 112 can capture information about image composition, movement, and/or position. The input/output module 110 can utilize this information to perform a variety of different tasks, such as interaction with theinteractive content 104. - For example, the input/
output module 110 can leverage theNUI device 112 to perform skeletal mapping along with feature extraction with respect to particular points of a human body (e.g., different skeletal points) to track one or more users (e.g., four users simultaneously) to perform motion analysis. In at least some embodiments, feature extraction refers to the representation of the human body as a set of features that can be tracked to generate input. For example, the skeletal mapping can identify points on a human body that correspond to aright hand 114 of auser 116. The input/output module 110 can use feature extraction techniques to recognize the points as a right hand and to characterize the points as a feature that can be tracked and used to generate input. Further to at least some embodiments, theNUI device 112 can capture images that can be analyzed by the input/output module 110 to recognize one or more motions and/or positioning of body parts or other objects made by a user, such as what body part is used to make a motion, a position (e.g., angle) of a body part relative to other body parts, which user made a motion, and so on. - In implementations, a variety of different types of gestures may be recognized, such as gestures that are recognized from a single type of input as well as gestures combined with other types of input, e.g., a hand gesture and voice input. Thus, the input/
output module 110 can support a variety of different gestures and/or gesturing techniques by recognizing and leveraging a division between inputs. It should be noted that by differentiating between inputs of theNUI device 112, a particular gesture can be interpreted in a variety of different ways when combined with another type of input. For example, although a gesture may be the same, different parameters and/or commands may be indicated when the gesture is combined with different types of inputs. Additionally or alternatively, a sequence in which gestures are received by theNUI device 112 can cause a particular gesture to be interpreted as a different parameter and/or command For example, a gesture followed in a sequence by other gestures can be interpreted differently than the gesture alone. - Displayed on the
display device 108 is a graphical user interface (GUI) 118, which is generated and managed according to various techniques discussed herein. For example, theGUI 118 displays visual attributes of theinteractive content 104, and can reflect user interaction with theinteractive content 104. - Displayed on the
GUI 118 is aninteractive object 120 of theinteractive content 104, which is controllable based on input received from theuser 116. Theinteractive object 120 can be an animated version of theuser 116, such as an avatar that is generated using computer animation and/or CGI techniques. Alternatively or additionally, theinteractive object 120 can be a real-time video image of theuser 116, e.g., as captured by a video camera such as utilized by theNUI device 112. As yet a further example, theinteractive object 120 can be generated by enhancing a live video image of theuser 116 using 2-dimensional (2D) and/or 3-dimensional (3D) computer graphics techniques. Thus, in implementations theinteractive object 120 can move along with theuser 116 such that movements of theuser 116 are reflected in similar movements of theinteractive object 120, e.g., in real time. - In this particular example, the
interactive content 104 includes a boxing video game, and theinteractive object 120 is an avatar that theuser 116 can control to compete with anopponent avatar 122 as part of a boxing match. In at least some embodiments, theopponent avatar 122 can be controlled by another user. Alternatively or additionally, theopponent avatar 122 can be controlled automatically via logic executing on thecomputing device 102, such as logic included as part of theinteractive content 104. - While embodiments are discussed herein with reference to manipulating interactive objects via touchless input (e.g., gesture recognition), this is not to be construed as limiting on the claimed subject matter. An interactive object, for instance, can be manipulated via a variety of different types and/or combinations of input in accordance with the claimed embodiments, such as input from a keyboard, a game controller, a touchpad, touchscreen input, voice input, and so forth.
- Further displayed in the
GUI 118 arescene objects 124 of theinteractive content 104. The scene objects 124 are representative of further visual aspects of theinteractive content 104. For example, the scene objects 124 can include visual scenery in which theinteractive object 120 can be displayed, such as background visuals, visual props, and so forth. In this example, the scene objects 124 include visual elements of a boxing ring in which theinteractive object 120 and theopponent avatar 122 can be displayed and interact as part of the video game. The scene objects 124 further include visuals of spectators viewing the boxing match. As detailed elsewhere herein, ways in which theinteractive object 120 is visually rendered can differ from ways in which the scene objects 124 are rendered, to enable theinteractive object 120 to be responsive to user input, while enabling the scene objects 124 to be rendered with high visual detail and/or resolution. - Having discussed an example environment in which techniques discussed herein can be implemented in accordance with one or more embodiments, consider now a discussion of an example implementation scenario.
-
FIG. 2 illustrates an example implementation scenario in accordance with one or more embodiments, generally at 200. Thescenario 200 illustrates an example rendering and display of visual elements of theinteractive content 104, such as during playback and/or gameplay of the interactive content. - Illustrated as part of the
scenario 200 is aframe sequence 202, which corresponds to a sequence of frames that can be rendered and displayed during playback of theinteractive content 104. Thus, theinteractive content 104 may not itself consist of discrete frames, but the frames are representative of discrete render and/or display events during playback of theinteractive content 104. For example, in a 60 Hz rendering scenario, each frame can correspond to 1/60 of a second of rendering and/or display time. - Starting with upper portion of the
scenario 200, aninitialization frame 204 of theframe sequence 202 is displayed. For example, theinitialization frame 204 can be displayed in response to an initialization of theinteractive content 104, such as a user starting play of a video game. Theinitialization frame 204 includes ascene object 206, which can be an image that is stored as part of theinteractive content 104, such as a pre-rendered image that can be retrieved and displayed without rendering. Additionally or alternatively, aspects of thescene object 206 can be rendered when theinteractive content 104 is initialized. - In at least some implementations, various types of visual processing and/or rendering can be performed during display of the
initialization frame 204. Examples of such processing include visual depth information processing, color processing, visual texture processing, and so forth. For instance, in a scenario where playback of theinteractive content 104 occurs at a 60 Hz frame rate, theinitialization frame 204 can correspond to 1/60 of a second of playback time. Thus, 1/60 of a second of background visual processing can occur during display of theinitialization frame 204. In at least some implementations, the visual processing can be performed for visualizations that will be displayed as part of subsequent frames. - Continuing to the center portion of the
scenario 200, acontent frame 208 is displayed. Thecontent frame 208 corresponds to a display frame that occurs subsequent to theinitialization frame 204 during playback of theinteractive content 104. Thecontent frame 208 includes thescene object 206, as well as theinteractive object 120 and theopponent avatar 122. - In at least some implementations, visual processing that was performed during display of the
initialization frame 204 can be applied to thecontent frame 208. For instance, color, depth, and/or texture processing can be applied to display of thescene object 206. Thus, thescene object 206 in thecontent frame 208 can be visually enhanced when compared to display of thescene object 206 in theinitialization frame 204. - Display of the
interactive object 120 in thecontent frame 208 reflects user interaction, such as input from a user as part of gameplay for theinteractive content 104. For example, gestures and/or movements of a user can be reflected in similar gestures and/or movements of theinteractive object 120. In this particular example, user input causes interaction with theinteractive object 120 as part of gameplay of a boxing game. - Further to at least some implementations, various types of visual processing can be performed during display of the
content frame 208. For instance, visual processing for visualizations that are to be displayed in subsequent frames can be performed. - Proceeding to the lower portion of the
scenario 200, acontent frame 210 is displayed. Thecontent frame 210 corresponds to a display frame that occurs subsequent to thecontent frame 208 during playback of theinteractive content 104. Thecontent frame 210 includes thescene object 206, as well as additional scene objects 212. The additional scene objects 212 are visualizations that were processed and/or rendered during previous frames, such as during display of theinitialization frame 204 and/or thecontent frame 208. In this example, the additional scene objects 212 include visuals of spectators that appear to be viewing theinteractive object 120 and theopponent avatar 122. - Display of the
interactive object 120 is updated in thecontent frame 210 to reflect user input, such as user input provided during display of thecontent frame 208. - Thus, the
scenario 200 illustrates that in at least some embodiments, scene objects can be visually updated intermittently, whereas interactive objects can be visually updated more frequently, e.g., in each frame of a frame sequence. -
FIG. 3 illustrates an example implementation scenario in accordance with one or more embodiments, generally at 300. In at least some implementations, thescenario 300 illustrates an example continuation of thescenario 200, discussed above. - Starting with the upper portion of the
scenario 300, acontent frame 302 of theframe sequence 202 is displayed. Thecontent frame 302 includes thescene object 206, as well as theinteractive object 120, theopponent avatar 122, and the additional scene objects 212. In at least some implementations, various visual aspects of the content frame 302 (e.g., thescene object 206 and/or the additional scene objects 212) are displayed the same as in a previous frame, e.g., as in thecontent frame 210 discussed above. For example, thescene object 206 and/or the additional scene objects 212 can be cached during display of thecontent frame 210, and can be re-displayed as part of thecontent frame 302. - Further, user interaction with the
interactive object 120 during display of a previous frame (e.g., the content frame 210) can be reflected in the display of theinteractive object 120 in thecontent frame 302. - During display of the
content frame 302, various types of visual processing is performed, e.g., as background processes that are not visually evident in thecontent frame 302. - Proceeding to the next portion of the
scenario 300, acontent frame 304 is displayed. Illustrated in thecontent frame 304 is that visual processing that was previously performed (e.g., during display of the content frame 302) is applied to the display of thecontent frame 304. In this example, visual texture that was previously rendered is applied to thescene object 206, as shown in theportions - Also illustrated in the
content frame 304 is that display of theinteractive object 120 is updated from thecontent frame 302 based on user input. For example, the position and/or action of theinteractive object 120 is visually updated from thecontent frame 302. - During display of the
content frame 304, various types of visual processing is performed, e.g., as background processes that are not visually evident in thecontent frame 304. - Proceeding to the next portion of the
scenario 300, acontent frame 308 is displayed. In thecontent frame 308, display of some visual aspects is the same as in thecontent frame 304. For example, thescene object 206 and/or the additional scene objects 212 are visually the same as in thecontent frame 304. Thescene object 206 and the additional scene objects 212, for instance, can be cached during display of thecontent frame 304 for subsequent display as part of thecontent frame 308. - Also illustrated in the
content frame 308 is that display of theinteractive object 120 is updated from thecontent frame 304 based on user input. For example, the position and/or action of theinteractive object 120 is visually updated from thecontent frame 304. - During display of the
content frame 308, various types of visual processing is performed, e.g., as background processes that are not visually evident in thecontent frame 308. - Proceeding to the lower portion of the
scenario 300, acontent frame 310 is displayed. In thecontent frame 310, various visual aspects are updated based on previously-performed processing, such as processing performed during display of thecontent frame 308. For example, the additional scene objects 212 are visually augmented to include more scene objects. Visual rendering of the additional scene objects 212, for instance, may have occurred during display of thecontent frame 308. - Further, display of the
interactive object 120 is updated from thecontent frame 308 based on user input. For example, the position and/or action of theinteractive object 120 is visually updated from thecontent frame 308. - As discussed with previous frames, various types of visual processing can be performed during display of the
content frame 310, such as visual processing for visual aspects that will be displayed in subsequent frames. - Thus, as described in the
scenarios scene object 206 and/or the additional scene objects 212) can occur over multiple frames. The visual processing of such visual aspects can be applied intermittently to visually update the visual aspects, such as every other frame, every third frame, and so forth. This can provide increased time for visual processing to enable the visual aspects to be rendered with increased detail, resolution, depth, and so forth. - Other visual aspects (e.g., the
interactive object 120 and/or the opponent avatar 122) can be processed and visually updated more frequently, e.g., with every frame. This can enable responsiveness to user input and can decrease lag time between a user providing input and an interactive object reflecting the user input. - Having discussed some example implementation scenarios, consider now a discussion of some example procedures in accordance with one or more embodiments.
-
FIG. 4 is a flow diagram that describes steps in a method in accordance with one or more embodiments. Step 400 updates display of scene objects intermittently based on visual processing performed during a previous frame. As discussed above, a scene object can include background visuals, such as a visual environment in which an interactive object can be displayed. Thus, in at least some implementations, a scene object refers to a non-interactive object, such as a visual object that does not directly respond to user input. - For instance, display of a scene object can be updated according to a variety of different update patterns, such as every other frame in a sequence, every third frame, every fourth frame, and so forth. Alternatively or additionally, scene objects can be visually updated according to shifting update pattern. For example, scene objects can be updated every other frame for a specific number of frames and/or a specific period of playback time. After this, the scene objects can be updated according to a different update pattern, such as every third frame, every fourth frame, and so forth.
- Step 402 updates display of an interactive object every frame. For instance, user input can be detected and used to update the display of the interactive object on a frame-by-frame basis, such as through movement of the interactive object and/or causing the interactive object to perform an action.
-
FIG. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments. The method is illustrated as steps being distributed over two frames of interactive content. Step 500 displays a previously-rendered version of a scene object. As discussed above, the previously-rendered version can be a stored image, such as a pre-rendered image of an object. Alternatively or additionally, the previously-rendered version can be an image that was rendered during a previous frame. - Step 502 performs visual processing for the scene object. As referenced above, various types of visual processing can be performed, such as color processing, texture processing, shadowing, depth processing, light processing, and so on. A variety of other types of visual processing are contemplated within the spirit and scope of the claimed embodiments.
- Step 504 updates a display of an interactive object. For example, an interactive object (e.g., an avatar) can be visually updated based on user input.
- Proceeding to
frame 2,step 506 applies the visual processing to update the display of the scene object. For example, the various visual processing performed duringframe 1 can be applied to enhance and/or alter the display of the scene object. Step 508 updates the display of the interactive object. For instance, user input provided duringframe 1 can be processed and used to update the display of the interactive object. - In at least some implementations, the method can repeat during playback of the interactive content to enable scene objects to be visually updated intermittently, and interactive objects to be updated on a frame-by-frame basis. Further, embodiments are discussed with reference to two frames for purpose of example only, and embodiments can be employed according to wide variety of different frame patterns and/or sequences.
- While embodiments are discussed herein with reference to video game interactive content, embodiments may be implemented utilizing a wide variety of different types of content. For example, embodiments can be employed in rendering and displaying interactions with other types of content, such as web content, applications, and so forth.
-
FIG. 6 illustrates an example system generally at 600 that includes anexample computing device 602 that is representative of one or more computing systems and/or devices that may implement various techniques described herein. Thecomputing device 602 may be, for example, a server of a service provider, a device associated with the client (e.g., a client device), an on-chip system, and/or any other suitable computing device or computing system. - The
example computing device 602 as illustrated includes aprocessing system 604, one or more computer-readable media 606, and one or more I/O Interfaces 608 that are communicatively coupled, one to another. Although not shown, thecomputing device 602 may further include a system bus or other data and command transfer system that couples the various components, one to another. A system bus can include any one or combination of different bus structures, such as a memory bus or memory controller, a peripheral bus, a universal serial bus, and/or a processor or local bus that utilizes any of a variety of bus architectures. A variety of other examples are also contemplated, such as control and data lines. - The
processing system 604 is representative of functionality to perform one or more operations using hardware. Accordingly, theprocessing system 604 is illustrated as includinghardware element 610 that may be configured as processors, functional blocks, and so forth. This may include implementation in hardware as an application specific integrated circuit or other logic device formed using one or more semiconductors. Thehardware elements 610 are not limited by the materials from which they are formed or the processing mechanisms employed therein. For example, processors may be comprised of semiconductor(s) and/or transistors (e.g., electronic integrated circuits (ICs)). In such a context, processor-executable instructions may be electronically-executable instructions. - The computer-
readable media 606 is illustrated as including memory/storage 612. The memory/storage 612 represents memory/storage capacity associated with one or more computer-readable media. The memory/storage 612 may include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth). The memory/storage 612 may include fixed media (e.g., RAM, ROM, a fixed hard drive, and so on) as well as removable media (e.g., Flash memory, a removable hard drive, an optical disc, and so forth). The computer-readable media 606 may be configured in a variety of other ways as further described below. - Input/output interface(s) 608 are representative of functionality to allow a user to enter commands and information to
computing device 602, and also allow information to be presented to the user and/or other components or devices using various input/output devices. Examples of input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, touch functionality (e.g., capacitive or other sensors that are configured to detect physical touch), a camera (e.g., which may employ visible or non-visible wavelengths such as infrared frequencies to detect movement that does not involve touch as gestures), and so forth. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, tactile-response device, and so forth. Thus, thecomputing device 602 may be configured in a variety of ways as further described below to support user interaction. - Various techniques may be described herein in the general context of software, hardware elements, or program modules. Generally, such modules include routines, programs, objects, elements, components, data structures, and so forth that perform particular tasks or implement particular abstract data types. The terms “module,” “functionality,” and “component” as used herein generally represent software, firmware, hardware, or a combination thereof. The features of the techniques described herein are platform-independent, meaning that the techniques may be implemented on a variety of commercial computing platforms having a variety of processors.
- An implementation of the described modules and techniques may be stored on or transmitted across some form of computer-readable media. The computer-readable media may include a variety of media that may be accessed by the
computing device 602. By way of example, and not limitation, computer-readable media may include “computer-readable storage media” and “computer-readable signal media.” - “Computer-readable storage media” may refer to media and/or devices that enable persistent and non-transitory storage of information in contrast to mere signal transmission, carrier waves, or signals per se. Thus, computer-readable storage media does not include transitory signal bearing media. The computer-readable storage media includes hardware such as volatile and non-volatile, removable and non-removable media and/or storage devices implemented in a method or technology suitable for storage of information such as computer readable instructions, data structures, program modules, logic elements/circuits, or other data. Examples of computer-readable storage media may include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, hard disks, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or other storage device, tangible media, or article of manufacture suitable to store the desired information and which may be accessed by a computer.
- “Computer-readable signal media” may refer to a signal-bearing medium that is configured to transmit instructions to the hardware of the
computing device 602, such as via a network. Signal media typically may embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier waves, data signals, or other transport mechanism. Signal media also include any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. - As previously described,
hardware elements 610 and computer-readable media 606 are representative of instructions, modules, programmable device logic and/or fixed device logic implemented in a hardware form that may be employed in some embodiments to implement at least some aspects of the techniques described herein. Hardware elements may include components of an integrated circuit or on-chip system, an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a complex programmable logic device (CPLD), and other implementations in silicon or other hardware devices. In this context, a hardware element may operate as a processing device that performs program tasks defined by instructions, modules, and/or logic embodied by the hardware element as well as a hardware device utilized to store instructions for execution, e.g., the computer-readable storage media described previously. - Combinations of the foregoing may also be employed to implement various techniques and modules described herein. Accordingly, software, hardware, or program modules and other program modules may be implemented as one or more instructions and/or logic embodied on some form of computer-readable storage media and/or by one or
more hardware elements 610. Thecomputing device 602 may be configured to implement particular instructions and/or functions corresponding to the software and/or hardware modules. Accordingly, implementation of modules as an module that is executable by thecomputing device 602 as software may be achieved at least partially in hardware, e.g., through use of computer-readable storage media and/orhardware elements 610 of the processing system. The instructions and/or functions may be executable/operable by one or more articles of manufacture (for example, one ormore computing devices 602 and/or processing systems 604) to implement techniques, modules, and examples described herein. - As further illustrated in
FIG. 6 , theexample system 600 enables ubiquitous environments for a seamless user experience when running applications on a personal computer (PC), a television device, and/or a mobile device. Services and applications run substantially similar in all three environments for a common user experience when transitioning from one device to the next while utilizing an application, playing a video game, watching a video, and so on. - In the
example system 600, multiple devices are interconnected through a central computing device. The central computing device may be local to the multiple devices or may be located remotely from the multiple devices. In one embodiment, the central computing device may be a cloud of one or more server computers that are connected to the multiple devices through a network, the Internet, or other data communication link. - In one embodiment, this interconnection architecture enables functionality to be delivered across multiple devices to provide a common and seamless experience to a user of the multiple devices. Each of the multiple devices may have different physical requirements and capabilities, and the central computing device uses a platform to enable the delivery of an experience to the device that is both tailored to the device and yet common to all devices. In one embodiment, a class of target devices is created and experiences are tailored to the generic class of devices. A class of devices may be defined by physical features, types of usage, or other common characteristics of the devices.
- In various implementations, the
computing device 602 may assume a variety of different configurations, such as forcomputer 614, mobile 616, andtelevision 618 uses. Each of these configurations includes devices that may have generally different constructs and capabilities, and thus thecomputing device 602 may be configured according to one or more of the different device classes. For instance, thecomputing device 602 may be implemented as thecomputer 614 class of a device that includes a personal computer, desktop computer, a multi-screen computer, laptop computer, netbook, and so on. - The
computing device 602 may also be implemented as the mobile 616 class of device that includes mobile devices, such as a mobile phone, portable music player, portable gaming device, a tablet computer, a multi-screen computer, and so on. Thecomputing device 602 may also be implemented as thetelevision 618 class of device that includes devices having or connected to generally larger screens in casual viewing environments. These devices include televisions, set-top boxes, gaming consoles, and so on. - The techniques described herein may be supported by these various configurations of the
computing device 602 and are not limited to the specific examples of the techniques described herein. This is illustrated through inclusion of therendering module 106 on thecomputing device 602. The functionality of therendering module 106 and/or other modules described with reference toFIG. 1 may also be implemented all or in part through use of a distributed system, such as over a “cloud” 620 via aplatform 622 as described below. - The
cloud 620 includes and/or is representative of aplatform 622 forresources 624. Theplatform 622 abstracts underlying functionality of hardware (e.g., servers) and software resources of thecloud 620. Theresources 624 may include applications and/or data that can be utilized while computer processing is executed on servers that are remote from thecomputing device 602.Resources 624 can also include services provided over the Internet and/or through a subscriber network, such as a cellular or Wi-Fi network. - The
platform 622 may abstract resources and functions to connect thecomputing device 602 with other computing devices. Theplatform 622 may also serve to abstract scaling of resources to provide a corresponding level of scale to encountered demand for theresources 624 that are implemented via theplatform 622. Accordingly, in an interconnected device embodiment, implementation of functionality described herein may be distributed throughout thesystem 600. For example, the functionality may be implemented in part on thecomputing device 602 as well as via theplatform 622 that abstracts the functionality of thecloud 620. - Discussed herein are a number of methods that may be implemented to perform techniques discussed herein. Aspects of the methods may be implemented in hardware, firmware, or software, or a combination thereof. The methods are shown as a set of blocks that specify operations performed by one or more devices and are not necessarily limited to the orders shown for performing the operations by the respective blocks. Further, an operation shown with respect to a particular method may be combined and/or interchanged with an operation of a different method in accordance with one or more implementations. Aspects of the methods can be implemented via interaction between various entities discussed above with reference to the
environment 100. - Techniques for multiple frame distributed rendering of interactive content are described. Although embodiments are described in language specific to structural features and/or methodological acts, it is to be understood that the embodiments defined in the appended claims are not necessarily limited to the specific features or acts described. Rather, the specific features and acts are disclosed as example forms of implementing the claimed embodiments.
Claims (21)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/006,523 US20180345144A1 (en) | 2012-06-20 | 2018-06-12 | Multiple Frame Distributed Rendering of Interactive Content |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/528,627 US9682321B2 (en) | 2012-06-20 | 2012-06-20 | Multiple frame distributed rendering of interactive content |
US15/625,748 US10016679B2 (en) | 2012-06-20 | 2017-06-16 | Multiple frame distributed rendering of interactive content |
US16/006,523 US20180345144A1 (en) | 2012-06-20 | 2018-06-12 | Multiple Frame Distributed Rendering of Interactive Content |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/625,748 Continuation US10016679B2 (en) | 2012-06-20 | 2017-06-16 | Multiple frame distributed rendering of interactive content |
Publications (1)
Publication Number | Publication Date |
---|---|
US20180345144A1 true US20180345144A1 (en) | 2018-12-06 |
Family
ID=49774879
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/528,627 Active 2033-04-04 US9682321B2 (en) | 2012-06-20 | 2012-06-20 | Multiple frame distributed rendering of interactive content |
US15/625,748 Active US10016679B2 (en) | 2012-06-20 | 2017-06-16 | Multiple frame distributed rendering of interactive content |
US16/006,523 Abandoned US20180345144A1 (en) | 2012-06-20 | 2018-06-12 | Multiple Frame Distributed Rendering of Interactive Content |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/528,627 Active 2033-04-04 US9682321B2 (en) | 2012-06-20 | 2012-06-20 | Multiple frame distributed rendering of interactive content |
US15/625,748 Active US10016679B2 (en) | 2012-06-20 | 2017-06-16 | Multiple frame distributed rendering of interactive content |
Country Status (1)
Country | Link |
---|---|
US (3) | US9682321B2 (en) |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10155168B2 (en) | 2012-05-08 | 2018-12-18 | Snap Inc. | System and method for adaptable avatars |
US9682321B2 (en) | 2012-06-20 | 2017-06-20 | Microsoft Technology Licensing, Llc | Multiple frame distributed rendering of interactive content |
US9300910B2 (en) | 2012-12-14 | 2016-03-29 | Biscotti Inc. | Video mail capture, processing and distribution |
US9654563B2 (en) | 2012-12-14 | 2017-05-16 | Biscotti Inc. | Virtual remote functionality |
US9485459B2 (en) | 2012-12-14 | 2016-11-01 | Biscotti Inc. | Virtual window |
US20150324076A1 (en) | 2012-12-14 | 2015-11-12 | Biscotti Inc. | Distributed Infrastructure |
US8814683B2 (en) | 2013-01-22 | 2014-08-26 | Wms Gaming Inc. | Gaming system and methods adapted to utilize recorded player gestures |
US9177410B2 (en) * | 2013-08-09 | 2015-11-03 | Ayla Mandel | System and method for creating avatars or animated sequences using human body features extracted from a still image |
CN104349197B (en) * | 2013-08-09 | 2019-07-26 | 联想(北京)有限公司 | A kind of data processing method and device |
US10158868B2 (en) * | 2013-10-15 | 2018-12-18 | Nvidia Corporation | Systems and methods to limit lag between a client and a server for remote computing |
US9634942B2 (en) | 2013-11-11 | 2017-04-25 | Amazon Technologies, Inc. | Adaptive scene complexity based on service quality |
US9413830B2 (en) | 2013-11-11 | 2016-08-09 | Amazon Technologies, Inc. | Application streaming service |
US9641592B2 (en) | 2013-11-11 | 2017-05-02 | Amazon Technologies, Inc. | Location of actor resources |
US9582904B2 (en) | 2013-11-11 | 2017-02-28 | Amazon Technologies, Inc. | Image composition based on remote object data |
US9578074B2 (en) | 2013-11-11 | 2017-02-21 | Amazon Technologies, Inc. | Adaptive content transmission |
US9805479B2 (en) | 2013-11-11 | 2017-10-31 | Amazon Technologies, Inc. | Session idle optimization for streaming server |
US9604139B2 (en) * | 2013-11-11 | 2017-03-28 | Amazon Technologies, Inc. | Service for generating graphics object data |
US9724605B2 (en) * | 2014-08-12 | 2017-08-08 | Utherverse Digital Inc. | Method, system and apparatus of recording and playing back an experience in a virtual worlds system |
US10692531B2 (en) * | 2014-10-25 | 2020-06-23 | Yieldmo, Inc. | Methods for serving interactive content to a user |
US10419788B2 (en) * | 2015-09-30 | 2019-09-17 | Nathan Dhilan Arimilli | Creation of virtual cameras for viewing real-time events |
US10163245B2 (en) * | 2016-03-25 | 2018-12-25 | Microsoft Technology Licensing, Llc | Multi-mode animation system |
US10432559B2 (en) | 2016-10-24 | 2019-10-01 | Snap Inc. | Generating and displaying customized avatars in electronic messages |
US10454857B1 (en) * | 2017-01-23 | 2019-10-22 | Snap Inc. | Customized digital avatar accessories |
CN111127617A (en) * | 2019-12-29 | 2020-05-08 | 浙江科技学院 | Rendering system and rendering method based on distributed rendering engine |
CN114494566A (en) * | 2020-11-09 | 2022-05-13 | 华为技术有限公司 | Image rendering method and device |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5864342A (en) * | 1995-08-04 | 1999-01-26 | Microsoft Corporation | Method and system for rendering graphical objects to image chunks |
US5864343A (en) * | 1993-08-31 | 1999-01-26 | Sun Microsystems, Inc. | Method and apparatus for generating three dimensional effects in a two dimensional graphical user interface |
US7489817B2 (en) * | 1999-09-20 | 2009-02-10 | Microsoft Corporation | Background maintenance of an image sequence |
Family Cites Families (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07325934A (en) * | 1992-07-10 | 1995-12-12 | Walt Disney Co:The | Method and equipment for provision of graphics enhanced to virtual world |
US6064393A (en) | 1995-08-04 | 2000-05-16 | Microsoft Corporation | Method for measuring the fidelity of warped image layer approximations in a real-time graphics rendering pipeline |
US6054393A (en) | 1997-01-09 | 2000-04-25 | Texas Instruments Incorporated | Method for improving the wet process chemical sequence |
US8300042B2 (en) | 2001-06-05 | 2012-10-30 | Microsoft Corporation | Interactive video display system using strobed light |
US7259747B2 (en) * | 2001-06-05 | 2007-08-21 | Reactrix Systems, Inc. | Interactive video display system |
JP2006085145A (en) | 2004-08-17 | 2006-03-30 | Sony Corp | Image signal processing apparatus and phase synchronization method |
WO2006089417A1 (en) * | 2005-02-23 | 2006-08-31 | Craig Summers | Automatic scene modeling for the 3d camera and 3d video |
EP2584530A2 (en) * | 2006-08-03 | 2013-04-24 | Alterface S.A. | Method and device for identifying and extracting images of multiple users, and for recognizing user gestures |
US20090186693A1 (en) * | 2007-12-26 | 2009-07-23 | Edge Of Reality, Ltd. | Interactive video game display method, apparatus, and/or system for object interaction |
US20090267956A1 (en) * | 2008-04-28 | 2009-10-29 | Playxpert, Llc | Systems, methods and articles for video capture |
KR101533247B1 (en) * | 2008-09-01 | 2015-07-02 | 엘지전자 주식회사 | Portable device and the methods of controlling the same |
US9898675B2 (en) * | 2009-05-01 | 2018-02-20 | Microsoft Technology Licensing, Llc | User movement tracking feedback to improve tracking |
US20100302138A1 (en) * | 2009-05-29 | 2010-12-02 | Microsoft Corporation | Methods and systems for defining or modifying a visual representation |
US9084002B2 (en) | 2010-05-03 | 2015-07-14 | Microsoft Technology Licensing, Llc | Heterogeneous image sensor synchronization |
US8970666B2 (en) * | 2011-09-16 | 2015-03-03 | Disney Enterprises, Inc. | Low scale production system and method |
US9682321B2 (en) | 2012-06-20 | 2017-06-20 | Microsoft Technology Licensing, Llc | Multiple frame distributed rendering of interactive content |
-
2012
- 2012-06-20 US US13/528,627 patent/US9682321B2/en active Active
-
2017
- 2017-06-16 US US15/625,748 patent/US10016679B2/en active Active
-
2018
- 2018-06-12 US US16/006,523 patent/US20180345144A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5864343A (en) * | 1993-08-31 | 1999-01-26 | Sun Microsystems, Inc. | Method and apparatus for generating three dimensional effects in a two dimensional graphical user interface |
US5864342A (en) * | 1995-08-04 | 1999-01-26 | Microsoft Corporation | Method and system for rendering graphical objects to image chunks |
US7489817B2 (en) * | 1999-09-20 | 2009-02-10 | Microsoft Corporation | Background maintenance of an image sequence |
Also Published As
Publication number | Publication date |
---|---|
US9682321B2 (en) | 2017-06-20 |
US20170282074A1 (en) | 2017-10-05 |
US10016679B2 (en) | 2018-07-10 |
US20130344961A1 (en) | 2013-12-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10016679B2 (en) | Multiple frame distributed rendering of interactive content | |
US9990759B2 (en) | Offloading augmented reality processing | |
US10298840B2 (en) | Foveated camera for video augmented reality and head mounted display | |
CN110989878B (en) | Animation display method and device in applet, electronic equipment and storage medium | |
US11724184B2 (en) | 2.5D graphics rendering system | |
US20150185825A1 (en) | Assigning a virtual user interface to a physical object | |
US20150187108A1 (en) | Augmented reality content adapted to changes in real world space geometry | |
JP2017528834A (en) | Method, apparatus and computer program for displaying images | |
US11430192B2 (en) | Placement and manipulation of objects in augmented reality environment | |
KR20220093216A (en) | Information reproduction method, apparatus, computer readable storage medium and electronic device | |
US20240127546A1 (en) | Overlay Placement For Virtual Reality And Augmented Reality | |
CN105027563A (en) | Low latency image display on multi-display device | |
US8963927B2 (en) | Vertex-baked three-dimensional animation augmentation | |
CN109189302B (en) | Control method and device of AR virtual model | |
US20170213394A1 (en) | Environmentally mapped virtualization mechanism | |
US11024257B2 (en) | Android platform based display device and image display method thereof | |
US11451721B2 (en) | Interactive augmented reality (AR) based video creation from existing video | |
US20150352442A1 (en) | Game having a Plurality of Engines | |
KR102213727B1 (en) | Graphics processing using multiple primitives | |
US12039141B2 (en) | Translating interactions on a two-dimensional interface to an artificial reality experience | |
WO2021044441A1 (en) | Interactive augmented reality (ar) based video creation from existing video | |
TW202423096A (en) | Cloud system and method for controlling cloud system | |
WO2015131950A1 (en) | Creating an animation of an image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IANNETTA, DAMIANO LUCIANO;REEL/FRAME:046673/0664 Effective date: 20120619 Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:046673/0756 Effective date: 20141014 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |