KR102471580B1 - Building an Objective-Effector for a Mixed Reality Setting - Google Patents

Abstract

In some implementations, the method includes obtaining a preselected set of attribute values for the objective-effector. In some implementations, the method includes manipulation of a first configuration control affordance while displaying a user interface comprising a plurality of configuration control affordances provided for executing configuration of one or more attributes characterizing an objective-effector. in response to receiving an input representing , setting a corresponding first attribute to a particular preselected attribute value, and modifying a display of the plurality of configuration control affordances to change a number of the plurality of configuration control affordances displayed. Include steps. In some implementations, the method includes configuring the objective-effector based on a particular preselected property value of at least a first property. In some implementations, an objective-effector is associated with a predefined set of actions.

Description

Building an Objective-Effector for a Mixed Reality Setting

The present invention relates generally to constructing an objective-effectuator for synthesized reality settings.

Some devices can create and present mixed reality settings. Some mixed reality settings include virtual reality settings that are synthesized substitutes for physical settings. Some mixed reality settings include augmented reality settings that are modified versions of physical settings. Some devices that present mixed reality settings include mobile communication devices such as smartphones, head-mounted displays (HMDs), glasses, heads-up displays (HUDs), and optical projection systems. Some previously available devices are not effective at presenting mixed reality settings, and many previously available devices are not effective at configuring mixed reality settings.

In order that this disclosure may be understood by those skilled in the art, a more detailed description may be made by reference to aspects of some exemplary implementations, some of which are shown in the accompanying drawings.
1A-1G are diagrams of an exemplary user interface for configuring an objective-effector in accordance with some implementations.
2 is a block diagram of an exemplary objective-effector constructor for constructing an objective-effector according to some implementations.
3A-3D are flow diagram representations of a method of constructing an objective-effector in accordance with some implementations.
4A-4C are flow diagram representations of a method of generating an objective-effector in accordance with some implementations.
5 is a block diagram of a server system comprising an objective-effector in accordance with some implementations.
In accordance with common practice, the various features shown in the drawings may not be drawn to scale. Accordingly, the dimensions of various features may be arbitrarily enlarged or reduced for clarity. Additionally, some of the drawings may not depict all of the components of a given system, method or device. Finally, like reference numbers may be used throughout the specification and drawings to indicate like features.

[Contents of the invention]

Various implementations disclosed herein include devices, systems, and methods for configuring objective-effectors for mixed reality settings. In various implementations, a device includes a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, a method includes obtaining a set of preselected attribute values for an objective-effector. In some implementations, the method provides a first configuration control while displaying a user interface comprising a plurality of configuration control affordances provided for executing configuration of one or more attributes characterizing an objective-effector. In response to receiving an input representing manipulation of the affordance, setting the corresponding first attribute to a particular preselected attribute value, and displaying the plurality of configuration control affordances to change the number of the plurality of configuration control affordances displayed. It includes the step of modifying In some implementations, the method includes configuring the objective-effector based on a particular preselected property value of at least a first property. In some implementations, an objective-effector is associated with a set of predefined actions.

In various implementations, the method includes obtaining a request to create an objective-effector for a mixed reality setting. In some implementations, the request indicates a set of property values for an objective-effector. In some implementations, the method includes determining whether the set of attribute values indicated in the request satisfies a preselected set of attribute values for the objective-effector. In some implementations, the method is responsive to determining that the set of attribute values indicated in the request satisfies the preselected set of attribute values for the objective-effector, based on the set of attribute values indicated in the request. to create an objective-effector. In some implementations, the method includes transmitting a data container that includes an objective-effector.

According to some implementations, a device includes one or more processors, non-transitory memory, and one or more programs. In some implementations, one or more programs are stored in non-transitory memory and executed by one or more processors. In some implementations, one or more programs include instructions for performing or causing the performance of any of the methods described herein. According to some implementations, a non-transitory computer-readable storage medium includes instructions that, when executed by one or more processors of a device, cause or cause a device to perform any of the methods described herein. store them inside According to some implementations, a device includes one or more processors, a non-transitory memory, and means for performing or causing performance of any of the methods described herein.

[Specific details for implementing the invention]

Numerous details are set forth in order to provide a thorough understanding of the example implementations shown in the drawings. However, the drawings only depict some exemplary aspects of the present disclosure and are therefore not to be considered limiting. Those skilled in the art will recognize that other effective aspects and/or variations do not include all of the specific details described herein. In addition, well-known systems, methods, components, devices, and circuits have not been described in exhaustive detail so as not to obscure more pertinent aspects of the example implementations described herein.

A physical setting refers to a world that people can perceive and/or that people can interact with without the aid of electronic systems. Physical settings (eg, physical forests) include physical components (eg, physical trees, physical structures, and physical animals). People can directly interact with and/or sense the physical setting, such as through touch, sight, smell, hearing, and taste.

In contrast, a mixed reality (SR) setting refers to a wholly or partially computer-generated setting that people can perceive and/or that people can interact with through electronic systems. In SR, a subset of the person's movements are monitored and, in response thereto, one or more attributes of one or more virtual objects in the SR setting are changed in a manner that obeys one or more laws of physics. For example, an SR system can detect a person taking a few steps forward and, in response, adjust the graphics and audio presented to the person in a manner similar to how these sights and sounds change in a physical setting. Modifications to attribute(s) of the virtual object(s) in the SR setting may also be made in response to representations of movement (eg audio commands).

A person may interact with and/or sense an SR object using any one of their senses, including touch, smell, sight, taste, and hearing. For example, a person may interact with and/or sense auditory objects that enable auditory transparency and/or create multi-dimensional (eg, three-dimensional) or spatial auditory settings. Multidimensional or spatial auditory settings provide a person with an awareness of individual auditory sources in a multidimensional space. Acoustic transparency optionally includes sound from the physical setting, with or without computer-generated audio. In some SR settings, a person can only interact with and/or sense auditory objects.

One example of SR is virtual reality (VR). A VR setting refers to a simulated setting designed to include only computer-generated sensory inputs for at least one of the senses. A VR setting includes a number of virtual objects that humans can interact with and/or sense. A person may interact with and/or sense virtual objects in a VR setting through simulation of a subset of human actions in a computer-generated setting, and/or simulation of a person or his presence in a computer-generated setting.

Another example of SR is mixed reality (MR). An MR setting refers to a simulated setting designed to integrate computer-generated sensory inputs (eg, virtual objects) with sensory inputs from a physical setting, or representation thereof. On the reality spectrum, mixed reality settings lie between VR settings on the one hand and full physical settings on the other, but not both.

In some MR settings, computer-generated sensory inputs can adapt to changes in sensory inputs from the physical setting. Additionally, some electronic systems for presenting MR settings require orientation and/or orientation relative to the physical setting to enable interaction between virtual objects and real objects (which are either physical settings or physical components from their representations). Or you can monitor location. For example, the system can monitor movements so that the virtual plant appears stationary relative to the physical building.

One example of mixed reality is augmented reality (AR). An AR setting refers to a simulated setting in which at least one virtual object is overlaid on a physical setting, or representation thereof. For example, an electronic system may have an opaque display and at least one image sensor for capturing images or video of the physical setting, which are representations of the physical setting. The system combines images or video with virtual objects and displays the combination on an opaque display. A person, using the system, views the physical setting indirectly through images or video of the physical setting, and observes virtual objects superimposed on the physical setting. When the system uses the image sensor(s) to capture images of the physical setting and uses these images to present the AR setting on an opaque display, the displayed images are called video pass-through. Alternatively, an electronic system for displaying an AR setting may have a transparent or translucent display that allows a person to directly view the physical setting. The system may display the virtual objects on a transparent or translucent display, allowing a person, with the system, to view the virtual objects superimposed on a physical setting. In another example, a system may include a projection system that projects virtual objects into a physical setting. Virtual objects can be projected, for example, onto a physical surface or as a holograph, allowing a person, with the system, to view the virtual objects superimposed on a physical setting.

An augmented reality setting can also refer to a simulated setting in which the representation of a physical setting is altered by computer-generated sensor information. For example, a portion of a representation of a physical setting may be graphically altered (eg, enlarged) so that the altered portion is still representative but not a faithfully reproduced version of the originally captured image(s). For another example, in providing video pass-through, the system may change at least one of the sensor images to impose a specific viewpoint different from the viewpoint captured by the image sensor(s). As a further example, the representation of a physical setting can be altered by graphically obscuring or excluding parts thereof.

Another example of mixed reality is augmented virtuality (AV). An AV setting refers to a computer-generated or simulated setting in which the virtual setting includes at least one sensory input from a physical setting. The sensory input(s) from the physical setting may be a representation of at least one characteristic of the physical setting. For example, a virtual object can take on the color of a physical component captured by the image sensor(s). In another example, a virtual object may exhibit characteristics consistent with actual weather conditions in a physical setting, as identified through imaging, weather-related sensors, and/or online weather data. In another example, an augmented reality forest may have virtual trees and structures, but animals may have features accurately reproduced from captured images of physical animals.

Many electronic systems allow individuals to interact with and/or sense various SR settings. One example includes head mounted systems. A head mounted system may have an opaque display and speaker(s). Alternatively, a head mounted system may be designed to accommodate an external display (eg, a smartphone). The head mounted system may have imaging sensor(s) and/or microphones to take images/video and/or capture audio of the physical setting, respectively. The head mounted system may also have a transparent or translucent display. A transparent or translucent display may incorporate a substrate through which light representing images is directed to the individual's eyes. The display may include an LED, OLED, digital light projector, laser scanning light source, liquid crystal on silicon, or any combination of these technologies. The substrate through which light can be transmitted can be a light guide, an optical combiner, an optical reflector, a holographic substrate, or any combination of these substrates. In one embodiment, a transparent or translucent display can selectively switch between an opaque state and a transparent or translucent state. In another example, the electronic system may be a projection-based system. A projection-based system may use retinal projection to project images onto an individual's retina. Alternatively, the projection system may also project virtual objects into a physical setting (eg, onto a physical surface or as a holograph). Other examples of SR systems include a head-up display, a windshield with the ability to display graphics, a window with the ability to display graphics, a lens with the ability to display graphics, a headphone or earphone, a speaker arrangement, an input mechanism (such as , controllers with or without haptic feedback), tablets, smartphones, and desktop or laptop computers.

The present invention provides methods, systems, and/or devices for constructing objective-effectors for mixed reality settings. In particular, the present invention provides methods, systems, and methods that allow an entity that owns an asset to enforce restrictions on the construction of an asset while allowing a user to configure the objective-effector of the asset. and/or devices. The user interface guides the user to configurations that satisfy the constraints placed by the entity that owns the asset. The user interface changes the number of configuration control affordances, guiding the user towards allowed configurations and away from disallowed configurations.

1A-1G are diagrams of an exemplary user interface 100 that allows a user to configure objective-effectors. As used herein, in various implementations, an objective-effector refers to a character/equipment representation that can be instantiated in a mixed reality setting, or an environment in a mixed reality setting. In various implementations, an objective-effector performs one or more actions to achieve (eg, complete, satisfy, or achieve) one or more objective. Although relevant features are shown, those skilled in the art will note that various other features have not been illustrated from this disclosure, for purposes of brevity and so as not to obscure more relevant aspects of the exemplary implementations disclosed herein. will recognize In the example of FIG. 1A , user interface 100 allows a user to construct an objective-effector corresponding to an action figure from fictional material. In other words, in the example of FIG. 1A, the objective-effector is a representation of a character from fictional material. To this end, as a non-limiting example, user interface 100 includes various configuration control affordances, such as material selection affordances 110 and motion selection affordances 120 .

In the example of FIGS. 1A-1G , material selection affordances 110 enable selection of a material for the objective-effector. To this end, the material selection affordances 110 include a carbon fiber selection affordance 110a, a steel selection affordance 110b, and a lead selection affordance 110c. The selection of the carbon fiber selection affordance 110a allows the objective-effector to be made of carbon fiber. Selection of the steel selection affordance 110b causes the objective-effector to be made of steel. The choice of lead select affordance 110c causes the objective-effector to be made of lead.

In the example of FIGS. 1A-1G , motion selection affordances 120 enable selection of a motion type for an objective-effector. To this end, the motion selection affordances 120 include a walking selection affordance 120a, a running selection affordance 120b, and a flying selection affordance 120c. Selection of the walk selection affordance 120a causes the objective-effector to use walking as its mode of movement. Selection of run selection affordance 120b causes the objective-effector to use running as its mode of movement. Selection of the flight select affordance 120c causes the objective-effector to use flight as its mode of movement.

In the example of FIGS. 1A-1G , the selectability of motion selection affordances 120 is based on the selection of material selection affordances 110 . For example, in some implementations, the entity that creates/owns the action figure provides rules that limit the selectability of motion selection affordances 120 based on the selection of material selection affordances 110 . In some implementations, the rules collectively form a rules engine (eg, rules engine 218 shown in FIG. 2 ). In some implementations, the rules that affect the selectability of motion selection affordances 120 are as follows.

Referring to FIG. 1B , the user interface 100 receives a user input 130a for selecting a carbon fiber selection affordance 110a. User input 130a indicates that the user has selected carbon fiber as the material from which to build the objective-effector. As shown in FIG. 1C , according to Rule 1, selection of carbon fiber selection affordance 110a makes all motion selection affordances 120 selectable. Thus, in the example of FIG. 1C , the walk select affordance 120a, the run select affordance 120b, and the flight select affordance 120c are selectable after the carbon fiber select affordance 110a is selected.

Referring to FIG. 1D , the user interface 100 receives a user input 130b for selecting a steel selection affordance 110b. User input 130b indicates that the user has selected steel as the material from which to build the objective-effector. As shown in FIG. 1E, according to Rule 2, selection of the steel selection affordance 110b makes the flight selection affordance 120c unselectable, and the walking selection affordance 120a and the running selection affordance 120b are selectable. let it In the example of FIG. 1E , user interface 100 overlays non-selectable affordance indicator 140 on flight selection affordance 120c to indicate that flight selection affordance 120c is no longer selectable. )do. In various implementations, user interface 100 changes a visual characteristic of flight selection affordance 120c to indicate that flight selection affordance 120c is not selectable (e.g., user interface 100 may, for example, For example, change the background color of flight selection affordance 120c by graying out flight selection affordance 120c to indicate its non-selectability).

Referring to FIG. 1F , the user interface 100 receives a user input 130c for selecting a lead selection affordance 110c. User input 130c indicates that the user has selected lead as the material from which the objective-effector will be built. As shown in FIG. 1G , according to Rule 3, the selection of the lead selection affordance 110c makes the running selection affordance 120b and the flying selection affordance 120c unselectable, and the walking selection affordance 120a can be selected. let it In the example of FIG. 1G , to indicate that run select affordance 120b and fly select affordance 120c are no longer selectable, user interface 100 displays run select affordance 120b and fly select affordance 120c. Remove In various implementations, to indicate that run select affordance 120b and fly select affordance 120c are not selectable, user interface 100 provides a visual representation of run select affordance 120b and fly select affordance 120c. change characteristics (e.g., user interface 100, e.g., by overlaying non-selectable affordance indicators 140 on run selection affordance 120b and flight selection affordance 120c (not shown); Block the run selection affordance 120b and flight selection affordance 120c to indicate their non-selection).

In various implementations, user interface 100 allows a user to configure an objective-effector, while allowing an asset generator (eg, an entity that created an asset represented by an objective-effector) to configure via rules Allows you to enforce constraints on the constructs of an objective-effector. In the example of FIGS. 1A-1G , user interface 100 allows a user to configure an objective-effector to move in different ways, while an asset creator can constrain certain movements to specific materials. let it be For example, Rule 3 could cause an asset generator to restrict the running or flying of an objective-effector made of lead because the relatively high weight of lead would make the objective-effector too heavy to run or fly. have. As such, in various implementations, user interface 100 enables configurations that result in more realistic/reasonable objective-effectors.

2 is a block diagram of an example system for configuring objective-effectors, in accordance with some implementations. In various implementations, system 200 includes objective-effector configurer 210 that configures objective-effector 212 based on user input 222 . In various implementations, the objective-effector constructor 210 includes a rules engine 218 and a user interface presenter 220 .

In various implementations, rules engine 218 includes one or more rules for constructing objective-effector 212 (eg, Rules 1-3 described herein). In some implementations, the rules are provided by asset creator entity 230 that creates/owns the asset represented by objective-effector 212 . For example, in some implementations, rules are provided by asset generator entity 230 that creates the character/equipment represented by objective-effector 212 .

In various implementations, user interface presenter 220 provides a user interface that allows a user to configure objective-effector 212 (eg, user interface 100 shown in FIGS. 1A-1G ). present. In some implementations, the user interface includes various configuration control affordances that enable configuration of the objective-effector 212 (e.g., material selection affordances 110 shown in FIGS. 1A-1G ) and/or motion. selection affordances 120). To this end, user interface presenter 220 provides user input 222 representing the requested configuration to objective-effector 212 (e.g., user input 130a shown in FIG. 1B, user input 130a shown in FIG. 1D). User input 130b or user input 130c shown in FIG. 1F) is received.

In various implementations, user interface presenter 220 modifies the user interface based on user input 222 and rules provided by rules engine 218 . For example, in some implementations, user interface presenter 220 changes a number of selectable configuration control affordances based on user input 222 and rules specified by rules engine 218 . For example, referring to FIGS. 1D and 1E , according to rule 2, in response to selection of steel selection affordance 110b, user interface presenter 220 selects motion selection affordances 120 that remain selectable. reduce the number of

In various implementations, user interface presenter 220 modifies the display of configuration control affordances. For example, in some implementations, user interface presenter 220 changes the number of configuration control affordances. In some implementations, user interface presenter 220 increases the number of configuration control affordances. In some implementations, user interface presenter 220 reduces the number of configuration control affordances. In some implementations, user interface presenter 220 modifies the display of the configuration control affordances by changing a visual characteristic of at least some of the configuration control affordances. For example, in some implementations, user interface presenter 220 overlays non-selectable affordance indicator 140 (shown in FIG. 1E ) over configuration control affordances that are no longer selectable. In some implementations, user interface presenter 220 changes the font and/or color (eg, background color) of the configuration control affordance to indicate that the configuration control affordance cannot be selected. For example, in some implementations, user interface presenter 220 grays out the configuration control affordance to indicate that the configuration control affordance is not selectable.

In various implementations, asset generator entity 230 provides preselected properties 232 for objective-effector 212 . In some implementations, the preselected properties 232 include a preselected texture 232a, a preselected geometry 232b, a preselected material 232c, a preselected musical 232d, a preselected physics 232e, and/or preselected behavior 232f. In some implementations, asset generator entity 230 stores preselected attributes 232 in datastore 234 accessible to objective-effector configurator 210 . In such implementations, user interface presenter 220 presents configuration control affordances that enable selection of one or more of the preselected attributes 232 provided by asset generator entity 230 .

In some implementations, the objective-effector configurer 210 receives information 214 representing other objective-effectors being instantiated in a mixed reality setting. In such implementations, the rules engine 218 uses rules to determine which of the preselected attributes 232 are selectable based on information 214 about other instantiated objective-effectors. For example, if information 214 indicates that some of the other objective-effectors instantiated in the mixed reality setting are known to be inappropriate, then rules engine 218 determines the selectability of preselected materials 232c. (eg, less protective materials such as cotton are no longer selectable, but more protective materials such as steel remain selectable or become selectable). In this example, user interface presenter 220 modifies the display of configuration control affordances to indicate a change in the selectability of preselected materials 232c (e.g., user interface presenter 220 is Make the configuration control affordance unselectable, but make the configuration control affordance for steel unselectable or leave it unselectable).

In some implementations, the objective-effector handler 210 receives scene information 216 corresponding to a mixed reality setting. In some implementations, scene information 216 represents dimensions, shape, location, and/or terrain associated with a mixed reality setting. In such implementations, rules engine 218 uses rules to determine which of preselected attributes 232 are selectable based on scene information 216 . For example, if scene information 216 indicates that the weather within the mixed reality setting is hot, rules engine 218 changes the selectability of preselected materials 232c (e.g., warmer materials such as wool No longer selectable, but cooler materials such as cotton either become selectable or remain selectable). In this example, user interface presenter 220 modifies the display of configuration control affordances to indicate a change in the selectability of preselected materials 232c (e.g., user interface presenter 220 is wool ), but makes the configuration control affordances for faces selectable or leaves them selectable).

3A is a flow diagram representation of a method 300 of constructing an objective-effector for a mixed reality setting. In various implementations, method 300 is performed by a device having a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, method 300 is performed by processing logic comprising hardware, firmware, software, or combinations thereof. In some implementations, method 300 is performed by a processor executing code stored in a non-transitory computer readable medium (eg, memory). Briefly, in some implementations, method 300 includes obtaining a set of preselected attribute values for an objective-effector, displaying a user interface that includes a plurality of configuration control affordances, a first attribute and modifying the display of configuration control affordances, and configuring the objective-effector based on the first property.

As represented by block 310, in various implementations, method 300 includes obtaining a set of preselected attribute values for an objective-effector. For example, referring to FIG. 2 , method 300 includes obtaining (eg, receiving) preselected attributes 232 from asset generator entity 230 .

As represented by block 320, in some implementations, method 300 includes a plurality of configuration control affordances provided to effect configuration of one or more attributes that characterize the objective-effector. and displaying a user interface. For example, referring to FIGS. 1A-1G , method 300 may include material selection affordances 110 and movement (eg, carbon fiber, steel, or lead) to enable selection of a material (eg, carbon fiber, steel, or lead). and displaying a user interface (100) with motion selection affordances (120) for enabling selection (walking, running, or flying).

As represented by block 330, in some implementations, method 300, in response to receiving an input indicating manipulation of a first configuration control affordance, assigns a corresponding first attribute to a specific preselected attribute. It includes setting a value. For example, referring to FIG. 1B , in response to receiving user input 130a indicating manipulation of carbon fiber select affordance 110a, method 300 may select carbon fiber material for an objective-effector. It includes the step of setting to In some implementations, method 300 includes modifying the display of the plurality of configuration control affordances to change the number of the plurality of configuration control affordances displayed. For example, referring to FIG. 1G , in response to receiving a selection of lead select affordance 110c, run select affordance 120b and flight select affordance 120c have been removed.

As represented by block 340, in some implementations, method 300 includes constructing an objective-effector based on a particular preselected property value of at least a first property. For example, referring to FIG. 1G, the objective-effector is configured to be made from lead. In some implementations, an objective-effector is associated with a predefined set of actions. In some implementations, method 300 includes presenting an objective-effector based on at least a particular preselected attribute value.

Referring to FIG. 3B , as represented by block 310a, in some implementations, method 300 may include a preselected texture, a preselected geometry, a preselected material, a preselected musical, and/or a preselected musical structure. Obtaining preselected physical properties comprising the selected physics. For example, referring to FIG. 2 , in some implementations, method 300 may include a preselected texture 232a, a preselected geometry 232b, a preselected material 232c, a preselected musical, and/or or acquiring (eg, receiving) the preselected physical 232e. In some implementations, method 300 includes receiving preselected physical attributes from an asset generator entity (eg, asset generator entity 230 shown in FIG. 2 ).

As represented by block 310b, in some implementations, method 300 includes obtaining behavioral properties for an objective-effector. For example, referring to FIG. 2 , in some implementations, method 300 includes obtaining (eg, receiving) preselected behavior 232f. In some implementations, method 300 includes receiving preselected behavioral attributes from an asset generator entity (eg, asset generator entity 230 shown in FIG. 2 ).

As represented by block 310c, in some implementations, method 300 includes obtaining a set of preselected actions that an objective-effector can perform in a mixed reality setting. In some implementations, method 300 includes receiving a preselected set of actions from an asset generator entity that creates an objective-effector (eg, asset generator entity 230 shown in FIG. 2 ). .

As represented by block 310d, in some implementations, method 300 includes obtaining preselected properties representing mixed reality settings for an objective-effector. In some implementations, method 300 includes receiving types of mixed reality settings in which an objective-effector can be placed. In some implementations, method 300 includes receiving information regarding mixed reality settings in which an objective-effector can be placed. For example, in some implementations, method 300 includes receiving environmental information and/or terrain information about mixed reality settings in which an objective-effector can be placed.

As represented by block 310e, in some implementations, the method 300 includes obtaining preselected attributes indicative of other objective-effectors with which the objective-effectuator can interact. . In some implementations, method 300 receives information representative of other character/equipment representations with which the objective-effector can interact.

As represented by block 310f, in some implementations, the objective-effector includes a representation of a character from fictional material, such as a novel, movie, cartoon, or the like.

As represented by block 310g, in some implementations the objective-effector includes a representation of equipment. In some implementations, the objective-effector is a representation of real-world equipment, such as a fighter jet. In some implementations, the objective-effector is a representation of a fiction device, such as a time travel machine.

As represented by block 310h, in some implementations, the objective-effector includes an object representation representing an object such as a person, thing, or place.

Referring to FIG. 3C , as represented by block 320a, in some implementations, method 300 determines that a first configuration control affordance allows selection of an attribute value within a preselected set of attribute values. and presenting a first configuration control affordance in response to doing so.

As represented by block 320b, in some implementations, method 300 may perform a second configuration control affordance in response to determining that the second configuration control affordance permits selection of attribute values outside the preselected set of attribute values. Forgoing presentation of the configuration control affordance.

As represented by block 320c, in some implementations, method 300 includes selecting configuration control affordances based on the objective-effector. For example, in some implementations, method 300 may include selecting a first set of configuration control affordances for a first objective-effector, and a configuration control affordance for a second objective-effector. and selecting a second set of .

As represented by block 320d, in some implementations, method 300 includes selecting configuration control affordances based on preselected attribute values. For example, in some implementations, method 300 includes selecting a first set of configuration control affordances for display on a first set of preselected attribute values, and a second set of preselected attribute values. and selecting a second set of configuration control affordances for display.

As represented by block 330a, in some implementations, method 300 includes reducing the number of configuration control affordances. For example, referring to FIG. 1G , the number of motion selection affordances 120 is reduced from three to one.

As represented by block 330b, in some implementations, method 300 includes increasing the number of configuration control affordances. In some implementations, increasing the number of configuration control affordances provides more configuration options to the user.

As represented by block 330c, in some implementations, method 300 includes changing a visual characteristic of some configuration control affordances to indicate non-selection of the configuration control affordances. For example, in some implementations, method 300 may place an indicator on top of the configuration control affordance to indicate that the configuration control affordance is not selectable (eg, the nonselectable affordance indicator 140 shown in FIG. 1E ). ))).

As represented by block 330d, in some implementations, method 300 includes determining, by a rules engine, a change in the number of configuration control affordances. For example, referring to FIG. 2, the rules engine 218 determines a change in the number of configuration control affordances. In some implementations, method 300 includes using one or more rules in a rules engine to determine a change in the number of configuration control affordances. In some implementations, method 300 includes increasing the number of configuration control affordances. In some implementations, method 300 includes reducing the number of configuration control affordances (eg, as shown in FIG. 1G ).

As represented by block 330e, in some implementations, method 300 includes obtaining rules forming a rules engine. For example, in some implementations, method 300 includes obtaining (eg, receiving) rules from an entity that controls (eg, owns) the objective-effector. In some implementations, method 300 includes receiving rules from an asset generator entity (eg, asset generator entity 230 shown in FIG. 2 ).

As represented by block 330f, in some implementations, method 300 includes selecting attribute values that are within a degree of similarity to the requested attribute values. In some implementations, method 300 includes requested attribute values are not within preselected attribute values. In such implementations, method 300 includes alternative attribute values selected from preselected attribute values that are within a degree of similarity to the requested attribute values.

As represented by block 330g, in some implementations, the manipulated configuration control affordance corresponds to a visual characteristic of the objective-effector, and a property corresponding to a behavioral characteristic is set. In some implementations, method 300 includes receiving a selection of a configuration control affordance relating to a first type of attribute, and setting a second type of attribute in response to the selection of the configuration control affordance.

Referring to FIG. 3D , as indicated by block 340a, in some implementations, method 300 includes displaying an objective-effector in a mixed reality setting. In some implementations, method 300 includes displaying an objective-effector according to a configuration configured via user input.

In some implementations, method 300 includes creating and displaying a mixed reality setting. In some implementations, the mixed reality setting is displayed on an electronic device such as a smartphone, tablet, laptop, desktop, and the like. In some implementations, the mixed reality setting is displayed by a head-mounted device (HMD) wearable by a user. In some implementations, the HMD includes a head-mounted enclosure. In some implementations, the head-mounted enclosure is shaped to form a receptacle for receiving an electronic device having a display. In some implementations, the HMD includes an integrated display.

As represented by block 340b, in some implementations, method 300 includes transmitting a data container that includes an objective-effector. In some implementations, method 300 includes receiving a request for an objective-effector. In such implementations, method 300 includes creating an objective-effector and sending the objective-effector in a data container to a device that requested the objective-effector.

As represented by block 350, in some implementations, method 300 is responsive to input manipulating the second configuration control affordance, setting the second property and maintaining the display of the configuration control affordances. It includes steps to In some implementations, method 300 includes maintaining a number of configuration control affordances.

As represented by block 350b, in some implementations, method 300 includes maintaining a visual characteristic of the configuration control affordances to indicate selectability of the configuration control affordances. For example, in some implementations, method 300 includes withholding changing visual characteristics of configuration control affordances. In some implementations, method 300 includes refusing to overlay an indicator on the configuration control affordance indicating that the configuration control affordance is not selectable.

4A is a flow diagram representation of a method 400 of creating an objective-effector for a mixed reality setting. In various implementations, method 400 is performed by a device having a non-transitory memory and one or more processors coupled with the non-transitory memory. In some implementations, method 300 is performed by processing logic comprising hardware, firmware, software, or combinations thereof. In some implementations, method 400 is performed by a processor executing code stored on a non-transitory computer readable medium (eg, memory). Briefly, in some implementations, method 400 includes obtaining a request to create an objective-effector, determining whether the request satisfied a preselected set of attribute values, and comprising: creating an actor, and sending a data container containing the objective-effector.

As represented by block 410, in various implementations, method 400 includes obtaining a request to create an objective-effector for a mixed reality setting. In some implementations, the request indicates a set of property values for an objective-effector.

As represented by block 420, in some implementations, method 400 includes determining whether a request satisfies a preselected set of attribute values for an objective-effector. For example, in some implementations, method 400 includes determining whether the set of attribute values indicated in the request satisfies a preselected set of attribute values for the objective-effector.

As represented by block 430, in some implementations, method 400 includes generating an objective-effector based on the request. For example, in some implementations, method 400 is responsive to determining that the set of attribute values indicated in the request satisfies the preselected set of attribute values for the objective-effector, such that the set of attribute values indicated in the request Generating an objective-effector based on the set of attribute values.

As represented by block 440, in some implementations, method 400 includes transmitting a data container that includes an objective-effector. In some implementations, method 400 includes encapsulating the objective-effector within an HTML wrapper.

Referring to FIG. 4B , as represented by block 420a, in some implementations, method 400 includes obtaining a set of preselected attribute values. In some implementations, method 400 includes receiving a set of preselected attribute values from an asset creator entity that creates an asset corresponding to the objective-effector.

As represented by block 420b, in some implementations, method 400 may include a preselected texture, a preselected geometry, a preselected material, a preselected musical, and/or a preselected physics. Obtaining physical attributes. For example, referring to FIG. 2 , in some implementations, method 400 may include a preselected texture 232a, a preselected geometry 232b, a preselected material 232c, a preselected musical, and/or acquiring (eg, receiving) the preselected physical 232e. In some implementations, method 400 includes receiving preselected physical attributes from an asset generator entity (eg, asset generator entity 230 shown in FIG. 2 ).

As represented by block 420c, in some implementations, method 400 includes obtaining behavioral properties for an objective-effector. For example, referring to FIG. 2 , in some implementations, method 400 includes obtaining (eg, receiving) preselected behavior 232f. In some implementations, method 400 includes receiving preselected behavioral attributes from an asset generator entity (eg, asset generator entity 230 shown in FIG. 2 ).

As represented by block 420d, in some implementations, method 400 includes obtaining a set of preselected actions that an objective-effector can perform in a mixed reality setting. In some implementations, method 400 includes receiving a preselected set of actions from an asset generator entity that creates an objective-effector (eg, asset generator entity 230 shown in FIG. 2 ). .

As represented by block 420e, in some implementations, method 400 includes obtaining preselected properties representing mixed reality settings for an objective-effector. In some implementations, method 400 includes receiving types of mixed reality settings in which an objective-effector can be placed. In some implementations, method 400 includes receiving information regarding mixed reality settings in which an objective-effector can be placed. For example, in some implementations, method 400 includes receiving environmental information and/or terrain information about mixed reality settings in which an objective-effector can be placed.

As represented by block 420f, in some implementations, method 400 includes obtaining preselected properties representative of other objective-effectuators with which the objective-effectuator can interact. . In some implementations, method 400 receives information representative of other character/equipment representations with which the objective-effector can interact.

As represented by block 420g, in some implementations, the objective-effector includes a representation of a character from fictional material, such as a novel, movie, cartoon, or the like.

As represented by block 420h, in some implementations the objective-effector includes a representation of equipment. In some implementations, the objective-effector is a representation of real-world equipment, such as a fighter jet. In some implementations, the objective-effector is a representation of a fiction device, such as a time travel machine.

As represented by block 420i, in some implementations, the objective-effector includes an object representation representing an object such as a person, thing, or place.

Referring to FIG. 4C , as represented by block 430a, in some implementations, method 400, in response to determining that the requested attribute values do not satisfy a preselected set of attributes, results in a requested attribute value. generating an objective-effector based on alternative attribute values from a preselected set of attributes that are within a degree of similarity for the attribute values.

As represented by block 430b, in some implementations, method 400 may be performed by a rules engine (eg, rules engine 218 shown in FIG. 2 ) for a request to satisfy preselected attributes. It includes the step of determining whether

As represented by block 430c, in some implementations, method 400 includes obtaining (eg, receiving) rules forming a rules engine. In some implementations, method 400 includes receiving rules from an asset creator entity that creates an asset represented by an objective-effector.

5 is a block diagram of a server system 500 enabled using one or more components of a device in accordance with some implementations. Although certain specific features are illustrated, those skilled in the art will recognize from this disclosure that various other features have not been illustrated for brevity and not to obscure more suitable aspects of the implementations disclosed herein. . To this end, as a non-limiting example, in some implementations, server system 500 includes one or more processing unit (CPU) 501 , network interface 502 , programming interface 503 , memory 504 , and and one or more communication buses 505 for interconnecting these and various other components.

In some implementations, network interface 502 is provided to establish and maintain a metadata tunnel between a cloud-hosted network management system and at least one private network comprising one or more compatible devices, among other uses. In some implementations, communication buses 505 include circuitry that interconnects system components and controls communication between them. Memory 504 includes high-speed random access memory such as DRAM, SRAM, DDR RAM or other random access solid state memory devices, and non-volatile memory such as one or more magnetic disk storage devices, optical disk storage devices , flash memory devices, or other non-volatile solid state storage devices. Memory 504 optionally includes one or more storage devices located remotely from CPU(s) 501 . Memory 504 includes non-transitory computer readable storage media.

In some implementations, memory 504 or a non-transitory computer readable storage medium of memory 504 may include the following programs, modules and data structures, or optional operating system 506, rules engine 218 and an objective-effector constructor 210 that includes a user interface presenter 220. As described herein, the objective-effector 210 enables a user to configure an objective-effector, while an asset generator that creates a corresponding asset can enforce restrictions on configurations. let it be As described herein, rules engine 218 includes one or more rules that determine available configurations for an objective-effector. As described herein, user interface presenter 220 presents a user interface that allows a user to configure an objective-effector.

While various aspects of implementations within the scope of the appended claims have been described above, it will be apparent that the various features of the foregoing implementations may be embodied in a wide variety of forms and that any specific structure and/or function described above is merely illustrative. will be. Based on this disclosure, those skilled in the art should understand that an aspect described herein can be implemented independently of any other aspects and that two or more of these aspects can be combined in various ways. For example, an apparatus may be implemented and/or a method may be practiced using any number of the aspects set forth herein. In addition, such an apparatus may be implemented and/or such a method may be practiced using other structures and/or functions in addition to or other than one or more of the aspects set forth herein.

It will also be understood that although the terms "first", "second", etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first node may be referred to as a second node, as long as all occurrences of a “first node” are consistently renamed and all occurrences of a “second node” are consistently renamed, and similarly, A second node may be referred to as a first node, which changes the meaning of the description. The first node and the second node are both nodes, but they are not the same node.

The terminology used herein is for the purpose of describing only specific embodiments and is not intended to limit the scope of the claims. As used in the description of the present embodiments and the appended claims, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. do. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. As used herein, the terms "comprise" and/or "comprising" specify the presence of the stated features, integers, steps, operations, elements, and/or components. However, it will be further understood that this does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components and/or groups thereof.

As used herein, depending on the context, the term "if" a stated antecedent condition means "when" it is true, "upon" it is true, or "if it is true". “in response to determining” or “in accordance with a determination that he is true” or “in response to detecting that he is true” can be interpreted Similarly, the phrase "if it is determined that [the stated antecedent condition is true]" or "if [the stated antecedent condition is true]" or "when [the stated antecedent condition is true]" depends on the context "on determining that the antecedent condition is true" or in response to determining that the condition is true "or upon determining that the condition is true" or upon detecting that the condition is "true" or the condition In response to detecting that "this fact" can be interpreted to mean.

Claims (61)

delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete delete A method executed by a processor in a device comprising a non-transitory memory and one or more processors associated with the non-transitory memory, the method comprising:
The method is:
obtaining a set of preselected attribute values for an objective-effectuator placed in the environment;
a first plurality of configuration control affordances provided to effect configuration of a first attribute characterizing the objective-effector and configuration of a second attribute characterizing the objective-effector; displaying a user interface including a second plurality of provided configuration control affordances;
acquiring information about the environment in which the objective-effector is placed;
display of the user interface based on information about the environment and rules restricting the configuration of the objective-effector within the environment while remaining of the first plurality of configuration control affordances remain selectable. modifying a subset of the plurality of configuration control affordances to be non-selectable;
In response to receiving an input indicating manipulation of a first configuration control affordance of the remainder of the first plurality of configuration control affordances, the first attribute is converted from the set of preselected attribute values to a second configuration control affordance associated with the first configuration control affordance. 1 setting a selectable attribute value;
modifying the displayed display of the second plurality of configuration control affordances by displaying a first subset of the second plurality of configuration control affordances while forgoing display of the remainder of the second plurality of configuration control affordances. step;
In response to receiving an input indicating manipulation of a second configuration control affordance of the remainder of the first plurality of configuration control affordances, the first attribute is converted from the preselected set of attribute values to a second configuration control affordance associated with the second configuration control affordance. 2 setting a selectable attribute value;
modifying a displayed display of the second plurality of configuration control affordances by displaying a second subset of the second plurality of configuration control affordances while suspending display of the remainder of the second plurality of configuration control affordances - wherein the the second subset is different from the first subset; and
configuring the objective-effector based on at least the first selectable attribute value or the second selectable attribute value of the first attribute, wherein the objective-effector performs one of predefined actions A method associated with a set.
delete delete 43. The method of claim 42, wherein modifying the display of the displayed second plurality of configuration control affordances comprises:
and changing a visual characteristic of the portion of the second plurality of configuration control affordances to indicate that the portion is not selectable. 43. The method of claim 42,
in response to receiving an input indicative of manipulation of the second configuration control affordance, setting the second attribute to a particular preselected attribute value, and maintaining display of the second plurality of configuration control affordances. Including, how. 47. The method of claim 46, wherein maintaining the display of the second plurality of configuration control affordances comprises:
and maintaining the number of the second plurality of configuration control affordances. 47. The method of claim 46, wherein maintaining the display of the second plurality of configuration control affordances comprises:
and maintaining a visual characteristic of the second plurality of configuration control affordances to indicate that the second plurality of configuration control affordances are selectable. 43. The method of claim 42, wherein obtaining a set of preselected attribute values comprises:
A method comprising obtaining physical properties including one or more of texture, geometry, material, musical, or physics. 43. The method of claim 42, wherein obtaining a set of preselected attribute values comprises:
obtaining behavioral properties for the objective-effector. 43. The method of claim 42,
and selecting the first or second plurality of configuration control affordances based on the objective-effector. 43. The method of claim 42,
and selecting the first or second plurality of configuration control affordances based on the preselected set of attribute values. 43. The method of claim 42,
determining, by a rules engine comprising one or more rules, a change in the number of configuration control affordances of the second plurality. 54. The method of claim 53, wherein the one or more rules are provided by an entity controlling the objective-effector. 43. The method of claim 42,
In response to determining that the input represents an attribute value that is not within the set of preselected attribute values, the preselected attribute value is such that the particular preselected attribute value is within a degree of similarity to the attribute value represented by the input. and selecting the particular preselected attribute value from the set of 43. The method of claim 42, wherein the first configuration control affordance is associated with a visual characteristic of the objective-effectuator, and wherein the first property affects a behavioral characteristic of the objective-effectuator. 43. The method of claim 42, wherein obtaining a preselected set of attributes comprises:
obtaining a set of preselected actions performable by the objective-effector. 43. The method of claim 42, wherein the set of preselected properties represent mixed reality settings for instantiating the objective-effector. 43. The method of claim 42, wherein the set of preselected attributes indicates other objective-effectors capable of interacting with the objective-effectuator. As a device,
one or more processors;
non-transitory memory;
one or more displays; and
one or more programs stored in the non-transitory memory;
The one or more programs, when executed by the one or more processors, cause the device to:
obtain a set of preselected attribute values for an objective-effector placed in the environment;
a first plurality of configuration control affordances provided to implement configuration of a first attribute characterizing the objective-effector and a first configuration provided to implement configuration of a second attribute characterizing the objective-effector; 2 display a user interface comprising a plurality of configuration control affordances;
obtain information about the environment in which the objective-effector is placed;
of the first plurality of configuration control affordances based on information about the environment and rules restricting the configuration of the objective-effector within the environment while remaining of the first plurality of configuration control affordances remain selectable. modify the display of the user interface to render the subset unselectable;
In response to receiving an input indicating manipulation of a first configuration control affordance of the remainder of the first plurality of configuration control affordances, the first attribute is converted from the set of preselected attribute values to a second configuration control affordance associated with the first configuration control affordance. 1 selectable attribute value, and displaying a first subset of the second plurality of configuration control affordances while suspending display of the remainder of the second plurality of configuration control affordances, thereby displaying the second plurality of components displayed. modify the display of control affordances;
In response to receiving an input indicating manipulation of a second configuration control affordance of the remainder of the first plurality of configuration control affordances, the first property is converted from the preselected set of property values to a second configuration control affordance associated with the second configuration control affordance. 2 selectable attribute value, and displaying a second subset of the second plurality of configuration control affordances while suspending display of the remainder of the second plurality of configuration control affordances, thereby displaying the second plurality of components displayed. modify the display of control affordances, wherein the second subset is different from the first subset; and,
configure the objective-effector based on at least the first selectable property value or the second selectable property value of the first property, wherein the objective-effector is associated with a predefined set of actions; device. As a non-transitory memory that stores one or more programs,
The one or more programs, when executed by one or more processors of a device having a display, cause the device to:
obtain a set of preselected attribute values for an objective-effector placed in the environment;
a first plurality of configuration control affordances provided to implement configuration of a first attribute characterizing the objective-effector and a first configuration provided to implement configuration of a second attribute characterizing the objective-effector; 2 display a user interface comprising a plurality of configuration control affordances;
obtain information about the environment in which the objective-effector is placed;
the first plurality of configuration control affordances based on information about the environment and rules limiting configuration of the objective-effector within the environment, while remaining of the first plurality of configuration control affordances remain selectable; modify the display of the user interface to render a subset of the non-selectable;
In response to receiving an input indicating manipulation of a first configuration control affordance of the remainder of the first plurality of configuration control affordances, the first attribute is converted from the set of preselected attribute values to a second configuration control affordance associated with the first configuration control affordance. 1 selectable attribute value, and displaying a first subset of the second plurality of configuration control affordances while suspending display of the remainder of the second plurality of configuration control affordances, thereby displaying the second plurality of components displayed. modify the display of control affordances;
In response to receiving an input indicating manipulation of a second configuration control affordance of the remainder of the first plurality of configuration control affordances, the first property is converted from the preselected set of property values to a second configuration control affordance associated with the second configuration control affordance. 2 selectable attribute value, and displaying a second subset of the second plurality of configuration control affordances while suspending display of the remainder of the second plurality of configuration control affordances, thereby displaying the second plurality of components displayed. modify the display of control affordances, wherein the second subset is different from the first subset; and
configure the objective-effector based on at least the first selectable property value or the second selectable property value of the first property, wherein the objective-effector is associated with a predefined set of actions; , non-transitory memory.

Images