JP2015507263A5

JP2015507263A5 -

Info

Publication number: JP2015507263A5
Application number: JP2014549156A
Authority: JP
Filing date: 2012-12-15
Publication date: 2016-01-21
Anticipated expiration: 2032-12-15

Claims

A method executed at least in part on at least one processor in a computing environment, comprising:
Processing a request received via a sensor fusion interface that enables interaction between one or more entities and a computerized device component;
Accessing a shared library coupled to a plurality of sensor modules, the shared library including multiple sensor input data associated with one or more entities;
Extracting entity state data from the shared library;
Providing the computerized device component with access to the entity state data;
A method that includes a step.

The method of claim 1, wherein providing the computerized device component with access to the entity state data further comprises communicating an event corresponding to a change in an entity attitude.

Providing the computerized device component with access to the entity state data further comprises communicating one or more commands for the computerized device component from the one or more entities. The method of claim 1.

The method of claim 1, wherein providing the computerized device component with access to the entity state data further comprises generating control data based on entity state data corresponding to various time points. .

The method of claim 1, wherein extracting the entity state data further comprises determining a position and orientation of a device being operated by the one or more entities.

The method of claim 1, wherein extracting the entity state data further comprises removing unwanted perturbations in the multi-sensor input data.

The method of claim 1, wherein accessing the shared library further comprises configuring the plurality of sensor modules to refine the multiple sensor input data.

The method of claim 1, wherein extracting the entity state data further comprises defining a symbolic activity that is converted to a command for the computerized device component.

The method of claim 1, further comprising updating the entity state data in response to an entity movement.

The method of claim 1, wherein extracting the entity state data further comprises creating an environmental model associated with the one or more entities.

Extracting the entity state data comprises extracting a first portion of entity state data associated with a first entity and a second portion of entity state data associated with a second entity; The method of claim 1, further comprising correlating the first part with the second part to determine an entity interaction.

In a computing environment, including an interaction mechanism configured to provide a sensor fusion interface to a computerized device component, for each entity in the environment, the sensor fusion interface generates a profile that includes entity state data. Exposing the profile to the computerized device component and instructing the common knowledge data component to update the profile in response to an entity activity, wherein the common knowledge data component is configured in accordance with a schema. A system configured to integrate multiple sensor input data from multiple sensor modules and identify the entity activity based on the multiple sensor input data.

The interaction mechanism is:
Based on the entity activities, operating the computerized devices in the physical environment,
Controlling a virtual character in a virtual environment generated by the computerized device component;
Initializing the plurality of sensor modules in response to the computerized device component;
Identifying collisions between multiple entities, and
Publish an event indicating that an entity's movement has gone out of scope of the device
The system of claim 12, further configured to perform at least one of the following:

The plurality of sensor modules may be a camera, microphone, digitizer, motion processor, game controller, speech recognition module, gesture recognition module, face recognition module, mobile phone or pointing device, or camera, microphone, digitizer, motion processor, game The system according to claim 12, comprising any combination of a controller, speech recognition module, gesture recognition module, face recognition module, mobile phone or pointing device.

A computer program for causing a processor to execute the method according to any one of claims 1 to 11.