JP2016194798A - Information processing device, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device, an information processing method, and a program which can improve user convenience in the case where a sensor is used for sensing a predetermined region of space.SOLUTION: Provided is an information processing device equipped with a processing unit which performs processing to generate preparatory information on the basis of first output information about a first object as obtained by a sensor for sensing a predetermined region of real space, and on the basis of second output information about a second object as obtained by a device carried by a user, wherein the preparatory information is used to generate operational information on the basis of third output information obtained by the sensor.SELECTED DRAWING: Figure 12

Description

  The present disclosure relates to an information processing apparatus, an information processing method, and a program.

  A technique for calibrating the positional relationship between cameras has been developed. As a technique for calibrating the positional relationship between cameras by calculating an F (Fundamental) matrix using a light emitting sphere as a calibration jig, for example, a technique described in Patent Document 1 below can be cited.

JP 2009-071844 A

  For example, in a system that enables operations such as application execution based on the recognition result of the movement of an object such as a user, a sensor that senses a predetermined range in real space, that is, the movement of the object can be recognized In order to improve the operational feeling, it is important to calibrate the correct sensor (recognition device) more accurately.

  Sensor calibration can be realized, for example, by using a light emitting sphere described in Patent Document 1 or a dedicated calibration jig such as a calibration board. Here, for example, when a new sensor is added or a calibrated sensor moves, or when the environment changes, it is desirable to calibrate the sensor again. However, if the sensor cannot be calibrated without a dedicated calibration jig such as a calibration board as described above, the sensor may not be easily calibrated again. .

  The present disclosure proposes a new and improved information processing apparatus, information processing method, and program capable of improving user convenience when a sensor that senses a predetermined range of space is used. .

According to the present disclosure, the first output information related to the first target acquired from the sensor that senses a predetermined range of the real space and the second related to the second target acquired from the device carried by the user. And a processing unit that performs processing for generating preparation information based on the output information of
An information processing apparatus is provided in which the preparation information is used to generate operation information based on third output information acquired from the sensor.

  Moreover, according to this indication, it is related with the 1st output information regarding the 1st object acquired from the sensor which senses the predetermined range of real space, and the 2nd object acquired from the apparatus carried by the user. A step of generating preparation information based on the second output information, and the preparation information is used to generate operation information based on the third output information acquired from the sensor. An information processing method executed by the information processing apparatus is provided.

  Moreover, according to this indication, it is related with the 1st output information regarding the 1st object acquired from the sensor which senses the predetermined range of real space, and the 2nd object acquired from the apparatus carried by the user. In order to cause the computer to execute a step of generating preparation information based on the second output information, and the preparation information generates operation information based on the third output information acquired from the sensor A program used for

  According to the present disclosure, when a sensor that senses a predetermined range of space is used, it is possible to improve user convenience.

  Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.

It is explanatory drawing for demonstrating the outline | summary of the information processing method which concerns on this embodiment. It is explanatory drawing for demonstrating the outline | summary of the information processing method which concerns on this embodiment. It is explanatory drawing for demonstrating an example of the process which concerns on the information processing method which concerns on this embodiment. It is explanatory drawing which shows an example of the data which show the object world model which concerns on this embodiment. It is explanatory drawing which shows an example of the data which show the object world model which concerns on this embodiment. It is explanatory drawing for demonstrating an example of the process which concerns on the information processing method which concerns on this embodiment. It is explanatory drawing for demonstrating an example of the process which concerns on the information processing method which concerns on this embodiment. It is explanatory drawing which shows an example of the data which show the object world model which concerns on this embodiment. It is a flowchart which shows an example of the process which concerns on the information processing method which concerns on this embodiment. It is explanatory drawing for demonstrating an example of the use case which can apply the information processing method which concerns on this embodiment. It is explanatory drawing for demonstrating the other example of the use case which can apply the information processing method which concerns on this embodiment. It is a block diagram which shows an example of a structure of the information processing apparatus which concerns on this embodiment. It is explanatory drawing which shows an example of the hardware constitutions of the information processing apparatus which concerns on this embodiment.

  Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

In the following, description will be given in the following order.
1. 1. Information processing method according to this embodiment 2. Information processing apparatus according to this embodiment Program according to this embodiment

(Information processing method according to this embodiment)
Before describing the configuration of the information processing apparatus according to the present embodiment, first, the information processing method according to the present embodiment will be described. Hereinafter, the information processing method according to the present embodiment will be described by taking as an example the case where the information processing apparatus according to the present embodiment performs the processing according to the information processing method according to the present embodiment.

[1] Outline of Information Processing Method According to the Present Embodiment In a system that enables operations such as application execution based on the recognition result of the movement of the user's hand, arm, etc., in order to improve UX (User Experience) In addition, a sensor for sensing a predetermined range in the real space is disposed in the space.

  Here, as one method for improving the user's UX using the system as described above, the detection accuracy of the sensor can be further increased. In addition, as one method for improving the detection accuracy of the sensor, for example, when the sensor is newly installed or when the position where the sensor is installed is moved, the sensor is calibrated. Is mentioned.

  Sensor calibration can be realized, for example, by using a light emitting sphere described in Patent Document 1 or a dedicated calibration jig such as a calibration board.

  However, each time a new sensor is installed, or every time it is desirable to calibrate the sensor, such as every time the position where the sensor is installed, the dedicated calibration as described above occurs. When calibration of a sensor using a jig is performed, there is a risk of placing an excessive burden on the user. In addition, if the sensor calibration using the dedicated calibration jig as described above is performed every time it is desirable to calibrate the sensor, there is no dedicated calibration jig. Since the sensor cannot be calibrated, there is a possibility that the sensor cannot be easily calibrated again.

  Therefore, the information processing apparatus according to the present embodiment indicates output information acquired from a sensor that senses a predetermined range in real space and a device that is carried by the user (hereinafter referred to as “portable device”). The sensor is calibrated using the output information obtained from (2).

  More specifically, the information processing apparatus according to the present embodiment uses output information related to the first target acquired from the sensor and output information related to the second target acquired from the portable device. Then, the sensor is calibrated.

  Here, the first target is a target detected based on output information acquired from the sensor. Examples of the first target according to the present embodiment include any target that can be detected by the sensor according to the present embodiment, such as the hand and arm of the user of the portable device.

  The second target is a target that is detected based on output information acquired from a portable device. An example of the second target will be described later.

  The information processing apparatus according to the present embodiment, for example, when the first target and the second target are related targets, such as when the first target moves, the second target also moves correspondingly. The sensor is calibrated using the output information related to the first target acquired from the sensor and the output information related to the second target acquired from the portable device. An example of processing for determining whether the first target and the second target are related in the information processing apparatus according to the present embodiment will be described later.

  In the following, the output information related to the first target acquired from the sensor will be referred to as “first output information”, and the output information related to the second target acquired from the portable device will be referred to as “second output information”. It shows.

  Examples of the sensor according to the present embodiment include an image sensor such as an image sensor constituting a stereo image sensor and a depth sensor of an arbitrary system such as a TOF (Time-Of-Flight) system. In addition, the sensor according to the present embodiment may be an arbitrary sensor that can output, for example, output information that can be used for recognition of a gesture in a space with a space as a sensing range. That is, the sensor according to the present embodiment is a sensor for sensing a user operation instruction, for example. In the use case shown below, a case where the sensor according to the present embodiment is an image sensor constituting a stereo image sensor will be described as an example.

  As output information (for example, first output information or third output information to be described later) acquired from the sensor according to the present embodiment, sensing such as captured image data or data indicating a depth value, for example. Data that can obtain position information of an object within a range is included.

  Moreover, as a portable device according to the present embodiment, for example, a wearable device used by being worn on the user's body, a device used by the user to hold in hand, a bag or clothes worn by the user, etc. And any device that the user wears directly or indirectly. Examples of the wearable device according to the present embodiment include a device worn on the hand or arm, such as a “watch-type device” or an “accessory-type device such as a ring type, bracelet type, or nail type”, or “glasses”. Type device "," cloth type, shoe type, hat type device "and the like.

  As 2nd output information acquired from the portable apparatus which concerns on this embodiment, the data which can obtain the detection result of the object shown to the following (a)-(c), for example are mentioned.

(A) Detection result regarding the amount of movement of the portable device (detection result corresponding to past and present movement)
As a detection result related to the movement amount of the portable device, for example, a movement amount vector can be cited.

  As 2nd output information acquired from the portable apparatus which concerns on said (a), detecting the movement of the portable apparatus with which the portable apparatus which concerns on this embodiment is equipped, for example Such as data indicating the detection value of an arbitrary motion sensor (for example, an acceleration sensor, a gyro sensor, etc.) capable of recording, or data indicating the detection value of an external sensor connected to the portable device. Arbitrary data that can be used to calculate the movement amount vector of the. Further, the second output information acquired from the portable device according to (a) may be data indicating a movement amount vector of the portable device.

  Examples of the second object according to (a) include any object that can be detected by a motion sensor or the like, such as a user's hand or arm of the user of the portable device.

(B) Detection result capable of predicting the behavior of a user carrying a portable device (detection result corresponding to future movement)
As a detection result capable of predicting the behavior of a user carrying a portable device (hereinafter, simply referred to as “user”), for example, spatial coordinates focused by the user are Can be mentioned. When a user performs some operation such as a pointing operation, the user often turns his gaze toward the operation target. Therefore, it is possible to predict the behavior of the user who owns the portable device by detecting the spatial coordinates that the user is paying attention to.

  As 2nd output information acquired from the portable apparatus which concerns on said (b), the detection value of the arbitrary sensors which can pinpoint a user's eyes | visual_axis, such as an image sensor, or can estimate, for example Data to be indicated (for example, data indicating coordinates that the user is paying attention to). In addition, the second output information acquired from the portable device according to the above (b) includes, for example, more accurate estimation of the user's line of sight, such as a detection value of a gyro sensor that detects the movement of the user's face. Data indicating a value that can be increased may be included.

  As a 2nd object which concerns on said (b), the spatial coordinate which the user is paying attention is mentioned, for example.

(C) The detection result regarding the amount of movement of the portable device and the detection result capable of predicting the behavior of the user The second based on the second output information acquired from the portable device according to the present embodiment The detection result of the second target may be the detection result related to the movement amount of the portable device shown in (a) above and the detection result capable of predicting the user behavior shown in (b) above. .

  1 and 2 are explanatory diagrams for explaining an overview of the information processing method according to the present embodiment. FIG. 1 shows an example of an information processing system according to the present embodiment including an information processing apparatus 100 that performs processing according to the information processing method according to the present embodiment. FIG. 2 shows an example of a use case to which the information processing system according to this embodiment is applied. Specifically, FIG. 2 shows a use case in which a user performs an operation using the body such as a pointing operation on a screen S on which a UI (User Interface) is displayed, and operates the UI. .

  The information processing system according to the present embodiment includes, for example, an information processing apparatus 100, a sensor 200, and a portable apparatus 300.

  Although FIG. 1 shows one sensor and one portable device, the information processing system according to the present embodiment includes a plurality of one or both of the sensor and the portable device. It may be. Hereinafter, a case where a plurality of sensors included in the information processing system according to the present embodiment is generically referred to or one of the sensors included in the information processing system according to the present embodiment is indicated as “sensor 200”. There is. In the following, a plurality of portable devices included in the information processing system according to the present embodiment will be collectively referred to, or one of the portable devices included in the information processing system according to the present embodiment will be described. It may be indicated as “portable device 300”.

  In the information processing system according to the present embodiment, for example, the information processing apparatus 100 and the sensor 200 may be an integrated apparatus. Hereinafter, a case where the information processing apparatus 100 and the sensor 200 are separate apparatuses as illustrated in FIG. 1 will be described as an example.

  The information processing apparatus 100 performs processing for generating preparation information based on the first output information acquired from the sensor 200 and the second output information acquired from the portable apparatus 300.

  The preparation information according to the present embodiment is information (data) for controlling the association between the sensor and a predetermined coordinate system, for example. Specifically, the preparation information according to the present embodiment is information used for processing for converting target position information obtained based on sensor output information into coordinate values in a predetermined coordinate system.

  Here, the coordinate value in the predetermined coordinate system in which the position information is converted is used, for example, to detect an operation using the body such as a pointing operation on the screen S on which the UI is displayed. That is, it can be said that the preparation information according to the present embodiment is information used for generating operation information based on output information acquired from a sensor, for example. Below, among the output information acquired from a sensor, the process which produces | generates preparation information for the output information (output information used in order to obtain operation information) used in order to acquire the positional information on object as mentioned above, for example The third output information is distinguished from the first output information used in the above.

  In the following, for convenience of explanation, the first output information and the third output information are described separately, but the third output information according to the present embodiment is the first output information according to the present embodiment. In addition, the first output information according to the present embodiment can serve as the third output information according to the present embodiment.

  As the predetermined coordinate system according to the present embodiment, for example, a spatial coordinate system having an origin at an arbitrary position of the screen S shown in FIG. 2 (hereinafter, sometimes referred to as “screen coordinate system”) may be mentioned. Here, on the screen S shown in FIG. 2, a display in which an operation target (for example, an icon related to a UI) operated based on the third output information of the sensors 200 </ b> A and 200 </ b> B (an example of the sensor 200) is displayed. It is a screen. That is, it can be said that the screen coordinate system is a coordinate system associated with a display screen on which an operation target operated based on the first output information of the sensor 200 is displayed.

  The predetermined coordinate system according to the present embodiment is not limited to the screen coordinate system, and includes a spatial coordinate system having an origin at an arbitrary position that can represent a position in space. That is, the position in space can be expressed by coordinates indicating an absolute position with respect to the origin of a predetermined coordinate system. Hereinafter, the coordinates represented by the predetermined coordinate system according to the present embodiment may be referred to as “absolute space coordinates”.

  As the position information based on the third output information of the sensor 200, for example, coordinate data in which the position is represented by the coordinate value of the spatial coordinate system relative to the sensor 200 can be cited. The spatial coordinate system relative to the sensor 200 is, for example, a spatial coordinate system having an arbitrary position of the sensor 200 as an origin. Hereinafter, the coordinates in the spatial coordinate system relative to the sensor 200 may be referred to as “relative space coordinates”.

  For example, when the third output information is captured image data or data indicating a depth value, the process for obtaining position information based on the third output information is, for example, information such as the information processing apparatus 100 or a server. This is performed in an external device of the processing device 100. For example, the information processing apparatus 100 and the external apparatus can obtain position information by processing according to an arbitrary method that can obtain position information from image data obtained by imaging the third output information, data indicating a depth value, or the like. obtain.

  The preparation information according to the present embodiment is obtained, for example, by obtaining a parameter for converting relative space coordinates to absolute space coordinates using a dedicated calibration jig such as a light emitting sphere described in Patent Document 1. The preparation information according to the present embodiment can also be obtained by processing for generating preparation information according to the present embodiment.

  The process of generating the preparation information according to the present embodiment is preparation information that is information used to calculate a predetermined coordinate value in a predetermined coordinate system based on the third output information as described above, for example. Is a process of correcting By performing the process of generating the preparation information according to the present embodiment, the corrected preparation information may be newly generated, or the contents of the preparation information to be corrected may be overwritten and updated. A specific example of processing for generating preparation information according to the present embodiment will be described later.

  The sensor 200 is provided in the space, for example, as shown in the sensors 200A and 200B in FIG. The sensor 200 senses a predetermined range in the real space and transmits the first output information to the information processing apparatus 100. In the use case shown in FIG. 2, the sensors 200 </ b> A and 200 </ b> B detect a user's body part (for example, an arm or a finger) or a device 300 carried by the user as a target.

  Here, the sensor 200 communicates with the information processing apparatus 100 wirelessly or by wire, for example, via a network (or directly). As a network according to the present embodiment, for example, a wired network such as a LAN (Local Area Network) or a WAN (Wide Area Network), a wireless network such as a wireless LAN (WLAN: Wireless Local Area Network), or TCP / IP ( Examples include the Internet using a communication protocol such as Transmission Control Protocol / Internet Protocol.

  The portable device 300 is used while being worn on a user's arm or the like, for example, as shown in the portable devices 300A, 300B, and 300C of FIG. In the use case shown in FIG. 2, the movement amount vector based on the second output information acquired from the portable devices 300 </ b> A and 300 </ b> B is the detection result related to the movement amount of the portable device shown in (a) above. Applicable. In the use case shown in FIG. 2, the spatial coordinates specified based on the second output information acquired from the portable device 300 </ b> C can predict the user's behavior shown in (b) above. Corresponds to the detection result.

  The portable device 300 performs detection using a sensor provided or a connected external sensor, and transmits second output information corresponding to the detection result to the information processing device 100. The portable device 300 communicates with the information processing device 100 wirelessly or by wire, for example, via a network (or directly).

  Here, the portable device 300 may transmit the second output information to the information processing device 100 when it is determined that the device 300 is present in the space in which the sensor 200 is provided, for example. For example, when the position of the own device (portable device 300) is included in the set area or when communication with the sensor 200 is established, It determines with existing in the space in which the sensor 200 is provided.

  As described above, when it is determined that the sensor 200 exists in the space in which the sensor 200 is provided, the information processing apparatus 100 transmits the second output information to the information processing apparatus 100, so that the information processing apparatus 100 is in the same space. There is an increased possibility that the preparation information can be corrected based on the first output information acquired from the existing sensor 200 and the second output information acquired from the portable device 300. Therefore, the information processing apparatus 100 can obtain preparation information that can calculate the coordinate value in the predetermined coordinate system more accurately.

  For example, as illustrated in FIG. 1, the information processing apparatus 100 obtains the preparation information based on the first output information acquired from the sensor 200 and the second output information acquired from the portable apparatus 300. Modify and generate preparation information. By generating the preparation information by the process of generating the preparation information, the association between the sensor 200 and the predetermined coordinate system is controlled.

  Here, when processing related to the information processing method according to the present embodiment is performed, a dedicated calibration required when an existing technique is used for controlling the association between the sensor 200 and a predetermined coordinate system. No need for a calibration jig.

  In addition, when the processing related to the information processing method according to the present embodiment is performed, even when a new sensor is added or a calibrated sensor moves, the preparation is performed. The sensor 200 can be calibrated by appropriately correcting the information. Therefore, when the process according to the information processing method according to the present embodiment is performed, the calibration of the sensor 200 can be easily performed again.

  Therefore, by performing the processing related to the information processing method according to the present embodiment, the convenience of the user can be improved when a sensor that senses a predetermined range of space is used.

[2] Processing Related to Information Processing Method According to Present Embodiment Next, processing related to the information processing method according to the present embodiment will be described more specifically. Below, the case where the information processing apparatus 100 shown in FIG. 1 performs the process which concerns on the information processing method which concerns on this embodiment is mentioned as an example.

  The information processing apparatus 100 relates to first output information related to the first target acquired from the sensor 200 that senses a predetermined range in real space, and to a second target acquired from the device 300 carried by the user. Based on the second output information, processing for generating preparation information is performed.

  FIG. 3 is an explanatory diagram for explaining an example of processing related to the information processing method according to the present embodiment.

  The information processing apparatus 100 uses, for example, the target world model M1 for each sensor 200 and the target world model M2 for each portable apparatus 300, so that the preparation information (sensor 200A preparation shown in FIG. Correct information P).

  4 and 5 are explanatory diagrams illustrating an example of data indicating the target world model according to the present embodiment. FIG. 4 illustrates an example of data indicating the target world model M1 for each sensor 200, and FIG. 5 illustrates an example of data indicating the target world model M2 for each portable device 300.

  The target world model M1 is, for example, a target in space (hereinafter referred to as “object”) detected based on the first output information of the sensor 200 and the spatial coordinates of the object are associated with each other. This is a data model held in time series. As data indicating the target world model M1, for example, as shown in FIG. 4, data indicating an object detected based on the first output information of the sensor 200 is associated with the relative space coordinates of the object, An example is a table (or database) recorded in time series.

  The information processing apparatus 100 is based on, for example, first output information acquired from the sensor 200, and a storage unit (described later) included in the information processing apparatus 100 or an external recording medium connected to the information processing apparatus 100 For example, the data indicating the target world model M1 stored in the recording medium is appropriately updated. Note that, as described above, the process of obtaining the position information based on the first output information may be performed in the information processing apparatus 100 or may be performed in an external apparatus of the information processing apparatus 100.

  The information processing apparatus 100 changes the relative spatial coordinates of the object detected based on the first output information of the sensor 200, for example, by referring to data indicating the target world model M1 as shown in FIG. The movement of the object viewed from 200 can be acquired as the detection result of the first target based on the first output information.

  Note that the data indicating the target world model M1 is not limited to the example shown in FIG. For example, data indicating the time corresponding to the first output information acquired from the sensor 200 may be further associated with the data indicating the target world model M1. The time corresponding to the first output information acquired from the sensor 200 is, for example, data indicating the time when the first output information is acquired or the time indicated by the time stamp of the first output information. Data etc. are mentioned.

  The target world model M2 is associated with, for example, the portable device 300 and the detection result of the second target based on the second output information acquired from the portable device 300, It is a data model held in time series. The data indicating the target world model M2 includes, for example, data indicating the portable device 300 as shown in FIG. 5 and a movement amount vector (detection results corresponding to past and current movements shown in (a) above). An example) is associated with target space coordinates (an example of a detection result corresponding to a future movement shown in (b) above) that is predicted to be directed by the user, and is recorded in time series ( Or database).

  The information processing apparatus 100 is connected to a storage unit (described later) included in the information processing apparatus 100 or the information processing apparatus 100 based on, for example, second output information acquired from the portable apparatus 300. Data indicating the target world model M2 stored in the recording medium such as an external recording medium is appropriately updated.

  For example, when the detection result shown in (a) above is obtained based on the second output information acquired from the portable device 300, the information processing apparatus 100 uses the movement amount vector shown in FIG. Recorded in data indicating the model M2. For example, based on the second output information acquired from the portable device 300, the information processing apparatus 100 uses the spatial coordinates of the object at the time before the movement and the spatial coordinates of the object at the time after the movement. Find the travel vector. Then, when the movement amount vector is obtained, the information processing apparatus 100 records the movement amount vector in data indicating the target world model M2.

  Further, for example, when the detection result shown in (b) above is obtained based on the second output information acquired from the portable device 300, the information processing device 100 uses the target space coordinates shown in FIG. Record in data indicating the target world model M2. Here, the target spatial coordinates are specified by using any technique capable of specifying the spatial coordinates such as SLAM (Simultaneous Localization and Mapping).

  The information processing apparatus 100 refers to, for example, data indicating the target world model M2 as illustrated in FIG. 5, and a detection result related to the movement amount of the device being carried and a detection result indicating a predicted user movement One or both of them can be acquired as the detection result of the second object based on the second output information.

  Note that the data indicating the target world model M2 is not limited to the example shown in FIG.

  For example, the data indicating the target world model M2 may be further associated with data indicating the time corresponding to the second output information acquired from the portable device 300. The time corresponding to the information acquired from the portable device 300 is, for example, data indicating the time when the second output information is acquired or the time indicated by the time stamp of the second output information. Data etc. are mentioned.

  Further, the data indicating the target world model M2 may not include, for example, the target space coordinates (an example of the detection result shown in (b) above).

  The information processing apparatus 100 receives data indicating the target world model M1 based on the first output information acquired from the sensor 200 and the target world model M2 based on the second output information acquired from the portable apparatus 300. Based on the data shown, the preparation information is corrected to generate preparation information. More specifically, the information processing apparatus 100 corrects the preparation information by performing, for example, any one of processes (1) to (3) below.

(1) First Example of Process for Generating Preparation Information The information processing apparatus 100 is configured to detect, for example, first target motion information (first target detection result based on first output information acquired from the sensor 200). And the second target motion information based on the second output information acquired from the portable device 300 (an example of the detection result of the second target). Then, the information processing apparatus 100 corrects the preparation information based on the movement comparison result. Here, for example, the comparison between the motion information of the first target and the motion information of the second target corresponds to an example of a process for determining whether the first target and the second target are related targets. To do. In addition, when the preparation information is corrected based on the movement comparison result, for example, this corresponds to the case where the second object moves according to the movement of the first object, and the first object and the second object Is a related subject.

  Here, as the motion information according to the present embodiment, for example, a movement amount vector for each object may be mentioned. The movement amount vector according to the present embodiment can be obtained from, for example, the spatial coordinates of the object at the first time point and the spatial coordinates of the object at the second time point after the first time point.

  For example, the information processing apparatus 100 obtains a movement amount vector from each of data indicating the target world model M1 and data indicating the target world model M2. Further, for example, the information processing apparatus 100 may obtain a movement amount vector at a corresponding time point. The corresponding time points according to the present embodiment include, for example, the same time point or a time point within a set error range. The error may be a fixed value set in advance or a variable value that can be set by an operation of the user of the information processing apparatus 100 or the like.

  Further, for example, the information processing apparatus 100 determines whether or not the correlation between the movement amount vectors obtained from the data indicating the target world model M1 and the data indicating the target world model M2 is high. Here, the determination as to whether or not the correlation between the movement amount vectors is high corresponds to the determination as to whether or not the detection value of the sensor 200 and the detection value of the portable device 300 are the same object detection result. To do.

  For example, when the correlation coefficient of the movement amount vector is set to a threshold (for example, 0 <threshold <1) or more, or when the correlation coefficient is larger than the threshold, the information processing apparatus 100 It is determined that the correlation of the movement amount vector is high.

Here, as an example of the case where the correlation of the movement amount vector at the corresponding time is high, for example, the following example is given.
When the first target detected based on the first output information of the sensor 200 is the same as the second target detected based on the second output information of the portable device 300 (for example, The movement of the user's arm is detected in both the sensor 200 and the portable device 300)
When the first target detected based on the first output information of the sensor 200 and the second target detected based on the second output information of the portable device 300 are related targets (For example, when the sensor 200 detects the palm of the user and the portable device 300 detects the movement of the user's arm)

  For example, when it is determined that the correlation between the movement amount vectors is high, the information processing apparatus 100 moves based on the movement amount vector based on the information acquired from the sensor 200 and the information acquired from the portable apparatus 300. A correction parameter for correcting the deviation from the quantity vector (hereinafter, referred to as “first correction parameter”) is calculated.

  The first correction parameter according to the present embodiment includes, for example, a movement amount vector based on the first output information acquired from the sensor 200 and a movement based on the second output information acquired from the portable device 300. It is obtained by obtaining a correction parameter for correcting the deviation from the quantity vector.

  Then, the information processing apparatus 100 corrects the preparation information with the first correction parameter. The correction of the preparation information in the process of generating the preparation information according to the first example corresponds to the correction of the positional deviation of the position of the first target based on the first output information.

  Note that the first correction parameter according to the present embodiment is not limited to the example described above.

  For example, the first correction parameter according to the present embodiment includes a time corresponding to the first output information acquired from the sensor 200 and a time corresponding to the second output information acquired from the portable device 300. It may be a correction parameter for further correcting the time lag.

  When there is a time lag between the time corresponding to the first output information acquired from the sensor 200 and the time corresponding to the second output information acquired from the portable device 300, the time lag is caused. Thus, there is a possibility that a shift occurs between the movement amount vector based on the first output information acquired from the sensor 200 and the movement amount vector based on the second output information acquired from the portable device 300. . The information processing apparatus 100 uses, for example, a movement amount vector based on the first output information acquired from the sensor 200 based on the correction value corresponding to the time difference, and the second output information acquired from the portable apparatus 300. One or both of the movement vector based on the correction is corrected. Then, the information processing apparatus 100 obtains a first correction parameter that further corrects the time lag, for example, by obtaining a correction parameter that corrects the deviation from the corrected movement amount vector.

  By correcting the preparation information with the first correction parameter that further corrects the time lag as described above, the information processing apparatus 100 has a time corresponding to the first output information and a time corresponding to the second output information. It is possible to obtain preparation information for further correcting the time lag.

  The information processing apparatus 100 corrects the preparation information by calculating the first correction parameter as described above, for example. In addition, the calculation method of the 1st correction parameter which concerns on this embodiment is not restricted above. The information processing apparatus 100 is “a positional deviation between the position of the object based on the first output information acquired from the sensor 200 and the position of the object based on the second output information acquired from the portable apparatus 300”, Or, “the time shift between the time corresponding to the positional deviation and the first output information acquired from the sensor 200 and the time corresponding to the second output information acquired from the portable device 300” is corrected. The first correction parameter can be calculated by any method capable of obtaining the correction parameter.

  Further, for example, when it is not determined that the correlation of the movement amount vector is high, the information processing apparatus 100 does not correct the preparation information.

  The information processing apparatus 100 performs, for example, the above-described process, thereby moving the first target motion information (an example of the detection result of the first target) based on the first output information acquired from the sensor 200, Preparation information based on the second target motion information (an example of the detection result of the second target) based on the second output information acquired from the portable device 300 and the comparison result (motion comparison result) Correct it.

  For example, the information processing apparatus 100 may record the calculated first correction parameter on a recording medium such as a storage unit (described later).

(2) Second Example of Process for Generating Preparation Information The information processing apparatus 100 is, for example, a spatial coordinate specified based on first output information acquired from the sensor 200 (an example of a first target detection result) ) And the spatial coordinates (an example of the detection result of the second object) specified based on the second output information acquired from the portable device 300. The information processing apparatus 100 corrects the preparation information based on the comparison result of the spatial coordinates. Here, for example, the comparison between the spatial coordinates specified based on the first output information and the spatial coordinates specified based on the second output information acquired from the portable device 300 is the first object. This corresponds to another example of processing for determining whether or not the second target is a related target.

  For example, when the first output information acquired from the sensor 200 indicates spatial coordinates, the information processing apparatus 100 uses the spatial coordinates indicated by the first output information acquired from the sensor 200. In addition, when the first output information acquired from the sensor 200 does not indicate the spatial coordinates, the information processing apparatus 100 uses an arbitrary technique that can specify the spatial coordinates such as SLAM, for example. The spatial coordinates are specified based on the first output information acquired from the sensor 200.

  In addition, the information processing apparatus 100 extracts, for example, target space coordinates corresponding to the first output information acquired from the sensor 200 from data indicating the target world model M2, and the extracted target space coordinates are carried around. Space coordinates based on the second output information acquired from the device 300. Here, as the target space coordinates corresponding to the first output information acquired from the sensor 200 extracted from the data indicating the target world model M2, for example, a space based on the first output information acquired from the sensor 200 is used. Target space coordinates (or target space coordinates whose distance is smaller than the threshold value) whose distance from the coordinates is equal to or less than a set threshold value are exemplified.

  Then, the information processing apparatus 100 calculates, for example, a correction parameter that corrects a deviation between the target space coordinates and the specified spatial coordinates as the second correction parameter. Further, for example, when there is no deviation between the target space coordinates and the specified space coordinates, the information processing apparatus 100 does not calculate the second correction parameter. Here, the second correction parameter according to the present embodiment corresponds to a correction parameter related to correction of the preparation information based on the comparison result of the spatial coordinates.

  Then, the information processing apparatus 100 corrects the preparation information with the calculated second correction parameter.

  The information processing apparatus 100 performs, for example, the above-described processing, and the spatial coordinates specified based on the first output information acquired from the sensor 200 and the second acquired from the portable apparatus 300. The preparation information is corrected based on the comparison result (spatial coordinate comparison result) with the spatial coordinates specified based on the output information.

  In addition, the information processing apparatus 100 records, for example, the calculated second correction parameter in a recording medium such as a storage unit (described later).

  Here, when the identification information indicating the user of the portable device 300 is acquired from the portable device 300 or when the identification information can be acquired from the portable device 300 The information processing apparatus 100 may cause the second correction parameter to be recorded on the recording medium in association with identification information indicating the user of the apparatus 300 being carried. For example, the information processing apparatus 100 can record the second correction parameter and the identification information in association with each other such as recording the second correction parameter and the identification information in a table (or database). And recording on a recording medium.

  As identification information which concerns on this embodiment, the arbitrary data (or data group) which can specify a user, such as data which show a user ID and a password, a user's biometric information (data), are mentioned, for example.

  The second correction parameter is, for example, as described above, the target space coordinates based on the second output information acquired from the portable device 300, that is, the detection result corresponding to the future movement shown in (b) above. Therefore, there is a high possibility that the correction parameter is unique for each user. Therefore, the information processing apparatus 100 records the second correction parameter and the identification information indicating the user of the portable device 300 on the recording medium in association with each other, so that the sensor 200 with the correction parameter more suitable for each user. Calibration can be realized.

(3) Third Example of Process for Generating Preparation Information The information processing apparatus 100, for example, generates the preparation information according to the first example shown in (1) above, and the second example shown in (2) above. It is also possible to modify the preparation information by, for example, one or both of the first correction parameter and the second correction parameter. is there. About an example of the process which combined the process which produces | generates the preparation information which concerns on the 1st example shown to said (1), and the process which produces | generates the preparation information which concerns on the 2nd example shown to the said (2), it mentions later. It shows in a specific example of processing related to the information processing method according to the present embodiment.

  The information processing apparatus 100 corrects the preparation information and generates the preparation information by performing the processing for generating the preparation information as described above, for example, as the processing related to the information processing method according to the present embodiment. By generating the preparation information by the process of generating the preparation information, the association between the sensor 200 and the predetermined coordinate system is controlled.

Further, the information processing device 100 generates the preparation information when both the first output information acquired from the sensor 200 and the second output information acquired from the portable device 300 are acquired. The processing to be performed can be performed, for example, at the following timing.
・ Periodic (intermittent) or non-periodic ・ When a user's predetermined motion is detected

  Here, examples of the predetermined operation of the user include a user operation such as a set gesture. The content of the predetermined operation according to the present embodiment is transmitted to the user via, for example, a physical medium such as paper or an electronic medium such as an online manual.

  Note that the method of transmitting the predetermined operation according to the present embodiment to the user is not limited to the above.

  For example, the information processing apparatus 100 controls notification for performing a predetermined operation, and notifies the user of the content of the predetermined operation by causing the apparatus (the information processing apparatus 100) or an external device to perform the notification. It is also possible to cause the user to perform a predetermined operation. The information processing apparatus 100, for example, a visual notification by displaying characters and images on a display screen, an auditory notification by outputting sound from a sound output device such as a speaker, or a combination of these notifications The content of the predetermined operation is transmitted to the user by performing the notification.

  6 and 7 are explanatory diagrams for explaining an example of processing related to the information processing method according to the present embodiment, and show an example of notification for causing the information processing apparatus 100 to perform a predetermined operation. ing.

  For example, as illustrated in FIG. 6, the information processing apparatus 100 causes the own apparatus (information processing apparatus 100) or an external apparatus to perform notification for performing a predetermined operation when a new sensor 200 is detected. . For example, when communication with a new sensor 200 is established, the information processing apparatus 100 performs notification as illustrated in FIG. 6.

  Further, for example, as illustrated in FIG. 7, the information processing apparatus 100 sends a notification for performing a predetermined operation when the movement of the position of the existing sensor 200 is detected, It may be performed by an external device. For example, when the movement of the position of the sensor 200 is detected based on the data related to the determination of the movement of the position acquired from the existing sensor 200, the information processing apparatus 100 performs notification as illustrated in FIG. .

  The movement of the installed position in the sensor 200 is, for example, a detection value of an external sensor such as an acceleration sensor connected to the sensor 200 or a sensor capable of detecting movement such as an acceleration sensor included in the sensor 200. Is determined by For example, the sensor 200 may perform the process related to the determination of the movement of the position where the sensor 200 is installed, or the information processing apparatus 100 may perform the process. When the process related to the determination of the position movement is performed by the sensor 200, the data related to the determination of the position movement includes, for example, data indicating the determination result of the position movement. In addition, when the information processing apparatus 100 performs the process related to the determination of the movement of the position, the data related to the determination of the movement of the position includes, for example, data indicating a detection value of a sensor included in the sensor 200.

  The information processing apparatus 100 performs visual notification as shown in FIGS. 6 and 7, so that the sensor 200 needs to be calibrated (or the sensor 200 is preferably calibrated). The content of the predetermined operation can be transmitted to the user, and the user can perform the predetermined operation. Needless to say, an example of notification for causing the information processing apparatus 100 to perform a predetermined operation is not limited to the examples illustrated in FIGS. 6 and 7.

  In addition, the process which concerns on the information processing method which concerns on this embodiment is not restricted to the process which produces | generates the said preparation information.

  For example, the information processing apparatus 100 further performs a predetermined process based on one or both of the first output information acquired from the sensor 200 and the preparation information as the process related to the information processing method according to the present embodiment. Is possible.

  Examples of the predetermined processing according to the present embodiment include one or both of (I) conversion processing shown below and (II) execution control processing shown below.

(I) Conversion processing The information processing apparatus 100 converts, for example, target position information obtained based on the first output information acquired from the sensor 200 into coordinate values in a predetermined coordinate system based on the preparation information. To do.

  The information processing apparatus 100, for example, the spatial coordinates recorded in the data indicating the target world model M1 of the sensor 200 (an example of the detection result of the first target based on the first output information acquired from the sensor 200). Are converted into coordinate values in a predetermined coordinate system using the preparation information. Then, the information processing apparatus 100 reflects the converted result on, for example, the target world model (for example, the target world model M3 shown in FIG. 3) in the entire target space.

  FIG. 8 is an explanatory diagram illustrating an example of data indicating the target world model according to the present embodiment, and illustrates an example of data indicating the target world model M3 in the entire space to be processed.

  The target world model M3 in the entire space is, for example, an object detected from the target space, the absolute coordinates in the space of the object, and the portable device 300 corresponding to the object are associated with each other. It is a data model held in time series. The absolute coordinates in the space are expressed with the set position in the space as the origin, for example. As data indicating the target world model M3, for example, as shown in FIG. 8, data indicating an object detected from a target space, absolute coordinates in the space of the object, and a portable object corresponding to the object. A table (or database) that is associated with the device 300 and is recorded in time series is exemplified.

(II) Execution Control Processing The information processing apparatus 100 converts the target position information obtained based on the first output information acquired from the sensor 200 into coordinate values in a predetermined coordinate system converted by preparation information, for example. Based processing (hereinafter may be referred to as “processing based on the converted detection result”).

  Examples of the control target to be processed by the information processing apparatus 100 include one or both of the own apparatus (information processing apparatus 100) and an external apparatus of the information processing apparatus 100.

  For example, the information processing apparatus 100 causes the control target to perform conversion detection based on a change in the target world model M3 in the entire space, that is, a change in the position of the object in the space (coordinate value in a predetermined coordinate system). Determine processing based on results. Then, the information processing apparatus 100 causes the control target to perform processing based on the converted detection result by transmitting a processing request including a command for executing the determined processing to the control target.

  Here, as a process based on the converted detection result, for example, a sensor that executes an application corresponding to an operation in accordance with an operation on the UI displayed on the screen S (example in the use case shown in FIG. 2) or the like. Arbitrary processing that can be performed using the detection result of the object based on the first output information acquired from 200 is given.

  The information processing apparatus 100 performs, for example, one or both of (I) conversion processing and (II) execution control processing as the predetermined processing. Note that the predetermined processing according to the present embodiment is not limited to the above (I) conversion processing and (II) execution control processing, and the information processing apparatus 100, for example, uses one of the first output information and the preparation information. Alternatively, any process that can be performed based on both can be performed as the predetermined process.

  The information processing apparatus 100 according to the present embodiment includes, for example, “the process for generating the preparation information”, “the process for generating the preparation information, and the predetermined process as processes related to the information processing method according to the embodiment. Process ".

  Note that “the process for generating the preparation information”, “the process for generating the preparation information, and the predetermined process” are obtained by separating the processes related to the information processing method according to the present embodiment for convenience. Therefore, the process according to the information processing method according to the present embodiment can be regarded as, for example, “the process of generating the preparation information” as two or more processes (depending on an arbitrary separation method). In addition, the process according to the information processing method according to the present embodiment can be regarded as, for example, “the process for generating the preparation information and the predetermined process” as one process. It can also be regarded as two or more processes (depending on an arbitrary separation method).

[3] Specific Example of Processing According to Information Processing Method According to This Embodiment Next, a specific example of processing according to the information processing method according to this embodiment in the information processing apparatus 100 will be described.

  FIG. 9 is a flowchart illustrating an example of processing according to the information processing method according to the present embodiment. Here, for example, the processing of steps S104 to S120 illustrated in FIG. 9 corresponds to an example of processing for generating the preparation information. Further, for example, the process in step S122 shown in FIG. 9 corresponds to an example of the process (I) (conversion process), and the process in step S124 shown in FIG. 9 is performed in the process (II) (execution control process). ).

  The information processing apparatus 100 updates data indicating the target world model M1 of the sensor 200 based on the first output information acquired from the sensor 200 (S100). For example, when data indicating the target world model M1 corresponding to the sensor 200 is not stored in the recording medium, the information processing apparatus 100 creates and updates data indicating the target world model M1 as illustrated in FIG. To do. For example, when data indicating the target world model M1 corresponding to the sensor 200 is stored in the recording medium, the information processing apparatus 100 updates the stored data indicating the target world model M1.

  The information processing apparatus 100 updates the data indicating the target world model M2 of the portable device 300 based on the second output information acquired from the portable device 300 (S102). For example, if the data indicating the target world model M2 corresponding to the portable device 300 is not stored in the recording medium, the information processing apparatus 100 stores the data indicating the target world model M2 as illustrated in FIG. Create and update. For example, when data indicating the target world model M2 corresponding to the portable device 300 is stored in the recording medium, the information processing apparatus 100 stores the data indicating the stored target world model M2. Update.

  Although FIG. 9 shows an example in which the process of step S102 is performed after the process of step S100 is performed, the process in the information processing apparatus 100 is not limited to the above. For example, the information processing apparatus 100 can perform the process of step S100 and the process of step S102 independently. Therefore, in the information processing apparatus 100, the process of step S100 and the process of step S102 may be performed in synchronization, or the process of step S100 may be performed after the process of step S102.

  The information processing apparatus 100 has, for example, a correlation between movement amount vectors of a data object indicating the target world model M1 of the sensor 200 and a data object indicating the target world model M2 corresponding to the portable apparatus 300. A high object is detected (S104). Here, the process of step S104 is performed by obtaining data corresponding to the same object from data indicating the target world model M1 corresponding to the sensor 200 and data indicating the target world model M2 corresponding to the portable device 300. This corresponds to the processing to be detected.

  For example, when the correlation coefficient of the movement vector is set to a threshold (for example, 0 <threshold <1) or more, or when the correlation coefficient is larger than the threshold, the information processing apparatus 100 It is determined that the correlation is high. Further, when the information processing apparatus 100 determines that the correlation of the movement amount vector is high, the information processing apparatus 100 determines that an object having a high correlation of the movement amount vector is detected.

  The information processing apparatus 100 determines whether an object having a high correlation is detected (S106).

  If it is not determined in step S106 that an object with high correlation has been detected, the information processing apparatus 100 performs, for example, processing from step S118 described below.

  If it is determined in step S106 that an object having a high correlation has been detected, the information processing apparatus 100 determines whether or not the shift of the movement amount vector is greater than or equal to a threshold (S108). Here, the determination in step S108 is based on the movement amount vector based on the first output information acquired from the sensor 200, and the movement amount vector based on the second output information acquired from the corresponding portable device 300. It corresponds to the processing to evaluate.

  Here, the threshold value related to the process of step S108 may be a fixed value set in advance, or may be a variable value that can be set by an operation of the user of the information processing apparatus 100 or the like. Further, in step S108, it may be determined whether or not the shift of the movement amount vector is larger than the threshold value.

  If it is not determined in step S108 that the displacement of the movement amount vector is greater than or equal to the threshold value, the information processing apparatus 100 performs processing from step S112 described later.

  If it is determined in step S108 that the displacement of the movement amount vector is greater than or equal to the threshold value, the information processing apparatus 100 corrects the preparation information corresponding to the sensor 200 (S110). For example, the information processing apparatus 100 performs processing for generating the preparation information according to the first example shown in (1) above, and corrects the preparation information using the calculated first correction parameter.

  As a specific example, the information processing apparatus 100 includes, for example, a movement amount vector based on first output information acquired from the sensor 200 and second output information acquired from the corresponding portable apparatus 300. A correction parameter that matches the movement amount vector based on is calculated as a first correction parameter. By calculating the first correction parameter as described above, the information processing apparatus 100 detects the position of the object based on the first output information acquired from the sensor 200 and the first apparatus acquired from the portable apparatus 300. The correction parameter for correcting the positional deviation from the position of the object based on the output information 2 can be calculated as the first correction parameter.

  Note that, as described above, the information processing apparatus 100, for example, has a time corresponding to the first output information acquired from the sensor 200 and a time corresponding to the first output information acquired from the portable apparatus 300. A correction parameter that further corrects the time lag from the above may be calculated as the first correction parameter.

  Then, the information processing apparatus 100 corrects the preparation information with the calculated first correction parameter.

  If it is not determined in step S108 that the displacement of the movement vector is greater than or equal to the threshold value, or if the process of step S110 is performed, it is determined whether the target space coordinates are set (S112). Here, the target space coordinates are set by obtaining a detection result corresponding to the future movement shown in (b) based on the second output information acquired from the portable device 300, for example. It is a spatial coordinate based on the 2nd output information acquired from the apparatus 300 currently carried.

  If it is not determined in step S112 that the target space coordinates are set, the information processing apparatus 100 performs processing from step S118 described below, for example.

  If it is determined in step S112 that the target space coordinates are set, the information processing apparatus 100 determines the spatial coordinates specified based on the first output information acquired from the sensor 200, and the target space coordinates. It is determined whether or not the deviation is greater than or equal to a threshold value (S114). Here, the determination in step S <b> 114 corresponds to a process of evaluating the space coordinates and the target space coordinates based on the first output information acquired from the sensor 200.

  Here, the threshold value related to the process of step S114 may be a fixed value set in advance or a variable value that can be set by an operation of the user of the information processing apparatus 100 or the like. Further, in step S114, it may be determined whether or not the deviation between the spatial coordinates specified based on the first output information acquired from the sensor 200 and the target spatial coordinates is larger than the threshold value.

  In step S114, when it is not determined that the difference between the spatial coordinates specified based on the first output information acquired from the sensor 200 and the target spatial coordinates is greater than or equal to the threshold value, the information processing apparatus 100, for example, will be described later. The processing from step S118 is performed.

  If it is determined in step S114 that the difference between the spatial coordinates specified based on the first output information acquired from the sensor 200 and the target spatial coordinates is equal to or greater than the threshold, the information processing apparatus 100 The preparation information corresponding to the sensor 200 is corrected (S116). For example, the information processing apparatus 100 performs processing for generating preparation information according to the second example shown in (2) above, and corrects the preparation information using the calculated second correction parameter.

  For example, the information processing apparatus 100 calculates, as the second correction parameter, a correction parameter that corrects a deviation between the target space coordinates and the specified space coordinates, for example. Then, the information processing apparatus 100 corrects the preparation information with the calculated second correction parameter.

  When the identification information corresponding to the device 300 being carried is acquired, the information processing apparatus 100 searches for the second correction parameter associated with the acquired identification information. When there is a second correction parameter associated with the identification information, the information processing apparatus 100 corrects the preparation information with the second correction parameter associated with the identification information.

  When the preparation information is selectively modified by the processing from the above steps S106 to S120, the information processing apparatus 100 uses the preparation information to convert the data indicating the target world model M1 of the sensor 200 into the target world in the entire space. The data representing the model M3 is reflected (S118).

  The information processing apparatus 100 performs, for example, the above processing (I) (conversion processing) to obtain the spatial coordinates of the data indicating the target world model M1 of the sensor 200 based on the preparation information based on the absolute spatial coordinates (predetermined coordinates Coordinate value in the system). Then, the information processing apparatus 100 records the converted absolute space coordinates in data indicating the target world model M3.

  The information processing apparatus 100 performs processing based on the change of the target world model M3 in the entire space (S120).

  For example, the information processing apparatus 100 determines a process based on the converted detection result by performing the process (II) (execution control process), and includes a process request including an instruction for executing the determined process. Is transmitted to the control target to cause the control target to perform processing based on the converted detection result.

  The information processing apparatus 100 performs, for example, the process illustrated in FIG. 9 as the process related to the information processing method according to the present embodiment.

  For example, when the process illustrated in FIG. 9 is performed, the preparation information is selected based on the first output information acquired from the sensor 200 and the second output information acquired from the portable device 300. Corrected.

  Therefore, for example, by performing the process illustrated in FIG. 9, the information processing apparatus 100 can control the association between the sensor 200 and a predetermined coordinate system.

  Further, for example, by performing the processing illustrated in FIG. 9, the information processing apparatus 100 converts the spatial coordinates based on the second output information acquired from the portable apparatus 300 to the absolute spatial coordinates based on the preparation information. Can be converted. Further, for example, by performing the processing illustrated in FIG. 9, the information processing apparatus 100 can cause the control target to perform processing based on the converted detection result.

  Therefore, the information processing apparatus 100 performs, for example, the process illustrated in FIG. 9, thereby increasing the possibility that the process intended by the user is performed by the user's action in a use case in which the UI illustrated in FIG. 2 is operated, for example. Therefore, user operability and convenience can be further improved.

  In addition, the process which concerns on the information processing method which concerns on this embodiment is not restricted to the example shown in FIG.

  For example, the information processing apparatus 100 does not need to perform the processing of steps S112 to S116 in FIG. 9, that is, does not need to correct the preparation information based on the second correction parameter.

  Further, for example, the information processing apparatus 100 may not perform “step S120 in FIG. 9” or “step S118 in FIG. 9 and S120”.

  Even if “Step S120 of FIG. 9” or “Step S118 of FIG. 9 and Step S120 of FIG. 9 are not performed, the information processing apparatus 100 obtains the preparation information by the process of generating the preparation information. Therefore, even if “step S120 in FIG. 9” or “step S118 in FIG. 9 and step S120 in FIG. Since it is possible to control the association with the coordinate system, it is possible to improve the convenience of the user when a sensor that senses a predetermined range of space is used.

[4] Use cases to which the information processing method according to the present embodiment can be applied Next, use cases to which the information processing method according to the present embodiment can be applied will be described. Hereinafter, a case where the information processing apparatus 100 performs the process related to the information processing method according to the present embodiment in the use case will be described as an example.

[4-1] First Example of Use Case With the preparation information set in the past due to changes in the usage environment such as the influence of sunlight, the accuracy of the detection result by a sensor such as an image sensor may be significantly deteriorated. . In addition, it is troublesome to cause the user to perform some calibration-related operation whenever the usage environment changes.

  When the information processing method according to the present embodiment is used, for example, using the second output information acquired from the wearable device (an example of the portable device 300) worn by the user, Since more suitable preparation information at the time can be obtained, the accuracy of the detection result of the object based on the first output information acquired from the sensor 200 can be kept high.

[4-2] Second Example of Use Case As described above, an object is detected based on the first output information acquired from the sensor 200 by performing the processing according to the information processing method according to the present embodiment. The accuracy of the result can be kept high.

  When the sensors are calibrated when the plurality of sensors 200 are installed in the space, for example, a second acquired from a wearable device worn by the user (an example of the portable device 300). Based on the output information, it is possible to expand the detection range by sharing information on the positions of the objects detected by the sensors 200 with each other.

  FIG. 10 is an explanatory diagram for explaining an example of a use case to which the information processing method according to the present embodiment can be applied. FIG. 10 shows an example in which a sensor 200B is newly installed in addition to the sensor 200A that has been installed.

  Here, as a result of the processing relating to the information processing method according to the present embodiment being performed on the newly installed sensor 200B, the object based on the first output information acquired from the sensor 200B as described above. The accuracy of the detection result can be made high.

  Note that the method of setting the accuracy of the detection result of the object based on the first output information acquired from the newly installed sensor 200 </ b> B is not limited to the example described above.

  For example, when the same object is detected based on the output information of each of the sensor 200A, the sensor 200B, and the portable device 300C, the movement amount vector based on the first output information acquired from the sensor 200A, the sensor The movement amount vector based on the first output information acquired from 200B and the movement amount vector based on the second output information acquired from the portable device 300C are the same.

  As described above, the information processing apparatus 100 uses the movement amount vector corresponding to each of the sensor 200A, the sensor 200B, and the portable apparatus 300C to make the target world model M1 of the sensor 200A, The association with the target world model M1 of the sensor 200B is automatically performed. For example, the first output information acquired from the newly installed sensor 200B by associating the target world model M1 of the newly installed sensor 200B with the target world model M1 of the installed sensor 200A. It is possible to make the accuracy of the detection result of the object based on the high accuracy state.

  Here, for example, the information processing apparatus 100 positively associates the target world model M1 of the sensor 200A with the target world model M1 of the sensor 200B by causing the user to perform notification as illustrated in FIG. You may attach

[4-3] Third Example of Use Case For example, when a plurality of sensors 200 are installed, the user may move the sensors 200 intentionally or unintentionally.

  Here, as described above, for example, the information processing apparatus 100 can determine that the sensor 200 has moved based on a detection value such as an acceleration sensor included in the sensor 200 and correct the preparation information again. .

  Note that the processing when the sensor 200 moves is not limited to the example shown above.

  For example, the information processing apparatus 100 can determine whether or not the sensor 200 has moved by evaluating the movement amount vector based on the second output information acquired from the portable apparatus 300. If it is determined that the sensor 200 has moved, the information processing apparatus 100 corrects the preparation information again.

  When determining whether or not the sensor 200 has moved based on the evaluation of the movement amount vector based on the second output information acquired from the portable device 300, the information processing device 100 is illustrated in FIG. The determination may be positively performed by causing the user to perform such notification.

[4-4] Fourth Example of Use Case As described above, the information processing apparatus 100 detects the target space coordinates (the detection corresponding to the future movement shown in (b) above) where the user is predicted to turn his gaze. Since the preparation information can be corrected according to an example of the result, the intention of the user can be reflected in the detection result of the object in the sensor 200.

  FIG. 11 is an explanatory diagram for explaining another example of a use case to which the information processing method according to the present embodiment can be applied. FIG. 11 shows an example in which the user looks at the stuffed animal O, which is the desired object, before the user moves the arm toward the desired object.

  The information processing apparatus 100 acquires information about the user's line of sight from the apparatus 300C that is carried, and specifies the target space coordinates.

  Thereafter, when the user moves the arm toward the stuffed toy O, the direction of the arm may be shifted from the direction in which the stuffed toy O exists. For example, the information processing apparatus 100 corrects the preparation information based on the target space coordinates, and converts the spatial coordinates based on the first output information of the sensors 200A and 200B to the absolute space coordinates (in a predetermined coordinate system) based on the preparation information. Coordinate value).

  As described above, the user wants to move his arm toward the stuffed animal O by converting the spatial coordinates based on the first output information of each of the sensors 200A and 200B into the absolute spatial coordinates based on the preparation information. Can reflect the intentions. Also, in other situations, the user's intention is obtained by converting the spatial coordinates based on the first output information of the sensors 200A and 200B into the absolute spatial coordinates (coordinate values in a predetermined coordinate system) based on the preparation information. And the difference between the detection result of the sensor and the actual user operation can be corrected.

[5] An example of the effect produced by using the information processing method according to the present embodiment The following effects can be obtained by using the information processing method according to the present embodiment, for example. Needless to say, the effects produced by using the information processing method according to the present embodiment are not limited to the examples shown below.
When the calibration of the sensor 200 is set, the second output information acquired from the wearable device (an example of the portable device 300) worn by the user is used. No special user operation is required. The wearable device (an example of the portable device 300) can use a general-purpose sensor, and the wearable device (an example of the portable device 300) is equipped with a dedicated sensor. There is no need to be.
By setting the preparation information corresponding to the use environment, the accuracy of the object detection result based on the first output information acquired from the sensor 200 can be kept high.
When the number of sensors 200 is increased, the sensors 200 can be calibrated using second output information acquired from a wearable device (an example of a portable device 300). When the sensor 200 is calibrated using the second output information acquired from the wearable device (an example of the portable device 300), the sensor 200 is related to the calibration when the sensor 200 is installed. No special user operation is required.
Obtained from the sensor 200 by converting the spatial coordinates based on the first output information of the sensor 200 into absolute spatial coordinates (coordinate values in a predetermined coordinate system) based on the preparation information corresponding to the operation target of the user. The user's intention can be reflected in the detection result based on the first output information.

(Information processing apparatus according to this embodiment)
Next, an example of the configuration of the information processing apparatus according to the present embodiment capable of performing the process according to the information processing method according to the present embodiment described above will be described.

  FIG. 12 is a block diagram illustrating an example of the configuration of the information processing apparatus 100 according to the present embodiment. The information processing apparatus 100 includes, for example, a communication unit 102 and a control unit 104.

  The information processing apparatus 100 includes, for example, a ROM (Read Only Memory) (not shown), a RAM (Random Access Memory) (not shown), a storage unit (not shown), and an operation unit (see FIG. And a display unit (not shown) for displaying various screens on the display screen. The information processing apparatus 100 connects the above constituent elements by, for example, a bus as a data transmission path.

  A ROM (not shown) stores control data such as programs and calculation parameters used by the control unit 104. A RAM (not shown) temporarily stores a program executed by the control unit 104.

  The storage unit (not shown) is a storage unit included in the information processing apparatus 100. For example, the data indicating the target world model M1 for each sensor 200 or the data indicating the target world model M2 for each portable device 300. Various data such as data related to the information processing method according to the present embodiment, such as data indicating the target world model M3 in the entire target space, preparation information for each sensor 200, and various applications are stored. Here, examples of the storage unit (not shown) include a magnetic recording medium such as a hard disk, a non-volatile memory such as a flash memory, and the like. Further, the storage unit (not shown) may be detachable from the information processing apparatus 100.

  As the operation unit (not shown), an operation input device to be described later can be cited. Moreover, as a display part (not shown), the display device mentioned later is mentioned.

[Hardware Configuration Example of Information Processing Apparatus 100]
FIG. 13 is an explanatory diagram illustrating an example of a hardware configuration of the information processing apparatus 100 according to the present embodiment. The information processing apparatus 100 includes, for example, an MPU 150, a ROM 152, a RAM 154, a recording medium 156, an input / output interface 158, an operation input device 160, a display device 162, and a communication interface 164. In addition, the information processing apparatus 100 connects each component with a bus 166 as a data transmission path, for example.

  The MPU 150 includes, for example, one or more processors configured with arithmetic circuits such as an MPU (Micro Processing Unit), various processing circuits, and the like, and functions as the control unit 104 that controls the entire information processing apparatus 100. . Further, the MPU 150 plays a role of, for example, the processing unit 110 described later in the information processing apparatus 100. Note that the processing unit 110 may be configured by a dedicated (or general-purpose) circuit that can implement processing.

  The ROM 152 stores programs used by the MPU 150, control data such as calculation parameters, and the like. The RAM 154 temporarily stores a program executed by the MPU 150, for example.

  The recording medium 156 functions as a storage unit (not shown), for example, data indicating the target world model M1 for each sensor 200, data indicating the target world model M2 for each portable device 300, and the target. Various data such as data related to the information processing method according to the present embodiment, such as data indicating the target world model M3 in the entire space, preparation information for each sensor 200, and various applications are stored. Here, examples of the recording medium 156 include a magnetic recording medium such as a hard disk and a non-volatile memory such as a flash memory. Further, the recording medium 156 may be detachable from the information processing apparatus 100.

  The input / output interface 158 connects, for example, the operation input device 160 and the display device 162. The operation input device 160 functions as an operation unit (not shown), and the display device 162 functions as a display unit (not shown). Here, examples of the input / output interface 158 include a USB (Universal Serial Bus) terminal, a DVI (Digital Visual Interface) terminal, an HDMI (High-Definition Multimedia Interface) (registered trademark) terminal, and various processing circuits. .

  For example, the operation input device 160 is provided on the information processing apparatus 100 and is connected to the input / output interface 158 inside the information processing apparatus 100. Examples of the operation input device 160 include a button, a direction key, a rotary selector such as a jog dial, or a combination thereof.

  For example, the display device 162 is provided on the information processing apparatus 100 and is connected to the input / output interface 158 inside the information processing apparatus 100. Examples of the display device 162 include a liquid crystal display (Liquid Crystal Display), an organic EL display (Organic Electro-Luminescence Display, or an OLED display (Organic Light Emitting Diode Display)), and the like.

  It goes without saying that the input / output interface 158 can be connected to an external device such as an external operation input device (for example, a keyboard or a mouse) as an external device of the information processing apparatus 100 or an external display device. Yes. The display device 162 may be a device capable of display and user operation, such as a touch panel.

  The communication interface 164 is a communication unit included in the information processing apparatus 100 and communicates with an external device such as the sensor 200 or the portable device 300 wirelessly or via a network (or directly). It functions as the communication unit 102 for this. Here, examples of the communication interface 164 include a communication antenna and an RF (Radio Frequency) circuit (wireless communication), an IEEE 802.15.1 port and a transmission / reception circuit (wireless communication), an IEEE 802.11 port and a transmission / reception circuit (wireless communication). Or a LAN (Local Area Network) terminal and a transmission / reception circuit (wired communication).

  The information processing apparatus 100 performs processing related to the information processing method according to the present embodiment, for example, with the configuration illustrated in FIG. 13. Note that the hardware configuration of the information processing apparatus 100 according to the present embodiment is not limited to the configuration illustrated in FIG. 13.

  For example, the information processing apparatus 100 may not include the communication interface 164 when communicating with an external apparatus or the like via a connected external communication device. The communication interface 164 may be configured to be able to communicate with one or more external devices by a plurality of communication methods.

  Further, the information processing apparatus 100 can be configured not to include the recording medium 156, the operation input device 160, and the display device 162, for example.

  Further, for example, the configuration shown in FIG. 13 (or a configuration according to a modification) may be realized by one or two or more ICs (Integrated Circuits).

  With reference to FIG. 12 again, an example of the configuration of the information processing apparatus 100 will be described. The communication unit 102 is a communication unit included in the information processing apparatus 100, and communicates with an external device such as the sensor 200 or the portable device 300 wirelessly or via a network (or directly). . The communication of the communication unit 102 is controlled by the control unit 104, for example.

  Here, examples of the communication unit 102 include a communication antenna and an RF circuit, a LAN terminal, and a transmission / reception circuit, but the configuration of the communication unit 102 is not limited to the above. For example, the communication unit 102 can have a configuration corresponding to an arbitrary standard capable of performing communication such as a USB terminal and a transmission / reception circuit, or an arbitrary configuration capable of communicating with an external device via a network. Further, the communication unit 102 may be configured to be able to communicate with one or more external devices by a plurality of communication methods.

  The control unit 104 is configured by, for example, an MPU and plays a role of controlling the entire information processing apparatus 100. In addition, the control unit 104 includes, for example, a processing unit 110 and plays a role of leading the processing related to the information processing method according to the present embodiment.

  The processing unit 110 plays a role of leading the process of generating the preparation information, and includes first output information regarding the first target acquired from the sensor 200 and the first output acquired from the portable device 300. Based on the 2nd output information regarding 2 object, the process which produces | generates preparation information is performed. The processing unit 110, for example, first output information related to the first target acquired from the sensor 200 and second related to the second target related to the first target acquired from the portable device 300. The preparation information is corrected based on the output information.

  The processing unit 110 may further perform a predetermined process according to the present embodiment. For example, the processing unit 110 performs one or both of the process (I) (conversion process) and the process (II) (execution control process) as the predetermined process according to the present embodiment.

  The control unit 104 includes, for example, the processing unit 110, thereby leading to processing related to the information processing method according to the present embodiment (for example, processing for generating the preparation information and the predetermined processing).

  The information processing apparatus 100 performs processing (for example, processing for generating the preparation information and the predetermined processing) according to the information processing method according to the present embodiment with the configuration illustrated in FIG. 12, for example.

  Therefore, the information processing apparatus 100 can improve user convenience when a sensor that senses a predetermined range of space is used, for example, with the configuration shown in FIG.

  Further, for example, with the configuration illustrated in FIG. 12, the information processing apparatus 100 can achieve the effect that is achieved by performing the processing related to the information processing method according to the present embodiment as described above.

  Note that the configuration of the information processing apparatus according to the present embodiment is not limited to the configuration illustrated in FIG.

  For example, the information processing apparatus according to the present embodiment can include the processing unit 110 illustrated in FIG. 12 separately from the control unit 104 (for example, realized by another processing circuit such as a processor).

  In addition, as described above, “the process for generating the preparation information” and “the process for generating the preparation information and the predetermined process” are separated from the processes related to the information processing method according to the present embodiment for convenience. Is. Therefore, the configuration for realizing the processing according to the information processing method according to the present embodiment is not limited to the processing unit 110 illustrated in FIG. 12, and the configuration according to the method of dividing the processing according to the information processing method according to the present embodiment. It is possible to take

  Further, for example, when communicating with an external device via an external communication device having the same function and configuration as the communication unit 102, the information processing apparatus according to the present embodiment does not include the communication unit 102. Also good.

  Further, the information processing apparatus according to the present embodiment may be configured such that, for example, the processing unit 110 illustrated in FIG. 12 does not perform the predetermined process.

  For example, even if the processing unit 110 illustrated in FIG. 12 does not perform the predetermined process, the information processing apparatus according to the present embodiment can perform the process of generating the preparation information. When a sensor that senses the predetermined range is used, the convenience of the user can be improved. For example, even if the processing unit 110 illustrated in FIG. 12 does not perform the predetermined process, the information processing apparatus according to the present embodiment is achieved by performing the process of generating the preparation information. An effect can be produced.

  As described above, the information processing apparatus has been described as the present embodiment, but the present embodiment is not limited to such a form. The present embodiment is, for example, a computer such as a PC (Personal Computer) or a server, a sensor according to the present embodiment installed in a space, a communication device such as a mobile phone or a smartphone, or a tablet device. The present invention can be applied to various devices that can perform the processing related to the information processing method. In addition, the present embodiment can be applied to a processing IC that can be incorporated in the above-described device, for example.

  In addition, the information processing apparatus according to the present embodiment is applied to a system including one or two or more apparatuses that are premised on connection to a network (or communication between apparatuses) such as cloud computing. May be. That is, the information processing apparatus according to the present embodiment described above can be realized as an information processing system that performs processing according to the information processing method according to the present embodiment using a plurality of apparatuses, for example.

(Program according to this embodiment)
A program for causing a computer to function as the information processing apparatus according to the present embodiment (for example, “the process for generating the preparation information”, “the process for generating the preparation information, and the predetermined process”). When a sensor that senses a predetermined range of space is used by executing a program that can execute a process related to an information processing method according to an embodiment by a processor or the like in a computer, the convenience of the user Can be improved.

  In addition, an effect produced by the processing related to the information processing method according to the above-described embodiment by executing a program for causing the computer to function as the information processing apparatus according to the present embodiment by a processor or the like in the computer. Can be played.

  The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the technical scope of the present disclosure is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.

  For example, in the above description, it has been shown that a program (computer program) for causing a computer to function as the information processing apparatus according to the present embodiment is provided. However, the present embodiment further includes a recording in which the program is stored. A medium can also be provided.

  The configuration described above shows an example of the present embodiment, and naturally belongs to the technical scope of the present disclosure.

  Further, the effects described in the present specification are merely illustrative or exemplary and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.

The following configurations also belong to the technical scope of the present disclosure.
(1)
Based on first output information related to a first object acquired from a sensor that senses a predetermined range in real space, and second output information related to a second object acquired from a device carried by the user. And a processing unit for generating preparation information,
The information processing apparatus, wherein the preparation information is used for generating operation information based on third output information acquired from the sensor.
(2)
The information processing apparatus according to (1), wherein the preparation information is information for controlling association between the sensor and a predetermined coordinate system.
(3)
The information for information processing according to (2), wherein the preparation information is information used for processing for converting target position information obtained based on the third output information into coordinate values in the predetermined coordinate system. apparatus.
(4)
The information processing apparatus according to any one of (1) to (3), wherein the first object and the second object are related objects.
(5)
The information processing apparatus according to (4), wherein the second object moves according to the movement of the first object.
(6)
The process for generating the preparation information is the information processing apparatus according to any one of (1) to (5), wherein the preparation information is a process for correcting the preparation information.
(7)
The processing unit corrects the preparation information based on a detection result of a first object based on the first output information and a detection result of a second object based on the second output information. The information processing apparatus according to 6).
(8)
The processing unit compares the motion information of the first target that is the detection result of the first target with the motion information of the second target that is the detection result of the second target, and compares the motion The information processing apparatus according to (7), wherein the preparation information is corrected based on a result.
(9)
The information processing apparatus according to (8), wherein the correction of the preparation information based on the movement comparison result is correction of a positional shift of the position of the first target based on the first output information.
(10)
The correction of the preparation information based on the motion comparison result further includes correction of a time lag between a time corresponding to the motion information of the first target and a time corresponding to the motion information of the second target. The information processing apparatus according to 9).
(11)
The processing unit compares the spatial coordinates corresponding to the first object, which is the detection result of the first object, and the spatial coordinates corresponding to the second object, which is the detection result of the second object. Then, the information processing apparatus according to any one of (7) to (10), wherein the preparation information is corrected based on a comparison result of spatial coordinates.
(12)
The information processing unit according to (11), wherein the processing unit records a correction parameter related to the correction of the preparation information based on a comparison result of spatial coordinates in association with identification information indicating a user of the portable device. apparatus.
(13)
The information processing apparatus according to (12), wherein when the identification information is acquired, the processing unit corrects the preparation information with the correction parameter associated with the acquired identification information.
(14)
The information processing apparatus according to any one of (1) to (13), wherein the processing unit performs the process of generating the preparation information irregularly.
(15)
The information processing apparatus according to any one of (1) to (14), wherein the processing unit performs the process of generating the preparation information when a user's predetermined operation is detected.
(16)
When the new sensor is detected or when the movement of the position of the existing sensor is detected, the processing unit controls notification for causing the predetermined operation to be performed (15) The information processing apparatus described in 1.
(17)
The information processing apparatus according to (5), wherein the first object and the second object are hands or arms.
(18)
The information processing apparatus according to any one of (1) to (17), wherein the portable device is a device worn on a hand or an arm.
(19)
The information processing apparatus according to any one of (1) to (18), wherein the sensor is an image sensor.
(20)
Based on first output information related to a first object acquired from a sensor that senses a predetermined range in real space, and second output information related to a second object acquired from a device carried by the user. And a step of performing processing for generating preparation information,
The information processing method executed by an information processing apparatus, wherein the preparation information is used to generate operation information based on third output information acquired from the sensor.
(21)
Based on first output information related to a first object acquired from a sensor that senses a predetermined range in real space, and second output information related to a second object acquired from a device carried by the user. And causing the computer to execute a step of generating the preparation information,
The preparation information is a program used for generating operation information based on third output information acquired from the sensor.
(22)
The information processing apparatus according to any one of (1) to (19), wherein the processing unit further performs a predetermined process based on the third output information and the preparation information.
(23)
The information processing apparatus according to any one of (1) to (19) and (22), wherein the second output information acquired from the portable apparatus is output information of a motion sensor.

DESCRIPTION OF SYMBOLS 100 Information processing apparatus 102 Communication part 104 Control part 110 Processing part 200, 200A, 200B Sensor 300, 300A, 300B, 300C Portable apparatus

Claims (21)

Based on first output information related to a first object acquired from a sensor that senses a predetermined range in real space, and second output information related to a second object acquired from a device carried by the user. And a processing unit for generating preparation information,
The information processing apparatus, wherein the preparation information is used for generating operation information based on third output information acquired from the sensor.   The information processing apparatus according to claim 1, wherein the preparation information is information for controlling association between the sensor and a predetermined coordinate system.   The information processing according to claim 2, wherein the preparation information is information used for a process of converting position information of a target obtained based on the third output information into a coordinate value in the predetermined coordinate system. apparatus.   The information processing apparatus according to claim 1, wherein the first object and the second object are related objects.   The information processing apparatus according to claim 4, wherein the second object moves according to the movement of the first object.   The information processing apparatus according to claim 1, wherein the process of generating the preparation information is a process of correcting the preparation information.   The processing unit corrects the preparation information based on a detection result of a first object based on the first output information and a detection result of a second object based on the second output information. Item 7. The information processing device according to Item 6.   The processing unit compares the motion information of the first target that is the detection result of the first target with the motion information of the second target that is the detection result of the second target, and compares the motion The information processing apparatus according to claim 7, wherein the preparation information is corrected based on a result.   The information processing apparatus according to claim 8, wherein the correction of the preparation information based on the movement comparison result is correction of a positional shift of the position of the first target based on the first output information.   The correction of the preparation information based on the motion comparison result further includes correction of a time lag between a time corresponding to the motion information of the first target and a time corresponding to the motion information of the second target. Item 10. The information processing device according to Item 9.   The processing unit compares the spatial coordinates corresponding to the first object, which is the detection result of the first object, and the spatial coordinates corresponding to the second object, which is the detection result of the second object. The information processing apparatus according to claim 7, wherein the preparation information is corrected based on a comparison result of spatial coordinates.   The information processing according to claim 11, wherein the processing unit causes a correction parameter related to the correction of the preparation information based on a comparison result of spatial coordinates to be recorded in association with identification information indicating a user of the portable device. apparatus.   The information processing apparatus according to claim 12, wherein, when the identification information is acquired, the processing unit corrects the preparation information with the correction parameter associated with the acquired identification information.   The information processing apparatus according to claim 1, wherein the processing unit performs the process of generating the preparation information irregularly.   The information processing apparatus according to claim 1, wherein the processing unit performs the process of generating the preparation information when a user's predetermined operation is detected.   The said processing part controls the notification for performing the said predetermined | prescribed operation | movement, when the said new sensor is detected or the movement of the position of the existing said sensor is detected. The information processing apparatus described in 1.   The information processing apparatus according to claim 5, wherein the first object and the second object are hands or arms.   The information processing apparatus according to claim 1, wherein the portable device is a device worn on a hand or an arm.   The information processing apparatus according to claim 1, wherein the sensor is an image sensor. Based on first output information related to a first object acquired from a sensor that senses a predetermined range in real space, and second output information related to a second object acquired from a device carried by the user. And a step of performing processing for generating preparation information,
The information processing method executed by an information processing apparatus, wherein the preparation information is used to generate operation information based on third output information acquired from the sensor. Based on first output information related to a first object acquired from a sensor that senses a predetermined range in real space, and second output information related to a second object acquired from a device carried by the user. And causing the computer to execute a step of generating the preparation information,
The preparation information is a program used for generating operation information based on third output information acquired from the sensor.

Images