WO2021241558A1

WO2021241558A1 - System and operation method

Info

Publication number: WO2021241558A1
Application number: PCT/JP2021/019754
Authority: WO
Inventors: 守仁黄; 雄司山川; 正俊石川
Original assignee: 国立大学法人東京大学
Priority date: 2020-05-26
Filing date: 2021-05-25
Publication date: 2021-12-02
Also published as: JP2021189223A; CN115605932A; US20230186784A1; JP7351523B2

Abstract

[Problem] To provide technology that effectively assists a user in learning a prescribed motion, irrespective of the user's age and motivation. [Solution] According to one embodiment of the present invention, a system is provided. This system comprises a first contact unit, a sensor unit, and a second contact unit. The first contact unit is connected to a point to be operated. By the first contact unit coming into contact with a first limb of a user, a target position that is defined by the point to be operated is variably configured in conformity with the motion of the first limb. The sensor unit is configured so as to measure an error from the prescribed trajectory of the target position. The second contact unit is provided with an error sensation presentation unit and is configured so as to come into contact with a second limb that is different from the first limb of the user. The error sensation presentation unit is configured so as to add a kinesthetic or tactile sense based on the error to the second limb and thereby present the error to the user. 7/13

Description

System and operation method

The present invention relates to a system and an operation method.

There are many scenes in which humans use their limbs to perform tasks that involve predetermined movements. Patent Document 1 discloses a skill training device used for training such a predetermined movement.

Japanese Unexamined Patent Publication No. 2020-12858

Since the skill training device disclosed in Patent Document 1 notifies as information when an operation different from the regulation is performed, the user must consciously read the information. Therefore, the learning effect is low depending on the age and motivation of the user.

In view of the above circumstances, the present invention has determined to provide a technique for assisting a user to effectively learn a predetermined operation regardless of the user's age and motivation.

According to one aspect of the present invention, a system is provided. This system includes a first contact portion, a sensor portion, and a second contact portion. The first contact portion is connected to the operated portion. By coming into contact with the user's first limb, the target position defined by the operated portion is variably configured according to the movement of the first limb. The sensor unit is configured to measure an error from a predetermined trajectory of the target position. The second contact portion includes an error sensation presenting portion and is configured to come into contact with a second limb different from the user's first limb. The error sensation presenting unit is configured to present an error to the user by applying a force sense or a tactile sense based on the error to the second limb.

According to this, the user can effectively learn a predetermined operation regardless of the user's age and motivation.

It is a schematic diagram which shows the whole structure of the system 1. It is a schematic diagram which shows the whole structure of the system 1. It is a block diagram which shows the hardware composition of the control device 3. It is a schematic diagram which shows the hardware composition of the main apparatus 4. It is a block diagram which shows the functional structure of the control device 3 (control unit 33). It is an activity diagram which shows the operation method of the system 1. It is a schematic diagram which shows an example of the image IM which image processing unit 332 performs image processing. It is a schematic diagram which shows the error vector v1.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. The various features shown in the embodiments shown below can be combined with each other.

By the way, the program for realizing the software appearing in the present embodiment may be provided as a non-transitory recording medium (Non-Transity Computer-Readable Medium) that can be read by a computer, or may be downloaded from an external server. It may be provided as possible, or it may be provided so that the program is started by an external computer and the function is realized by the client terminal (so-called cloud computing).

Further, in the present embodiment, the "part" may include, for example, a combination of hardware resources implemented by a circuit in a broad sense and information processing of software specifically realized by these hardware resources. .. In addition, various information is handled in this embodiment, and these information are, for example, physical values of signal values representing voltage and current, and signal values as a bit aggregate of a binary number composed of 0 or 1. It is represented by high-low or quantum superposition (so-called qubit), and communication / operation can be executed on a circuit in a broad sense.

Further, a circuit in a broad sense is a circuit realized by at least appropriately combining a circuit, a circuit, a processor, a memory, and the like. That is, an integrated circuit for a specific application (Application Specific Integrated Circuit: ASIC), a programmable logic device (for example, a simple programmable logic device (Simple Programmable Logic Device: SPLD), a composite programmable logic device (Complex Programg)). It includes a programmable gate array (Field Programmable Gate Array: FPGA) and the like.

1. 1. Hardware Configuration This section describes the hardware configuration of the system 1 according to the embodiment.

1.1 System 1
1 and 2 are schematic views showing the overall configuration of the system 1. As shown in FIG. 1, the user U can use the system 1 to perform training on a predetermined operation. The training here may be training for a healthy user U to acquire a predetermined movement, or training for an injured user U for the purpose of rehabilitation. Further, as shown in FIG. 2, the system 1 includes an image pickup device 2 (an example of a sensor unit), a control device 3, and a main device 4, and these are electrically connected systems.

1.2 Imaging device 2
The image pickup device 2 is a so-called vision sensor (camera) configured to be able to capture information in the outside world, and it is particularly preferable to use a high-speed vision with a high frame rate.

The image pickup device 2 (sensor unit) is configured to measure the error E from the predetermined trajectory of the target position TP. This will be described in more detail later. Preferably, the frame rate (acquisition rate) of the image pickup apparatus 2 (sensor unit) is 100 fps (hertz) or more, and more specifically, for example, 100, 125, 150, 175, 200, 225, 250, 275. 300,325,350,375,400,425,450,475,500,525,550,575,600,625,650,675,700,725,750,775,800,825,850,875,900, 925,950,975,1000,1025,1050,1075,1100,1125,1150,1175,1200,1225,1250,1275,1300,1235,1350,1375,1400,1245,1450,1475,1500,1525 1550, 1575, 1600, 1625, 1650, 1675, 1700, 1725, 1750, 1775, 1800, 1825, 1850, 1875, 1900, 1925, 1950, 1975, 2000 fps, and any two of the numerical values exemplified here. It may be within the range between.

The image pickup device 2 is connected to the communication unit 31 in the control device 3 described later by a telecommunication line (for example, a USB cable or the like), and is configured to be able to transfer the captured image IM to the control device 3.

Further, in the image pickup apparatus 2, a camera capable of measuring not only visible light but also a band that cannot be perceived by humans such as an ultraviolet region and an infrared region may be adopted. By adopting such a camera, the system 1 according to the present embodiment can be implemented even in a dark field.

1.3 Control device 3
FIG. 3 is a block diagram showing a hardware configuration of the control device 3. As shown in FIG. 3, the control device 3 has a communication unit 31, a storage unit 32, and a control unit 33, and these components are electrically connected to the inside of the control device 3 via the communication bus 30. It is connected to the. Hereinafter, each component will be further described.

Although wired communication means such as USB, IEEE1394, Thunderbolt, and wired LAN network communication are preferable, the communication unit 31 requires wireless LAN network communication, mobile communication such as 3G / LTE / 5G, Bluetooth (registered trademark) communication, and the like. It may be included according to the above. That is, it is more preferable to carry out as a set of these plurality of communication means. As a result, information and commands are exchanged between the control device 3 and other communicable devices.

The storage unit 32 stores various information defined by the above description. This is, for example, as a storage device such as a Solid State Drive (SSD), or a random access memory (Random Access Memory:) that stores temporarily necessary information (arguments, arrays, etc.) related to program operations. It can be implemented as a memory such as RAM). Further, these combinations may be used. Further, the storage unit 32 stores various programs that can be read by the control unit 33 described below. Further, the storage unit 32 stores a time-series image IM imaged by the image pickup device 2 and received by the communication unit 31. Here, the image IM is, for example, array information including pixel information of 8 bits for each of RGB.

The control unit 33 processes and controls the overall operation related to the control device 3. The control unit 33 is, for example, a central processing unit (CPU) (not shown). The control unit 33 realizes various functions related to the control device 3 by reading out a predetermined program stored in the storage unit 32. That is, information processing by software (stored in the storage unit 32) is specifically realized by hardware (control unit 33), and as shown in FIG. 3, as each functional unit in the control unit 33. Can be executed. Although it is shown as a single control unit 33 in FIG. 3, it is not limited to this, and it may be implemented so as to have a plurality of control units 33 for each function. Further, it may be a combination thereof.

1.4 Main device 4
FIG. 4 is a schematic diagram showing a hardware configuration of the main device 4. The main device 4 is a device in which the user U can operate the operated portion 43 by using his / her limbs. Further, the main device 4 is a device that receives a control signal CS from the control device 3 and drives it in various ways according to the control signal CS. The main device 4 includes a first contact portion 41 and a second contact portion 42.

As shown in FIG. 4, the first contact portion 41 is connected to the operated portion 43. The first contact portion 41 is in contact with the first limb HF1 of the user U, so that the target position TP defined by the operated portion 43 is variably configured according to the movement of the first limb HF1. The range of the target position TP that the user U can move using the first contact portion 41 is referred to as the first range.

As shown in FIG. 4, the second contact portion 42 includes an error sensation presenting portion 45. It is configured to come into contact with a second limb HF2 that is different from the first limb HF1 of the user U. The error sensation presenting unit 45 is configured to present the error E to the user U by imparting a force sense or a tactile sense based on the error E measured via the image pickup apparatus 2 to the second limb HF2. ..

The form of the first contact portion 41 and the second contact portion 42 is not particularly limited, but is appropriate depending on the usability of contacting the first limb HF1 or the second limb HF2. The form should be selected. For example, if the first limb HF1 and the second limb HF2 are the left and right hands (left hand LH and right hand RH) of the user U, the first contact portion 41 and the second contact portion 42 are the left hand LH. It should be configured so that it can be grasped by the right hand RH and the right hand RH.

Further, the main device 4 further includes a position adjusting unit 44. The position adjusting unit 44 is, for example, a stage that can be driven in the XY direction, and it is preferable that the operated portion 43 can be displaced in a second range smaller than the first range that can be operated by the user U. With such a configuration, the position adjusting unit 44 can adjust the target position TP at the operated portion 43 so as to correct the error E.

In the system 1 as a whole, the lower of the frame rate of the image pickup apparatus 2 and the drive rate of the position adjusting unit 44 functions as the control rate related to the correction of the error E. In other words, by increasing the frame rate and the drive rate to the same extent, it is possible to correct the error E of the target position TP only by feedback control without using any prediction. That is, preferably, the drive rate of the position adjusting unit 44 is 100 hertz or more, similar to the image pickup apparatus 2.

It should be noted that it is not necessary to perform the correction by the position adjusting unit 44 when the user U trains the predetermined operation. The correction by the position adjusting unit 44 is similar to the camera shake correction of the camera, and supplementarily realizes an appropriate predetermined operation. The user U may be trained to correctly perform a predetermined operation even when the position adjusting unit 44 is not provided. In such a case, the user U will be required to perform a high-level operation, but it does not prevent the user U from carrying out such training.

2. 2. Functional configuration This section describes the functional configuration of this embodiment. FIG. 5 is a block diagram showing a functional configuration of the control device 3 (control unit 33). Regarding the above-mentioned control unit 33, the control device 3 includes a reception unit 331, an image processing unit 332, a calculation unit 333, and a control signal generation unit 334. Hereinafter, each component will be further described.

(Reception Department 331)
The reception unit 331 receives information via the communication unit 31 or the storage unit 32, and is configured to be readable in the working memory. In particular, the reception unit 331 is configured to receive various information (image IM, displacement information of the position adjustment unit 44, etc.) from the image pickup device 2 and / or the main device 4 via the communication unit 31. When the control device 3 is connected to other devices, the reception unit 331 may be implemented to receive the information transmitted from those devices. In the present embodiment, various information received by the reception unit 331 will be described as being stored in the storage unit 32.

After the reception unit 331 receives and temporarily reads the information into the working memory, it is not necessary to store at least a part of the information in the storage unit 32. Further, at least a part of the information may be stored in an external server other than the storage unit 32.

(Image processing unit 332)
The image processing unit 332 is configured to read the program stored in the storage unit 32 into the image IM and execute predetermined image processing. For example, the image processing unit 332 executes image processing for specifying the line L which is a predetermined trajectory from the image IM. Details will be described later.

(Calculation unit 333)
The calculation unit 333 is configured to perform a predetermined calculation using the image IM whose image processing has been executed by the image processing unit 332. For example, the calculation unit 333 calculates the error vector v1 or the symmetry vector v2 from the image IM. Details will be described later.

(Control signal generation unit 334)
The control signal generation unit 334 is configured to generate a control signal CS for controlling the main device 4. Specifically, the control signal generation unit 334 generates the control signal CS1 that drives the position adjustment unit 44. Further, the control signal generation unit 334 generates the control signal CS2 that operates the error sense presentation unit 45. The value of the control signal CS may be defined by, for example, a voltage.

3. 3. Control processing This section describes the flow of control processing of system 1.

3.1 Operation method FIG. 6 is an activity diagram showing an operation method of the system 1. Here, for the sake of simplicity, the user U is right-handed, the first limb HF1 is referred to as a right hand RH, and the second limb HF2 is referred to as a left hand LH2. That is, the user U grasps the first contact portion 41 with the right hand RH and grasps the second contact portion 42 with the left hand LH (activity A101). Grasp is an example of contact. Then, the user U operates the first contact portion 41 with the right hand RH to move the target position TP at the operated portion 43 along the line L which is a predetermined trajectory (activity A102). Such an operation is included in, for example, cutting work, coating work, medical practice, and the like.

When the user U displaces the first contact portion 41, the target position TP is also displaced accordingly. At this time, the image pickup device 2 captures the target position TP and the line L, and the image IM is transmitted to the control device 3 (activity A103). In other words, the reception unit 331 receives the image IM, which is stored in the storage unit 32.

FIG. 7 is a schematic diagram showing an example of an image IM in which the image processing unit 332 performs image processing. The image processing unit 332 analyzes the image IM received by the reception unit 331 by image processing, and specifies the position of the line L in the image IM (activity A104). This is performed, for example, by binarizing the captured image IM by setting a threshold value for a predetermined parameter (brightness, etc.) related to the image. Then, the position of the line L can be specified by calculating the position of the center of gravity of the line L from the image IM.

Then, the target position TP may be implemented as an intersection of the line of sight of the image pickup apparatus 2 and the defined surface P. Although not shown in FIG. 4, the image pickup device 2 is attached to the position adjusting unit 44. That is, the target position TP is the center of the image IM (image center CT) imaged by the image pickup apparatus 2.

As shown in FIG. 7, image processing may be performed on a predetermined area ROI of a part of the image IM. In particular, in order to correct the error E at a high control rate, the line L is in the vicinity of a fixed position of the image IM (for example, the image center CT), and the region near this fixed position is referred to as the predetermined region ROI. By doing so, the number of pixels for image processing can be reduced. As a result, the computational load of the control device 3 can be reduced to maintain a high control rate.

Subsequently, the calculation unit 333 calculates an error vector v1 representing an error E between the target position TP (image center CT) and the line L (activity A105). FIG. 8 is a schematic diagram showing the error vector v1. If the error E falls within the second range that is the movable range of the position adjustment unit 44, the control signal generation unit 334 generates a control signal CS1 that corrects the error E and transmits it to the position adjustment unit 44 (activity A106). ). Further, the control signal generation unit 334 generates a control signal CS2 that presents the error E to the user U and transmits it to the error sense presentation unit 45 (activity A107).

In other words, the control signal CS1 is transmitted to the position adjusting unit 44 in the main device 4 via the communication unit 31, so that the position adjusting unit 44 is driven, whereby the error E can be corrected. The control method in this case is not particularly limited, but for example, P control, PD control, PID control and the like can be appropriately adopted. A preferable value may be set for each coefficient related to the control, if necessary. Further, when the control signal CS2 is transmitted to the error sensation presenting unit 45 in the main device 4 via the communication unit 31, the error sensation presenting unit 45 operates, whereby the error E can be presented to the user U. ..

On the other hand, when the error E does not fall within the second range which is the movable range of the position adjusting unit 44, the control signal generation unit 334 does not generate the control signal CS1 for correcting the error E, and the error E is sent to the user U. The control signal CS2 to be presented may be generated and transmitted to the error sense presenting unit 45 (activity A107).

The force or tactile sensation based on the error E is determined in proportion to the error vector v1 representing the error E. That is, in order to present the magnitude (degree) and direction of the error E to the user U, the force sense or the tactile sense is the user as a vector proportional to the error vector v1 (the proportionality constant is a positive or negative number and includes 1). It should be given to U. In particular, by imparting a force sense or a tactile sense to the left hand LH different from the operating right hand RH, the error E can be presented to the user U without impairing the operation feeling. Further, particularly preferably, the force sense or the tactile sense based on the error E is converted into a frequency suitable for human sense presentation and presented. By presenting the force or tactile sensation at a frequency perceptible to humans, the user U can grasp the state of the error E.

By repeating the control process described above in control rate units, the user U can train and learn a predetermined operation. In summary, this system 1 operating method comprises first to fourth steps. In the first step, the first limb HF1 of the user U is brought into contact with the first contact portion 41 of the system 1, and the second limb HF2 of the user U is brought into contact with the second contact portion 42 of the system 1. .. In the second step, the target position TP defined by the operated portion 43 of the system 1 is moved by moving the first limb HF1 in contact with the first contact portion 41. In the third step, the error E from the predetermined trajectory of the target position TP is measured. In the fourth step, the error E is presented to the user U by applying a force sense or a tactile sense based on the error E to the second limb HF2 in contact with the second contact portion 42.

3.2 Synchronous movement To supplement the above assumption, preferably, the first limb HF1 and the second limb HF2 are the left and right hands (left hand LH and right hand RH) or foot (left foot LF and right foot RF) of the user U. Is. Humans use the coordinated movement of both arms to perform various and complicated tasks. In order to move both human arms in a coordinated manner, it is thought that there is a brain mechanism that enables them to cooperate with each other while interfering with each other. In particular, synchronous movements of both arms (for example, even if different movements are performed simultaneously with the right hand RH and the left hand LH, both hands tend to move in the same manner) are often seen in daily life, and both arms Synchronous control is also considered to be the most basic mechanism for the brain.

That is, when a force sense or a tactile sense is given to the left hand LH, the user U himself quickly adjusts the right hand RH in the direction of correcting the error E by the left-right synchronous movement. According to such a control process, the user U can more intuitively and effectively train and learn a predetermined motion regardless of the age and motivation of the user U.

The force or tactile sensation based on the error E may be determined in proportion to the symmetry vector v2 in which the error vector v1 representing the error E is symmetrically moved with respect to the plane of symmetry instead of the error vector v1 (FIG. 8). reference). The plane of symmetry here is a plane extending back and forth from the center of the trunk of the user U. Even in consideration of stretching exercises and the like, human beings can naturally perform left-right symmetric movements by using a plane extending from the center of the trunk to the front and back as a symmetrical plane. Therefore, the user U may present the error E by a force sense or a tactile sense proportional to the symmetry vector v2 instead of the error vector v1. Further, the error vector v1 or the symmetry vector v2 may be selected according to the preference of the user U.

4. In addition, the system 1 may be further ingeniously devised by the following aspects.

(1) The system 1 may further include a guide light irradiation unit (not shown). The guide light irradiation unit may be configured to be coaxial or relative to the image pickup device 2 (sensor unit) and to be capable of irradiating guide light indicating the target position TP. Since the relative positions of the guide light irradiation unit and the image pickup device 2 are known at the time of design, the target position TP can be irradiated from the guide light irradiation unit as projected light. Preferably, the image pickup apparatus 2 and the guide light irradiation unit are implemented as a coaxial optical system by using a beam splitter or the like. As a result, the user U can more intuitively grasp how the first contact portion 41 should be moved in order to displace the target position TP along a predetermined trajectory.

(2) In the above-described embodiment, the target position TP is implemented as an intersection (image center CT) between the line of sight of the image pickup apparatus 2 and the defined surface P, but this is merely an example and is not limited to this. For example, a cutting tool (for example, an end mill or a medical scalpel) can be attached to the position adjusting portion 44 at the operated portion 43, and the tip position of the cutting tool can be set to the target position TP. At this time, the relative positions of the image pickup apparatus 2 and the cutting tool are known at the time of design. According to such a modification, the user U can carry out training in cutting and medical treatment.

(3) Further, a laser emitting portion (for processing) is attached to the position adjusting portion 44 at the operated portion 43, and the irradiation position (on the specified surface P) of the laser emitted from the laser emitting portion is set as the target position TP. can do. At this time, the relative positions of the image pickup apparatus 2 and the laser emitting portion are known at the time of design. According to such a modification, the user U can be trained in laser machining so that the desired object has a defined shape.

(4) Further, a coating portion configured to be able to apply paint or the like can be attached to the position adjusting portion 44 at the operated portion 43, and the tip position of the coating portion can be set to the target position TP. At this time, the relative positions of the image pickup apparatus 2 and the coating tool are known at the time of design. According to such a modification, the user can carry out training in the coating process.

(5) Various objects can be considered as targets for determining the target position TP, including the cutting tool, laser emitting part, coating tool, etc. described above, and these can be freely attached and detached. ..

(6) Another sensor may be used in place of or in combination with the image pickup apparatus 2. For example, a laser displacement sensor, an infrared sensor, or the like can be appropriately adopted.

(7) The control device 3 which is a part of the system 1 may be implemented by itself, not as the system 1.

(8) A program that causes the computer to function as the control device 3 may be implemented.

Furthermore, it may be provided in each of the following embodiments.
The system further includes a guide light irradiating unit, the guide light irradiating unit having a fixed position coaxially or relative to the sensor unit and capable of irradiating a guide light indicating the target position.
In the system, the first and second limbs are the left and right hands of the user, and the first and second contact portions are configured to be graspable by the left and right hands, respectively.
In the system, the force or tactile sensation based on the error is determined in proportion to the error vector representing the error.
In the system, the first and second limbs are the left and right hands or feet of the user, and the force or tactile sensation based on the error causes the error vector representing the error to move symmetrically with respect to the plane of symmetry. Determined in proportion to the symmetry vector, where the plane of symmetry is a plane extending anterior-posteriorly from the center of the user's trunk.
In the system, the force or tactile sensation based on the error is converted into a frequency suitable for human sensory presentation and presented.
In the system, the sensor unit is an imaging unit configured to be capable of capturing information in the outside world.
In the system, the target position is the center of an image captured by the imaging unit.
The system further comprises a position adjusting unit, which can displace the operated portion in a second range smaller than the first range in which the user can operate, and corrects the error. As described above, the position of the operated portion can be adjusted.
In the system, the acquisition rate of the sensor unit and the drive rate of the position adjustment unit are 100 hertz or more.
A method of operating the system, comprising first to fourth steps, in which the user's first limbs are brought into contact with the first contact portion of the system and the user's second. The limbs are brought into contact with the second contact portion of the system, and in the second step, the first limbs in contact with the first contact portion are moved, whereby the operated portion of the system is used. The specified target position is moved, the error from the predetermined trajectory of the target position is measured in the third step, and the force or tactile sensation based on the error is measured in the fourth step. A method of presenting the error to the user by applying it to the second limb in contact with the contact portion of the body.
Of course, this is not the case.

Finally, various embodiments of the present invention have been described, but these are presented as examples and are not intended to limit the scope of the invention. The novel embodiment can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. The embodiment and its modifications are included in the scope and gist of the invention, and are included in the scope of the invention described in the claims and the equivalent scope thereof.

1: System 2: Image pickup device 3: Control device 30: Communication bus 31: Communication unit 32: Storage unit 33: Control unit 331: Reception unit 332: Image processing unit 333: Calculation unit 334: Control signal generation unit 4: Main device 41: First contact part 42: Second contact part 43: Operated part 44: Position adjustment part 45: Error sense presentation part CS: Control signal CS1: Control signal CS2: Control signal CT: Image center E: Error HF1 : First limb HF2: Second limb IM: Image L: Line LF: Left foot LH: Left hand P: Specified surface RF: Right foot RH: Right hand ROI: Predetermined area TP: Target position U: User v1: Error vector v2: Symmetric vector

Claims

It ’s a system,
A first contact portion, a sensor portion, and a second contact portion are provided.
The first contact portion is
Connected to the operated part,
By coming into contact with the user's first limb, the target position defined by the operated portion is variably configured according to the movement of the first limb.
The sensor unit is configured to measure an error from a predetermined trajectory of the target position.
The second contact portion is
It is provided with an error sensation presenting unit, and is configured to come into contact with a second limb different from the first limb of the user.
The error sensation presenting unit is configured to present the error to the user by applying a force sense or a tactile sense based on the error to the second limb.
In the system according to claim 1,
Further equipped with a guide light irradiation unit,
The guide light irradiation unit is configured such that the position coaxially or relative to the sensor unit is fixed and the guide light indicating the target position can be irradiated.
In the system according to claim 1 or 2.
The first and second limbs are the left and right hands of the user.
The first and second contact portions are configured so that they can be grasped by the left and right hands, respectively.
In the system according to any one of claims 1 to 3.
The force or tactile sensation based on the error is determined in proportion to the error vector representing the error.
In the system according to any one of claims 1 to 3.
The first and second limbs are the left and right hands or feet of the user.
The force or tactile sensation based on the error is determined in proportion to the symmetry vector obtained by symmetrically moving the error vector representing the error with respect to the plane of symmetry, where the plane of symmetry is moved back and forth from the center of the trunk of the user. Things that are a protracted surface.
In the system according to claim 4 or 5.
The force or tactile sensation based on the error is converted into a frequency suitable for human sense presentation and presented.
In the system according to any one of claims 1 to 5.
The sensor unit is an imaging unit configured to be capable of capturing information from the outside world.
In the system according to claim 7,
The target position is the center of an image captured by the imaging unit.
In the system according to any one of claims 1 to 8.
Further equipped with a position adjustment unit,
The position adjustment unit is
The operated portion can be displaced in a second range smaller than the first range in which the user can operate.
It is configured so that the position of the operated portion can be adjusted so as to correct the error.
In the system of claim 9,
The acquisition rate of the sensor unit and the drive rate of the position adjustment unit are 100 hertz or more.
How to operate the system
With the first to fourth steps
In the first step, the user's first limb is brought into contact with the first contact portion of the system, and the user's second limb is brought into contact with the second contact portion of the system.
In the second step, by moving the first limb in contact with the first contact portion, the target position defined by the operated portion of the system is moved.
In the third step, the error from the predetermined trajectory of the target position is measured.
In the fourth step, a method of presenting the error to the user by applying a force sense or a tactile sense based on the error to the second limb in contact with the second contact portion. ..