WO2017185585A1

WO2017185585A1 - Human-machine interaction system and method

Info

Publication number: WO2017185585A1
Application number: PCT/CN2016/098840
Authority: WO
Inventors: 王锐; 赵阳; 钱学雷
Original assignee: 王锐; 赵阳; 钱学雷
Priority date: 2016-04-28
Filing date: 2016-09-13
Publication date: 2017-11-02
Also published as: CN105955510A

Abstract

A human-machine interaction system and method, the human-machine interaction system comprising a positioning apparatus, a wearable RFID read/write device, a posture identification apparatus, a processing unit, and an output device; the positioning apparatus is independently placed or arranged on an attached object, one or a plurality of RFID tags corresponding on a one-to-one basis with spatial 3D coordinates being arranged thereon; the wearable RFID read/write device can be wearably fixed onto a target subject to implement reading and writing of the RFID tags; the posture identification apparatus can be wearably fixed onto the target subject to acquire posture data of the target subject; the processing unit is connected to the wearable RFID read/write device and the posture identification apparatus; and the output device is connected to the processing unit. The present system and method use radio frequency identification technology for positioning and inertia sensors for posture identification, implementing human-machine interaction on the basis of the acquired position data and posture data, and have low environmental interference, convenient and flexible installation, high precision, and low costs.

Description

Human-computer interaction system and method

Cross-reference to related applications

The present application claims priority to Chinese Patent Application No. 201610281427.2, filed on Apr. 28, 2016, the disclosure of which is hereby incorporated by reference.

Technical field

The present invention relates to the field of human-computer interaction technologies, and in particular, to a human-computer interaction system and method.

Background technique

With the development of society, the advancement of network and communication technology, graphic image processing technology and computer technology, Virtual Reality, a computer simulation system that can create and experience virtual worlds, has become more and more popular and become human. A new way of communication. The most important feature of virtual reality is that it has good interactivity and immersion. The main technology of interaction and immersion relies on high-precision spatial positioning and accurate gesture recognition, that is, effective human-computer interaction. Provide a better experience of seamless integration.

Summary of the invention

In order to achieve the above object, the present invention provides a human-computer interaction system and method, which utilizes radio frequency identification technology to achieve positioning, uses inertial sensors to implement gesture recognition, and implements human-computer interaction based on obtained position data and attitude data. The invention is less affected by the environment, convenient and flexible to install, free from the limitation of the positioning space area and the number of target objects, high precision and low cost.

According to an aspect of the present invention, a human-computer interaction system is provided, the human-computer interaction system including a positioning device, a wearable RFID reader/writer, a gesture recognition device, a processing unit, and an output device, wherein:

The positioning device is independently placed or arranged on an attached object, and one or more radio frequency identification (RFID) tags are arranged in the positioning device, and the RFID tags are in one-to-one correspondence with spatial three-dimensional coordinates;

The wearable RFID reader/writer can be wearably fixed on the target object, perform read and write operations on the RFID tag, and obtain target object location data;

The gesture recognition device is wearable and fixed on the target object, and acquires target object posture data;

The processing unit is connected to the wearable RFID reader/writer and the gesture recognition device for processing the target object position data and the target object posture data;

The output device is coupled to the processing unit for outputting target object position data and target object posture data processed by the processing unit.

Optionally, the positioning device is composed of one positioning unit or is composed of a plurality of positioning unit connections. When the positioning device is composed of a plurality of positioning unit connections, the positioning unit is provided with a connecting member.

Optionally, the RFID tag is a medium frequency/ultra high frequency RFID tag.

Optionally, the wearable RFID reader comprises: a reader body and a fixing unit, wherein:

The reader/writer body performs a read and write operation on the RFID tag;

The fixing unit is connected to the reader/writer body to wearably fix the reader/writer body.

Optionally, the fixing unit is physically connected to the reader/writer body through a connector or is made as an embedded connection.

Optionally, the reader/writer body comprises: an antenna unit, a radio frequency signal processing unit, a processor, a communication unit, and a power supply unit, wherein:

The antenna unit is connected to the radio frequency signal processing unit;

The radio frequency signal processing unit is connected to the antenna unit and the processor;

The communication unit is connected to the processor;

The power output end of the power supply unit is connected to the power input terminals of the radio frequency signal processing unit, the processor, and the communication unit.

Optionally, the radio frequency signal processing unit further includes a filter; the processor includes a data processing chip and a packaging unit.

Optionally, the gesture recognition device includes a plurality of inertial sensors that are fixed to a wearable unit.

According to another aspect of the present invention, a method for human-computer interaction using the human-machine interaction system is further provided, the method comprising the following steps:

Establishing a one-to-one correspondence between the RFID tags in the positioning device laid in the positioning space and the spatial information of the positioning space;

The wearable RFID reader reads the RFID tag data of the location of the target object, obtains the three-dimensional coordinate information corresponding to the RFID tag according to the correspondence between the identifier information and the three-dimensional space coordinate, and obtains the location data of the target object;

Acquiring the inertial sensing data collected by the gesture recognition device worn by the target object, and processing the obtained inertial sensing data to obtain the target object attitude data;

The obtained target object position data and target object posture data are processed and output.

Optionally, the step of reading, by the wearable RFID reader, the RFID tag data of the location of the target object further comprises filtering, by the wearable RFID reader, the plurality of RFID tag data read at the same time. step.

The human-computer interaction system and method proposed by the invention realizes positioning by using radio frequency identification technology, realizes gesture recognition by using inertial sensors, and realizes human-computer interaction according to the obtained position data and posture data. The positioning device in the human-computer interaction system of the invention can be conveniently installed in the space where the target object is located, and the wearable RFID reader and the gesture recognition device can be conveniently worn on the target object; since the positioning device is inexpensive to use The RFID tag and the gesture recognition device use an inexpensive inertial sensor, so the overall input cost is low. In addition, the present invention is less affected by the environment, is not limited by the positioning space area and the number of target objects, and has high precision.

DRAWINGS

1 is a block diagram showing the structure of a human-machine interaction system according to an embodiment of the present invention;

2 is a block diagram showing the structure of a positioning device according to an embodiment of the present invention;

3 is a schematic structural diagram of a positioning unit according to an embodiment of the invention;

4 is a schematic diagram of connection of a positioning unit according to an embodiment of the invention;

FIG. 5 is a structural block diagram of a wearable RFID reader/writer according to an embodiment of the invention; FIG.

FIG. 6 is a flowchart of a human-computer interaction method according to an embodiment of the invention.

detailed description

The present invention will be further described in detail below with reference to the specific embodiments of the invention. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

According to an aspect of the present invention, a human-computer interaction system is provided. As shown in FIG. 1, the human-computer interaction system includes a positioning device, a wearable RFID reader/writer, a gesture recognition device, a processing unit, and an output device, wherein :

The positioning device is independently placed or arranged on the attached object, and the positioning device is provided with one or more radio frequency identification (RFID) tags, and the RFID tags are in one-to-one correspondence with the spatial three-dimensional coordinates;

The wearable RFID reader is wearable and fixed on the target object, performs read and write operations on the RFID tag, and acquires location data of the target object;

The processing unit is connected to the wearable RFID reader and the gesture recognition device;

The output device is coupled to the processing unit.

The positioning device is composed of a positioning unit or a plurality of positioning unit connections, wherein: one or more radio frequency identification (RFID) tags are disposed in the positioning unit, and the RFID tag and the space three-dimensional coordinates are A correspondence. The positioning device can be placed independently at a certain place, or can be laid/arranged/fixed to the attached object, and the specific installation manner depends on the specific Depending on the application, it can be laid on the floor, fixed on a wall or ceiling, placed on a table, fixed on goods, etc. The positioning device can form a space or cover a space. When the target object, that is, the object to be positioned, moves in the space, the spatial position of the target object can be determined by reading the relevant RFID tag information through the RFID reader/writer. Thereby achieving precise positioning.

The positioning unit is a solid unit having a certain length, width, thickness or other internal or surface that can place the RFID tag. The positioning unit may present a regular shape, such as a square, a rectangle or a circle, or may also have an irregular shape. In order to facilitate the laying of the positioning device in the positioning space and the rational and rational use of the material, the positioning unit can be flexibly selected. The shape of the unit. However, regardless of the shape of the positioning unit, when a plurality of positioning units are used to form the positioning device, the positioning unit needs to be provided with a connecting member, such as a card slot, a buckle, and a connecting buckle at the edge of the positioning unit or near the edge. The connector is connected to fix the relative position between the positioning units or the relative position between the positioning unit and the attached object. It should be noted that the shape of the above positioning unit is merely an exemplary description, and is not intended to limit the present invention. Any reasonable and manufacturable positioning unit shape falls within the protection scope of the present invention.

The positioning unit is made of a non-metallic material or mainly made of a non-metallic material such as polycarbonate, polyvinyl chloride or the like. Of course, the manufacturing material of the positioning unit can be selected according to the installation position of the positioning unit. For example, when the positioning unit is used as a floor, a pressure-resistant non-metal material can be selected, when the positioning unit is used as a ceiling or mounted on a wall. When you are on, you can choose lightweight non-metallic materials and so on.

Each of the RFID tags has a unique identification information, which ensures that each RFID tag is unique in the space required for positioning, and there is a one-to-one correspondence between the identification information and the spatial three-dimensional coordinates. relationship. For example, the identification information may include one or more of EPC ID information of the RFID tag, a serial number of the positioning unit where the RFID tag is located, and a serial number of the RFID tag in the positioning unit. Of course, the identification information may also be other information as long as it can uniquely distinguish a plurality of RFID tags in the same positioning space. The identification information can be established by an editing tool, which can edit and set the positioning unit serial number of the RFID tag and the serial number of the RFID tag in the positioning unit.

The RFID tag can be installed on the inside or the surface of the positioning unit. In practical applications, the installation position of the RFID tag can be selected according to actual needs and the installation position of the positioning device, for example, if the positioning device is laid on the floor. In order to protect the RFID tag and extend its service life, the RFID tag may be installed inside the positioning unit; if the positioning device is installed on a wall or a ceiling, since the RFID tag does not need to bear weight, in order to increase the RFID The identification distance of the tag is increased, and the RFID tag is optionally mounted on the surface of the positioning unit. In this case, in order to protect the RFID tag, the RFID tag may also be The outer surface or the surface of the positioning unit on which the RFID tag is mounted is sheathed with a protective layer which can be made of a pressure-resistant material. It should be noted that the mounting position of the above RFID tag is merely an exemplary description, and is not intended to limit the present invention. Any reasonable and manufacturable mounting position falls within the protection scope of the present invention.

The RFID tag may be any suitable size or size of RFID tag, and the identification range of one or more RFID tags of the positioning unit may completely cover or partially cover the positioning device. In an embodiment of the invention, the RFID tag is a medium-high frequency/ultra-high frequency RFID tag or a medium-high frequency/ultra-high frequency passive RFID tag. It can be understood that the working frequency of the medium-high frequency RFID tag is 3 MHz. At 30MHz, UHF RFID tags operate at frequencies from 860MHz to 960MHz. In a preferred embodiment of the present invention, a 13.54 MHz high frequency passive RFID tag or a 866 MHz/902 MHz UHF passive RFID tag is adopted. These passive RFID tags are less affected by environmental factors, have low cost, and are highly resistant to interference. long lasting. Of course, in practical applications, medium-high frequency or ultra-high frequency RFID tags of other working frequencies can be used according to actual needs. It should be noted that the dimensions and specifications of the above RFID tags are merely exemplary and are not intended to limit the present invention. Any reasonable and achievable RFID tag size and specifications fall within the scope of the present invention.

The RFID tag may be uniformly distributed in the positioning unit, or may be non-uniformly distributed. It can be understood that the uniform distribution refers to the same distance between each RFID tag in the positioning unit, and the non-uniform distribution It means that the distance between each RFID tag in the positioning unit is not the same or not exactly the same. The selection of the RFID tag distribution mode is related to the positioning accuracy and the positioning cost requirement. In order to make the coverage of the RFID tag have no blind zone and achieve all-round seamless high-precision positioning, an evenly distributed mode is usually selected; but in practical applications, Considering that some areas may not require the coverage of RFID tags, in the case that the accuracy requirements can be met, in order to reduce the cost, a non-uniform distribution mode may be selected, and even a distribution mode may be customized according to the actual application requirements of the user. Of course, the arrangement distance between the RFID tags can also be determined according to the required positioning effect and accuracy. Generally, the distance between the RFID tags does not exceed 1 m, and preferably, the distance between the RFID tags is greater than Its size is 3 times. It should be noted that the distribution manner of the above RFID tag is merely an exemplary description, and is not intended to limit the present invention. Any reasonable and achievable distribution manner of the RFID tag falls within the protection scope of the present invention.

The positioning device of the present invention will be further described below by taking a positioning device composed of a plurality of positioning unit connections as an example.

2 is a schematic structural view of a positioning device according to an embodiment of the present invention. As shown in FIG. 2, the positioning device 1 is composed of a plurality of positioning units 11. In the embodiment, the positioning unit 11 adopts a rectangular shape. A regular shape.

3 is a schematic structural diagram of the positioning unit 11 in the embodiment. As shown in FIG. 3, in the interior of the positioning unit 11, the RFID tags 12 are arranged in a non-uniform distribution manner. In this embodiment, between each RFID tag 12 The distance is greater than 1.5 times the size of the RFID tag.

The RFID tag 12 in the positioning unit 11 is edited by the editing tool with unique editing information, and the unique identification information and the spatial position information of the positioning unit 11 where the RFID tag 12 is located and the position of the RFID tag 12 in the positioning unit 11 The information is associated one by one so that the corresponding unique spatial position information of the RFID tag 12 in the positioning device 1 can be determined.

In this embodiment, the positioning unit 11 is made by heating and pressing a polyvinyl chloride material.

Referring to FIG. 4, in the embodiment, the positioning unit 11 is formed by a seamless splicing method, and in FIG. 4, a and b respectively represent two adjacent positioning units.

FIG. 5 is a structural block diagram of a wearable RFID reader/writer according to an embodiment of the present invention. As shown in FIG. 5, the wearable RFID reader/writer 2 includes a reader/writer body 21 and a fixing unit 22, wherein:

The reader/writer body 21 performs a read and write operation on an RFID tag;

The fixing unit 22 is connected to the reader/writer body 21 to perform wearable fixing on the reader/writer body 21;

The fixing unit 22 is connected to the reader/writer body 21 to wearably fix the reader/writer body 21, and the fixing unit 22 is such that when the reader/writer body 21 or the wearable RFID is to be When the reader/writer 2 is worn on a certain part of the body, it can effectively read and write the RFID tag, and ensure that the read/write performance of the reader body is not affected by the movement of the wearing part.

The reader/writer body 21 is a core component of the wearable RFID reader/writer, and includes an antenna unit 211, a radio frequency signal processing unit 212, a processor 213, a communication unit 214, and a power supply unit 215, where:

The antenna unit 211 is connected to the radio frequency signal processing unit 212, and is mainly responsible for receiving the frequency signal matched by the radio frequency signal processing unit 212 and matching the RFID tag, and modulating and demodulating the received RFID tag data. And processing the processed RFID tag data to the radio frequency signal processing unit 212. Based on the antenna unit 211, the wearable RFID reader/writer can send a signal matching the frequency band of the RFID tag that needs to be recognized and read, and then read the RFID. The data content in the tag. The antenna used by the antenna unit 211 may be a flexible antenna or a non-flexible antenna as long as the antenna is not damaged by wearing. In an embodiment of the invention, in order to more suitably wear and protect the antenna, it is preferred to use a flexible antenna for signal transmission and reception. The frequency band of the signal transmitted by the antenna unit 211 may be a medium-high frequency band or an ultra-high frequency band. It can be understood that the frequency range of the medium-high frequency band is 3 MHz to 30 MHz, and the frequency range of the ultra-high frequency band is 860 MHz to 960 MHz. Preferably, an ultra-high frequency band of 860 MHz to 960 MHz is selected.

The radio frequency signal processing unit 212 is connected to the antenna unit 211 and the processor 213, and the radio frequency signal processing unit 212 is configured to process the frequency band signal transmitted by the antenna unit 213 and the RFID tag data received by the antenna unit 211, such as Activating an RFID tag by the antenna unit 213, acquiring information stored in the RFID tag, writing information to the RFID tag, and performing multi-signal processing on a plurality of RFID tags read by the reader at a time, such as group read collision avoidance (when there is When multiple RFID tags are in the measurable range, how to read and process multiple RFID tags separately to avoid interference). In an embodiment of the invention The radio frequency signal processing unit 212 further includes a filter for filtering the plurality of RFID tag data when the reader/writer reads the plurality of RFID tag data at a time to obtain high precision and high accuracy. RFID tag data.

Preferably, the radio frequency signal processing unit 212 employs a chip processor that can process ultra-high band signals.

Those skilled in the art can understand that the RFID tag is passive and needs to be powered by the card reader. The RF signal processing unit 212 can transmit energy to the RFID tag through the antenna, and then the RFID tag is activated, starts and reads the card. The device communicates through the antenna. The basic goal of this communication is to obtain information stored on an RFID tag or to write information to an RFID tag. However, the specific acquisition process depends on different standards, such as the UHF standard of EPCglobal 2, or other standards.

The processor 213 is mainly responsible for processing the RFID tag data received by the radio frequency signal processing unit 212 and the antenna unit 211, encapsulating the RFID tag data according to the data format requirements supported by the communication unit 214, and transmitting the data to the communication unit 214. A command to transmit data, thereby transmitting the RFID tag data obtained from the antenna unit 211 to the other communication device through the communication unit 214.

The processor 213 has a data input end, a data output end, a communication input end and a communication output end, wherein the data input end is connected to the radio frequency signal processing unit 212 to receive the RFID tag data through the radio frequency signal processing unit 212 and the antenna unit 213. The data output terminal is connected to the communication unit 214 to perform RFID signal processing on the RFID tag data obtained from the RF signal processing unit 212 and the antenna unit 213, packaged according to the data format supported by the communication unit 214, and then issued to the communication unit 214. A command to transmit data to transmit RFID tag data obtained from the radio frequency signal processing unit 212 and the antenna unit 213 through the communication unit 214; the communication input terminal is connected to the communication unit 214 to receive read data or write sent by the external device The communication information of the data is connected to the radio frequency signal processing unit 212 to cause the antenna unit 211 to transmit a signal of a certain frequency according to the received communication information by the radio frequency signal processing unit 212, thereby activating the RFID tag to be read.

The processor 213 includes at least a data processing chip and a package unit, and the data processing chip is used to receive the data received by the radio frequency signal processing unit 212 and the antenna unit 211. The RFID tag data is processed; the encapsulation unit is configured to encapsulate the RFID tag data processed by the data processing chip according to a data format supported by the communication unit 214. The communication unit 214 is connected to the processor 213, and is mainly responsible for performing real-time communication between the wearable RFID reader and the external device such as a PC end or a mobile device, thereby processing the RFID tag processed by the processor 213. The data is sent to an external device for further analysis processing or application.

The communication unit 214 includes at least a communication chip, and the communication chip may be a wired communication chip or a wireless communication chip. The wireless communication chip may be a remote wireless communication chip or a near field wireless communication chip. The communication chip may be a communication chip supported by mobile communication technology, such as a GPRS communication chip, a 2G communication chip, a 3G communication chip, a 4G communication chip, or the like, or a combination of multiple wireless communication chips; the near field communication chip may be Bluetooth A communication chip, an infrared communication chip, a WIFI communication chip, a sensor communication chip, a beacon communication chip, or the like, or a combination of a plurality of near field communication chips. It should be noted that the foregoing communication chip is only an exemplary description and is not intended to limit the present invention. Any component that can realize remote and near field communication falls within the protection scope of the present invention. In an embodiment of the present invention, a WIFI communication chip is used for real-time communication and data transmission with an external device, so that a later data processing device, such as a computer, can further process the RFID tag data content obtained by the wearable RFID reader/writer. And analysis.

The power output of the power supply unit 215 is connected to the power input terminals of the radio frequency signal processing unit 212, the processor 213, and the communication unit 214 to provide power for the radio frequency signal processing unit 212, the processor 213, and the communication unit 214.

The power supply unit 215 can be a lithium battery, a polymer battery, a battery, a solar battery, or a combination of the above batteries. In an embodiment of the invention, the power supply unit 215 is a polymer battery to alleviate the wearable RFID. The weight of the reader.

The fixing unit 22 is made of or mainly made of a non-metallic material such as plastic, rubber, textile material or a combination of the above materials, and the like, in fact, as long as the metal material is not present in the vicinity of the fixing unit 22 of the fixed antenna unit 211 or in the vicinity thereof. Further, the fixing unit 22 may be made of a flexible non-metal material or a non-flexible non-metal material, and the specific material selection depends on the wearing part of the wearable RFID reader. The fixing unit 22 can be made into a rubber foot cover, which can be made into a cloth bracelet arm ring, a flexible collar, a knitted glove, and even a portable device that can be clamped on a certain part of the human body or clothing, and the user also Ergonomic specific implementations can be tailored to the needs of the actual application.

The fixing unit 22 and the reader/writer body 21 can be connected in various ways, such as physical connection through a connector or directly into an embedded connection, for example, the reader body 21 can be fixed to the fixing by a connector. On the surface or one side of the unit 22, the fixing unit 22 may be formed in a ring shape, and the reader/writer body 21 may be embedded or dispersedly embedded in the fixing unit 22, where the distributed embedded means that the reader/writer body 21 is The individual units are independently embedded in the fixed unit 22, such as embedding the flexible antenna unit in a position where the risk of damage is high, embedding the non-flexible processor, the power supply unit, and the communication unit into a position where the risk of damage is small, It protects, of course, even if the flexible antenna unit is not easily damaged, its deformation will adversely affect the transceiving performance, so the antenna unit can also be placed together with other units at a position where the risk of damage is small. It should be particularly noted that the connection manner of the fixing unit 22 and the reader/writer body 21 is only an exemplary description, and is not intended to limit the present invention. Any achievable and reasonable connection manner and connection components fall into the protection of the present invention. range.

The gesture recognition device is wearable, and includes a plurality of inertial sensors placed at a target object, such as various joints of the human body, to obtain inertial sensing data at the corresponding joints, thereby obtaining a certain Attitude body data

Wherein, the inertial sensor is a multi-axis sensor, such as a nine-axis sensor including a gyro XYZ axis, an accelerometer XYZ axis, and a magnetometer XYZ axis, so that multi-dimensional inertial sensing data can be obtained, thereby more accurately determining the human body. attitude.

In order to facilitate the placement of a plurality of inertial sensors, in an embodiment of the invention, the plurality of inertial sensors are fixed on a wearable unit capable of covering or partially covering joints that need to acquire inertial sensing data. A plurality of inertial sensors are respectively fixed on the wearable unit at the corresponding joint, so that the target object directly wears the wearable unit with a plurality of inertial sensors fixed to realize the collection of data for the multi-joint inertial transmission.

The wearable unit is made of or mainly made of a non-ferromagnetic material because a ferromagnetic material such as iron-nickel affects the magnetic field, thereby affecting the measurement of the magnetometer, except for aluminum. More preferably, The wearable unit is fabricated from a flexible, non-ferromagnetic material, such as plastic, rubber, textile material, or a combination of the above. Of course, the user can also customize the ergonomic specific implementation according to the needs of the actual application.

The processing unit is connected to the plurality of inertial sensors in the wearable RFID reader/writer and the gesture recognition device, and is mainly responsible for target object position data obtained by the wearable RFID reader and the gesture recognition device. Obtaining the target object posture data for correction and error elimination processing, and calculating the spatial position of the target object at a certain moment and the posture of the target object at the spatial position according to the two types of data, and transmitting the obtained information to the output device .

The output device is connected to the processing unit for outputting location data and posture data of the received target object. The output device can be not only an electronic data output device such as a display, a head-mounted display, a projector, a television, but also a non-electronic data output device such as a motion picture film, a paper, or a media medium. In an embodiment of the present invention, in order to better realize real-time interaction between human and machine, the output device is selected as a display to input position data and posture data of the target object into a simulated three-dimensional space for real-time display.

According to another aspect of the present invention, a method for human-computer interaction using the human-computer interaction system is also proposed. As shown in FIG. 6, the method includes the following steps:

Step S1: establishing a one-to-one correspondence between the RFID tags in the positioning device laid in the positioning space and the spatial information of the positioning space;

Each RFID tag has a unique identification information that ensures that each RFID tag is unique in the space of the desired location, and that there is a one-to-one correspondence between the identification information and the three-dimensional space coordinates.

In an embodiment of the present invention, the RFID tag in the positioning unit can be edited by the editing tool installed on the PC, and the unique identification information and the spatial location information of the positioning unit where the RFID tag is located and the RFID can be The position information of the tag in the positioning unit is associated with each other, so that the unique spatial position information of the RFID tag in the positioning device can be determined.

Step S2: The wearable RFID reader reads the RFID tag data of the location of the target object, and obtains the RFID according to the correspondence between the identification information and the three-dimensional space coordinates. The coordinate information of the three-dimensional space corresponding to the label, thereby obtaining the position data of the target object;

In this step, the wearable RFID reader/writer transmits the obtained RFID tag data to an external device such as a PC, and obtains the RFID tag according to the correspondence between the identification information set by the external device such as the PC and the three-dimensional space coordinates. 3D space coordinate information.

The step S2 further includes the step of filtering the plurality of RFID tag data read by the wearable RFID reader at the same time to obtain high-precision and high-accuracy RFID tag data, thereby obtaining an accurate target object. Spatial location data.

The signal frequency band emitted by the wearable RFID reader can be a medium-high frequency band or an ultra-high frequency band.

Step S3: acquiring inertial sensing data collected by the gesture recognition device worn by the target object, and processing the obtained inertial sensing data to obtain target target posture data;

In this step, the processing performed on the obtained inertial sensing data includes at least a noise removal process to eliminate the influence of environmental factors on the data.

Step S4: processing and outputting the target object position data obtained in the step S2 and the target object posture data obtained in the step S3.

In this step, the target object position data obtained in the step S2 and the target object posture data obtained in the step S3 are corrected and error-removed, and the high-precision human body space position data and posture are calculated according to the two types of data. data.

In this step, the attitude data and the position movement data of the target object can be output to an electronic data output device such as a display, a head-mounted display, a projector, a television, or the like, and can also be output to a non-electronic data output device such as a film film, a paper, or a media medium. . In an embodiment of the present invention, in order to better realize human-machine real-time interaction, the attitude data and the position movement data of the target object are output to the display to perform virtual display in the simulated three-dimensional space.

In an embodiment of the present invention, after the step S2, the method further includes: performing statistics on the RFID tag data read by the wearable RFID reader in a predetermined time period, and predicting the spatial location information of the target object at the next moment. The step is such that only the fine adjustment is needed when the location data of the new target object is received and displayed, which greatly enhances the real-time performance of the human-computer interaction system.

The preset time period may be a certain time period before the current time determined according to the needs of the actual application.

The method for performing statistics on the RFID tag information may be performed by using a plurality of methods, and the spatial location information of the target object at the next moment may be predicted by using a plurality of prediction models, and those skilled in the art may select according to actual application requirements. No remarks or special restrictions are given.

In summary, the invention realizes positioning by using radio frequency identification technology, realizes gesture recognition by using inertial sensors, and realizes human-computer interaction according to obtained position data and posture data. When the target object moves in a space formed or covered by the positioning device, the spatial position of the target object is determined according to the content of the RFID tag read by the RFID reader/writer worn on the body, and the gesture is recognized according to the posture worn on the body. The device determines the posture of the target object at this time, integrates the accurate spatial position data and the posture data into the simulated three-dimensional space for display, and can realize accurate human-machine real-time interaction. Of course, those skilled in the art can also understand that the present invention can also be used. In the case of non-real-time human-computer interaction.

The specific embodiments of the present invention have been described in detail, and are not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

A human-computer interaction system, characterized in that the human-computer interaction system comprises a positioning device, a wearable RFID reader/writer, a gesture recognition device, a processing unit and an output device, wherein:

The positioning device is independently placed or arranged on an attached object, and one or more radio frequency identification (RFID) tags are arranged in the positioning device, and the RFID tags are in one-to-one correspondence with spatial three-dimensional coordinates;

The wearable RFID reader/writer can be wearably fixed on the target object, perform read and write operations on the RFID tag, and obtain target object location data;

The gesture recognition device is wearable and fixed on the target object, and acquires target object posture data;

The processing unit is connected to the wearable RFID reader/writer and the gesture recognition device for processing the target object position data and the target object posture data;

The output device is coupled to the processing unit for outputting target object position data and target object posture data processed by the processing unit.
The human-machine interaction system according to claim 1, wherein the positioning device is composed of one positioning unit or is composed of a plurality of positioning unit connections, and when the positioning device is composed of a plurality of positioning units, The positioning unit is provided with a connector.
The human-machine interaction system according to claim 1, wherein the RFID tag is a medium-high frequency/ultra-high frequency RFID tag.
The human-machine interaction system according to claim 1, wherein the wearable RFID reader/writer comprises: a reader/writer body and a fixing unit, wherein:

The reader/writer body performs a read and write operation on the RFID tag;

The fixing unit is connected to the reader/writer body to wearably fix the reader/writer body.
The human-machine interaction system according to claim 1, wherein the fixed unit and the reader/writer body are physically connected or fabricated as an embedded connection through a connector.
The human-computer interaction system according to claim 1, wherein said reading and writing The body includes: an antenna unit, a radio frequency signal processing unit, a processor, a communication unit, and a power supply unit, wherein:

The antenna unit is connected to the radio frequency signal processing unit;

The radio frequency signal processing unit is connected to the antenna unit and the processor;

The communication unit is connected to the processor;

The power output end of the power supply unit is connected to the power input terminals of the radio frequency signal processing unit, the processor, and the communication unit.
The human-machine interaction system according to claim 5, wherein the radio frequency signal processing unit further comprises a filter; the processor comprises a data processing chip and a packaging unit.
The human-computer interaction system according to claim 5, wherein said gesture recognition means comprises a plurality of inertial sensors fixed to a wearable unit.
A method for human-computer interaction using the human-computer interaction system of claim 1, wherein the method comprises the following steps:

Establishing a one-to-one correspondence between the RFID tags in the positioning device laid in the positioning space and the spatial information of the positioning space;

The wearable RFID reader reads the RFID tag data of the location of the target object, obtains the three-dimensional coordinate information corresponding to the RFID tag according to the correspondence between the identifier information and the three-dimensional space coordinate, and obtains the location data of the target object;

Acquiring the inertial sensing data collected by the gesture recognition device worn by the target object, and processing the obtained inertial sensing data to obtain the target object attitude data;

The obtained target object position data and target object posture data are processed and output.
The method according to claim 9, wherein the step of reading, by the wearable RFID reader, the RFID tag data of the location of the target object further comprises reading the same time for the wearable RFID reader The step of filtering the plurality of RFID tag data.