KR101654156B1 - Apparatus and method for motion capture using sensor module - Google Patents

Apparatus and method for motion capture using sensor module Download PDF

Info

Publication number
KR101654156B1
KR101654156B1 KR1020150083702A KR20150083702A KR101654156B1 KR 101654156 B1 KR101654156 B1 KR 101654156B1 KR 1020150083702 A KR1020150083702 A KR 1020150083702A KR 20150083702 A KR20150083702 A KR 20150083702A KR 101654156 B1 KR101654156 B1 KR 101654156B1
Authority
KR
South Korea
Prior art keywords
sensor
motion
sensing
identification signal
data
Prior art date
Application number
KR1020150083702A
Other languages
Korean (ko)
Inventor
주민규
Original Assignee
㈜리커시브소프트
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ㈜리커시브소프트 filed Critical ㈜리커시브소프트
Priority to KR1020150083702A priority Critical patent/KR101654156B1/en
Application granted granted Critical
Publication of KR101654156B1 publication Critical patent/KR101654156B1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Length Measuring Devices With Unspecified Measuring Means (AREA)
  • Testing Or Calibration Of Command Recording Devices (AREA)

Abstract

According to the present invention, a motion capture system using data transmission and reception of a sensor module has superior reliability. The motion capture system using data transmission and reception of a sensor module includes: multiple motion sensor devices (1000); and a server (2000). The multiple motion sensor devices (1000) include: a sensor module (100) including a terrestrial magnetism sensor (110) sensing a bearing, an acceleration sensor (120) sensing acceleration and an acceleration direction, and a gyro sensor (130) sensing rotational inertia; a sensor case (200); a transmitter-receiver (300) transmitting sensing data and an inherent identification signal to the outside; and a mount unit (400). The server (2000) performs a motion sensing calculation based on the sensing data at a location where the motion sensor devices (1000) are mounted.

Description

TECHNICAL FIELD [0001] The present invention relates to a motion capture system using data transmission and reception of a sensor module, and a motion capture method using the same.

The present invention relates to a motion capture system and method for capturing motion of a user, and more particularly, to a motion capture system using data transmission / reception of a sensor module and a motion capture method using the same.

As various game machines become popular in the home, interest in interfaces for manipulating characters appearing in the game is increasing day by day.

For example, it is common to operate a character appearing on the screen by using a device such as a joystick or a mouse, but in recent years, there has also appeared an operation method in which a virtual character moves in response to a human action.

In order to generate the motion of the three-dimensional virtual character corresponding to the motion of a person, it is common to first make a skeleton model for a virtual joint having a degree of freedom corresponding to a motion joint portion of a person and a predetermined length.

Then, an infrared marker or an inertial sensor is attached to each joint of a person to measure the angle of movement of each joint, and then, using the positions (x, y, z) and angles (φ, θ, And the operation of the virtual character is generated.

However, in order to realize the motion of the 3D virtual character naturally, it is common to use a large number of sensors to be attached to a human being because it is necessary to obtain human motion information as much as possible.

However, if the number of sensors is increased, it is difficult to perform calibration through initial measurement and it is not suitable for use as an interface of an application system such as a game because it requires expensive equipment in terms of unit cost of implementing the system.

In general, when a motion capture device with high accuracy is desired, there is a method of using an optical motion capture device. However, in this case, there is a disadvantage that the number of cameras installed on the outside increases in order to secure a view of the camera.

Therefore, it is important to generate 3D virtual character motion effectively using a small number of sensor information that can be used in various application fields.

US Patent No. 8,355,529 B2 KR Patent Registration No. 10-0415884 B1 US Publication No. 2012/0280902 A1

SUMMARY OF THE INVENTION It is an object of the present invention to solve the above problems of the prior art.

More specifically, an object of the present invention is to provide a motion sensing apparatus including a sensing module in which a plurality of sensors are integrated into one body and a motion sensing device including a transceiver for transmitting and receiving sensing data of the sensing module to a user's body, And a motion capture system capable of recognizing the motion of the user based on the calculated motion data is provided on the basis of the received motion data, thereby providing a relatively inexpensive and reliable motion capture system.

In order to achieve the above object, a motion capture system using data transmission / reception of a sensor module according to the present invention includes a geomagnetism sensor 110 for sensing a direction, an acceleration sensor 120 for sensing an acceleration and an acceleration direction, A sensor module (100) including a sensor (130); A sensor case 200 for mounting the sensor module 100 therein and protecting the sensor module 100 from an external impact; The sensor module 100 is mounted inside the sensor case 200 and has a unique identification signal and is connected to the sensor module 100 to detect the position of the geomagnetic sensor 110, the acceleration sensor 120, the gyro sensor A transceiver 300 for transmitting sensed data and a unique identification signal to the outside; And a mount unit 400 coupled to a lower portion of the sensor case 200 to attach the sensor case 200 having the sensor module 100 and the transceiver 300 to a user's body, The sensor device 1000 receives the unique identification signal transmitted from each transceiver 300 of the plurality of motion sensor devices 1000 and the sensing data of the sensor module 100 and transmits the sensed data to the respective motion sensor devices And a server 2000 for performing a motion sensing operation based on sensing data at a position where the sensing unit 1000 is mounted.

A motion capture method using a motion capture system using data transmission / reception of a sensor module includes a motion sensor device 1000 for fixing a plurality of motion sensor devices 1000, each having a unique identification signal, Device fixing step (A); A motion sensor device identification signal for inputting to the server 2000 the individual identification signal and position of each motion sensor device 1000 fixed to each joint of the body and a part of the object to be captured in the motion sensor device fixing step (A) A position input step (B); (C) performing an operation by a user after the motion sensor device identification signal and position input step (B); The acceleration sensor 120, the gyro sensor 120, and the gyro sensor 110 of the motion sensor device 1000, which are fixed to each joint of the user's body and a region to be captured, A sensing data generation step (D) for generating sensing data in the memory (130); (E) transmitting data sensed by the sensing data generation step (D) and a unique identification signal of the transceiver (300) to the outside; The sensing data having the respective unique identification signals sent from the plurality of motion sensor devices 1000 fixed to the joints of the user's body and the parts to be captured are received from the server 2000 through the data transmission step (E) (F); A sensing data body position matching step (G) for matching the sensing data inputted in the server receiving step (F) on the basis of the motion sensor device identification signal and the position of each motion sensor device (1000) inputted in the position input step (B) ); When the sensed data of the motion sensor device 1000 for each part of the user's body and the part of the captured object are matched by the sensed data body position matching step (G), a motion computation Step (H); And an image processing step (I) of converting the motion of the user calculated by the motion calculation step (H) into image data.

As described above, according to the present invention, each motion sensor device 1000 independently has a unique identification signal, and is installed in each part of the user's body to generate sensing data according to the movement of the user and sends the sensed data to the server 2000, In the server 2000, it is possible to identify and map which sensing data is output from which part of the user's body by using the sensing data and the identification signal, thereby recognizing the motion of the user and outputting the sensed data as image data.

Accordingly, it is possible to replace the conventional expensive optical motion capture apparatus and provide a motion capture system with a reliability higher than that of a mechanical low-cost motion capture apparatus.

1 is an overall configuration diagram of a motion capture system using data transmission / reception of a sensor module according to an embodiment of the present invention;
FIG. 2 is an exemplary view showing a band type and a suit type of a motion capture system using data transmission / reception of a sensor module according to an embodiment of the present invention; FIG.
3 is a flowchart of a motion capture method using a motion capture system using data transmission / reception of a sensor module according to an embodiment of the present invention;

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings, but the present invention is not limited by the scope of the present invention.

1, a motion capture system using data transmission / reception of a sensor module according to the present invention includes a geomagnetism sensor 110 for sensing a direction, an acceleration sensor 120 for detecting acceleration and acceleration directions, A sensor module (100) including a sensor (130); A sensor case 200 for mounting the sensor module 100 therein and protecting the sensor module 100 from an external impact; The sensor module 100 is mounted inside the sensor case 200 and has a unique identification signal and is connected to the sensor module 100 to detect the position of the geomagnetic sensor 110, the acceleration sensor 120, the gyro sensor A transceiver 300 for transmitting sensed data and a unique identification signal to the outside; And a mount unit 400 coupled to a lower portion of the sensor case 200 to attach the sensor case 200 having the sensor module 100 and the transceiver 300 to a user's body, The sensor device 1000 receives the unique identification signal transmitted from each transceiver 300 of the plurality of motion sensor devices 1000 and the sensing data of the sensor module 100 and transmits the sensed data to the respective motion sensor devices And a server 2000 for performing a motion sensing operation based on sensing data at a position where the sensing unit 1000 is mounted.

Specifically, the sensor module 100 including the geomagnetism sensor 110 for sensing the respective orientations, the acceleration sensor 120 for sensing the acceleration and the acceleration direction, and the gyro sensor 130 for sensing the rotational inertia, The sensor case 200 is mounted inside the sensor case 200 coated with an elastic material such as silicone. Because of the nature of the motion capture, it is often necessary to wear a motion capture device and take an intense motion or action. Therefore, Since there is a possibility that an impact may be applied to the module 100, the color of the sensor case 200 may be treated with a fluorescent paint so as to be recognized by an optical motion capture device.

The sensor module 100 is connected to a transceiver 300 that transmits a unique identification signal to transmit the sensing data to the outside. The sensing data is synchronized with the unique identification signal of the transceiver 300 And transmitted to the server 2000.

Accordingly, each of the motion sensor devices 1000 independently has a unique identification signal, and is installed in each part of the user's body to generate sensing data according to the movement of the user and transmits the sensed data to the server 2000, It is possible to identify and map which sensing data comes from which part of the body of the user with the sensing data and the identification signal, and the joints of the virtual animation character and the parts of the object to be captured are based on the sensing data of the respective parts Motion capture is enabled.

In the case of the above-mentioned motion sensor device 1000, since there is no wiring for connecting them to each other since they are independently driven apart, there is no wiring for connecting the battery 500 to the inside of the sensor case 200 And a power supply is provided by incorporating a mercury battery or a lithium ion battery therein, or by adopting a cable system in which an external electric wire for supplying power is connected to supply electric power.

2, the mount portion 400 of the motion sensor device 1000 may be fixedly coupled with a band 410 that is bended to a user's body in a user's body fixing manner, It can be selected to be fixedly coupled to each part of the chute 420 to be worn.

3, a motion capture method using a motion capture system using data transmission / reception of a sensor module is a method in which a plurality of motion sensor devices 1000, each having a unique identification signal, (A) fixing a motion sensor device to be fixed to a target site; A motion sensor device identification signal for inputting to the server 2000 the individual identification signal and position of each motion sensor device 1000 fixed to each joint of the body and a part of the object to be captured in the motion sensor device fixing step (A) A position input step (B); (C) performing an operation by a user after the motion sensor device identification signal and position input step (B); The acceleration sensor 120, the gyro sensor 120, and the gyro sensor 110 of the motion sensor device 1000, which are fixed to each joint of the user's body and a region to be captured, A sensing data generation step (D) for generating sensing data in the memory (130); (E) transmitting data sensed by the sensing data generation step (D) and a unique identification signal of the transceiver (300) to the outside; The sensing data having the respective unique identification signals sent from the plurality of motion sensor devices 1000 fixed to the joints of the user's body and the parts to be captured are received from the server 2000 through the data transmission step (E) (F); A sensing data body position matching step (G) for matching the sensing data inputted in the server receiving step (F) on the basis of the motion sensor device identification signal and the position of each motion sensor device (1000) inputted in the position input step (B) ); When the sensed data of the motion sensor device 1000 for each part of the user's body and the part of the captured object are matched by the sensed data body position matching step (G), a motion computation Step (H); And an image processing step (I) of converting the motion of the user calculated by the motion calculation step (H) into image data.

Therefore, the present invention with reference to the above description has the effect of replacing the existing expensive optical motion capture device and providing a reliable motion capture system than the mechanical low-cost motion capture device.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.

100: Sensor module
200: Sensor case
300: Transceiver
400: Mount portion
1000: Multiple motion sensor devices
2000: Server

Claims (4)

delete delete delete A sensor module (100) including a geomagnetic sensor (110) for sensing an orientation, an acceleration sensor (120) for sensing an acceleration and an acceleration direction, and a gyro sensor (130) for sensing rotation inertia. A sensor case 200 for mounting the sensor module 100 therein and protecting the sensor module 100 from an external impact; The sensor module 100 is mounted inside the sensor case 200 and has a unique identification signal and is connected to the sensor module 100 to detect the position of the geomagnetic sensor 110, the acceleration sensor 120, the gyro sensor A transceiver 300 for transmitting sensed data and a unique identification signal to the outside; And a mount unit 400 coupled to a lower portion of the sensor case 200 to attach the sensor case 200 having the sensor module 100 and the transceiver 300 to a user's body, The sensor device 1000 receives the unique identification signal transmitted from each transceiver 300 of the plurality of motion sensor devices 1000 and the sensing data of the sensor module 100 and transmits the sensed data to the respective motion sensor devices And a server 2000 for performing a motion capture operation based on sensing data at a position where the sensor module 1000 is mounted. In the motion capture system using the data transmission / reception of the sensor module,
(A) fixing a plurality of motion sensor devices (1000) each having a unique identification signal to a part of each joint of the body and the object to be captured;
A motion sensor device identification signal for inputting to the server 2000 the individual identification signal and position of each motion sensor device 1000 fixed to each joint of the body and a part of the object to be captured in the motion sensor device fixing step (A) A position input step (B);
(C) performing an operation by a user after the motion sensor device identification signal and position input step (B);
The acceleration sensor 120, the gyro sensor 120, and the gyro sensor 110 of the motion sensor device 1000, which are fixed to each joint of the user's body and a region to be captured, A sensing data generation step (D) for generating sensing data in the memory (130);
(E) transmitting data sensed by the sensing data generation step (D) and a unique identification signal of the transceiver (300) to the outside;
The sensing data having the respective unique identification signals sent from the plurality of motion sensor devices 1000 fixed to the joints of the user's body and the parts to be captured are received from the server 2000 through the data transmission step (E) (F);
A sensing data body position matching step (G) for matching the sensing data inputted in the server receiving step (F) on the basis of the motion sensor device identification signal and the position of each motion sensor device (1000) inputted in the position input step (B) );
When the sensed data of the motion sensor device 1000 for each part of the user's body and the part of the captured object are matched by the sensed data body position matching step (G), a motion computation Step (H);
And an image processing step (I) of imaging the motion of the user calculated by the motion calculation step (H).
KR1020150083702A 2015-06-12 2015-06-12 Apparatus and method for motion capture using sensor module KR101654156B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020150083702A KR101654156B1 (en) 2015-06-12 2015-06-12 Apparatus and method for motion capture using sensor module

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020150083702A KR101654156B1 (en) 2015-06-12 2015-06-12 Apparatus and method for motion capture using sensor module

Publications (1)

Publication Number Publication Date
KR101654156B1 true KR101654156B1 (en) 2016-09-05

Family

ID=56939109

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020150083702A KR101654156B1 (en) 2015-06-12 2015-06-12 Apparatus and method for motion capture using sensor module

Country Status (1)

Country Link
KR (1) KR101654156B1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101950945B1 (en) * 2018-05-16 2019-02-25 (주)코어센스 Apparatus for produciing motion image of motion capture system and mtehod thereof
KR102097033B1 (en) 2019-10-16 2020-04-03 주식회사 코탁스 System for estimating motion by sensing interaction of point body

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100415884B1 (en) 2000-11-06 2004-01-24 (주)모션테크놀로지 Method and apparatus for capturing motion of human body and thereby making motion data file
US20120280902A1 (en) 2011-05-05 2012-11-08 Qualcomm Incorporated Proximity sensor mesh for motion capture
US8355529B2 (en) 2006-06-19 2013-01-15 Sony Corporation Motion capture apparatus and method, and motion capture program
KR20140051554A (en) * 2012-10-23 2014-05-02 이인택 Motion capture system for using ahrs

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100415884B1 (en) 2000-11-06 2004-01-24 (주)모션테크놀로지 Method and apparatus for capturing motion of human body and thereby making motion data file
US8355529B2 (en) 2006-06-19 2013-01-15 Sony Corporation Motion capture apparatus and method, and motion capture program
US20120280902A1 (en) 2011-05-05 2012-11-08 Qualcomm Incorporated Proximity sensor mesh for motion capture
KR20140051554A (en) * 2012-10-23 2014-05-02 이인택 Motion capture system for using ahrs

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101950945B1 (en) * 2018-05-16 2019-02-25 (주)코어센스 Apparatus for produciing motion image of motion capture system and mtehod thereof
KR102097033B1 (en) 2019-10-16 2020-04-03 주식회사 코탁스 System for estimating motion by sensing interaction of point body

Similar Documents

Publication Publication Date Title
CN106445130B (en) A kind of motion capture gloves and its calibration method for gesture identification
US10642368B2 (en) Body posture detection system, suit and method
KR101427365B1 (en) Motion Capture System for using AHRS
US20100194879A1 (en) Object motion capturing system and method
KR101080078B1 (en) Motion Capture System using Integrated Sensor System
KR101214227B1 (en) method of motion tracking.
EP3188128A1 (en) Information-processing device, information processing method, and program
CN105125160B (en) Oral cavity endoscope detecting system and detecting method thereof
JP5640716B2 (en) Information processing apparatus and information processing system
US11460912B2 (en) System and method related to data fusing
KR20210093866A (en) Information processing devices, information processing methods and programs
CN106248110A (en) Attitude measuring is from the method and system of dynamic(al) correction
RU121947U1 (en) TRAFFIC CAPTURE SYSTEM
KR101654156B1 (en) Apparatus and method for motion capture using sensor module
KR20160111281A (en) Wireless control system for modular robot using motion suit
WO2011016302A1 (en) Marker for motion capture
Jovanov et al. Avatar—A multi-sensory system for real time body position monitoring
Islam et al. Full-body tracking using a sensor array system and laser-based sweeps
CN105278538B (en) A kind of no-manned machine distant control device and method indicated with heading
CN111420391A (en) Head-mounted display system and space positioning method thereof
CN107091640B (en) Master controller action attitude detection device and electronic control system
KR20160015674A (en) System for analyzing of human movement using inertial sensor
CN106500725A (en) The method and system that attitude measuring is corrected automatically
CN106248109A (en) Attitude measuring is from the method and system of dynamic(al) correction
US20070146312A1 (en) Interactive control system

Legal Events

Date Code Title Description
E701 Decision to grant or registration of patent right
GRNT Written decision to grant