KR20230122558A - 3D human character size correction method using motion capture system - Google Patents

Abstract

The embodiment includes generating a 3D character corresponding to the user's motion capture; Receiving motion data of a user on a moving distance measuring device; calculating a movement distance of the 3D character using the motion data; and correcting the size of the 3D character in correspondence to the ratio of the actual movement distance of the user and the movement distance of the 3D character.

Description

3D human character size correction method using motion capture system {3D human character size correction method using motion capture system}

The embodiment relates to a method for correcting the size of a 3D human character according to the length of a user's body by linking a motion capture system with a 3D engine such as Unity or Unreal. utilizes treadmill equipment to make this possible.

Although each user wearing motion capture equipment has different physical conditions, there is a problem that the size of the 3D object projected on the content is fixed.

Furthermore, since the motion capture system using an inertial sensor does not know the size of the person wearing the sensor, there is a problem of using a 3D human character of the default size specified by the content developer or by manually adjusting the size of the character. there is.

When using a 3D human character that does not apply the physical condition of a person wearing motion capture equipment in 3D content, there is a problem that the movement amount of the character is different from the actual one.

The embodiment provides a character size correction method for correcting the size of a 3D human character according to a user's body length by linking a motion capture system with a 3D engine such as Unity or Unreal.

In addition, the embodiment provides a character size correction method that provides a more accurate 3D character by easily correcting the character to the shape of an actual user.

The problem to be solved in the embodiment is not limited thereto, and it will be said that the solution to the problem described below or the purpose or effect that can be grasped from the embodiment is also included.

A character size correction method according to an embodiment includes generating a 3D character corresponding to motion capture of a user; Receiving motion data of a user on a moving distance measuring device; calculating a movement distance of the 3D character using the motion data; and correcting the size of the 3D character in response to the ratio of the actual movement distance of the user and the movement distance of the 3D character.

In the receiving step, motion data of the user may be generated while the user moves a certain distance in the movement distance measuring device.

The arbitrary distance may correspond to the actual moving distance of the user.

In the step of correcting the size of the 3D character, the step length and height of the 3D character may be scaled at the ratio.

In the generating step, reference motion data corresponding to the reference pose (T-pose) is stored as an initial value, and each point in the reference motion data may be stored as Equation 1 below.

[Equation 1]

: is the initial displacement of the nth point

The receiving of the motion data of the user may include reproducing the motion of the 3D character using information on the start and end positions of each point of each frame of the motion data and the amount of rotation.

In the step of calculating the movement distance of the 3D character,

The movement distance of the 3D character may be calculated using the distance between the ankles of the 3D character (AnkleDistance) and the difference (θ) between the moving directions of the ankles and the direction in which the waist looks in the global coordinate system.

In the step of calculating the movement distance of the 3D character,

The movement distance of the 3D character may be calculated by Equation 2 below.

[Equation 2]

(Here, the stride corresponds to the moving distance of the 3D character)

Character size correction apparatus according to an embodiment includes a receiving unit for receiving motion data; and a control unit, wherein the control unit generates a 3D character corresponding to the motion capture of the user, receives motion data of the user on a movement distance measuring device, and calculates a movement distance of the 3D character using the motion data. and correcting the size of the 3D character in response to the ratio of the actual moving distance of the user and the moving distance of the 3D character.

In the step of correcting the size of the 3D character, the step length and height of the 3D character may be scaled at the ratio.

According to the embodiment, a character size correction method capable of 3D human character size correction is implemented using treadmill equipment, although size correction is impossible only with motion capture equipment.

In addition, the embodiment may implement a character size correction method that provides a more accurate 3D character by easily correcting the character to the shape of an actual user.

Various advantageous advantages and effects of the present invention are not limited to the above description, and will be more easily understood in the process of describing specific embodiments of the present invention.

1 is a block diagram of a motion capture system and a compensation device according to an embodiment of the present invention;
2 is a flowchart of a character size correction method according to an embodiment of the present invention;
3 is a detailed flowchart of a character size correction method according to an embodiment,
4 is a diagram showing each point of a 3D character;
5 is a diagram in which a 3D character is reproduced from motion data for a user's movement;
6 is a diagram explaining the derivation of the movement distance of a 3D character;
7 is a diagram showing a comparison of a difference between an actual moving distance and a moving distance of a 3D character;
8 is a diagram explaining size correction of a 3D character.

Since the present invention can make various changes and have various embodiments, specific embodiments are illustrated and described in the drawings. However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers such as second and first may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a second element may be termed a first element, and similarly, a first element may be termed a second element, without departing from the scope of the present invention. The terms and/or include any combination of a plurality of related recited items or any of a plurality of related recited items.

It is understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but other elements may exist in the middle. It should be. On the other hand, when an element is referred to as “directly connected” or “directly connected” to another element, it should be understood that no other element exists in the middle.

Terms used in this application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the present application, they should not be interpreted in an ideal or excessively formal meaning. don't

Also, some embodiments may be presented as functional block structures and various processing steps. Some or all of these functional blocks may be implemented as a varying number of hardware and/or software components that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more processors, controllers, or microprocessors, or circuit configurations to perform intended functions. Also, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. Functional blocks may be implemented as an algorithm running on one or more processors. In addition, the present disclosure may employ prior art for electronic environment setting, signal processing, and/or data processing. Terms such as module and component may be used broadly and are not limited to mechanical and physical components.

Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings, but the same or corresponding components regardless of reference numerals are given the same reference numerals, and overlapping descriptions thereof will be omitted.

1 is a block diagram of a motion capture system and correction device according to an embodiment of the present invention, FIG. 2 is a flowchart of a character size correction method according to an embodiment of the present invention, and FIG. 3 is a character size correction method according to an embodiment 4 is a diagram showing each point of a 3D character, FIG. 5 is a diagram in which a 3D character is reproduced from motion data for a user's movement, and FIG. 6 explains derivation of a movement distance of a 3D character. FIG. 7 is a diagram showing a comparison between a difference between an actual movement distance and a movement distance of a 3D character, and FIG. 8 is a diagram explaining size correction of a 3D character.

Referring to FIG. 1 , a motion capture system 1000 according to an embodiment may include a motion capture device 100 and a sensor 200 .

The motion capture system 1000 may output motion capture through the motion capture device 100 or process motion information of the user in response to the motion of a subject or user (eg, a person) equipped with the sensor 200. . Motion capture can be depicted as 3D drawings or 3D characters. Hereinafter, a description will be made based on 3D characters.

The sensor 200 may include a gyro sensor as an inertial sensor. Furthermore, the sensor 200 may include various sensors (eg, a foot pressure sensor) applicable to motion data. Accordingly, the motion capture device 100 may receive motion data, pressure data, joint data (angle), and the like from the sensor 200 .

The motion capture device 100 may be connected to the sensor 200 to process motion data. That is, the motion capture device 100 may process data received from the sensor 200 to process and extract motion information and reproduce or output a 3D character.

As described above, the motion capture device 100 may correct motion capture in addition to processing and extracting motion information. Accordingly, the motion capture device 100 may include a correction device. Hereinafter, the motion capture device 100 will be described as including a motion compensation device.

The calibration device 100 may include a receiver 110 and a controller 120 . The receiving unit 110 may be connected to the sensor 200 to receive sensor data including motion data. In addition, the receiving unit 110 may be connected to a moving distance measurement device to receive information about a user's moving distance. For example, the movement distance measurement device may include a treadmill.

The controller 120 may be connected to the receiver 110 to create a 3D character corresponding to the user's motion capture. Furthermore, the control unit 120 s receives the user's motion data on the movement distance measurement device, calculates the movement distance of the 3D character using the motion data, and compares the user's actual movement distance with the movement distance of the 3D character. , the size of the 3D character can be corrected in response to the ratio between the moving distances. A detailed description of this may be equally applied to a description of a character size correction method to be described later. That is, the control unit 120 may perform each step of a character size correction method described later.

2 and 3, the character size correction method according to the embodiment includes generating a 3D character corresponding to the user's motion capture (S310), and receiving the user's motion data on the movement distance measuring device (S320). ), calculating the movement distance of the 3D character using motion data (S330), correcting the size of the 3D character in response to the ratio of the user's actual movement distance and the movement distance of the 3D character (S340). can

Furthermore, the step of receiving the user's motion data (S320) includes the step of the user moving on a moving distance measuring device (hereinafter mixed with a treadmill) (S321), the step of collecting motion data (S322), and the motion data for each frame. A step of reproducing the movement of the 3D character using information on the start and end positions of the points and the amount of rotation (S323) may be included.

And the step of correcting the size of the 3D character (S340) is the step of comparing the actual movement distance with the movement distance of the 3D character (S341) and the step of scaling (correcting the size) the step length and height of the 3D character by a ratio (S342) can include

Specifically, the controller may create a 3D character corresponding to the user's motion capture (S310). Referring further to FIG. 4 , a user may mount at least one sensor disposed at a specific location. The controller may create a 3D character (ch) based on data (eg, motion data) received from these sensors. Also, the controller may store a point of the first motion data corresponding to the reference pose (eg, T-pose) as an initial value. In addition, a 3D human character (mixed with 3D character) (ch) having an arbitrary size corresponding to the point of the first motion data may be created. Accordingly, the character ch may have at least one point corresponding to the sensor.

In an embodiment, the control unit 120 stores the reference motion data corresponding to the reference posture (T-pose) as an initial value in the generating step (S310), and each point in the reference motion data, which is motion data for the reference posture, is It can be stored as Equation 1 below.

[Equation 1]

: is the initial displacement of the nth point

Furthermore, the reference posture may include various postures such as Tpose, Apose, and Ypose.

And, the controller 120 may receive motion data of the user on the movement distance measuring device (S320).

Referring further to FIG. 5 , when motion data is received (S320), the user may first move on a moving distance measuring device (hereinafter, used together with a treadmill) (S321). This movement may correspond to a step of receiving movement information from the distance measuring device. For example, the controller may receive movement information corresponding to the user's movement from the movement distance measuring device.

Further, the controller may collect motion data while the user moves on the movement distance measuring device (S322). In other words, in the receiving step (S320), motion data of the user may be generated while the user US moves a certain distance in the movement distance measuring device TM. That is, while the user US is moving on the moving distance measurement device TM, the calibration device may receive motion data from the sensor SE attached to the user US. Also, the above-described arbitrary movement distance may correspond to the actual movement distance of the user US.

Also, the controller may reproduce the movement of the 3D character ch from motion data received while the user US moves on the movement distance measuring device TM. That is, the control unit may reproduce the motion of the 3D character by using the start and end position information and rotation amount of each point of each frame of the motion data (S323). For example, the start and end position information and rotation amount of each point of each frame of motion data are transmitted to a 3D engine, and the 3D engine parses the received data to reproduce the user's movement as a 3D human character. The 3D engine may be located within or external to the motion capture device 100 .

And the controller can calculate the movement distance of the 3D character using the motion data (S330).

Specifically, further looking at FIG. 6, when the controller calculates the movement distance of the 3D character, the movement distance of the 3D character is the distance between the ankle and ankle of the 3D character (AnkleDistance), the direction of movement of the ankle and ankle in the global coordinate system, and the waist can be calculated using the difference (θ) of the direction in which

As an example, the movement distance of the 3D character may be calculated by Equation 2 below.

[Equation 2]

(Here, the stride corresponds to the moving distance of the 3D character)

Further looking at FIG. 7 , the controller may correct the size of the 3D character according to the ratio of the user's actual movement distance (DISTANCE A) and the 3D character's movement distance (DISTANCE B) (S340).

As an example, in the case of correcting the size of the 3D character (S340), the controller compares the actual movement distance (DISTANCE A) with the movement distance of the 3D character (S341), and then scales the stride length and height of the 3D character in proportion Alternatively, size correction may be performed (S342).

As an example, since the 3D character is initially created in an arbitrary size, the movement distance of the uncorrected 3D character (initial 3D character) and the movement distance of the user on the treadmill may be calculated differently. In the present invention according to an embodiment, the size of the character may be corrected through a ratio between the movement distance of the 3D character and the user's movement distance (actual movement distance).

8, the control unit obtains the ratio of the moving distance of the 3D character and the actual moving distance of the user as shown in Equation 3 below, and then adjusts the size of the 3D character having an arbitrary size by the calculated ratio as shown in Equation 4 below. can

[Equation 3]

Here, scale is a ratio, Human Walking Distance is the actual movement distance of the user, and Character Walking Distance is the movement distance of the 3D character.

[Equation 4]

Height' is the height of the corrected 3D character, scale is a ratio, and height is an arbitrary size or initial height of the 3D character.

Furthermore, in the embodiment, the movement distance of the 3D character may be obtained through a step length calculation method (Equation 2). In addition, the corrected stride length ( stride' ) may be recalculated through the scale between the 3D character corrected to the size of the actual user (eg, a person) and the basic 3D character as shown in Equation 5 below.

[Equation 5]

stride' is the length of the corrected stride, scale is a ratio, and stride is an arbitrary size or stride of the initial 3D character.

The character size correction method according to the disclosed embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer readable medium. In addition, an embodiment of the present disclosure may be a computer-readable recording medium on which one or more programs including instructions for executing a character size correction method are recorded.

And, the computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the medium may be those specially designed and configured for the present invention or those known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. - includes hardware devices specially configured to store and execute program instructions, such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of program instructions include high-level language codes that can be executed by a computer using an interpreter, as well as machine language codes such as those produced by a compiler.

Here, the device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' only means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and this term refers to the case where data is stored semi-permanently in the storage medium. and temporary storage are not distinguished. For example, a 'non-temporary storage medium' may include a buffer in which data is temporarily stored.

According to one embodiment, the character size correction method according to various embodiments disclosed in this document may be included and provided in a computer program product. Computer program products may be traded between sellers and buyers as commodities. A computer program product is distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (eg downloaded or uploaded) online, directly between smartphones. In the case of online distribution, at least a part of a computer program product (eg, a downloadable app) is stored on a device-readable storage medium such as a memory of a manufacturer's server, an application store's server, or a relay server. It can be temporarily stored or created temporarily.

Specifically, it may be implemented as a computer program product including a recording medium in which a program for performing the character size correction method according to the disclosed embodiment is stored.

Although the embodiments have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concept of the present invention defined in the following claims are also within the scope of the present invention. belongs to

The term '~unit' used in this embodiment means software or a hardware component such as a field-programmable gate array (FPGA) or ASIC, and '~unit' performs certain roles. However, '~ part' is not limited to software or hardware. '~bu' may be configured to be in an addressable storage medium and may be configured to reproduce one or more processors. Therefore, as an example, '~unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables. Functions provided within components and '~units' may be combined into smaller numbers of components and '~units' or further separated into additional components and '~units'. In addition, components and '~units' may be implemented to play one or more CPUs in a device or a secure multimedia card.

Although the above has been described with reference to the embodiments, this is only an example and does not limit the present invention, and those skilled in the art to which the present invention belongs will not deviate from the essential characteristics of the present embodiment. It will be appreciated that various variations and applications are possible. For example, each component specifically shown in the embodiment can be modified and implemented. And differences related to these modifications and applications should be construed as being included in the scope of the present invention as defined in the appended claims.

Claims (10)

generating a 3D character corresponding to the user's motion capture;
Receiving motion data of a user on a moving distance measuring device;
calculating a movement distance of the 3D character using the motion data; and
Correcting the size of the 3D character in correspondence to the ratio of the actual movement distance of the user and the movement distance of the 3D character; Character size correction method comprising a.
According to claim 1,
In the receiving step, the motion data of the user is generated while the user moves a certain distance in the movement distance measuring device.
According to claim 2,
The arbitrary distance is a character size correction method corresponding to the actual movement distance of the user.
According to claim 1,
In the step of correcting the size of the 3D character, the step length and height of the 3D character are scaled by the ratio.
According to claim 1,
In the generating step, the reference motion data corresponding to the reference posture (T-pose) is stored as an initial value;
A character size correction method in which each point in the reference motion data is stored as Equation 1 below.
[Equation 1]
: is the initial displacement of the nth point
According to claim 5,
Receiving the motion data of the user,
and reproducing the movement of the 3D character by using the start and end position information and rotation amount of each point of each frame of the motion data.
According to claim 6,
In the step of calculating the movement distance of the 3D character,
The moving distance of the 3D character is calculated using the distance between the ankles of the 3D character (AnkleDistance) and the difference (θ) between the traveling direction of the ankle and the ankle in the global coordinate system and the direction the waist is looking at. Character size correction method.
According to claim 7,
In the step of calculating the movement distance of the 3D character,
A character size correction method in which the movement distance of the 3D character is calculated by Equation 2 below.
[Equation 2]

(Here, the stride corresponds to the moving distance of the 3D character)
a receiving unit for receiving motion data; and
Including; control unit;
The control unit generates a 3D character corresponding to the user's motion capture, receives the user's motion data on a movement distance measuring device, calculates the movement distance of the 3D character using the motion data, and determines the user's actual movement distance. A motion capture correction device for correcting a size of the 3D character in response to a ratio of a movement distance and a movement distance of the 3D character.
According to claim 9,
In the step of correcting the size of the 3D character, the step length and height of the 3D character are scaled by the ratio.

Images