KR20240022862A - Multi-use motion camera system for immersive contents - Google Patents

Multi-use motion camera system for immersive contents Download PDF

Info

Publication number
KR20240022862A
KR20240022862A KR1020220101449A KR20220101449A KR20240022862A KR 20240022862 A KR20240022862 A KR 20240022862A KR 1020220101449 A KR1020220101449 A KR 1020220101449A KR 20220101449 A KR20220101449 A KR 20220101449A KR 20240022862 A KR20240022862 A KR 20240022862A
Authority
KR
South Korea
Prior art keywords
camera
marker
camera system
image
optical
Prior art date
Application number
KR1020220101449A
Other languages
Korean (ko)
Inventor
양기혁
Original Assignee
(주)모션테크놀로지
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)모션테크놀로지 filed Critical (주)모션테크놀로지
Priority to KR1020220101449A priority Critical patent/KR20240022862A/en
Publication of KR20240022862A publication Critical patent/KR20240022862A/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/003—Navigation within 3D models or images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/292—Multi-camera tracking
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/80—Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30204—Marker

Abstract

본 발명은 광학식 카메라, 이미지 처리모듈, 및 트래킹 모듈을 포함하는 실감형 콘텐츠를 위한 다기능 광학식 모션 카메라 시스템에 관한 것이다.The present invention relates to a multi-functional optical motion camera system for realistic content including an optical camera, an image processing module, and a tracking module.

Description

실감형 콘텐츠를 위한 다기능 광학식 모션 카메라 시스템{MULTI-USE MOTION CAMERA SYSTEM FOR IMMERSIVE CONTENTS}Multifunctional optical motion camera system for realistic content {MULTI-USE MOTION CAMERA SYSTEM FOR IMMERSIVE CONTENTS}

본 발명은 실감형 콘텐츠를 위한 다기능 광학식 모션 카메라 시스템에 관한 것이다.The present invention relates to a multi-functional optical motion camera system for realistic content.

모션 캡처 시스템은 실제 대상의 움직임을 캡처하여 이를 컴퓨터로 생성된 오브젝트에 맵핑시키는데 사용된다. 이러한 시스템은 동영상과 비디오 게임의 제작에 있어서 인물의 디지털 표현을 창출하여 컴퓨터 그래픽 애니메이션을 생성하는 소스 데이터로서 사용되도록 하는 데에 보통 쓰인다. 통상의 시스템에서는, 배우가 여러 위치에 부착된 마커가 달린 의상을 입고, 디지털 카메라는 마커를 조명하는 동안에 서로 다른 각도에서 배우의 움직임을 기록한다. 이어, 시스템은 영상을 분석하여 각 프레임에 서의 배우 의상에 달린 마커의 위치(예컨대, 공간 좌표)와 방향을 결정한다. 시스템은 마커의 위치를 추적함으로써 시간에 따른 마커의 공간적 표현을 생성하고 움직이는 배우의 디지털 표현을 구축한다. 그러한 움직임은 디지털 모델에 적용되어 텍스처링되고 렌더링되어 배우 및/또는 행위의 완벽한 CG 표현을 생성한다. 이 기술은 여러 대중적인 영화에서 실사 애니메이션을 산출하는 특수 효과 회사에서 사용되어 왔다.Motion capture systems are used to capture the movements of real-world objects and map them to computer-generated objects. These systems are commonly used in the production of moving pictures and video games to create digital representations of people that can be used as source data to create computer graphics animations. In a typical system, an actor wears a costume with markers attached to various locations, and a digital camera records the actor's movements from different angles while illuminating the markers. Next, the system analyzes the video to determine the location (e.g., spatial coordinates) and direction of the marker on the actor's clothing in each frame. By tracking the marker's position, the system creates a spatial representation of the marker over time and builds a digital representation of the actor in motion. Those movements are applied to the digital model, textured and rendered to create a complete CG representation of the actor and/or action. This technology has been used by special effects companies to produce live-action animation in several popular films.

WO2007025298AWO2007025298A

본 발명은 실감형 콘텐츠를 위한 다기능 광학식 모션 카메라 시스템을 제공하는 것을 목적으로 한다.The purpose of the present invention is to provide a multi-functional optical motion camera system for realistic content.

본 발명은 실감형 콘텐츠를 위한 다기능 광학식 모션 카메라 시스템을 제공한다.The present invention provides a multi-functional optical motion camera system for realistic content.

본 발명의 실시예에 따르면 실감형 콘텐츠를 위한 다기능 광학식 모션 카메라 시스템을 제공할 수 있다.According to an embodiment of the present invention, a multi-functional optical motion camera system for realistic content can be provided.

본 발명은 광학식 카메라, 이미지 처리모듈, 및 트래킹 모듈을 포함하는 실감형 콘텐츠를 위한 다기능 광학식 모션 카메라 시스템에 관한 것이다.The present invention relates to a multi-functional optical motion camera system for realistic content including an optical camera, an image processing module, and a tracking module.

본 발명의 광학식 카메라는 SoC 기반의 메인 보드, CMOS 기반의 카메라 모듈, 커스텀 렌즈,적외선 LED 라이트를 포함한다.The optical camera of the present invention includes a SoC-based main board, a CMOS-based camera module, a custom lens, and an infrared LED light.

본 발명의 이미지 처리 모듈은 카메라 영상 획득하면 렌즈 필터를 통하여 이미지와 마커 구분이 용이하도록 처리하고, 카메라 설정을 통해 이미지를 필터 처리하고 FPGA 알고리즘을 통해 이미지 처리를 통해 마커의 시안성을 향상한다. 알고리즘을 통해 마커 좌표를 추출할 수 있다.When the image processing module of the present invention acquires a camera image, it processes it to easily distinguish between the image and the marker through a lens filter, filters the image through camera settings, and improves the visibility of the marker through image processing through an FPGA algorithm. Marker coordinates can be extracted through an algorithm.

본 발명의 광학식 카메라는 프로세서의 유연성과 FPGA의 고성능을 요구하는 Soc 칩으로 실감형 모션센서 성능에 부합하는 자이링스 징크칩을 사용한다. The optical camera of the present invention is a SoC chip that requires the flexibility of a processor and the high performance of an FPGA, and uses a Xilinx Zinc chip that matches the performance of a realistic motion sensor.

본 발명의 트래킹 모듈은 카메라 제어 및 카메라 칼리브레이션과 3차원 마커 데이터 생성을 통해 실감형 콘텐츠를 지원한다. 트래킹 소프트웨어는 광학식 카메라를 제어하고, 실시간 뷰어, 실시간 레코딩, 플레이, 리지드 바디를 구현하도록 데이터를 처리하고, 3차원 마커 데이터를 생성하고 카메라 칼리브레이션을 한다.The tracking module of the present invention supports realistic content through camera control, camera calibration, and 3D marker data generation. Tracking software controls the optical camera, processes data to implement a real-time viewer, real-time recording, play, and rigid body, generates 3D marker data, and performs camera calibration.

Claims (1)

광학식 카메라,
상기 광학식 카메라가 영상 획득하면 렌즈 필터를 통하여 이미지와 마커 구분이 용이하도록 처리하고, 상기 광학식 카메라의 설정에 따라 이미지를 필터 처리하고 마커 좌표를 추출하는 FPGA 알고리즘에 의한 이미지 처리를 통해 마커의 시인성을 상승시키는 이미지 처리모듈, 및
상기 광학식 카메라를 제어하고 및 카메라 칼리브레이션과 3차원 마커 데이터 생성을 통해 실감형 콘텐츠를 지원하는 트래킹 모듈을 포함하는 실감형 콘텐츠를 위한 다기능 광학식 모션 카메라 시스템.optical Camera,
When the optical camera acquires an image, it processes it to easily distinguish between the image and the marker through a lens filter, and improves the visibility of the marker through image processing using an FPGA algorithm that filters the image according to the settings of the optical camera and extracts marker coordinates. an image processing module that elevates, and
A multi-functional optical motion camera system for realistic content, including a tracking module that controls the optical camera and supports realistic content through camera calibration and 3D marker data generation.
KR1020220101449A 2022-08-12 2022-08-12 Multi-use motion camera system for immersive contents KR20240022862A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020220101449A KR20240022862A (en) 2022-08-12 2022-08-12 Multi-use motion camera system for immersive contents

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020220101449A KR20240022862A (en) 2022-08-12 2022-08-12 Multi-use motion camera system for immersive contents

Publications (1)

Publication Number Publication Date
KR20240022862A true KR20240022862A (en) 2024-02-20

Family

ID=90057147

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020220101449A KR20240022862A (en) 2022-08-12 2022-08-12 Multi-use motion camera system for immersive contents

Country Status (1)

Country Link
KR (1) KR20240022862A (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007025298A2 (en) 2005-08-26 2007-03-01 Sony Corporation Reconstruction render farm used in motion capture

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007025298A2 (en) 2005-08-26 2007-03-01 Sony Corporation Reconstruction render farm used in motion capture

Similar Documents

Publication Publication Date Title
CN114895471B (en) Head mounted display for virtual reality and mixed reality with in-out position tracking, user body tracking and environmental tracking
US11671717B2 (en) Camera systems for motion capture
US8218825B2 (en) Capturing and processing facial motion data
US11425283B1 (en) Blending real and virtual focus in a virtual display environment
CN107209960A (en) For system, the device and method of the user interface for providing reality environment
JP2000132306A (en) Device and method for inputting information and game device
US20210374982A1 (en) Systems and Methods for Illuminating Physical Space with Shadows of Virtual Objects
KR20240022862A (en) Multi-use motion camera system for immersive contents
JP2000098871A (en) Virtual image stereoscopic compositing device, virtual image stereoscopic compositing method, game device and recording medium
JP2000098300A (en) Device and method for stereoscopically synthesizing virtual image, game device and recording medium
US10362300B2 (en) Three dimensional content projection
KR102658303B1 (en) Head-mounted display for virtual and mixed reality with inside-out positional, user body and environment tracking
JP2000098870A (en) Virtual image stereoscopic compositing device virtual image stereoscopic compositing method, game device and recording medium
KR20240051334A (en) Head-mounted display for virtual and mixed reality with inside-out positional, user body and environment tracking
Parker Shadow Figures: An Interactive Shadow Animation Platform for Performance