TWM471913U - Somatosensory remote control robot gaming device - Google Patents

Somatosensory remote control robot gaming device Download PDF

Info

Publication number
TWM471913U
TWM471913U TW102220522U TW102220522U TWM471913U TW M471913 U TWM471913 U TW M471913U TW 102220522 U TW102220522 U TW 102220522U TW 102220522 U TW102220522 U TW 102220522U TW M471913 U TWM471913 U TW M471913U
Authority
TW
Taiwan
Prior art keywords
robot
wireless transmission
remote control
somatosensory remote
somatosensory
Prior art date
Application number
TW102220522U
Other languages
Chinese (zh)
Inventor
Che-Ting Kuo
Wei-Xuan Zhang
Hao-Cheng Wang
Yu-Qi Zhou
Original Assignee
Univ Taipei Chengshih Science
Che-Ting Kuo
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Univ Taipei Chengshih Science, Che-Ting Kuo filed Critical Univ Taipei Chengshih Science
Priority to TW102220522U priority Critical patent/TWM471913U/en
Publication of TWM471913U publication Critical patent/TWM471913U/en

Links

Description

體感遙控機器人遊戲裝置Somatosensory remote control robot game device

本創作係有關於一種體感遙控機器人遊戲裝置,尤指一種利用RGB-D感測器以獲取遊戲者之身體動作資訊,並藉此遙控一機器人之體感互動裝置。The present invention relates to a somatosensory remote-controlled robot game device, and more particularly to a body-worn interactive device that uses a RGB-D sensor to obtain a player's body motion information and thereby remotely control a robot.

習知,利用加速度計或是陀螺儀可透過接觸式的操作以獲得體感信號,另外利用影像擷取裝置則可透過非接觸式的操作以獲得體感信號,此體感信號進一步與虛擬實境結合可達到一體感互動的目的。關於體感互動裝置之習知技術說明如下:中華民國專利M459485係揭示一種結合體感互動與擴增實境技術之舞蹈自學系統,包括一顯示單元、一影像擷取單元、一媒體來源單元及一擴增實境處理單元。影像擷取單元係取得一動態體感影像,媒體來源單元係提供一多媒體資訊,擴增實境處理單元將動態體感影像與多媒體資訊結合形成一擴增實境影像,並透過顯示單元顯示擴增實境影像。本創作主要利用擴增實境技術開發此舞蹈自學系統,當學習者利用攝影機照著自身時,系統就會自動擷取學習者身體輪廓影像,投射顯示於系統視訊中舞蹈者的身旁,進而進行舞蹈觀摩與自學的活動。It is known that an accelerometer or a gyroscope can be used to obtain a somatosensory signal through a contact operation, and a non-contact operation can be used to obtain a somatosensory signal by using an image capturing device, and the somatosensory signal is further integrated with a virtual reality. The combination of the environment can achieve the purpose of unity and interaction. The prior art description of the somatosensory interaction device is as follows: The Republic of China Patent M459485 discloses a dance self-learning system combining somatosensory interaction and augmented reality technology, including a display unit, an image capturing unit, a media source unit and An augmented reality processing unit. The image capturing unit obtains a dynamic somatosensory image, and the media source unit provides a multimedia information, and the augmented reality processing unit combines the dynamic somatosensory image with the multimedia information to form an augmented reality image, and displays the expanded image through the display unit. Increase the reality image. This creation mainly uses augmented reality technology to develop this dance self-learning system. When the learner uses the camera to shine on itself, the system will automatically capture the body contour image of the learner and project it to the side of the dancer in the system video. Conduct dance and self-study activities.

中華民國專利M447259係揭示一種互動式蝴蝶體感遊 戲裝置,其主要具備有一顯示蝴蝶角色與阻礙角色之遊戲畫面的顯示單元,而該顯示單元連結一控制器,且該控制器連結至少一控制蝴蝶角色飛行速度的速度感應器及至少一控制蝴蝶角色飛行高度的高度感應器,以可經由顯示單元的遊戲畫面顯示而控制蝴蝶角色的速度與高度,以可讓蝴蝶角色遠離阻礙角色的追逐;藉此,讓遊戲者可學習手眼合一之視覺與腦部神經控制的協調性功效,同時增加遊戲趣味與互動交流的效用者。The Republic of China patent M447259 reveals an interactive butterfly body tour The play device mainly has a display unit for displaying a butterfly character and a game screen for obstructing the character, and the display unit is coupled to a controller, and the controller is coupled to at least one speed sensor for controlling the flying speed of the butterfly character and at least one control butterfly The altitude sensor of the character's flying height controls the speed and height of the butterfly character through the display of the game screen of the display unit, so that the butterfly character can be kept away from the chasing of the character; thereby allowing the player to learn the visual harmony of the hand and the eye. Coordinated with the neural control of the brain, while increasing the fun of the game and the interactive use of the interactive.

中華民國專利M427957係揭示一種結合RGB-D攝影機的運動休閒系統。該系統包括至少一RGB-D攝影機例如Kinect,一運動休閒器材例如一腳踏車與一腳踏車負載訓練裝置,以及一電腦。其中該RGB-D攝影機及該腳踏車負載訓練裝置與該電腦相聯。RGB-D攝影機可放置於運動休閒器材的適當方向位置,以擷取使用者即時影像,疊合於虛擬實境中。該虛擬實境內容隨運動器材的里程計數據而更動,進一步利用RGB-D攝影機判斷使用者對於運動休閒器材的操作狀況,提供虛擬實境的互動性。The Republic of China Patent M427957 discloses a sports and leisure system incorporating an RGB-D camera. The system includes at least one RGB-D camera such as Kinect, a sports equipment such as a bicycle and a bicycle load training device, and a computer. The RGB-D camera and the bicycle load training device are associated with the computer. The RGB-D camera can be placed in the appropriate orientation of the sports equipment to capture the user's instant image and overlay it in a virtual reality. The virtual reality content is changed with the odometer data of the sports equipment, and the RGB-D camera is further used to judge the user's operation status of the sports and leisure equipment, and to provide virtual reality interaction.

中華民國專利M321316係揭示一種全身性運動遊戲影像互動裝置,其將人體上半身部位與運動遊戲軟體結合,並配合一顯示介面達到影像互動效果,本創作提供至少一腳部感測元件與至少一體感控制器,分別安裝於腳部運動裝置與人體上半身(例如:手部、腳部、頭部、腰部等部位),藉由數個體感控制器安裝於人體上半身並結合腳部感測元件,俾供使用者在運動遊戲時,達到全身性更精準且細微的影像互動效果。The Republic of China patent M321316 discloses a systemic interactive video game interactive device that combines the upper body part of the human body with the sports game software and cooperates with a display interface to achieve image interaction effects. The present invention provides at least one foot sensing element and at least a sense of unity. The controller is respectively installed on the foot movement device and the upper body of the human body (for example, the hand, the foot, the head, the waist, etc.), and is mounted on the upper body of the human body by a plurality of individual sense controllers and combined with the foot sensing components. For users to achieve more systematic and subtle image interaction effects in sports games.

習知,利用加速度計或是陀螺儀可透過接觸式的操作以獲得體感信號,另外利用影像擷取裝置則可透過非接觸式的 操作以獲得體感信號,此體感信號進一步與虛擬實境結合可達到一體感互動的目的,然而以上設計之互動性僅僅侷限於一虛擬實境中,並不具備以體感信號遙控一實體裝置之功能。It is known that an accelerometer or a gyroscope can be used to obtain a somatosensory signal through a contact operation, and a non-contact type can be obtained by using an image capturing device. The operation obtains the somatosensory signal, and the somatosensory signal is further combined with the virtual reality to achieve the purpose of unity interaction. However, the interaction of the above design is limited to a virtual reality, and does not have a physical signal to remotely control an entity. The function of the device.

有鑑於此,本案創作人積極構思,提出一種體感遙控機器人遊戲裝置,其係利用一RGB-D感測器擷取遊戲者之即時動作影像,並藉此產生一指令信號用以控制一機器人在一遊戲場地中進行遊戲任務,其具有以體感信號操控實體機器人動作之技術難度,因而增進遊戲者的成就感與娛樂效果。In view of this, the creator of the present case actively conceived and proposed a somatosensory remote-controlled robot game device, which uses an RGB-D sensor to capture the player's instant motion image, and thereby generates a command signal for controlling a robot. The game task is played in a game field, which has the technical difficulty of manipulating the action of the physical robot with the somatosensory signal, thereby enhancing the player's sense of achievement and entertainment.

本創作係包括一RGB-D感測器、一電腦、一無線傳送模組及一機器人,該RGB-D感測器可同時量測影像色彩與實際之深度距離,藉由深度區域篩選與背景深度相減可達到去除背景與物件偵測等效果,因此利用該RGB-D感測器可獲取遊戲者之身體動作資訊,經傳送至該電腦,並運用一電腦程式分析判斷該身體動作資訊,用以產生一相對應的指令信號,再透過該無線傳送模組以無線傳輸方式傳送至該機器人。The creation system includes an RGB-D sensor, a computer, a wireless transmission module and a robot. The RGB-D sensor can simultaneously measure the image color and the actual depth distance, and the depth region is filtered and the background. The depth subtraction can achieve the effects of removing the background and object detection. Therefore, the RGB-D sensor can be used to obtain the body motion information of the player, and transmitted to the computer, and the computer motion analysis is used to determine the body motion information. The method is configured to generate a corresponding command signal, and then transmit the wireless signal to the robot through the wireless transmission module.

該機器人係設有一機器人控制器及一無線接收模組,該機器人控制器可藉由該無線接收模組接收該指令信號,該機器人控制器內建有對應該指令信號之資料數據,並可用以控制該機器人之動作。因此,遊戲者可直覺地以擺動肢體的方式,即可令該機器人執行相對應之動作。The robot controller is provided with a robot controller and a wireless receiving module. The robot controller can receive the command signal by using the wireless receiving module. The robot controller has built-in data data corresponding to the command signal, and can be used for Control the movement of the robot. Therefore, the player can intuitively perform the corresponding action by swinging the limb.

本創作亦可包括一遊戲場地,該遊戲場地係設有至少一障礙關卡,藉以增進遊戲者操控該機器人之難度及遊戲樂趣。The creation may also include a game venue having at least one obstacle level to enhance the difficulty and game play of the player.

10‧‧‧RGB-D感測器10‧‧‧RGB-D sensor

20‧‧‧電腦20‧‧‧ computer

30‧‧‧無線傳送模組30‧‧‧Wireless Transmission Module

40‧‧‧機器人40‧‧‧ Robot

50‧‧‧機器人控制器50‧‧‧Robot controller

60‧‧‧無線接收模組60‧‧‧Wireless receiving module

70‧‧‧遊戲者70‧‧‧ players

80‧‧‧遊戲場地80‧‧‧Playground

90‧‧‧障礙關卡90‧‧‧ obstacle level

第1圖係本創作之功能方塊圖。Figure 1 is a functional block diagram of this creation.

第2圖係本創作之實施示意圖。Figure 2 is a schematic diagram of the implementation of this creation.

請參閱第1圖及第2圖,本創作係一種體感遙控機器人遊戲裝置,其包括一RGB-D感測器10、一電腦20、一無線傳送模組30及一機器人40。其中,該RGB-D感測器10例如Kinect感應器,放置在一適當位置用以擷取遊戲者70之即時動作影像,並傳送至該電腦20,運用一電腦程式可分析遊戲者70之身體關節位置的變化,並據以判斷遊戲者70之身體動作資訊,例如前進、後退、右轉、左轉、夾取、出拳或踢擊等,且產生一相對應的指令信號,再透過該無線傳送模組30以無線傳輸方式傳送至該機器人40,該無線傳輸方式可以為藍芽、Zigbee或是RF2.4G無線傳輸協定。Referring to FIG. 1 and FIG. 2 , the present invention is a somatosensory remote control robot game device including an RGB-D sensor 10 , a computer 20 , a wireless transmission module 30 , and a robot 40 . The RGB-D sensor 10, such as a Kinect sensor, is placed in an appropriate position for capturing the instant motion image of the player 70 and transmitted to the computer 20, and the computer 70 can be analyzed by a computer program. a change in the position of the joint, and based on which the body motion information of the player 70 is determined, such as forward, backward, right turn, left turn, grip, punch, or kick, and a corresponding command signal is generated, and then the The wireless transmission module 30 transmits the wireless transmission mode to the robot 40. The wireless transmission mode may be a Bluetooth, Zigbee or RF2.4G wireless transmission protocol.

該機器人40例如二足人型機器人,係設有一機器人控制器50及一無線接收模組60,該機器人控制器50可藉由該無線接收模組60接收該指令信號,該機器人控制器50內建有對應該指令信號之資料數據,因此,該機器人控制器50可控制該機器人40作出相對應之動作,例如前進、後退、右轉、左轉、夾取、出拳或踢擊等。The robot 40, for example, a bipedal robot, is provided with a robot controller 50 and a wireless receiving module 60. The robot controller 50 can receive the command signal by the wireless receiving module 60. The robot controller 50 is The data data corresponding to the command signal is built. Therefore, the robot controller 50 can control the robot 40 to perform corresponding actions, such as forward, backward, right turn, left turn, pinch, punch or kick.

本創作可進一步包括一遊戲場地80,該遊戲場地80係設有至少一障礙關卡90,遊戲者70可直覺地以擺動肢體的方式,即可令該機器人40執行相對應之動作,藉以通過該障礙關卡90。The present invention may further include a game venue 80, the game venue 80 is provided with at least one obstacle level 90, and the player 70 can intuitively swing the limb to enable the robot 40 to perform a corresponding action, thereby passing the Obstacle level 90.

綜上所述,本創作可提供遊戲者70以體感信號操控該機器人 40之動作,用以在該遊戲場地80進行機器人遊戲任務,藉由操控該機器人40之技術難度,增進遊戲者70的成就感與娛樂效果。In summary, the creation can provide the player 70 to manipulate the robot with a somatosensory signal. The action of 40 is used to perform a robot game task on the game field 80, and the skill and entertainment effect of the player 70 is enhanced by manipulating the technical difficulty of the robot 40.

10‧‧‧RGB-D感測器10‧‧‧RGB-D sensor

20‧‧‧電腦20‧‧‧ computer

30‧‧‧無線傳送模組30‧‧‧Wireless Transmission Module

40‧‧‧機器人40‧‧‧ Robot

50‧‧‧機器人控制器50‧‧‧Robot controller

60‧‧‧無線接收模組60‧‧‧Wireless receiving module

Claims (6)

一種體感遙控機器人遊戲裝置,包括:一RGB-D感測器,係用以獲取遊戲者之身體動作資訊;一電腦,係與該RGB-D感測器電性連接,並藉由一電腦程式分析判斷該身體動作資訊,且對應輸出一指令信號;一無線傳送模組,係透過無線傳輸方式用以傳送該指令信號;以及一機器人,係設有一機器人控制器及一無線接收模組,該機器人控制器藉由該無線接收模組接收該指令信號,該機器人控制器內建有對應該指令信號之資料數據,並用以控制該機器人之動作;藉此,遊戲者以擺動肢體的方式,即可令該機器人執行相對應之動作。A somatosensory remote control robot game device includes: an RGB-D sensor for acquiring body motion information of a player; a computer connected to the RGB-D sensor and connected by a computer The program analyzes and determines the body motion information, and correspondingly outputs a command signal; a wireless transmission module transmits the command signal through a wireless transmission mode; and a robot is provided with a robot controller and a wireless receiving module. The robot controller receives the command signal by the wireless receiving module, and the robot controller has built-in data data corresponding to the command signal, and is used to control the action of the robot; thereby, the player swings the limb, This allows the robot to perform the corresponding action. 如請求項1所述之一種體感遙控機器人遊戲裝置,其中該RGB-D感測器係為Kinect感應器。A somatosensory remote control robot game device according to claim 1, wherein the RGB-D sensor is a Kinect sensor. 如請求項1所述之一種體感遙控機器人遊戲裝置,其中該無線傳送模組及該無線接收模組係為藍芽無線傳輸模組。The somatosensory remote control robot game device of claim 1, wherein the wireless transmission module and the wireless receiving module are Bluetooth wireless transmission modules. 如請求項1所述之一種體感遙控機器人遊戲裝置,其中該無線傳送模組及該無線接收模組係為Zigbee無線傳輸模組。A somatosensory remote control robot game device according to claim 1, wherein the wireless transmission module and the wireless receiving module are Zigbee wireless transmission modules. 如請求項1所述之一種體感遙控機器人遊戲裝置,其中該無線傳送模組及該無線接收模組係為RF2.4G無線傳輸模組。A somatosensory remote control robot game device according to claim 1, wherein the wireless transmission module and the wireless receiving module are RF2.4G wireless transmission modules. 如請求項1所述之一種體感遙控機器人遊戲裝置,其中更包括一遊戲場地,該遊戲場地係設有至少一障礙關卡,藉以增進遊戲者操控該機器人之難度及遊戲樂趣。A somatosensory remote control robot game device according to claim 1, further comprising a game venue, wherein the game venue is provided with at least one obstacle level, thereby enhancing the difficulty and game fun of the player to control the robot.
TW102220522U 2013-11-04 2013-11-04 Somatosensory remote control robot gaming device TWM471913U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW102220522U TWM471913U (en) 2013-11-04 2013-11-04 Somatosensory remote control robot gaming device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW102220522U TWM471913U (en) 2013-11-04 2013-11-04 Somatosensory remote control robot gaming device

Publications (1)

Publication Number Publication Date
TWM471913U true TWM471913U (en) 2014-02-11

Family

ID=50551435

Family Applications (1)

Application Number Title Priority Date Filing Date
TW102220522U TWM471913U (en) 2013-11-04 2013-11-04 Somatosensory remote control robot gaming device

Country Status (1)

Country Link
TW (1) TWM471913U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9481087B2 (en) 2014-12-26 2016-11-01 National Chiao Tung University Robot and control method thereof

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9481087B2 (en) 2014-12-26 2016-11-01 National Chiao Tung University Robot and control method thereof

Similar Documents

Publication Publication Date Title
JP6982215B2 (en) Rendering virtual hand poses based on detected manual input
US10987574B2 (en) Head mounted display
TWI642039B (en) An augmented learning system for tai-chi chuan with head-mounted display
EP3429714B1 (en) Spectator view tracking of virtual reality (vr) user in vr environments
US9898872B2 (en) Mobile tele-immersive gameplay
JP5277081B2 (en) Method and apparatus for providing a gearing effect to an input based on one or more visual, acoustic, inertial and mixed data
JP2010253277A (en) Method and system for controlling movements of objects in video game
CN105705210A (en) Camera based safety mechanisms for users of head mounted displays
JP2010257461A (en) Method and system for creating shared game space for networked game
JP7148626B2 (en) Asynchronous virtual reality interaction
KR101794233B1 (en) Realistic game content providing system using motion recognition and special effect control technique
CN103501869A (en) Manual and camera-based game control
TWI683687B (en) System of exercise healthy machine with virtual reality transmitting by cloud server
US8371897B1 (en) Vision technology for interactive toys
TW201334771A (en) Rehabilitation horse riding simulation system combined with virtual reality
KR20150097050A (en) learning system using clap game for child and developmental disorder child
US20220179482A1 (en) Boundary setting device, boundary setting method, and program
JP7441442B2 (en) VR device, method, program and storage medium
TWM471913U (en) Somatosensory remote control robot gaming device
JP2009153583A (en) Human body action-sensing electronic-game controller
CN105771240A (en) Simulation interactive game method
EP3598270A1 (en) Method and control unit for controlling a virtual reality display, virtual reality display and virtual reality system
WO2010068901A3 (en) Interface apparatus for software
Wu et al. Interface design for somatosensory interaction
KR20110116280A (en) Word game simulation system based on grid and motion detection

Legal Events

Date Code Title Description
MM4K Annulment or lapse of a utility model due to non-payment of fees