CN108245881A - 基于ar的三维拼板模型搭建系统 - Google Patents

基于ar的三维拼板模型搭建系统 Download PDF

Info

Publication number
CN108245881A
CN108245881A CN201711479436.3A CN201711479436A CN108245881A CN 108245881 A CN108245881 A CN 108245881A CN 201711479436 A CN201711479436 A CN 201711479436A CN 108245881 A CN108245881 A CN 108245881A
Authority
CN
China
Prior art keywords
jointed plate
information
plate model
unit
model
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711479436.3A
Other languages
English (en)
Inventor
赵亚丁
伍永豪
彭泉
曾贵平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan Molio Network Co Ltd
Original Assignee
Wuhan Molio Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan Molio Network Co Ltd filed Critical Wuhan Molio Network Co Ltd
Priority to CN201711479436.3A priority Critical patent/CN108245881A/zh
Publication of CN108245881A publication Critical patent/CN108245881A/zh
Pending legal-status Critical Current

Links

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/20—Input arrangements for video game devices
    • A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
    • A63F13/213—Input arrangements for video game devices characterised by their sensors, purposes or types comprising photodetecting means, e.g. cameras, photodiodes or infrared cells
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/33—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
    • A63F13/335—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/52—Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80—Special adaptations for executing a specific game genre or game mode
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
    • G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/40—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterised by details of platform network
    • A63F2300/407—Data transfer via internet
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6045—Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/6063—Methods for processing data by generating or executing the game program for sound processing
    • A63F2300/6081—Methods for processing data by generating or executing the game program for sound processing generating an output signal, e.g. under timing constraints, for spatialization
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082—Virtual reality
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8094—Unusual game types, e.g. virtual cooking

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Acoustics & Sound (AREA)
  • Business, Economics & Management (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本发明提出了一种基于AR的三维拼板模型搭建系统，借助于增强现实技术展示三维拼板模型的拼接过程，无需借助于实物，更加安全、环保；形象直观，便于共享和复制，借助于互联网进行传播，成本更低，便于大规模推广。

Description

基于AR的三维拼板模型搭建系统
技术领域
本发明涉及智慧教育技术领域，尤其涉及一种基于AR的三维拼板模型搭建系统。
背景技术
增强现实技术(Augmented Reality，简称AR)，是一种实时地计算摄影机影像的位置及角度并加上相应图像、视频、3D模型的技术，这种技术的目标是在屏幕上把虚拟世界套在现实世界并进行互动。这种技术1990年提出。随着随身电子产品CPU运算能力的提升，预期增强现实的用途将会越来越广。
现有的拼板模型对于开发儿童三维想象力，提高儿童对于物体的探索有很大的促进作用。但是，现有的拼板模型一般采用硬纸板或者木材制作，含有较多化学成分，其表面涂覆的化学颜料对儿童身体有毒副作用；此外，木材往往采用质地松散的松树板制作，表面含有较多毛刺，在拼接过程中容易划破皮肤；第三，现有的实物拼板模型制作成本较高，不便于大规模推广应用，耗损木材，不便于回收利用，对环境破坏较大。
发明内容
有鉴于此，本发明提出了一种安全、环保的基于AR的三维拼板模型搭建系统。
本发明的技术方案是这样实现的：本发明提供了一种基于AR的三维拼板模型搭建系统，其包括，
搭建信息配置单元，用于在服务器中配置三维拼板模型的零部件三维模型、零部件组合规则信息；设置三维模型动作指令信息，建立三维模型动作指令信息与肢体动作之间的关联关系表；
摄像头，采集用户的肢体动作视频；
三维拼板模型建立单元，根据用户的肢体动作视频，解析其肢体动作，并查找相关联的三维模型动作指令信息，并根据三维模型动作指令信息移动零部件三维模型，根据零部件组合规则信息组合相应的零部件三维模型；
组合动态信息投射单元，将三维拼板模型建立单元生成的三维拼板模型实时投射到可穿戴式头盔中的显示器上。
在以上技术方案的基础上，优选的，所述零部件组合规则信息包括螺纹连接、键连接、铆接、焊接、粘接、过盈连接、皮带轮连接、齿轮连接和磁力连接。进一步优选的，还包括组合操作响应单元，将三维模型动作指令信息中的组合指令与零部件组合规则信息进行匹配，并发送匹配是否成功的提示信息给组合动态信息投射单元，组合动态信息投射单元将匹配是否成功的提示信息投射到可穿戴式头盔中的显示器上。更进一步优选的，还包括语音提示单元，组合操作响应单元将匹配是否成功的提示信息发送到语音提示单元，语音提示单元进行语音播放。
在以上技术方案的基础上，优选的，所述三维模型动作指令信息包括对三维拼板模型进行平移、旋转和组合的指令。
本发明的三维拼板模型搭建系统相对于现有技术具有以下有益效果：
(1)借助于增强现实技术展示三维拼板模型的拼接过程，无需借助于实物，更加安全、环保；
(2)形象直观，便于共享和复制，借助于互联网进行传播，成本更低，便于大规模推广。
附图说明
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本发明基于AR的三维拼板模型搭建系统的框架图。
具体实施方式
下面将结合本发明实施方式中的附图，对本发明实施方式中的技术方案进行清楚、完整地描述，显然，所描述的实施方式仅仅是本发明一部分实施方式，而不是全部的实施方式。基于本发明中的实施方式，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施方式，都属于本发明保护的范围。
如图1所示，本发明的基于AR的三维拼板模型搭建系统，其包括搭建信息配置单元、摄像头、三维拼板模型建立单元、组合动态信息投射单元、组合操作响应单元和语音提示单元。
搭建信息配置单元，用于在服务器中配置三维拼板模型的零部件三维模型、零部件组合规则信息；设置三维模型动作指令信息，建立三维模型动作指令信息与肢体动作之间的关联关系表。具体的，所述零部件组合规则信息包括螺纹连接、键连接、铆接、焊接、粘接、过盈连接、皮带轮连接、齿轮连接和磁力连接。当然，也可以根据实际三维拼板模型的具体结构，设置不同的组合规则。具体的，所述三维模型动作指令信息包括对三维拼板模型进行平移、旋转和组合的指令。
摄像头，采集用户的肢体动作视频，可采用现有技术。
三维拼板模型建立单元，根据用户的肢体动作视频，解析其肢体动作，并查找相关联的三维模型动作指令信息，并根据三维模型动作指令信息移动零部件三维模型，根据零部件组合规则信息组合相应的零部件三维模型。
组合动态信息投射单元，将三维拼板模型建立单元生成的三维拼板模型实时投射到可穿戴式头盔中的显示器上。
组合操作响应单元，将三维模型动作指令信息中的组合指令与零部件组合规则信息进行匹配，并发送匹配是否成功的提示信息给组合动态信息投射单元，组合动态信息投射单元将匹配是否成功的提示信息投射到可穿戴式头盔中的显示器上。
语音提示单元，组合操作响应单元将匹配是否成功的提示信息发送到语音提示单元，语音提示单元进行语音播放。
以上所述仅为本发明的较佳实施方式而已，并不用以限制本发明，凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。

Claims (5)

1.一种基于AR的三维拼板模型搭建系统，其特征在于：其包括，
搭建信息配置单元，用于在服务器中配置三维拼板模型的零部件三维模型、零部件组合规则信息；设置三维模型动作指令信息，建立三维模型动作指令信息与肢体动作之间的关联关系表；
摄像头，采集用户的肢体动作视频；
三维拼板模型建立单元，根据用户的肢体动作视频，解析其肢体动作，并查找相关联的三维模型动作指令信息，并根据三维模型动作指令信息移动零部件三维模型，根据零部件组合规则信息组合相应的零部件三维模型；
组合动态信息投射单元，将三维拼板模型建立单元生成的三维拼板模型实时投射到可穿戴式头盔中的显示器上。
2.如权利要求1所述的基于AR的三维拼板模型搭建系统，其特征在于：所述零部件组合规则信息包括螺纹连接、键连接、铆接、焊接、粘接、过盈连接、皮带轮连接、齿轮连接和磁力连接。
3.如权利要求2所述的基于AR的三维拼板模型搭建系统，其特征在于：还包括组合操作响应单元，将三维模型动作指令信息中的组合指令与零部件组合规则信息进行匹配，并发送匹配是否成功的提示信息给组合动态信息投射单元，组合动态信息投射单元将匹配是否成功的提示信息投射到可穿戴式头盔中的显示器上。
4.如权利要求3所述的基于AR的三维拼板模型搭建系统，其特征在于：还包括语音提示单元，组合操作响应单元将匹配是否成功的提示信息发送到语音提示单元，语音提示单元进行语音播放。
5.如权利要求2所述的基于AR的三维拼板模型搭建系统，其特征在于：所述三维模型动作指令信息包括对三维拼板模型进行平移、旋转和组合的指令。
CN201711479436.3A 2017-12-29 2017-12-29 基于ar的三维拼板模型搭建系统 Pending CN108245881A (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711479436.3A CN108245881A (zh) 2017-12-29 2017-12-29 基于ar的三维拼板模型搭建系统

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711479436.3A CN108245881A (zh) 2017-12-29 2017-12-29 基于ar的三维拼板模型搭建系统

Publications (1)

Publication Number Publication Date
CN108245881A true CN108245881A (zh) 2018-07-06

Family

ID=62724498

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711479436.3A Pending CN108245881A (zh) 2017-12-29 2017-12-29 基于ar的三维拼板模型搭建系统

Country Status (1)

Country Link
CN (1) CN108245881A (zh)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120231887A1 (en) * 2011-03-07 2012-09-13 Fourth Wall Studios, Inc. Augmented Reality Mission Generators
CN103998107A (zh) * 2011-05-23 2014-08-20 乐高公司 用于增强现实的玩具搭建系统
CN105413198A (zh) * 2015-11-06 2016-03-23 大连新锐天地传媒有限公司 Ar儿童早教积木系统
CN106683501A (zh) * 2016-12-23 2017-05-17 武汉市马里欧网络有限公司 一种ar儿童情景扮演投影教学方法及系统
CN106843473A (zh) * 2016-12-30 2017-06-13 武汉市马里欧网络有限公司 基于ar的儿童涂色系统及方法
CN106823408A (zh) * 2016-12-30 2017-06-13 武汉市马里欧网络有限公司 基于ar的儿童积木搭建系统及方法
CN106846971A (zh) * 2016-12-30 2017-06-13 武汉市马里欧网络有限公司 基于ar的儿童书法学习系统及方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120231887A1 (en) * 2011-03-07 2012-09-13 Fourth Wall Studios, Inc. Augmented Reality Mission Generators
CN103998107A (zh) * 2011-05-23 2014-08-20 乐高公司 用于增强现实的玩具搭建系统
CN105413198A (zh) * 2015-11-06 2016-03-23 大连新锐天地传媒有限公司 Ar儿童早教积木系统
CN106683501A (zh) * 2016-12-23 2017-05-17 武汉市马里欧网络有限公司 一种ar儿童情景扮演投影教学方法及系统
CN106843473A (zh) * 2016-12-30 2017-06-13 武汉市马里欧网络有限公司 基于ar的儿童涂色系统及方法
CN106823408A (zh) * 2016-12-30 2017-06-13 武汉市马里欧网络有限公司 基于ar的儿童积木搭建系统及方法
CN106846971A (zh) * 2016-12-30 2017-06-13 武汉市马里欧网络有限公司 基于ar的儿童书法学习系统及方法

Similar Documents

Publication Publication Date Title
Matsas et al. Design of a virtual reality training system for human–robot collaboration in manufacturing tasks
Sherman et al. Understanding virtual reality: Interface, application, and design
Huang et al. Augmented 3D hands: a gesture-based mixed reality system for distributed collaboration
Piumsomboon et al. [POSTER] CoVAR: mixed-platform remote collaborative augmented and virtual realities system with shared collaboration cues
Nagendran et al. AMITIES: Avatar-mediated interactive training and individualized experience system
Sharma et al. Multi-user VR classroom with 3D interaction and real-time motion detection
Tobita et al. Floating avatar: telepresence system using blimps for communication and entertainment
Specian et al. Quori: A community-informed design of a socially interactive humanoid robot
CN108245881A (zh) 基于ar的三维拼板模型搭建系统
Tan et al. Virtual reality based immersive telepresence system for remote conversation and collaboration
CN103680248A (zh) 船舶机舱虚拟现实仿真系统
CN101125251A (zh) 射箭机器人系统
Velho et al. Situated participatory virtual reality
CN108325206A (zh) 拼板模型模拟搭建系统
Zoellner et al. iTACITUS–novel interaction and tracking paradigms for mobile AR
Piplica et al. Full-body gesture interaction with improvisational narrative agents
Kirakosian et al. Immersive simulation and training of person-to-3d character dance in real-time
CN106560863A (zh) 一种基于3d平面技术的虚拟开发方法
Yang et al. Research on a visual sensing and tracking system for distance education
De Paolis et al. The simulation of a billiard game using a haptic interface
CN108211355A (zh) 基于ar的三维魔方
Beever Exploring Mixed Reality Level Design Workflows
Burns DANCR: An Improvisational Tool for Contemporary Dance
Gourishankar et al. Hapstick: a high fidelity haptic simulation for billiards
Pang et al. Design considerations of a robotic head for telepresence applications

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180706