WO2019127571A1 - Procédé et système de reconnaissance de support basés sur un projecteur - Google Patents

Procédé et système de reconnaissance de support basés sur un projecteur Download PDF

Info

Publication number
WO2019127571A1
WO2019127571A1 PCT/CN2017/120397 CN2017120397W WO2019127571A1 WO 2019127571 A1 WO2019127571 A1 WO 2019127571A1 CN 2017120397 W CN2017120397 W CN 2017120397W WO 2019127571 A1 WO2019127571 A1 WO 2019127571A1
Authority
WO
WIPO (PCT)
Prior art keywords
projection
picture
display surface
unit
complex
Prior art date
Application number
PCT/CN2017/120397
Other languages
English (en)
Chinese (zh)
Inventor
那庆林
麦浩晃
黄彦
Original Assignee
神画科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 神画科技(深圳)有限公司 filed Critical 神画科技(深圳)有限公司
Priority to PCT/CN2017/120397 priority Critical patent/WO2019127571A1/fr
Publication of WO2019127571A1 publication Critical patent/WO2019127571A1/fr

Links

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/363Image reproducers using image projection screens
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/398Synchronisation thereof; Control thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]

Definitions

  • the invention relates to the field of AR interactive projectors, and in particular relates to a projector-based prop identification method and system.
  • Augmented Reality is a technology that calculates the position and angle of camera images in real time and adds corresponding images, videos, and 3D models.
  • the goal of this technology is to put the virtual world on the screen. The real world and interact. This technique was proposed in 1990. As the computing power of portable electronic products increases, it is expected that the use of augmented reality will become wider and wider.
  • AR interactive game In the AR interactive game, the market demand is very large, but the supply side is slightly insufficient, especially the enterprises with core intellectual property rights and excellent technology.
  • the AR interactive games in the industry are mostly mobile platforms. Previously, most of the AR interactive games were played in two ways:
  • the content captured by the camera includes physical objects into the game scene, controls the game logic, and guides the game flow.
  • AR Auggmented Reality
  • the technical problem to be solved by the present invention is to provide a physical object recognition system based on a projector for solving the above-mentioned defects of the prior art, and solving the problem that the physical item identification is very difficult under the complicated background of the mixed virtual scene.
  • the technical solution adopted by the present invention to solve the technical problem thereof is to provide a props recognition method based on a projector, the prop identification method comprising the steps of: placing a physical prop on a projection display surface; and projecting a complex image on a projection display surface
  • the projected complex picture is switched to a simple picture, or the projection light source is turned off, and the image data of the projection display surface at this time is acquired; the simple picture of the projection is switched back to the complex picture again, or the projection light source is turned on; and, through the image data Identify physical items.
  • the simple screen includes a solid color picture, a brightness reduction picture, or a contrast reduction picture.
  • the item identification method further includes the steps of: preset switching conditions; triggering a switching condition in the process of projecting a complex picture on the projection display surface, switching the projected complex picture to a simple picture or turning off the projection light source. And acquiring the image data of the projection display surface at this time; switching the simple screen of the projection back to the complex image or turning on the projection light source again; and identifying the physical item through the image data.
  • the projection screen includes a virtual switch.
  • the virtual switch is clicked, and the projection unit switches the projected complex image into a simple screen, and acquires the time. Project image data of the display surface.
  • the AR interactive projector includes a switching circuit.
  • the switching circuit is controlled by a physical switch or a remote controller to switch the complex image of the projection into Simple screen or turn off the projection light source and obtain the image data of the projection display surface at this time.
  • the switching condition includes: the time in the demonstration process reaches the time point of the demonstration process; wherein, in the process of projecting the complex image on the projection display surface, the time in the demonstration process reaches the presentation process time point, and the projection is performed.
  • the complicated picture is switched to a simple picture, or the projection light source is turned off, and the image data of the projection display surface at this time is acquired.
  • the demo process time point includes when the script presentation is completed, or when the countdown countdown is completed.
  • a projection area is disposed on the projection screen; wherein, in the process of projecting the complex image on the projection display surface, the corresponding physical object is placed in the placement area of the projection display surface; After projecting the picture and identifying the physical item, perform a logical judgment. If the selected physical item is correct and placed in the correct position, the process is advanced.
  • the projector is an AR interactive projector.
  • the technical solution adopted by the present invention to solve the technical problem thereof is to provide a projector-based physical item identification system, the physical item identification system comprising a projection unit, a monitoring unit, an identification unit and a processing unit, wherein the processing unit respectively The projection unit, the monitoring unit and the identification unit are electrically connected, and the identification unit is electrically connected to the monitoring unit; wherein the projection unit projects the image onto the projection display surface, and the physical display object is placed on the projection display surface;
  • the processing unit controls the projection unit to switch the projected complex picture to a simple picture or close the projection light source, and controls the monitoring unit to acquire image data of the projection display surface at this time; and the processing The unit again controls the projection unit to switch the projected simple picture back to the complex picture, or turns on the projection light source;
  • the recognition unit acquires the image data of the monitoring unit and recognizes the physical item, and sends the information of the physical item to the processing unit.
  • the invention has the beneficial effects that the present invention switches the complex image of the projection into a simple image and recognizes the physical object in the process of projecting the complex image on the projection display surface, without directly recognizing the mixing complexity, compared with the prior art.
  • the virtual scene of the game's physical props thus simplifying complex problems; and, improving the stability and accuracy of recognition, and reducing recognition time, greatly enrich the experience of interactive games.
  • Embodiment 1 is a schematic flow chart of Embodiment 1 of an item identification method according to the present invention.
  • Embodiment 2 is a schematic flow chart of Embodiment 2 of the props identification method of the present invention.
  • FIG. 3 is a schematic structural view of a physical prop identification system of the present invention.
  • step 1 of the prop identification method of the present invention is a schematic structural diagram of step 1 of the prop identification method of the present invention.
  • step 2 of the prop identification method of the present invention is a schematic structural diagram of step 2 of the prop identification method of the present invention.
  • step 3 of the prop identification method of the present invention is a schematic structural diagram of step 3 of the prop identification method of the present invention.
  • step 4 of the prop identification method of the present invention is a schematic structural diagram of step 4 of the prop identification method of the present invention.
  • FIG. 8 is a schematic flowchart of Embodiment 1 of an item identification method based on a preset switching condition according to the present invention.
  • FIG. 9 is a schematic flowchart of Embodiment 2 of a method for identifying a prop based on a preset switching condition according to the present invention.
  • FIG. 10 is a schematic structural diagram of FIG. 8 or FIG. 9 based on virtual switch trigger switching identification
  • FIG. 11 is a schematic structural diagram of FIG. 8 or FIG. 9 based on a switch circuit triggering switching identification
  • FIG. 12 is a schematic structural diagram of FIG. 8 or FIG. 9 based on a countdown trigger switching identification
  • FIG. 13 is a schematic structural diagram of FIG. 8 or FIG. 9 based on step 1 of the game process
  • step 2 of FIG. 8 or FIG. 9 triggering handover identification based on a game process
  • Figure 15 is a flow chart showing the identification of image data of the present invention.
  • the present invention provides a preferred embodiment of a prop identification method.
  • a real object props recognition method based on a projector, and referring to FIG. 3, the physical object identification method includes the following steps:
  • step S10 a complex image is projected on the projection display surface 20 and a physical object 30 is placed on the projection display surface 20.
  • step S201 the projection unit 11 switches the projected complex screen to a simple screen.
  • step S30 the monitoring unit 12 acquires the image data of the projection display surface 20 at this time.
  • step S401 the projection unit 11 switches the projected simple screen back to the complex screen again.
  • Step S50 and the recognition unit 13 identifies the physical item 30 by the image data.
  • step S10 a complex image is projected on the projection display surface 20 and a physical object 30 is placed on the projection display surface 20.
  • Step S202 the projection unit 11 turns off the projection light source.
  • step S30 the monitoring unit 12 acquires the image data of the projection display surface 20 at this time.
  • Step S402 the projection unit 11 turns on the projection light source.
  • Step S50 and the recognition unit 13 identifies the physical item 30 by the image data.
  • Step S401 and step S50 are performed independently, and there is no context; step S402 and step S50 are performed independently, and there is no context.
  • a projector-based physical item 30 identification system includes a projection unit 11, a monitoring unit 12, an identification unit 13, and a processing unit 14, and the processing The unit 14 is electrically connected to the projection unit 11, the monitoring unit 12 and the identification unit 13, respectively, and the identification unit 13 is electrically connected to the monitoring unit 12.
  • the projection unit 11 projects a complex image onto the projection display surface 20, and the physical object 30 is placed on the projection display surface 20; and the processing unit 14 controls the projection unit 11 during the projection of the complex image by the projection unit 11 Switching the projected complex picture to a simple picture, or turning off the projection, and the control monitoring unit 12 acquires the image data of the projected display surface 20 at this time; and the processing unit 14 again controls the projection unit 11 to switch the projected simple picture back to the complex The screen, or the projection is turned on; the recognition unit 13 acquires the image data of the monitoring unit 12 and recognizes the physical item 30, and transmits the information of the physical item 30 to the processing unit 14.
  • the projector is an AR interactive projector.
  • AR projection uses key technologies such as image recognition, 3D reconstruction and automatic 3D mapping to identify the carrier in real time through the camera, and map the preset content to the carrier by means of the powerful computing power of the host.
  • the physical props 30 include components of different colors, different shapes, and different patterns, and the physical props 30 further include an identification card, that is, an AR card, and the AR card is an AR technology.
  • Application product which is used with super-dimensional software.
  • the front of the AR card is the character map, and the back is the FM code map.
  • the software scans the FM code, there will be a 3D stereo image of the positive character.
  • the stereo character has actions, language, special effects, and Interaction.
  • the simple picture includes a solid color picture, which facilitates the difficulty of image data processing after obtaining image data, and improves the accuracy of identifying the physical item 30.
  • step S30 the acquired image data is based on a simple screen, and the physical object 30 is on the projection display surface 20.
  • the acquired image data is based on a simple screen, and the physical object 30 is on the projection display surface 20.
  • at least one or more pictures are collected as a basis for subsequent image data processing.
  • step S401 the projected complex picture is switched to a simple picture, and the projected simple picture is switched back to the complex picture again, and the interval required is very short.
  • the monitoring unit acquires the image data.
  • the simple picture includes a solid color picture, a brightness reduction picture or a contrast reduction picture; the solid color picture is a single color picture, the brightness reduction picture is a picture after the brightness of the complex picture is lowered, or other low brightness pictures, the contrast is low
  • the screen is a screen with a low contrast of a complicated screen, or another screen with a low contrast.
  • step S50 the specific content of the physical item 30 is identified as: the type, shape and size of the physical item 30, the pattern and color of the physical item 30, and the position and direction of the physical item 30.
  • a projection area 201 is disposed on the projection screen; wherein, in the process of projecting a complex image on the projection display surface 20 , the corresponding physical prop 30 is placed in the placement area of the projection display surface 20 . 201.
  • the physical object 30 is placed on the projection area 201 projected on the projection display surface 20; and the projected complex picture is switched to a simple picture, and the projected simple picture is switched back to the complex picture again; the monitoring unit 12 acquires the switching.
  • the image data of the shadow display surface is displayed on the simple screen; further, after the projection screen is switched and the physical object 30 is recognized, a logical determination is made, and if the selected physical object 30 is correct and the position is placed correctly, the flow is advanced.
  • the present invention provides a preferred embodiment of a prop identification method based on preset switching conditions.
  • the physical item 30 identification method further includes the steps of:
  • the monitoring unit 12 acquires image data of the projection display surface 20 at this time.
  • the projection unit 11 again switches the projected simple screen back to the complex screen.
  • the recognition unit 13 recognizes the physical item 30 by the image data.
  • the projection unit 11 turns off the projection light source.
  • the monitoring unit 12 acquires image data of the projection display surface 20 at this time.
  • the projection unit 11 turns on the projection light source.
  • the recognition unit 13 recognizes the physical item 30 by the image data.
  • the switching recognition function is activated by triggering various switching conditions, including active triggering and passive triggering.
  • the active trigger includes a virtual switch 21 trigger or a physical switch trigger; and the passive trigger includes triggering different trigger points according to a preset process of the program, and each time the trigger point is triggered, the switch recognition function is started.
  • the present invention provides a preferred embodiment of virtual switch trigger switching identification.
  • the projection screen includes a virtual switch 21; wherein, in the process of projecting a complex image on the projection display surface 20, the virtual switch 21 is clicked, the projected complex image is switched to a simple screen, or the projection light source is turned off, and the projection is obtained.
  • the image data of the face 20 is displayed.
  • a game interaction scheme is provided.
  • a complex virtual scene is projected to the projection display surface 20, and the player places a real physical item 30 in the placement area 201 according to the situation of the virtual scene (such as a character path finding or attack state); the physical item 30
  • the present invention provides a preferred embodiment of a switching circuit.
  • the AR interactive projector includes a switching circuit.
  • the switching circuit In the process of projecting a complex image on the projection display surface 20, the switching circuit is controlled to be turned on by the physical switch or the remote controller 40, and the complicated screen of the projection is switched to a simple screen and monitored.
  • the unit 12 acquires image data of the projection display surface 20 at this time.
  • the remote controller 40 is provided with a changeover switch 41.
  • the present invention provides a preferred embodiment for triggering handover identification at a point in time during a demonstration process.
  • the switching condition includes the time of the demonstration process reaching the presentation process time point; wherein, in the process of projecting the complex image on the projection display surface 20, the time during the demonstration process reaches the presentation process time point, and the projected complex image is switched to the simple picture. Or the projection light source is turned off, and the monitoring unit 12 acquires the image data of the projection display surface 20 at this time.
  • the demo process time point includes the countdown 22 when the countdown is completed. Specifically, when the projection screen enters a scene or when the scene completes a certain process, the countdown is entered. At this time, the user needs to place the physical prop 30 in the designated placement area 201, waiting for the countdown 22 to end, of course, the countdown 22 It can be terminated by initiative; and the switch recognition function is activated after the end.
  • the demonstration process time point includes when the script presentation is completed, preferably when the game script is completed.
  • a trigger position 202 is set, and when the projected person 23 "walks" to the trigger position 202 through the projected route 24, the start switch recognition function is turned on; and, in the process, the user needs to be in the placement area.
  • the physical props 30 are prevented, as shown in the rectangular bridge of FIG. 12 to the two sides of the "river".
  • the next scene is entered, and the projected character 23 walks along the rectangular bridge to the opposite side of the "river”.
  • the present invention provides a preferred embodiment for identifying a physical item by image data.
  • the image data includes the type, shape, size, direction, outline, and position coordinate data of the item.
  • the monitoring unit 12 captures the image data of the projection display surface 20, and the recognition unit 13 processes the image data, such as image segmentation, extracting image edge contours, position coordinates, feature point coordinates, and the like, and identifying the shape and size of the props.
  • Characteristics such as categories. For example, a circle indicates a turret, a rectangle indicates a bridge, a triangle indicates a knife, and the like.
  • Identifying the physical item through the image data also includes the steps:
  • the monitoring unit 12 captures image data of the projection display surface 20.
  • the recognition unit 13 preprocesses the image data: image denoising and image segmentation.
  • the recognition unit 13 extracts information such as an image contour edge, a position coordinate, and a feature point coordinate.
  • the recognition unit 13 recognizes features such as the shape, size, and type of the item.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

La présente invention se rapporte au domaine des projecteurs interactifs de RA et plus particulièrement à un procédé et un système de reconnaissance de support basés sur un projecteur. Le procédé de reconnaissance de support comprend les étapes consistant à : placer un support physique sur une surface d'affichage de projection ; dans le processus de projection d'une image complexe sur la surface d'affichage de projection, commuter une image complexe de la projection vers une image simple; et acquérir des données d'image de la surface d'affichage de projection à ce moment ; commuter l'image simple de la projection à nouveau vers l'image complexe ; et reconnaître le support physique au moyen des données d'image. Le système de reconnaissance de support physique comprend une unité de projection, une unité de surveillance, une unité de reconnaissance et une unité de traitement, l'unité de traitement étant respectivement connectée à l'unité de projection, à l'unité de surveillance et à l'unité de reconnaissance ; et l'unité de reconnaissance étant connectée à l'unité de surveillance. Dans la présente invention, il n'est pas nécessaire de reconnaître directement un support de jeu physique d'une scène virtuelle complexe mixte de façon à simplifier un problème complexe ; la stabilité et la précision de la reconnaissance sont améliorées ; un temps de reconnaissance est réduit ; et l'expérience de jeu interactif est fortement enrichie.
PCT/CN2017/120397 2017-12-30 2017-12-30 Procédé et système de reconnaissance de support basés sur un projecteur WO2019127571A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/120397 WO2019127571A1 (fr) 2017-12-30 2017-12-30 Procédé et système de reconnaissance de support basés sur un projecteur

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2017/120397 WO2019127571A1 (fr) 2017-12-30 2017-12-30 Procédé et système de reconnaissance de support basés sur un projecteur

Publications (1)

Publication Number Publication Date
WO2019127571A1 true WO2019127571A1 (fr) 2019-07-04

Family

ID=67064474

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/120397 WO2019127571A1 (fr) 2017-12-30 2017-12-30 Procédé et système de reconnaissance de support basés sur un projecteur

Country Status (1)

Country Link
WO (1) WO2019127571A1 (fr)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101183276A (zh) * 2007-12-13 2008-05-21 上海交通大学 基于摄像头投影仪技术的交互系统
US20100315418A1 (en) * 2008-02-12 2010-12-16 Gwangju Institute Of Science And Technology Tabletop, mobile augmented reality system for personalization and cooperation, and interaction method using augmented reality
CN102663448A (zh) * 2012-03-07 2012-09-12 北京理工大学 一种基于网络的增强现实物体识别分析方法
CN202736183U (zh) * 2012-06-19 2013-02-13 许丰 智能投影电子桌游装置
US20150161799A1 (en) * 2012-12-06 2015-06-11 Cherif Atia Algreatly 3d immersion technology
CN105279795A (zh) * 2014-07-09 2016-01-27 先科媒体有限公司 基于3d标记的增强现实系统
US20170053449A1 (en) * 2015-08-19 2017-02-23 Electronics And Telecommunications Research Institute Apparatus for providing virtual contents to augment usability of real object and method using the same
CN108211356A (zh) * 2017-12-30 2018-06-29 神画科技(深圳)有限公司 一种基于投影仪的道具识别方法及系统

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101183276A (zh) * 2007-12-13 2008-05-21 上海交通大学 基于摄像头投影仪技术的交互系统
US20100315418A1 (en) * 2008-02-12 2010-12-16 Gwangju Institute Of Science And Technology Tabletop, mobile augmented reality system for personalization and cooperation, and interaction method using augmented reality
CN102663448A (zh) * 2012-03-07 2012-09-12 北京理工大学 一种基于网络的增强现实物体识别分析方法
CN202736183U (zh) * 2012-06-19 2013-02-13 许丰 智能投影电子桌游装置
US20150161799A1 (en) * 2012-12-06 2015-06-11 Cherif Atia Algreatly 3d immersion technology
CN105279795A (zh) * 2014-07-09 2016-01-27 先科媒体有限公司 基于3d标记的增强现实系统
US20170053449A1 (en) * 2015-08-19 2017-02-23 Electronics And Telecommunications Research Institute Apparatus for providing virtual contents to augment usability of real object and method using the same
CN108211356A (zh) * 2017-12-30 2018-06-29 神画科技(深圳)有限公司 一种基于投影仪的道具识别方法及系统

Similar Documents

Publication Publication Date Title
EP2642451B1 (fr) Appareil et procédé d'interaction de réalité augmentée
US10068547B2 (en) Augmented reality surface painting
JP5567206B2 (ja) コンピューティングデバイスインターフェース
EP2521097B1 (fr) Système et procédé pour traitement des entrées avec réalité améliorée
US20120293544A1 (en) Image display apparatus and method of selecting image region using the same
US11516554B2 (en) Method and system for enhancing sound and picture quality based on scene recognition, and display
US20110099476A1 (en) Decorating a display environment
US11504624B2 (en) Method and apparatus for controlling movement of virtual object in augmented reality, and terminal
CN106730815B (zh) 一种易实现的体感互动方法及系统
US20180197345A1 (en) Augmented reality technology-based handheld viewing device and method thereof
CN103533276B (zh) 一种平面多投影快速拼接方法
US11087545B2 (en) Augmented reality method for displaying virtual object and terminal device therefor
CN108211356A (zh) 一种基于投影仪的道具识别方法及系统
US20150185829A1 (en) Method and apparatus for providing hand gesture-based interaction with augmented reality applications
WO2022206304A1 (fr) Procédé et appareil de lecture de vidéo, dispositif, support de stockage et produit de programme
CN106713891B (zh) 基于d3d接口播放立方体全景视频的方法及系统
CN113918074A (zh) 一种用于自闭症儿童认知教学的光影实体交互装置及方法
WO2019127571A1 (fr) Procédé et système de reconnaissance de support basés sur un projecteur
CN111198609A (zh) 交互显示方法、装置、电子设备及存储介质
CN105511649B (zh) 一种多点定位系统及多点定位方法
CN111258408B (zh) 一种用于人机交互的对象边界确定方法及设备
KR102103614B1 (ko) 전방 프로젝션 환경에서 그림자를 제거하기 위한 방법
Seewald et al. Magic Mirror: I and My Avatar-A Versatile Augmented Reality Installation Controlled by Hand Gestures.
CN113778233A (zh) 一种操控显示设备的方法、装置及可读介质
CN116055708B (zh) 一种感知可视交互式球幕三维立体成像方法及系统

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17936321

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17936321

Country of ref document: EP

Kind code of ref document: A1