WO2019127571A1

WO2019127571A1 - Prop recognition method and system based on projector

Info

Publication number: WO2019127571A1
Application number: PCT/CN2017/120397
Authority: WO
Inventors: 那庆林; 麦浩晃; 黄彦
Original assignee: 神画科技（深圳）有限公司
Priority date: 2017-12-30
Filing date: 2017-12-30
Publication date: 2019-07-04

Abstract

The present invention relates to the field of AR interactive projectors, and particularly relates to a prop recognition method and system based on a projector. The prop recognition method comprises the steps of: placing a physical prop on a projection display surface; in the process of projecting a complex picture onto the projection display surface, switching a complex picture of the projection to a simple picture, and acquiring image data of the projection display surface at this time; switching the simple picture of the projection back to the complex picture again; and recognizing the physical prop by means of the image data. The physical prop recognition system comprises a projection unit, a monitoring unit, a recognition unit and a processing unit, wherein the processing unit is respectively connected to the projection unit, the monitoring unit and the recognition unit; and the recognition unit is connected to the monitoring unit. In the present invention, there is no need to directly recognize a physical game prop of a mixed complex virtual scene so as to simplify a complex problem; the stability and accuracy of recognition is improved; a recognition time is reduced; and the interactive game experience is greatly enriched.

Description

Projector-based prop identification method and system

Technical field

The invention relates to the field of AR interactive projectors, and in particular relates to a projector-based prop identification method and system.

Background technique

Augmented Reality (AR) is a technology that calculates the position and angle of camera images in real time and adds corresponding images, videos, and 3D models. The goal of this technology is to put the virtual world on the screen. The real world and interact. This technique was proposed in 1990. As the computing power of portable electronic products increases, it is expected that the use of augmented reality will become wider and wider.

In the AR interactive game, the market demand is very large, but the supply side is slightly insufficient, especially the enterprises with core intellectual property rights and excellent technology. The AR interactive games in the industry are mostly mobile platforms. Previously, most of the AR interactive games were played in two ways:

1. Place an identification card on the desktop, and identify the card and interact with the recognized content through the screen of the mobile phone.

2. By using "AR technology" (augmented reality technology), the content captured by the camera appears in another form in the screen.

However, in the projector, the content captured by the camera includes physical objects into the game scene, controls the game logic, and guides the game flow. In the complex background of mixed virtual scenes, especially in AR interactive projectors, AR (Augmented Reality) game real object recognition is very difficult.

technical problem

The technical problem to be solved by the present invention is to provide a physical object recognition system based on a projector for solving the above-mentioned defects of the prior art, and solving the problem that the physical item identification is very difficult under the complicated background of the mixed virtual scene.

Technical solution

The technical solution adopted by the present invention to solve the technical problem thereof is to provide a props recognition method based on a projector, the prop identification method comprising the steps of: placing a physical prop on a projection display surface; and projecting a complex image on a projection display surface In the process, the projected complex picture is switched to a simple picture, or the projection light source is turned off, and the image data of the projection display surface at this time is acquired; the simple picture of the projection is switched back to the complex picture again, or the projection light source is turned on; and, through the image data Identify physical items.

Preferably, the simple screen includes a solid color picture, a brightness reduction picture, or a contrast reduction picture.

Preferably, the item identification method further includes the steps of: preset switching conditions; triggering a switching condition in the process of projecting a complex picture on the projection display surface, switching the projected complex picture to a simple picture or turning off the projection light source. And acquiring the image data of the projection display surface at this time; switching the simple screen of the projection back to the complex image or turning on the projection light source again; and identifying the physical item through the image data.

Preferably, the projection screen includes a virtual switch. In the process of projecting a complex image on the projection display surface, the virtual switch is clicked, and the projection unit switches the projected complex image into a simple screen, and acquires the time. Project image data of the display surface.

Preferably, the AR interactive projector includes a switching circuit. In the process of projecting a complex image on the projection display surface, the switching circuit is controlled by a physical switch or a remote controller to switch the complex image of the projection into Simple screen or turn off the projection light source and obtain the image data of the projection display surface at this time.

Preferably, the switching condition includes: the time in the demonstration process reaches the time point of the demonstration process; wherein, in the process of projecting the complex image on the projection display surface, the time in the demonstration process reaches the presentation process time point, and the projection is performed. The complicated picture is switched to a simple picture, or the projection light source is turned off, and the image data of the projection display surface at this time is acquired.

Preferably, the demo process time point includes when the script presentation is completed, or when the countdown countdown is completed.

Preferably, a projection area is disposed on the projection screen; wherein, in the process of projecting the complex image on the projection display surface, the corresponding physical object is placed in the placement area of the projection display surface; After projecting the picture and identifying the physical item, perform a logical judgment. If the selected physical item is correct and placed in the correct position, the process is advanced.

Preferably, the projector is an AR interactive projector.

The technical solution adopted by the present invention to solve the technical problem thereof is to provide a projector-based physical item identification system, the physical item identification system comprising a projection unit, a monitoring unit, an identification unit and a processing unit, wherein the processing unit respectively The projection unit, the monitoring unit and the identification unit are electrically connected, and the identification unit is electrically connected to the monitoring unit; wherein the projection unit projects the image onto the projection display surface, and the physical display object is placed on the projection display surface; The processing unit controls the projection unit to switch the projected complex picture to a simple picture or close the projection light source, and controls the monitoring unit to acquire image data of the projection display surface at this time; and the processing The unit again controls the projection unit to switch the projected simple picture back to the complex picture, or turns on the projection light source; the recognition unit acquires the image data of the monitoring unit and recognizes the physical item, and sends the information of the physical item to the processing unit.

Beneficial effect

The invention has the beneficial effects that the present invention switches the complex image of the projection into a simple image and recognizes the physical object in the process of projecting the complex image on the projection display surface, without directly recognizing the mixing complexity, compared with the prior art. The virtual scene of the game's physical props, thus simplifying complex problems; and, improving the stability and accuracy of recognition, and reducing recognition time, greatly enrich the experience of interactive games.

DRAWINGS

The present invention will be further described below in conjunction with the accompanying drawings and embodiments, in which:

1 is a schematic flow chart of Embodiment 1 of an item identification method according to the present invention;

2 is a schematic flow chart of Embodiment 2 of the props identification method of the present invention;

3 is a schematic structural view of a physical prop identification system of the present invention;

4 is a schematic structural diagram of step 1 of the prop identification method of the present invention;

5 is a schematic structural diagram of step 2 of the prop identification method of the present invention;

6 is a schematic structural diagram of step 3 of the prop identification method of the present invention;

7 is a schematic structural diagram of step 4 of the prop identification method of the present invention;

FIG. 8 is a schematic flowchart of Embodiment 1 of an item identification method based on a preset switching condition according to the present invention; FIG.

FIG. 9 is a schematic flowchart of Embodiment 2 of a method for identifying a prop based on a preset switching condition according to the present invention;

10 is a schematic structural diagram of FIG. 8 or FIG. 9 based on virtual switch trigger switching identification;

11 is a schematic structural diagram of FIG. 8 or FIG. 9 based on a switch circuit triggering switching identification;

12 is a schematic structural diagram of FIG. 8 or FIG. 9 based on a countdown trigger switching identification;

13 is a schematic structural diagram of FIG. 8 or FIG. 9 based on step 1 of the game process;

14 is a schematic structural diagram of step 2 of FIG. 8 or FIG. 9 triggering handover identification based on a game process;

Figure 15 is a flow chart showing the identification of image data of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A preferred embodiment of the present invention will now be described in detail with reference to the accompanying drawings.

As shown in Figures 1 to 7, the present invention provides a preferred embodiment of a prop identification method.

A real object props recognition method based on a projector, and referring to FIG. 3, the physical object identification method includes the following steps:

In step S10, a complex image is projected on the projection display surface 20 and a physical object 30 is placed on the projection display surface 20.

In step S201, the projection unit 11 switches the projected complex screen to a simple screen.

In step S30, the monitoring unit 12 acquires the image data of the projection display surface 20 at this time.

In step S401, the projection unit 11 switches the projected simple screen back to the complex screen again.

Step S50, and the recognition unit 13 identifies the physical item 30 by the image data.

or,

Step S202, the projection unit 11 turns off the projection light source.

Step S402, the projection unit 11 turns on the projection light source.

Step S401 and step S50 are performed independently, and there is no context; step S402 and step S50 are performed independently, and there is no context.

In the present embodiment, and referring to FIG. 3, a projector-based physical item 30 identification system includes a projection unit 11, a monitoring unit 12, an identification unit 13, and a processing unit 14, and the processing The unit 14 is electrically connected to the projection unit 11, the monitoring unit 12 and the identification unit 13, respectively, and the identification unit 13 is electrically connected to the monitoring unit 12. The projection unit 11 projects a complex image onto the projection display surface 20, and the physical object 30 is placed on the projection display surface 20; and the processing unit 14 controls the projection unit 11 during the projection of the complex image by the projection unit 11 Switching the projected complex picture to a simple picture, or turning off the projection, and the control monitoring unit 12 acquires the image data of the projected display surface 20 at this time; and the processing unit 14 again controls the projection unit 11 to switch the projected simple picture back to the complex The screen, or the projection is turned on; the recognition unit 13 acquires the image data of the monitoring unit 12 and recognizes the physical item 30, and transmits the information of the physical item 30 to the processing unit 14.

Preferably, the projector is an AR interactive projector. AR projection uses key technologies such as image recognition, 3D reconstruction and automatic 3D mapping to identify the carrier in real time through the camera, and map the preset content to the carrier by means of the powerful computing power of the host.

In step S201 or step 202, and referring to FIG. 4, the physical props 30 include components of different colors, different shapes, and different patterns, and the physical props 30 further include an identification card, that is, an AR card, and the AR card is an AR technology. Application product, which is used with super-dimensional software. The front of the AR card is the character map, and the back is the FM code map. When the software scans the FM code, there will be a 3D stereo image of the positive character. The stereo character has actions, language, special effects, and Interaction. Moreover, the simple picture includes a solid color picture, which facilitates the difficulty of image data processing after obtaining image data, and improves the accuracy of identifying the physical item 30.

In step S30, the acquired image data is based on a simple screen, and the physical object 30 is on the projection display surface 20. In general, at least one or more pictures are collected as a basis for subsequent image data processing.

In step S401, the projected complex picture is switched to a simple picture, and the projected simple picture is switched back to the complex picture again, and the interval required is very short. During the switching interval period, the monitoring unit acquires the image data. The simple picture includes a solid color picture, a brightness reduction picture or a contrast reduction picture; the solid color picture is a single color picture, the brightness reduction picture is a picture after the brightness of the complex picture is lowered, or other low brightness pictures, the contrast is low The screen is a screen with a low contrast of a complicated screen, or another screen with a low contrast.

In step S50, the specific content of the physical item 30 is identified as: the type, shape and size of the physical item 30, the pattern and color of the physical item 30, and the position and direction of the physical item 30.

Referring to FIG. 4 to FIG. 7 , a projection area 201 is disposed on the projection screen; wherein, in the process of projecting a complex image on the projection display surface 20 , the corresponding physical prop 30 is placed in the placement area of the projection display surface 20 . 201. Specifically, the physical object 30 is placed on the projection area 201 projected on the projection display surface 20; and the projected complex picture is switched to a simple picture, and the projected simple picture is switched back to the complex picture again; the monitoring unit 12 acquires the switching. Further, the image data of the shadow display surface is displayed on the simple screen; further, after the projection screen is switched and the physical object 30 is recognized, a logical determination is made, and if the selected physical object 30 is correct and the position is placed correctly, the flow is advanced.

As shown in FIG. 8 and FIG. 9, the present invention provides a preferred embodiment of a prop identification method based on preset switching conditions.

The physical item 30 identification method further includes the steps of:

S11. Preset switching conditions.

S12. In the process of projecting a complex picture on the projection display surface 20, a switching condition is triggered.

S201. Switch the complicated screen of the projection to a simple screen.

S30. The monitoring unit 12 acquires image data of the projection display surface 20 at this time.

S401. The projection unit 11 again switches the projected simple screen back to the complex screen.

S50, and the recognition unit 13 recognizes the physical item 30 by the image data.

Or, S11, preset switching conditions.

S201. The projection unit 11 turns off the projection light source.

S401. The projection unit 11 turns on the projection light source.

In steps S11 and S12, the switching recognition function is activated by triggering various switching conditions, including active triggering and passive triggering.

The active trigger includes a virtual switch 21 trigger or a physical switch trigger; and the passive trigger includes triggering different trigger points according to a preset process of the program, and each time the trigger point is triggered, the switch recognition function is started.

As shown in FIG. 10, the present invention provides a preferred embodiment of virtual switch trigger switching identification.

The projection screen includes a virtual switch 21; wherein, in the process of projecting a complex image on the projection display surface 20, the virtual switch 21 is clicked, the projected complex image is switched to a simple screen, or the projection light source is turned off, and the projection is obtained. The image data of the face 20 is displayed.

Specifically, after the physical object 30 is placed, the mouse pointer or the hand or other obstruction is moved over the virtual switch 21, and the virtual switch 21 is activated by clicking, and the projection screen enters the next preset process. For example, a game interaction scheme is provided. First, a complex virtual scene is projected to the projection display surface 20, and the player places a real physical item 30 in the placement area 201 according to the situation of the virtual scene (such as a character path finding or attack state); the physical item 30 After the placement is completed, the player clicks the virtual switch 21 on the projection display surface 20 to trigger the scene switching; then closes the complex picture, projects the simple picture or turns off the projection light source; captures a simple picture of the physical object 30; and most recognizes the game physical item 30, And resume the projection of complex images or turn on the projection light source; and, the main game program determines the game logic and advances the game flow.

As shown in Figure 11, the present invention provides a preferred embodiment of a switching circuit.

The AR interactive projector includes a switching circuit. In the process of projecting a complex image on the projection display surface 20, the switching circuit is controlled to be turned on by the physical switch or the remote controller 40, and the complicated screen of the projection is switched to a simple screen and monitored. The unit 12 acquires image data of the projection display surface 20 at this time.

The remote controller 40 is provided with a changeover switch 41.

As shown in Figures 12 through 14, the present invention provides a preferred embodiment for triggering handover identification at a point in time during a demonstration process.

The switching condition includes the time of the demonstration process reaching the presentation process time point; wherein, in the process of projecting the complex image on the projection display surface 20, the time during the demonstration process reaches the presentation process time point, and the projected complex image is switched to the simple picture. Or the projection light source is turned off, and the monitoring unit 12 acquires the image data of the projection display surface 20 at this time.

Referring to Figure 12, the demo process time point includes the countdown 22 when the countdown is completed. Specifically, when the projection screen enters a scene or when the scene completes a certain process, the countdown is entered. At this time, the user needs to place the physical prop 30 in the designated placement area 201, waiting for the countdown 22 to end, of course, the countdown 22 It can be terminated by initiative; and the switch recognition function is activated after the end.

Referring to Figures 13 and 14, the demonstration process time point includes when the script presentation is completed, preferably when the game script is completed. For example, when entering a scene, a trigger position 202 is set, and when the projected person 23 "walks" to the trigger position 202 through the projected route 24, the start switch recognition function is turned on; and, in the process, the user needs to be in the placement area. In 201, the physical props 30 are prevented, as shown in the rectangular bridge of FIG. 12 to the two sides of the "river". After the switching is recognized, the next scene is entered, and the projected character 23 walks along the rectangular bridge to the opposite side of the "river".

As shown in FIG. 15, the present invention provides a preferred embodiment for identifying a physical item by image data.

The image data includes the type, shape, size, direction, outline, and position coordinate data of the item. Specifically, the monitoring unit 12 captures the image data of the projection display surface 20, and the recognition unit 13 processes the image data, such as image segmentation, extracting image edge contours, position coordinates, feature point coordinates, and the like, and identifying the shape and size of the props. Characteristics such as categories. For example, a circle indicates a turret, a rectangle indicates a bridge, a triangle indicates a knife, and the like.

Identifying the physical item through the image data also includes the steps:

S10. The monitoring unit 12 captures image data of the projection display surface 20.

S20. The recognition unit 13 preprocesses the image data: image denoising and image segmentation.

S30. The recognition unit 13 extracts information such as an image contour edge, a position coordinate, and a feature point coordinate.

S40. The recognition unit 13 recognizes features such as the shape, size, and type of the item.

The above is only the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention, and equivalent changes or modifications made by the scope of the present invention are covered by the present invention.

Claims

A projector-based prop identification method, characterized in that the prop identification method comprises the steps of:

A physical item is placed on the projection display surface;

In the process of projecting a complex picture on the projection display surface, switching the projected complex picture to a simple picture, or turning off the projection light source, and acquiring image data of the projection display surface at this time;

Switch the simple screen of the projection back to the complex screen again, or turn on the projection light source;

And, the physical item is identified by the image data.
The item identifying method according to claim 1, wherein the simple picture comprises a solid color picture, a brightness reduction picture, or a contrast reduction picture.
The item identification method according to claim 1, wherein the item identification method further comprises the steps of:

Preset switching conditions;

In the process of projecting a complex picture on the projection display surface, triggering a switching condition, switching the projected complex picture to a simple picture, or turning off the projection light source, and acquiring image data of the projection display surface at this time;

Switch the simple screen of the projection back to the complex screen again, or turn on the projection light source;

And, the physical item is identified by the image data.
The props recognition method according to claim 3, wherein the projection screen comprises a virtual switch; wherein

In the process of projecting a complex picture on the projection display surface, the virtual switch is clicked, the projected complex picture is switched to a simple picture, and the image data of the projection display surface at this time is acquired.
The item identification method according to claim 3, wherein the AR interactive projector comprises a switching circuit;

In the process of projecting a complex picture on the projection display surface, the switching circuit is turned on by the physical switch or the remote controller, the complicated picture of the projection is switched to a simple picture, or the projection light source is turned off, and the image data of the projection display surface at this time is acquired.
The item identification method according to claim 3, wherein the switching condition comprises a time during the demonstration process reaching a presentation process time point; wherein

In the process of projecting a complex picture on the projection display surface, the time during the demonstration process reaches the presentation process time point, the projected complex picture is switched to a simple picture, or the projection light source is turned off, and the image data of the projection display surface at this time is acquired.
The item identification method according to claim 6, wherein the presentation process time point includes when the script presentation is completed, or when the countdown countdown is completed.
The item identification method according to any one of claims 1 to 7, wherein a projection area is disposed on the projection screen;

In the process of projecting a complex picture on the projection display surface, the corresponding physical item is placed in the placement area of the projection display surface;

After switching the projection screen and identifying the physical item, a logical judgment is made, and if the selected physical item is correct and the position is correctly placed, the flow is advanced.
The prop identification method according to claim 1, wherein the projector is an AR interactive projector.
A projector-based physical item identification system, characterized in that: the physical item identification system comprises a projection unit, a monitoring unit, an identification unit and a processing unit, and the processing unit is respectively electrically connected with the projection unit, the monitoring unit and the identification unit Connecting, the identification unit is electrically connected to the monitoring unit; wherein

The projection unit projects a picture onto the projection display surface, and a physical item is placed on the projection display surface; and the processing unit controls the projection unit to switch the projected complex picture to a simple picture in the process of projecting the complex picture by the projection unit. Or turning off the projection light source, and controlling the monitoring unit to acquire the image data of the projection display surface at this time; and, the processing unit again controls the projection unit to switch the projected simple screen back to the complex screen, or turn on the projection light source;

The identification unit acquires image data of the monitoring unit and identifies the physical item, and sends the information of the physical item to the processing unit.