WO2019128086A1

WO2019128086A1 - Stage interactive projection method, apparatus and system

Info

Publication number: WO2019128086A1
Application number: PCT/CN2018/088867
Authority: WO
Inventors: 杨伟樑; 高志强; 林清云
Original assignee: 广景视睿科技（深圳）有限公司
Priority date: 2017-12-31
Filing date: 2018-05-29
Publication date: 2019-07-04
Also published as: CN109993835A

Abstract

Embodiments of the present application relate to the technical field of digital projection display, and particularly relate to a stage moving projection system and a method thereof. A stage comprises a stage space. The interactive projection method comprises the following steps: obtaining environment information of a master located in the stage space; analyzing the environment information, and determining an intended projection direction; and performing projection in the intended projection direction. On the basis of the method, the embodiments of the present application can track an intended projection direction of a master and perform projection.

Description

Stage interactive projection method, device and system

Technical field

The present application relates to the field of digital projection display technology, and in particular, to a stage motion projection method, apparatus and system thereof.

Background technique

With the development of science and technology and the continuous improvement of people's living standards, people's requirements for visual senses are getting higher and higher: on the one hand, people's requirements for human-machine interface display devices are increasingly toward micro, large screen and high resolution. On the other hand, in terms of display effects, people tend to pursue 3D dynamic, augmented reality, and immersive visual enjoyment. Augmented reality technology is a technology developed on the basis of virtual reality (VR), which is a technology that enhances users' perception of the real world by utilizing information provided by computer systems. Specifically, it applies the virtual information to the real world, that is, superimposes the computer-generated virtual object, scene or system prompt information into the real scene, thereby realizing the enhancement of reality. The functions of the projection device will vary depending on the usage scenario.

At present, the common stage performances are generally based on the changing body language, dazzling costumes, static background and lighting effects to comprehensively display the performance content. The fun of the performance is limited. With the development of technology, the display screen is used. Display some dynamic video screens to match the actors' performances; or use some somatosensory devices to sense the actors' physical movements and change the corresponding video images in real time to form interactive effects with the actors. However, this method can not achieve the combination of video content and people or props in the stage scene, forming a dazzling stage effect of virtual reality combination and intelligent interaction.

Therefore, a stage interactive projection system and method for tracking the user's intentional projection direction and changing the direction of the projection lens in real time to realize virtual reality integration has become one of the research focuses in the field of projection.

Summary of the invention

In order to solve the above technical problem, the present application provides an interactive projection method, apparatus, and system thereof that can track a user's intentional projection direction.

In order to solve the above technical problem, an embodiment of the present application provides an interactive projection method, apparatus, and system thereof that can track a user's intentional projection direction.

The embodiment of the present application provides a stage-based interactive projection method, the stage includes a stage space, and the interactive projection method includes the following steps: acquiring environment information of a master located in the stage space; analyzing the environment information, Determining the direction of intentional projection; projecting in the direction of the intended projection.

Optionally, the collecting environment information of the master located in the stage space includes the following steps: acquiring a specific location of the master in the stage space; locking the master in the stage space The location; obtain the environmental information of the host.

Optionally, the analyzing the environmental information, determining the intentional projection direction comprises the following steps: comparing the environmental information with each model in the model library; if the environmental information and the model library are When the matching value of a model reaches a preset value, the intentional projection direction corresponding to the model is extracted.

Optionally, the stage space is divided into a plurality of projection areas, and the projecting to the intentional projection direction comprises the steps of: determining a corresponding projection area according to the intentional projection direction; determining projection content according to the projection area. And delivering the projected content to the projection area.

Optionally, the projecting to the intentional projection space comprises the steps of: dividing the stage space into corresponding projection regions according to the intentional projection direction; determining projection content according to the intentional projection direction, and The projection area delivers the projected content.

The embodiment of the present application further provides a stage-based interactive projection device, wherein the stage includes a stage space, wherein the interactive projection device includes the following module: an acquisition module, configured to acquire a master located in the stage space Environmental information; an analysis module for analyzing the environmental information to determine an intentional projection direction; and a projection module for projecting in the intentional projection direction.

Optionally, the acquiring module includes: a positioning unit, configured to acquire a specific location of the master in the stage space; and a locking unit, configured to lock the position of the master in the stage space And an obtaining unit, configured to acquire environment information of the controlled person.

Optionally, the analysis module comprises: an analysis unit, configured to perform the comparison analysis on the environment information and each model in the model library; and a matching unit, configured to use the environment information and the model The matching value of any model in the library reaches a preset value; an extracting unit for extracting an intent projection direction corresponding to the model.

Optionally, the stage space is divided into a plurality of projection areas, and the projection module comprises: a regional unit, determining a corresponding projection area according to the intentional projection direction; and a first projection unit, determining according to the projection area Projecting content and delivering the projected content to the projection area.

Optionally, the projection module comprises: a partitioning unit, configured to divide the stage space into a corresponding projection area according to the intentional projection direction; and a second projection unit, determining a projection according to the intentional projection direction Content and delivering the projected content to the projection area.

An embodiment of the present application further provides an interactive projection system, the interactive projection system comprising: an intention recognition device for collecting environmental information; a projection display device for projecting to an intentional projection space; and a direction control device for Changing a projection direction angle of the projection display device; a processor for acquiring environmental information of a host located in the stage space; analyzing the environmental information to determine an intentional projection direction; and projecting to the intentional projection direction.

Optionally, the interactive projection system further includes: a storage device configured to store a preset model library and projection content; the processor further configured to perform the environment information and each model in the model library Alignment analysis; if the matching value of the environment information and any model in the model library reaches a preset value, extracting an intentional projection direction corresponding to the model; determining a correspondence according to the intentional projection direction a projection area; determining a projection content according to the projection area, and delivering the projection content to the projection area.

Compared with the prior art, the embodiment of the present application provides a stage-based interactive projection method, the stage includes a stage space, and the interactive projection method includes the following steps: acquiring environment information of a host located in the stage space And analyzing the environmental information to determine an intentional projection direction; projecting to the intentional projection direction. In the above manner, the embodiment of the present application can implement tracking of the intentional projection direction of the master and projecting.

DRAWINGS

The one or more embodiments are exemplified by the accompanying drawings in the accompanying drawings, and FIG. The figures in the drawings do not constitute a scale limitation unless otherwise stated.

1 is a flowchart of an interactive projection method provided by Embodiment 1 of the present application;

2 is a flow chart of obtaining environmental information located in the stage space in an interactive projection method according to Embodiment 1 of the present application;

3 is a flow chart of analyzing the environmental information and determining an intentional projection direction in an interactive projection method according to Embodiment 1 of the present application;

4 is a flow chart of projecting to the intentional projection direction in an interactive projection method according to Embodiment 1 of the present application;

FIG. 5 is a flowchart of another implementation manner of projecting to the intentional projection direction in an interactive projection method according to Embodiment 1 of the present application; FIG.

6 is a schematic structural diagram of an interactive projection apparatus according to Embodiment 2 of the present application;

7 is a schematic structural diagram of an interactive projection apparatus according to Embodiment 2 of the present application;

8 is a schematic diagram of an application environment of an interactive projection system according to Embodiment 3 of the present application;

FIG. 9 is a schematic structural diagram of an interactive projection system according to Embodiment 3 of the present application.

Detailed ways

In order to facilitate the understanding of the present application, the present application will be described in more detail below with reference to the accompanying drawings and specific embodiments. It is to be noted that when an element is described as being "fixed" to another element, it can be directly on the other element, or one or more central elements can be present. When an element is referred to as "connected" to another element, it can be a <RTI ID=0.0> </ RTI> </ RTI> <RTIgt; The terms "vertical," "horizontal," "left," "right," "inside," "outside," and the like, as used in this specification, are for the purpose of illustration.

Unless otherwise defined, all technical and scientific terms used in the specification are the same meaning The terms used in the description of the present application are for the purpose of describing the specific embodiments and are not intended to limit the application. The term "and/or" used in this specification includes any and all combinations of one or more of the associated listed items.

Embodiment 1

Referring to FIG. 1 , an embodiment of the present application provides a stage-based interactive projection method, where the stage includes a stage space, and the interactive projection method includes the following steps:

Step 101: Acquire environment information of a master located in the stage space.

Among them, the master includes performers, directors, spectators or stage audio or lighting equipment. Environmental information includes physical movements, voice information, stage audio or stage lighting, body movements such as gesture direction, eye movement direction, head swing direction, etc. Voice information includes sound color, loudness, and the like. Specifically, the environment information of the master located in the stage space may be collected by the intention recognition device, such as an image capturing device, an audio collecting device, a light collecting device, and the like.

Referring to FIG. 2, specifically, obtaining the environment information of the master located in the stage space in step 101 specifically includes steps 1011 to 1013:

Step 1011: Acquire a specific location of the master in the stage space.

Step 1012: Lock the position of the master in the stage space.

Step 1013: Acquire the environmental information of the controlled person.

In step 1011 to step 1013, specifically, the specific location of the master in the stage space may be acquired by a positioning device, such as wifi positioning. By analyzing the specific position of the master in the stage space, the key position of the main control is locked to collect environmental information. To improve the accuracy of environmental information collection. For example, if there is a non-master in the vicinity of the master, the non-master may interfere with the environmental information of the master, and locate the master's specific location, lock the master to obtain environmental information, and improve the environment. The accuracy of information collection. As another example, the position of the master in the stage space can be determined by the positioning device. For example, the positioning device includes a mobile positioning end and a positioning terminal, the positioning terminal can acquire the position of the positioning end, and the main controller carries the mobile positioning end, and the position of the performer can be obtained by the positioning terminal.

Further, the positioning device further includes a plurality of fixed positioning ends, wherein the positioning terminal can acquire the positions of the fixed terminals, and each fixed positioning end is disposed at each position of the stage space, and the distance between the moving positioning end and the fixed positioning end can be determined more accurately. Move the position of the positioning end to more accurately determine the position of the master in the stage space.

Step 102: Analyze the environmental information to determine an intentional projection direction;

Referring to FIG. 3, specifically, step 102 specifically includes the following steps 1021 to 1022:

Step 1021: Perform comparison analysis on the environment information and each model in the model library.

Specifically, the preset model library is stored by the storage device, and the model library corresponds to the type of the environment information, for example, the body language of the master corresponds to the body language model library.

Step 1022: If the matching value of the environment information and any model in the model library reaches a preset value, extract an intentional projection direction corresponding to the model.

Specifically, in steps 1021 to 1022, by matching the environment information with the preset model, the master can convert the environment information into the intentional projection direction data by setting the preset model library.

Step 103: Projecting in the direction of the intentional projection.

Referring to FIG. 4, in particular, in the embodiment, the projection display device can be controlled to change the angle by the direction control device to project in the intentional projection direction. Further, the projecting to the intentional projection direction in step 103 specifically includes steps 1031 to 1032:

Step 1031: Determine a corresponding projection area according to the intentional projection direction.

Step 1032: Determine projection content according to the projection area, and place the projection content to the projection area.

In step 1031 to step 1032, the stage space is divided into a plurality of projection regions, each projection region corresponding to different projection content, and the corresponding projection content is pushed to the corresponding region according to the intention projection direction of the master, so that the projection is made. The content is combined with the person or object in the corresponding projection area; the size of the divided area can be adjusted according to the effect required by different programs; it can be detailed to each actor or each item for the stage space has a different correspondence Projection content. The projected content can be stored by the storage device.

Referring to FIG. 5, in some embodiments, specifically, the projecting to the intentional projection direction in step 103 specifically includes the following steps 1033 to 1034:

Step 1033: Divide the stage space into corresponding projection areas according to the intentional projection direction.

Step 1034: Determine projection content according to the intentional projection direction, and place the projection content to the projection area.

In step 1033 to step 1034, the environment information is stage audio, and the projection content and the projection area correspond to the stage audio, and different projection areas and corresponding projection contents are assigned according to different sound contents; The loudness level of the audio is used to divide the projection area; the projection area can also be divided according to the audio words; for example, when the performer on the stage sings the word "butterfly fly", the intention tracking device includes the vocabulary Voice, and adjust the projection direction of the projection display device according to the projection area divided by the word "butterfly fly", project the projection display content corresponding to the "butterfly fly" vocabulary; or in the dance performance, according to the collected background music The pitch or loudness level is used to display the corresponding area and content. For another example, the projection content and the projection area correspond to the stage lighting effect, that is, the stage space area is defined in advance, and each space area is provided with a light intensity detector, and each area is assigned a different projection according to different light intensity level contents. Display content; the size of the divided area can be adjusted according to the effect required by different programs.

In some embodiments, in some embodiments, the environmental information includes a blink frequency, and the projected content includes a brightness of the projected light, and the interactive projection method further includes the following steps 104 to 106:

Step 104: Determine whether the intentional projection direction is facing the face of the master;

Step 105: If the projection direction is facing the face of the master, the blink frequency of the master is collected.

Step 106: If the blink frequency of the master exceeds the blink frequency threshold, the brightness of the projection will be lowered.

Specifically, in steps 104 to 106, since the projection is relatively intense due to the projection light, the direct master's eyes may cause discomfort, and some or all of the predicted content may be dimmed for this case. For example, the system can identify which pixel of the projection is projected into the user's eyes, and can turn the values of these pixels black. By doing so, the user is not obscured by the bright light projected into the user's eyes or otherwise troubled.

In an embodiment of the present application, the interactive projection method acquires environmental information of a master located in the stage space; analyzes the environmental information, determines an intentional projection direction; and projects the direction of the intentional projection. Thus, the interactive projection method enables tracking of the intent projection direction of the master.

Embodiment 2

Please refer to FIG. 6. FIG. 6 is a schematic structural diagram of an interactive projection apparatus 20 according to Embodiment 2 of the present application. The interactive projection apparatus 20 includes: an acquisition module 201, configured to acquire a master located in the stage space. The environmental information; the analysis module 202 is configured to analyze the environmental information to determine an intentional projection direction; and the projection module 203 is configured to project in the intentional projection direction.

Referring to FIG. 7 , the acquiring module 201 includes the following units: a positioning unit 2011 for acquiring a specific location of the master in the stage space; and a locking unit 2012 for locking the master The location of the stage space; the obtaining unit 2013 is configured to acquire environment information of the master.

Optionally, the analyzing module 202 includes the following unit: an analyzing unit 2021, configured to perform comparison analysis on the environment information and each model in the model library; and a matching unit 2022, configured to use the environment information and The matching value of any of the models in the model library reaches a preset value; an extracting unit 2023 is configured to extract an intent projection direction corresponding to the model.

Optionally, the stage space is divided into a plurality of projection areas, and the projection module 203 includes the following unit: an area unit 2031, and determines a corresponding projection area according to the intentional projection direction; the first projection unit 2032, according to the The projection area determines the projected content and delivers the projected content to the projected area.

Optionally, the projection module 203 includes a unit: a partitioning unit 2033, configured to divide the stage space into corresponding projection areas according to the intentional projection direction; and a second projection unit 2034, according to the intentional projection The direction determines the projected content and delivers the projected content to the projected area.

In some embodiments, in some embodiments, the environmental information includes a blink frequency, and the projected content includes a brightness of the projected light, and the interactive projection device further includes:

A judging module is configured to judge whether the intentional projection direction is facing the face of the master.

A brightness module for collecting a blink frequency of the master if the projection direction is facing the face of the master.

In the embodiment of the present application, the interactive projection device is configured to acquire environment information of a host located in the stage space, and an analysis module, configured to analyze the environment information to determine an intentional projection direction; and the projection module It is used to project in the direction of the intended projection.

Embodiment 3

Referring to FIG. 8 and FIG. 9 , FIG. 8 is a schematic diagram of an application environment of an interactive projection system 30 according to Embodiment 3 of the present application, and FIG. 9 is a schematic structural diagram of an interactive projection system 30 according to Embodiment 3 of the present application.

The interactive projection system 30 includes:

Intent identification device 301 for collecting environmental information;

a projection display device 302 for projecting into the intent projection space;

a direction control device 303, configured to change a projection direction angle of the projection display device;

The processor 304 is configured to acquire environment information of a master located in the stage space, analyze the environment information, determine an intentional projection direction, and project to the intentional projection direction.

The interactive projection system 30 also includes:

Optionally, a storage device 305 is configured to store a preset model library and projected content;

The processor 304 is further configured to compare the environment information with each model in the model library; if the matching value between the environment information and any model in the model library reaches a preset value And extracting an intentional projection direction corresponding to the model; determining a corresponding projection area according to the intentional projection direction; determining a projection content according to the projection area, and delivering the projection content to the projection area.

Optionally, the interactive projection system 30 further includes a positioning device 306 for acquiring a specific location of the master in the stage space.

The processor 304 is further configured to acquire a specific location of the master in the stage space, lock a position of the master in the stage space, and acquire environment information of the master.

It should be noted that the system embodiment of the third embodiment of the present application is based on the same inventive concept as the foregoing method embodiment 1 and the device embodiment 2. Therefore, the specific content of the third embodiment can refer to the specific content of the first embodiment to the fourth embodiment. I will not repeat them here.

It should be noted that the present application does not limit the method and device for interactive projection, and the specific use scenarios of the system, and can be used in a square, a room, or other scenes where a stage can be used.

Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, and are not limited thereto; in the idea of the present application, the technical features in the above embodiments or different embodiments may also be combined. The steps may be carried out in any order, and there are many other variations of the various aspects of the present application as described above, which are not provided in the details for the sake of brevity; although the present application has been described in detail with reference to the foregoing embodiments, The skilled person should understand that the technical solutions described in the foregoing embodiments may be modified, or some of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the embodiments of the present application. The scope of the technical solution.

Claims

A stage-based interactive projection method, the stage comprising a stage space, wherein the interactive projection method comprises the following steps:

Obtaining environmental information of the master located in the stage space;

Analyzing the environmental information to determine an intentional projection direction;

Projecting in the direction of the intended projection.
The interactive projection method according to claim 1, wherein the collecting environment information of the master located in the stage space comprises the following steps:

Obtaining a specific location of the master in the stage space;

Locking the position of the master in the stage space;

Obtain the environmental information of the host.
The interactive projection method according to claim 1, wherein the analyzing the environmental information to determine an intentional projection direction comprises the following steps:

Comparing the environmental information with each model in the model library;

If the matching value of the environment information and any model in the model library reaches a preset value, the intentional projection direction corresponding to the model is extracted.
The interactive projection method according to claim 1, wherein the stage space is divided into a plurality of projection regions, and the projecting to the intentional projection direction comprises the following steps:

Determining a corresponding projection area according to the intentional projection direction;

The projection content is determined according to the projection area, and the projection content is delivered to the projection area.
The interactive projection method according to claim 1, wherein the projecting to the intentional projection space comprises the following steps:

Dividing the stage space into corresponding projection areas according to the intentional projection direction;

Determining the projected content according to the intentional projection direction, and delivering the projected content to the projected area.
A stage-based interactive projection device, the stage comprising a stage space, wherein the interactive projection device comprises the following modules:

An acquisition module, configured to acquire environment information of a master located in the stage space;

An analysis module for analyzing the environmental information to determine an intentional projection direction;

a projection module for projecting in the direction of the intentional projection.
The interactive projection apparatus according to claim 1, wherein the acquisition module comprises the following units:

a positioning unit, configured to acquire a specific location of the master in the stage space;

a locking unit, configured to lock a position of the master in the stage space;

An obtaining unit, configured to obtain environment information of the master.
The interactive projection apparatus according to claim 1, wherein said analysis module comprises the following units:

An analysis unit, configured to compare the environmental information with each model in the model library;

a matching unit, configured to: when a matching value between the environment information and any model in the model library reaches a preset value;

An extracting unit for extracting an intentional projection direction corresponding to the model.
The interactive projection method according to claim 1, wherein the stage space is divided into a plurality of projection areas, and the projection module comprises the following units:

a regional unit, determining a corresponding projection area according to the intentional projection direction;

The first projection unit determines the projection content according to the projection area, and deposits the projection content to the projection area.
The interactive projection apparatus according to claim 1, wherein said projection module comprises the following unit:

a partitioning unit, configured to divide the stage space into corresponding projection areas according to the intentional projection direction;

a second projection unit that determines a projection content according to the intentional projection direction and delivers the projection content to the projection area.
An interactive projection system, characterized in that the interactive projection system comprises:

Intent identification device for collecting environmental information;

a projection display device for projecting into an intentional projection space;

a direction control device for changing a projection direction angle of the projection display device;

a processor for acquiring environmental information of a master located in the stage space; analyzing the environmental information to determine an intentional projection direction; and projecting in the intentional projection direction.
The interactive projection system of claim 11 wherein said interactive projection system further comprises:

a storage device for storing a preset model library and projection content;

The processor is further configured to compare the environment information with each model in the model library; if the matching value between the environment information and any model in the model library reaches a preset value, And extracting an intentional projection direction corresponding to the model; determining a corresponding projection area according to the intentional projection direction; determining a projection content according to the projection area, and placing the projection content to the projection area.