CN116867555A - Interactive pepper's ghost effect system and method - Google Patents

Abstract

An interactive pepper's ghost system includes a sensor configured to detect a parameter indicative of an orientation of a handheld device. The pepper's ghost system also includes a controller configured to receive sensor feedback from the sensor corresponding to a parameter indicative of the orientation of the handheld device. The controller is configured to control the pepper's ghost visual effect based on the sensor feedback.

Description

Interactive pepper's ghost effect system and method

Cross reference to related applications

The present application claims priority and its benefit from U.S. provisional application serial No. 63/147973 (titled "INTERACTIVE PEPPER' S ghest EFFECT SYSTEM AND METHOD", filed on 10/2 of 2021), which is hereby incorporated by reference in its entirety for all purposes.

Background

This section is intended to introduce the reader to various aspects of art that may be related to various aspects of the present disclosure, which are described and/or claimed below. This discussion is believed to be helpful in providing the reader with background information to facilitate a better understanding of the various aspects of the present disclosure. Accordingly, it is to be understood that these statements are to be read in this light, and not as admissions of prior art.

Theme parks, amusement parks, theatres, movie theatres, stadiums, concert halls, and the like have been created to provide customers with a variety of immersive experiences. These casinos may include sceneries (e.g., movies, dramas, rides, games) that provide the patron with an immersive experience. For example, conventional performance attractions may utilize various combinations of physical performance elements (or props), stage management (staffing), and lights to create various visual effects from the perspective of the customer. One commonly used visual effect may be referred to as a Pepper's ghost illusion. For example, a traditional pepper's ghost system may employ a primary stage (first scene), a secondary stage (second scene), and a beam splitter (e.g., a piece of glass) positioned to substantially combine images from each scene (when viewed from the perspective of the viewer). The image from the second scene may be reflected from the beam splitter (e.g., from the glass surface) toward the viewer, while the image from the first scene is transmitted through the beam splitter (e.g., through the glass). Stage lighting may be controlled to illuminate aspects of the scene but not the beam splitter. This may increase the visibility of the desired scene features and limit or prevent the beam splitter itself from being observed by a viewer. This creates an illusion on the primary stage that is actually only a physical presence of reflections of the secondary stage.

While well-established effects such as the traditional pepper's ghost effect are an illusion of effectiveness, it is now recognized that these traditional effects lack meaningful viewer interaction. For example, spectators (which may include one or more customers) typically have no control over various aspects of the performance established around such effects. In other words, the audience in such conventional systems is passive. In today's environments where customers are accustomed to more interactions (e.g., via video games), such passive interactions may be of interest to lose. Further, even in performances employing spectator interactions, it is presently recognized that technical limitations may make spectator interactions overly expensive, inaccurate, trivial, or any combination thereof. Accordingly, improved performance attractions are desired.

Disclosure of Invention

The following outlines certain embodiments commensurate in scope with the originally claimed subject matter. These embodiments are not intended to limit the scope of the present disclosure, but rather, these embodiments are intended only to provide a brief overview of some of the disclosed embodiments. Indeed, this disclosure may encompass a variety of forms that may be similar to or different from the embodiments set forth below.

In one embodiment, an interactive pepper's ghost system includes a sensor configured to detect a parameter indicative of an orientation of a handheld device. The pepper's ghost system also includes a controller configured to receive sensor feedback from the sensor corresponding to the parameter indicative of the orientation of the handheld device. The controller is configured to control a pepper's ghost visual effect based on the sensor feedback.

In one embodiment, an entertainment system includes: transparent or translucent screens; a plurality of light emitters directed toward the transparent or translucent screen; a hand-held device; a sensor configured to monitor an orientation of the handheld device; a controller configured to receive sensor feedback from the sensor indicating the orientation of the handheld device, wherein the controller is configured to select at least one light emitter of the plurality of light emitters based on the sensor feedback and to activate the at least one light emitter to emit light onto the transparent or translucent screen such that a pepper's ghost effect is created from an angle at the handheld device.

In one embodiment, an interactive pepper's ghost system comprises: a handheld device configured to be held by an operator; a sensor configured to monitor an orientation of the handheld device; a microphone configured to detect voice audio from the operator; transparent or translucent screens; and a controller. The controller is configured to: a first data feedback indicating the orientation of the handheld device is received from the sensor, and a position (location) of the transparent or translucent screen to which the handheld device is pointed is determined based on the first data feedback. The controller is further configured to: receiving second data feedback indicative of the voice audio from the operator, and determining a voice command of a plurality of available voice commands based on the second data feedback. The controller is further configured to activate at least one light emitter of a plurality of light emitters based on the location determined by the controller and the voice command determined by the controller such that the at least one light emitter emits light onto the location of the transparent or translucent screen to generate a pepper's ghost effect.

Drawings

These and other features, aspects, and advantages of the present invention will become better understood when the following detailed description is read with reference to the accompanying drawings in which like characters represent like parts throughout the drawings, wherein:

FIG. 1 is a top view of an interactive pepper's ghost system according to an aspect of the present disclosure;

FIG. 2 is a top perspective view of the interactive pepper's ghost system of FIG. 1, in accordance with an aspect of the present disclosure;

FIG. 3 is a schematic block diagram illustrating a control scheme for controlling the interactive pepper's ghost system of FIG. 1, in accordance with an aspect of the present disclosure;

FIG. 4 is a top perspective view of a collapsible housing for the interactive pepper's ghost system of FIG. 1, in accordance with an aspect of the present disclosure; and

fig. 5 is a process flow diagram illustrating a method of operating the interactive pepper's ghost system of fig. 1, in accordance with an aspect of the present disclosure.

Detailed Description

One or more specific embodiments will be described below. In an effort to provide a concise description of these embodiments, not all features of an actual implementation are described in the specification. It should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another. Moreover, it should be appreciated that such a development effort might be complex and time consuming, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure.

When introducing elements of various embodiments of the present disclosure, the articles "a," "an," and "the" are intended to mean that there are one or more of the elements. The terms "comprising," "including," and "having" are intended to be inclusive and mean that there may be additional elements other than the listed elements. Furthermore, it should be appreciated that references to "one embodiment" or "an embodiment" of the present disclosure are not intended to be interpreted as excluding the existence of additional embodiments that also incorporate the recited features.

The present disclosure relates generally to interactive pepper's ghost systems and methods for use in casinos (e.g., theme parks, amusement parks, theatres). More particularly, the present disclosure relates to a system for controlling pepper's ghost effects based on interactions from a customer.

Various casinos may provide many immersive and interactive experiences for customers. For example, a casino may contain points of performance that utilize various combinations of physical performance elements (or "props") and light to cause various visual effects. However, in some conventional embodiments, these performance attractions may lack audience interaction. Further, in conventional performance attractions that do employ spectator interactions, spectator interactions may not exert or cause any control over the performance attraction. For example, a story told by a performance attraction may be fixed, and the audience may lack meaningful control over changing certain aspects of the story.

In accordance with the present disclosure, an interactive pepper's ghost system may enable viewer interaction, for example, enabling some control over aspects of a scene or story. Audience control may be enabled by monitoring the movement of the patron (or movement of a device controlled by the patron) and may be propagated or facilitated at least in part by the pepper's ghost visual effect. In accordance with the present disclosure, a "pepper's ghost" can refer to a visual effect that can be achieved through various stage management/lighting structures and techniques, including a primary stage (first scene), a secondary stage or darkroom (second scene), and a beam splitter (e.g., a piece of glass) positioned to substantially combine images from each scene when viewed from a customer's perspective. An image from a second scene (e.g., from a darkroom, which may not be directly visible to a viewer) may be reflected from the beam splitter (e.g., from a glass surface) toward the viewer, while an image of the first scene is transmitted through the beam splitter (e.g., through glass). Stage lighting may be controlled to illuminate aspects of the scene but not the beam splitter. This may increase the visibility of the desired scene features and limit or prevent the beam splitter itself from being observed by a viewer. This creates an illusion on the primary stage that is actually only a physical presence of reflections of the secondary stage.

An interactive pepper's ghost system according to the present disclosure includes a controller and a handheld device. The handheld device may be, for example, a color paper gun (confetti cannon), a wand, a key, a console controller, a cellular phone, or some other handheld device. The orientation of the handheld device (and in some embodiments the position of the handheld device) may be monitored by the controller. In some embodiments, infrared light detection may be employed to enable the controller to monitor the orientation of the handheld device. For example, in an embodiment, the handheld device may include an infrared light emitter, and the controller may be communicatively coupled with an infrared sensor (or array of infrared sensors) configured to detect infrared light emitted from the infrared light emitter of the handheld device. In another embodiment, the handheld device may include an infrared light reflector, the separate infrared light emitter may emit infrared light toward the infrared light reflector of the handheld device, and the controller may be communicatively coupled with an infrared light sensor (or array of infrared sensors) configured to detect infrared light reflected by the infrared light reflector of the handheld device. In yet another embodiment, different aspects of the handheld device (e.g., shape, bar code, reflective coating) may be detected, such as by a camera. Further, gyroscopes and/or accelerometers located at the handheld device may also be employed to monitor the orientation and position of the handheld device.

Based on sensor feedback received by the controller from an infrared light sensor or other sensors (e.g., camera, gyroscope, accelerometer), the controller may determine the orientation of the handheld device (such as a toy magic sword). For example, the controller may determine the direction in which the handheld device (e.g., toy saber) is directed or pointed. While infrared light detection or other sensor devices may be used to determine the location of the handheld device, in some embodiments the location of the handheld device is fixed (e.g., in a predefined area) such that the location of the handheld device is known relative to other components of the system. Based on the orientation and location of the handheld device, the controller may control a pepper's ghost effect that simulates the visual effect perceived by the customer as if it were caused by the handheld device. For example, if the handheld device is a toy magic sword (as previously described), the controller may control the pepper's ghost visual effect to simulate spells applied by the magic sword. Pepper's ghost visual effects are described in detail below and may be defined as the illusion of the presence of features (e.g., images, objects, items (items), props, or the like) in a scene that are actually reflected from a separate scene that is never directly viewable by a viewer positioned to observe the pepper's ghost visual effects.

The interactive pepper's ghost system can include various features that enable pepper's ghost effects. For example, an interactive pepper's ghost system can include a stage and a transparent or translucent screen (e.g., a beam splitter) disposed between a handheld device and the stage. In general, a more transparent screen (e.g., beam splitter) may be able to achieve a more realistic effect than a less transparent screen. For simplicity, a transparent or translucent screen may be referred to as a "screen" in some examples below. In general, the screen may be invisible or mostly invisible from the perspective of an operator (e.g., a customer) holding the handheld device. In some embodiments, the hand-held device, transparent or translucent screen and stage may be arranged in a row or line. That is, the line of sight from the handheld device or a customer controlling the handheld device may extend from the location of the handheld device through the transparent or translucent screen and then into the stage. The darkroom may be positioned adjacent to a transparent or translucent screen and may be offset from the line of sight described above. The darkroom may comprise a darkwall and a number of controllable lamps configured to project or direct light toward a transparent or translucent screen. Further, the darkroom may not be directly visible to the operator of the handheld device and other customers in the audience. In some embodiments, controllable lights may be disposed in a grid, and some of the controllable lights may be triggered or activated by a controller to project or direct light toward certain areas of a transparent or translucent screen based on the sensor feedback described above. The transparent or translucent screen may be placed at some angle (such as a 45 degree angle) relative to the line of sight described above and at an additional angle (such as an additional 45 degree angle) relative to the direction of light provided via the lamps placed in the darkroom.

Adjusting the angle of the screen as described above enables light directed from the darkroom towards the screen to appear from the perspective of a customer at or adjacent to the handheld device as if it corresponds to a visual effect occurring on the stage. That is, when light from the darkroom is projected onto the screen between the handheld device and the stage, the light reflected from the screen appears to the customer as if it were a visual effect that occurs behind the screen (which is not visible or mostly not visible to the customer) and on the stage. In some embodiments, the physical item may be placed in a darkroom, and the above-described lights placed in the darkroom may cause illumination of the physical item and corresponding reflection onto a transparent or translucent screen, thereby giving the impression that the physical item in the darkroom is also present in the stage behind the transparent or translucent screen. In other embodiments, the lamp described above may simulate the visual effect directly onto a transparent or translucent screen without any other physical items disposed in the darkroom.

In accordance with the present disclosure, a handheld device may include a toy cannon that simulates striking a colored paper, water, smoke, or the like onto a stage behind a transparent or translucent screen. In some embodiments, the stage may contain various performance elements or props that interact with pepper's ghost effects. For example, the visual effect may simulate a particular appearance or arrangement associated with one of the props (e.g., colored paper dropped on a chair). In some embodiments, the controller may cause a physical effect to the prop that corresponds to or works with the visual effect. For example, a visual effect caused by a light from a darkroom and corresponding to an orientation of the handheld device may simulate the appearance of a fire, smoke, vapor, electricity, light, water, snow, or the like emitted from the handheld device, and the controller may move the prop to correspond to the visual effect (e.g., move forward, move backward, move side-to-side, rotate, disperse, separate, engage). In general, the above-described systems enable a customer to operate a handheld device to cause a visual pepper's ghost effect that simulates a customer interaction with a stage, a prop on the stage, and a scene or story conveyed through the stage and prop.

In some embodiments, a microphone is used to capture voice commands issued by an operator (e.g., a customer) of a handheld device (e.g., a color paper cannon). The controller may be communicatively coupled with the microphone and configured to receive data feedback from the microphone. The voice command may correspond to a particular visual effect of a number of available visual effects stored to a memory of the controller. For example, a first voice command may cause a first visual effect (e.g., red, orange, and yellow light patterns or lights simulating a fire) and a second voice command may cause a second, different visual effect (e.g., blue, white, and gray patterns or lights simulating water). Accordingly, the system causes a pepper's ghost visual effect at a location corresponding to the orientation of the handheld device and has an aesthetic characteristic (e.g., color) corresponding to the voice command. These and other features are described in detail below.

Continuing with the drawings, FIG. 1 is a top view of one embodiment of an interactive pepper's ghost system 10. In the illustrated embodiment, the system 10 includes: a spectator compartment 12 in which a handheld device 14 (e.g., a color paper cannon) is disposed; stage compartment 16 in which performance elements 18, 20 (or props) and at least one projector 21 are housed; a middle compartment 22 in which a transparent or translucent screen 24 (hereinafter "screen") is disposed; and a dark compartment 26 in which an effects light 30 (e.g., LED light, display, television screen) is disposed. As described in detail below, the system 10 may utilize the above-described compartments 12, 16, 22, 26 (referred to as "compartments" in some examples below) and corresponding components to simulate the visual effects caused by the handheld device 14 in the stage compartment 16. That is, the visual effect may coincide with the location and orientation of the handheld device 14 such that the location and orientation of the visual effect is aligned with the location and orientation of the handheld device 14 such that, for example, the effect appears to have originated from the handheld device 14.

The system 10 may also include: a controller 32 having a processor 34 (e.g., processing circuitry) and a memory 36 (e.g., memory circuitry), an infrared sensor 38 (e.g., a camera), an infrared emitter 40, and an infrared reflector 42. Memory 36 may include instructions stored thereon that, when executed by processor 34, cause controller 32 to perform various functions. While controller 32, infrared sensor 38, and infrared emitter 40 are illustrated in central compartment 22 of system 10 (i.e., adjacent to screen 24), it should be understood that controller 32, infrared sensor 38, and infrared emitter 40 may be disposed in other compartments of system 10. Further, any of the controller 32, infrared sensor 38, or infrared emitter 40 (if disposed in the middle compartment 22) may be disposed in an area that does not substantially obstruct the line of sight from the handheld device 14 through the screen 24 and then into the stage compartment 16. In an embodiment, the controller 32, infrared sensor 38, and infrared emitter 40 may be small enough to be placed in the line of sight described above without substantially degrading the experience of the operator (e.g., customer) of the handheld device 14 or other customers located in the audience compartment 12.

In the illustrated embodiment, infrared emitter 40 may be configured to emit infrared light toward handheld device 14, and infrared reflector 42 on handheld device 14 may reflect infrared light. The infrared reflector 42 may include some mechanism, such as a filter, that reflects light (e.g., infrared light) having wavelengths within a particular range of wavelengths (e.g., approximately between 700 nanometers and 1 millimeter). The infrared sensor 38 may be configured to detect the reflected infrared light. In some embodiments, infrared sensor 38 may include a grid of sensors configured to detect infrared light. In some embodiments, no infrared reflector is employed at the handheld device 14, and instead an infrared emitter 40 is positioned at the handheld device 14 such that infrared light emitted by the infrared emitter 40 of the handheld device 14 is detected by the infrared sensor 38. In either case, controller 32 may receive sensor feedback from infrared sensor 38 indicating the orientation of handheld device 14. In some embodiments, the sensor feedback may also indicate the location of the handheld device 14 (e.g., including any combination of X, Y and Z coordinates). However, in the illustrated embodiment, the handheld device 14 is positioned within a zone 37 or zone 37 whose coordinates are known to the controller 32 (e.g., because the zone 37 is placed a predefined and known distance 39 from the infrared sensor 38) such that the approximate location of the handheld device 14 is known and need not be monitored. Other location and orientation monitoring, such as via gyroscopes, accelerometers, shape recognition cameras, communication signals (e.g., bluetooth), and the like employed at the controller 32 and/or the handheld device 14 are also possible.

Based on the sensor feedback described above (e.g., infrared feedback, camera feedback, gyroscope feedback, accelerometer feedback), the controller 32 may control the lights 30 disposed in the darkroom 26 that simulate visual effects perceived by a customer in the audience compartment 12 as if they were occurring in the stage 16 or interacting with the stage 16 when directed toward the screen 24. For example, the lamps 30 may be arranged in a grid (e.g., via an array of LED lamps). Further, the light 30 may include an array of LED panels or screens capable of providing detailed graphic effects (e.g., animated explosions). The controller 32 may utilize the sensor feedback described above to trigger certain of the lights 30 in the grid such that the triggered ones of the lights 30 cause visual effects associated with the location and orientation of the handheld device 14. For example, a customer may direct handheld device 14 toward performance element 18 in stage compartment 16 of system 10. The controller 32 may determine at least an orientation of the handheld device 14 based on the sensor feedback described above. The controller 32 may then activate some of the lights 30 to direct light toward certain areas of the screen 24. The screen may be positioned at an angle 41 (e.g., approximately 45 degrees +/-2 degrees) relative to a line of sight 43 through the audience compartment 23, the middle compartment 22, and the stage compartment 16. The screen 24 may also be positioned at an angle 47 (e.g., approximately 45 degrees +/-2 degrees) relative to a line of sight 49 from the dark compartment 26 toward the middle compartment 22.

Due to the above-described angles 41, 47 of the screen 24 and the fact that the screen 24 comprises a transparent or translucent material, light reflected from the lights 30 in the darkroom (e.g., triggered by the controller 32) onto the screen 24 may cause a visual effect that appears to an operator of the handheld device 14 to be aligned with the performance element 18 to which the handheld device 14 is directed as if it were occurring in the stage compartment 16. Accordingly, from the perspective of the operator of the handheld device 14 or any other customer located in the audience compartment 12 of the system 10, the visual effect is perceived as if it were occurring in the stage compartment 16 and originated from the handheld device 14. As previously described, the more transparent material for the screen 24 may improve the realism of the visual effect. In addition to controlled actuation of the lamps 30 in the dark compartment 26, the dark compartment 26 may include a dark (e.g., black) material that reduces any undesired reflection of light onto the screen 24 (e.g., light other than light directed toward the screen 24 via the lamps 30 in the dark compartment 26).

In some embodiments, a microphone 56 communicatively coupled with the controller 32 may also be employed to trigger the visual effect. For example, microphone 56 may detect voice commands (e.g., from an operator of handheld device 14) that indicate commands that cause a visual effect. Microphone 56 and/or controller 32 may include voice recognition software configured to determine voice commands and the type of effects associated with the voice commands. Several commands and corresponding different visual effects may be possible. For example, if the handheld device 14 is an effect cannon, several voice or audio commands may correspond to several different types of virtual effect materials (e.g., water, colored paper, fireworks) that can be expelled by the cannon. The visual effects associated with the various different types of visual effect materials can be simulated as if they were projected from the handheld device 14 (e.g., cannon) onto the various performance elements 18, 20 or other areas of the stage bay 16 or onto the various performance elements 18, 20 or other areas of the stage bay 16. Accordingly, the controller 32 may monitor the orientation of the handheld device 14 and may trigger the appropriate lights 30 in the darkened compartment 26 based on the voice command detected by the microphone 56 and the orientation of the handheld device 14 to cause the appropriate visual effect (e.g., water) perceived by the operator as the appropriate performance element(s) 18, 20 or other area occurring in the stage compartment 16. That is, the controller 32 may determine which lights 30 to trigger based on orientation monitoring of the handheld device 14 (e.g., via the sensor 38), and the controller 32 may determine when to trigger the lights based on audio or voice commands (e.g., via microphone 56 feedback). In some embodiments, each lamp 30 may comprise a lamp of various colors. For example, each lamp 30 may comprise a plurality of LED lamps corresponding to a plurality of different colors. As described above, various types of different visual effects may be caused in response to various types of different audio or voice commands. A first audio command corresponding to a first spell may cause a first visual effect having a first color or combination of colors, and a second audio command corresponding to a second spell may cause a second visual effect having a second color or combination of colors. Accordingly, feedback from microphone 56 may be employed to determine the spells (e.g., desired visual effects), and controller 32 may control lights 30 such that the appropriate color(s) corresponding to the determined spells are directed toward screen 24.

As previously described, at least one projector 21 may be positioned in stage compartment 16. Although two projectors 21 are illustrated in fig. 1, any number of projectors is possible. The projector 21 may be configured to illuminate the stage 16 and corresponding performance elements 18, 20 (e.g., at all times during a performance or attraction). Further, actuation assemblies 50, 52 may be used to cause movement of performance elements 18. For example, actuation assemblies 50 associated with performance elements 18 may include motorized tracks and dollies that move performance elements 18 across track lateral directions 51, as shown. The actuation assembly 52 may include motorized fasteners that are released (e.g., via control by the controller 32) to disperse the corresponding show element 20 into two pieces 53, 54. Other actuation assemblies are also possible in accordance with the present disclosure.

Control of performance elements 18, 20 (e.g., via actuation assemblies 50, 52) may be coordinated with control of lights 30 in darkroom 26 based on sensor feedback associated with orientation and/or voice commands of handheld device 14. For example, the controller 32 may simulate a visual effect via the lights 30 such that the visual effect appears to occur with the show element 18 (as the show element 18 is moved laterally 51 via the actuation assembly 50). In one example, a customer may direct handheld device 14 toward performance element 18 and provide commands intended to move performance element 18 as if handheld device 14 were able to control gravity. The controller 32 may receive sensor feedback from the infrared sensor 38 (or some other orientation monitoring sensor) corresponding to the orientation of the handheld device 14, and feedback from the microphone 56 corresponding to commands issued by the customer. Via actuation of some of the lights 30 to direct light toward certain areas of the screen 24, the controller 32 may cause a visual effect, such as simulating the appearance of electricity being emitted from the handheld device 14 toward the show element 18. Further, the controller 32 may direct movement of the performance element 18 to correspond to the visual effect. It should be noted that the information exchange components described above (e.g., at least the controller 32, the infrared sensor 38, the microphone 56, the lights 30, and the performance elements 18, 20) may be wirelessly connected via a network system 59 (e.g., the internet system). Some of these components may additionally or alternatively be wired.

Fig. 2 is a top perspective view of an embodiment of the interactive pepper's ghost system 10 of fig. 1. In the illustrated embodiment, the lamps 30 contained in the dark compartments 26 of the system 10 may be arranged in a grid 61, as previously described. It should be noted that for clarity, the lamps 30 (e.g., individual lamps, LED arrays or panels, display screens) are illustrated by the back side of the dark wall 63 of the dark compartment 26. However, it should be understood that the lamp 30 may not be visible through the back side of the dark wall 63, and instead be placed inside the dark compartment 26 and directed towards the screen 24. In general, the dark compartment 26 may include dark walls (e.g., dark wall 63, dark wall 84, and dark wall 86) that reduce undesired reflection of light onto the screen 24. The system 10 may also include a plurality of other walls 88, 90, 92, 94, 96 defining the respective compartments 16, 22, 12 of the system 10. In some embodiments, the wall 92 may pass through the stage compartment 16, the middle compartment 22 with the screen 24, and the audience compartment 12. In other embodiments, the wall 92 may comprise three separate walls (or panels) for each of the compartments 16, 22, 12. The walls 63, 84, 86, 88, 90, 92, 94, 96 will be described in detail with reference to the following figures.

The grid 61 of lamps 30 corresponding to the dark cells 26 may include columns C1, C2, and C3 and rows R1, R2, and R3. The first lamp 60 may be positioned at C1, R1, the second lamp 62 may be positioned at C2, R1, the third lamp 64 may be positioned at C3, R1, the fourth lamp 66 may be positioned at C1, R2, the fifth lamp 68 may be positioned at C2, R2, the sixth lamp 70 may be positioned at C3, R2, the seventh lamp 72 may be positioned at C1, R3, the eighth lamp 74 may be positioned at C2, R3, and the ninth lamp 76 may be positioned at C3, R3. The lamps 60, 62, 64, 66, 68, 70, 72, 74, 76 may be collectively referred to as the lamps 30. Further, it should be noted that each of the lamps 60, 62, 64, 66, 68, 70, 72, 74, 76 may comprise a plurality of lamps having a plurality of different colors, or may comprise a single lamp capable of emitting a plurality of different colors. For example, the lamp 60 may be capable of emitting red, green, and blue light (in addition to other colors of light).

In the illustrated embodiment, the screen 24 may include a grid 80 corresponding to the grid 61 of lights 30 in the dark compartment 26. For example, control of the first lamps 60 disposed in the C1, R1 of the grid 61 may cause the first lamps 60 to direct light to corresponding areas of the grid 80 associated with the screen 24. Of course, the grid 80 associated with the screen 24 is not visible and corresponds only to the physical location of the individual lights 30 in the dark compartment 26. Further, the grid 82 in the stage compartment 16 may correspond to the grid 80 of the screen 24 and the grid 61 of the lights 30 in the dark compartment 26. Moreover, the grid 82 in the stage compartment 16 is not visible and corresponds only to the physical location of the individual lights 30 in the dark compartment 26. By controlling the first lamps 60 in, for example, C1, R1 of the grid 61, light is directed towards the corresponding areas of the grid 80 of the screen 24 and the light is reflected by the screen 24 to simulate the visual effect that occurs in the corresponding areas of the grid 82 of the stage compartment 16 from the perspective of the customer in the audience compartment 23. The control of the lamps 30 in the dark compartment 26 may be performed in the manner described above with respect to fig. 1.

Referring back to fig. 1, it should be noted that only one controller 32 having one processor 34 and memory 36 is illustrated. However, it should be appreciated that multiple controllers may be employed to communicate with each other to achieve the effects described above. For example, the controller 32 in fig. 1 may represent any number of controllers, such as a first controller configured to receive sensor feedback from the infrared sensor 38 and microphone 56, a second controller communicatively coupled with the first controller and configured to activate individual ones of the lights 30, and a third controller configured to control operation of the stage compartment 16 and corresponding performance elements 18, 20. Other control schemes are also contemplated in accordance with the present disclosure.

For example, fig. 3 is a schematic block diagram illustrating an example of a control scheme 100 for controlling the interactive pepper's ghost system 10 of fig. 1. In fig. 1, a single controller 32 is illustrated. However, the single controller 32 may represent multiple controllers that work together to cause the various effects described with respect to FIG. 1. For example, in fig. 3, "controller 32" may include four separate controller components, including input manager 102, LED manager 104, stage projector manager 106, and physical object manager 108. Each of the control components (or managers) 102, 104, 106, 108 may include a dedicated processor and memory. That is, the processor 34 and memory 36 illustrated in fig. 1 may represent dedicated processors and memory of each of the control components (or managers) 102, 104, 106, 108 illustrated in fig. 3.

The input manager 102 in fig. 3 may be configured to receive device orientation input from the infrared sensor 38 (or some other input sensor such as a camera, gyroscope, accelerometer, or the like) and audio input 112 from the microphone 56. The input manager 102 may determine various control features based on the inputs 110, 112 as previously described. The input manager 102 may include, for example, a video game console. LED manager 104 may be configured to receive data from input manager 102 based on the processing of orientation input 110 and audio spell input 112 by input manager 102. For example, input manager 102 may indicate (via data communicated thereto) to LED manager 104 the orientation of handheld device 14 of fig. 1 and the operations intended to be implemented based on audio spell input 112. The LED manager 104 may then control the appropriate ones of the lights 30 (LEDs in the illustrated embodiment) to simulate a pepper's ghost effect (according to the orientation input 110 and audio input 112 as previously described). The LED manager 104 may also communicate data to the physical object manager 108 indicating which lamps 30 are to be or are being activated. The LED manager 104 may also indicate to the physical object manager 108 the type of effect that is activated. The physical object manager 108 may then control the performance elements 18, 20 (referred to as physical objects in fig. 3) in accordance with the data received from the LED manager 104. For example, if the effect corresponds to a jet of high pressure water, object manager 108 may control the movement of the prop in response to being affected by the virtual water flow.

The input manager 102 may also pass data to the stage projector manager 106. As previously described, one or more stage projectors 21 may be used to illuminate a stage visible to an operator of the handheld device 14 (e.g., wand) of fig. 1. In some embodiments, projector 21 may be controlled to increase or decrease the brightness of light emitted from projector 21. Control of projector 21 may improve the realism of the pepper's ghost visual effect provided in accordance with the discussion above. Further, projector 21 may be selectively controlled to correspond to various types of spells simulated by the system. For example, a spell may darken or darken a stage visible to a customer, i.e., by controlling projector 21 to reduce the brightness of light or cancel light emitted from projector 21. The control scheme described above is one example of the various control components (e.g., input manager 102, LED manager 104, stage projector manager 106, physical object manager 108) that can communicate with each other to achieve the desired pepper's ghost effect discussed in detail with reference to fig. 1 and 2. However, other schemes are also possible.

Fig. 4 is a top perspective view of an embodiment of a collapsible housing 150 for the interactive pepper's ghost system 10 of fig. 1. The collapsible housing 150 may include the various walls 63, 84, 86, 90, 92, 96 illustrated in fig. 2 that define the various compartments 12, 16, 22, 26 (or chambers) illustrated in fig. 2. The wall 94 illustrated in fig. 2 is removed in fig. 4, but in certain embodiments the collapsible housing 150 of fig. 4 may include the wall 94 of fig. 2.

In the embodiment illustrated in fig. 4, the various walls 63, 84, 86, 90, 92, 96 may be connected at a junction 152. Further, the wall 92 may include three separate walls (or panels) 154, 156, 158 connected via a junction 152. The joint 152 may include a hinge 160 (represented by a circle in the illustrated embodiment), the hinge 160 configured to enable the walls 63, 84, 86, 90, 92, 96 (including the panels 154, 156, 158 of the wall 92) to fold relative to one another. In some embodiments, the screen 24 for creating a pepper's ghost effect may be removed from the collapsible housing 150 before the collapsible housing 150 is folded into a stack. In other embodiments, the screen 24 may be attached to one of the walls 63, 84, 86, 90, 92, 96 or panels 154, 156, 158 and/or may be sized to be folded into a stack. Further, it should be noted that the size and dimensions of the features of the collapsible housing 150 and screen 24 in fig. 4 are merely examples and should not be taken as exact. In certain embodiments, all of the walls 63, 68, 86, 90, 92, 96 and panels 154, 156, 158 may comprise similar widths (e.g., a distance 170 between two joints 152). The collapsible housing 150 (one example of which is illustrated in fig. 4) may enable mobility and easier storage of the system.

Fig. 5 is a process flow diagram illustrating one embodiment of a method 200 of operating the interactive pepper's ghost system 10 of fig. 1. The method 200 includes detecting (block 202) an orientation of a handheld device. For example, as previously described, the orientation of a handheld device (such as a toy magic sword) may be monitored via an infrared light assembly or other monitoring device (e.g., a shape detection camera) described with respect to fig. 1. Additionally or alternatively, other sensors (such as gyroscopes and accelerometers employed in the handheld device) may be utilized to detect the orientation of the handheld device. The controller may receive data feedback from one or more of the sensors described above and may determine an orientation of the handheld device (e.g., a direction in which the handheld device is pointed, or a location or object in which the handheld device is pointed).

The method 200 also includes detecting (block 204) a voice command issued by an operator of the handheld device. For example, as previously described, many voice commands corresponding to various types of visual effects may be possible. The controller described above may include voice recognition software that determines a voice command from the number of voice commands available. For example, a voice command of "fire" may cause a first visual effect (e.g., an effect that appears to be a fire or a stream of fire), and a voice command of "water" may cause a second visual effect (e.g., an effect that appears to be a stream of water). The microphone may detect voice commands and the controller may receive data feedback from the microphone indicating the voice commands.

The method 200 also includes selecting (block 206) a visual effect from a number of available visual effects based on the orientation of the handheld device and the voice command. For example, as previously described, voice commands may be utilized by the controller to determine the aesthetic (e.g., fire, smoke, vapor, electricity, light, water, snow) of the visual effect. The orientation of the handheld device may be used by the controller to determine the location where the visual effect is created. For example, as previously described, the system may include a handheld device, a stage opposite a region of the handheld device (e.g., a spectator seat), and a transparent or translucent screen disposed between the handheld device and the stage. The operator may direct the handheld device to the location of the stage and/or to a performance element or prop (e.g., a physical object) disposed on the stage. The operator may announce an instruction (e.g., a spell). Based on the detected orientation of the handheld device, the controller may activate at least one light disposed in a darkroom or compartment to direct light toward an appropriate area of the transparent or translucent screen. From the perspective of the operator of the handheld device, light reflected from the transparent or translucent screen may cause a pepper's ghost effect that simulates the visual effect that occurs in the stage area at the location (or performance element) at which the handheld device is pointed.

The method 200 also includes controlling (block 210) the performance elements or props described above on the stage to correspond to the selected visual effect caused by the activation of at least one light in block 208. For example, control of the presentation element may be consistent with the visual effect. In practice, the visual effect directed toward the show element may coincide with movement (e.g., lateral movement, rearward and forward movement, distraction, separation, engagement) of the show element. The controller may time the activation of the at least one light and the movement of the performance element such that they occur substantially simultaneously and/or in the order in which the operator of the handheld device is given the impression that the handheld device and the spells cause the visual effect and the movement of the performance element.

The interactive pepper's ghost system described above may be capable of improved spectator interaction with a performance attraction at an entertainment venue. Improved audience interaction, which may enable an audience (e.g., a customer) to control various aspects of a performance attraction, may improve customer attention and entertainment.

While only certain features of the invention have been illustrated and described herein, many modifications and changes will occur to those skilled in the art. It is, therefore, to be understood that the appended claims are intended to cover all such modifications and changes as fall within the true spirit of the invention.

The techniques presented and claimed herein are referenced and applied to substantial objects and concrete examples that arguably improve upon the practice of the art, and as such are not abstract, intangible, or pure theories. Further, if any claim attached to the end of this specification contains one or more elements designated as "means for [ performing ]," means for [ function ], or "step for [ performing ]," function ], it is intended that such elements be interpreted according to 35u.s.c.112 (f). However, for any claim containing elements specified in any other way, it is intended that such elements not be construed in accordance with 35u.s.c.112 (f).

Claims (20)

1. An interactive pepper's ghost system, comprising:

a sensor configured to detect a parameter indicative of an orientation of the handheld device; and

a controller configured to receive sensor feedback from the sensor corresponding to the parameter indicative of the orientation of the handheld device, and to control a pepper's ghost visual effect based on the sensor feedback.

2. The interactive pepper's ghost system of claim 1, comprising the handheld device and an infrared light emitter configured to direct infrared light toward the handheld device, wherein the handheld device comprises an infrared reflector configured to reflect the infrared light, and wherein the sensor comprises an infrared sensor configured to detect the infrared light.

3. The interactive pepper's ghost system as claimed in claim 1, comprising:

a light source communicatively coupled with the controller, wherein the controller is configured to control the light source based on the sensor feedback to cause a projection of light corresponding to the pepper's ghost visual effect and the orientation of the handheld device; and

a transparent or translucent screen configured to reflect the projection of light corresponding to the pepper's ghost visual effect.

4. An interactive pepper's ghost system as claimed in claim 3, comprising a stage onto which the pepper's ghost visual effect is simulated, wherein the transparent or translucent screen is placed between the handheld device and the stage.

5. An interactive pepper's ghost system as claimed in claim 4, wherein the light source is placed in a darkroom offset from the line of sight between the stage, the transparent or translucent screen and the location of the hand held device.

6. The interactive pepper's ghost system as claimed in claim 4, wherein the stage comprises a performance element associated with the pepper's ghost visual effect, and wherein the controller is configured to control the pepper's ghost visual effect based on the sensor feedback such that the pepper's ghost visual effect interacts aesthetically with the performance element from an angle at or adjacent to the handheld device.

7. The interactive pepper's ghost system of claim 6, comprising an actuator configured to cause movement of the performing element, wherein the controller is configured to control the actuator based on the sensor feedback such that the movement of the performing element coincides with the pepper's ghost visual effect.

8. An interactive pepper's ghost system as claimed in claim 3, wherein the light source is configured to direct the projection of light towards the location of the transparent or translucent screen, and wherein the controller is configured to determine the location based on the sensor feedback from the sensor.

9. The interactive pepper's ghost system as claimed in claim 3, wherein the light source comprises a plurality of LED lights arranged in a grid, wherein the controller determines rows and columns of the grid based on the sensor feedback, and wherein the controller activates at least one LED light of the plurality of LED lights, the at least one LED light being placed within the rows and columns, to cause the projection of light from the at least one LED light and corresponding to the pepper's ghost visual effect.

10. The interactive pepper's ghost system as claimed in claim 1, comprising:

a first chamber configured to house an audience member holding the handheld device, wherein the first chamber is defined by at least one first wall;

a second chamber configured to house a transparent or translucent screen of the interactive pepper's ghost system, wherein the second chamber is connected to the first chamber and defined by at least one second wall;

a third chamber configured to house a stage of the interactive pepper's ghost system, wherein the third chamber is connected to the second chamber such that the first chamber, the second chamber and the third chamber are placed along a straight line, and wherein the third chamber is defined by at least one third wall; and

a fourth chamber configured to house a light source of the interactive pepper's ghost system, wherein the fourth chamber is connected to the second chamber and offset from the straight line, and wherein the fourth chamber is defined by at least one fourth wall.

11. The interactive pepper's ghost system as claimed in claim 10, wherein the at least one first wall, the at least one second wall, the at least one third wall and the at least one fourth wall are connected at the junction via hinges such that the at least one first wall, the at least one second wall, the at least one third wall and the at least one fourth wall are foldable into a stack.

12. An entertainment system, comprising:

transparent or translucent screens;

a plurality of light emitters directed toward the transparent or translucent screen;

a hand-held device;

a sensor configured to monitor an orientation of the handheld device; and

a controller configured to receive sensor feedback from the sensor indicating the orientation of the handheld device, wherein the controller is configured to select at least one light emitter of the plurality of light emitters based on the sensor feedback and to activate the at least one light emitter to emit light onto the transparent or translucent screen such that a pepper's ghost effect is created from an angle at the handheld device.

13. The entertainment system of claim 12, comprising a stage, wherein the transparent or translucent screen is disposed between the stage and the handheld device.

14. The entertainment system of claim 13, comprising a line of sight from the handheld device through the transparent or translucent screen and then into the stage, wherein the transparent or translucent screen is disposed at a 45 degree angle relative to the line of sight.

15. The entertainment system of claim 12, wherein the sensor comprises an infrared sensor configured to detect infrared light emitted from or reflected by the handheld device.

16. The entertainment system of claim 12, comprising a microphone communicatively coupled with the controller and configured to detect audio or voice commands from an operator of the handheld device, wherein the controller is configured to receive data feedback from the microphone indicative of the audio or voice commands, and wherein the controller is configured to activate the at least one light emitter in response to the data feedback from the microphone.

17. The entertainment system of claim 16, comprising a collapsible housing having a plurality of collapsible walls defining the following compartments: a spectator compartment in which the handheld device is disposed; a central compartment in which the transparent or translucent screen is disposed; a stage compartment in which a stage is disposed; and a dark compartment in which a plurality of lamps are disposed; wherein the audience compartment, the middle compartment, and the stage are disposed in a line such that the middle compartment is between the audience compartment and the stage compartment, wherein the dark compartment is connected to the middle compartment and offset from the line, and wherein the plurality of foldable walls are foldable into a stack via a hinged joint connecting the plurality of foldable walls.

18. An interactive pepper's ghost system, comprising:

a handheld device configured to be held by an operator;

a sensor configured to monitor an orientation of the handheld device;

a microphone configured to detect voice audio from the operator;

transparent or translucent screens; and

a controller configured to:

receiving first data feedback from the sensor indicative of the orientation of the handheld device;

determining a position on the transparent or translucent screen at which the wand is pointed based on the first data feedback;

receiving second data feedback indicative of the voice audio from the operator; and

determining a voice command of a plurality of available voice commands based on the second data feedback; and

activating at least one light emitter of a plurality of light emitters based on the location determined by the controller and the voice command determined by the controller such that the at least one light emitter emits light onto the location of the transparent or translucent screen to generate a pepper's ghost effect.

19. The interactive pepper's ghost system of claim 18, comprising a stage positioned behind the transparent or translucent screen such that the transparent or translucent screen is positioned between the cane and the stage and such that the pepper's ghost effect causes the operator to perceive a visual effect corresponding to the light emitted by the at least one light emitter as if it were occurring in the stage.

20. The interactive pepper's ghost system of claim 19, comprising a physical performance object positioned in the stage, wherein the controller is configured to control physical movement of the physical performance object, and wherein the controller causes the physical movement of the physical performance object to coincide with the pepper's ghost effect.