CN104216512B - Walk about role audio triggering control - Google Patents

Abstract

A kind of control system, the audio system walked about and provided in role's stage property is operated for selectivity, such as the dialog tree that can be navigated according to the performer for the wearing stage property order that defines plays audio file.The control system includes trigger mechanism, is provided in this walks about role's stage property, and the trigger mechanism can be operated by the performer of wearing stage property, to generate and transmit at least one trigger signal, and through dialogue tree navigation.Controller receives trigger signal, and transmits the control signal for promoting the audio system to reset the dialogue prerecorded.The system includes triggering processing module, is run by the controller, and for handling the trigger signal, and as the response for such processing, for navigating, the audio prerecorded is used to perform, to select the set for the dialogue prerecorded.The trigger mechanism is included in the first and second pressure sensors in the thumb and forefinger of the gloves of stage property.

Description

Walk about role audio triggering control

Technical field

The present invention relates generally to (walk-around) to walk about wear stage property (costumed) role and to it is such walk The audio output (for example, role can sing or speak) that on dynamic role or such role that walks about is carried out is controlled, and Selectively navigated dialog tree or drama audio more particularly, to the performer for allowing to wear role's stage property of walking about or operator The method and system of playback, and in some cases, the audio prerecorded for allowing the dialog tree to be provided is determined System be adapted to specific context (such as, there is provided context modulate), so as to be adapted to this walk about wear near the role of stage property one Individual or how personal individual character (such as, there is provided be adapted to young man or be adapted to celebrate a birthday or celebrate another event people sound Frequently).

Background technology

Using walking about or wear the role of stage property to receive the visitor of many mechanisms including theme or amusement park simultaneously Interacted with them.The role to walk about can be provided by the operator of wearing stage property or performer, and the stage property includes covering performer face Head.Stage property head is installed on the scarf of performer's wearing or supported by scarf.In head and/or stage property, there is provided including some The equipment of sound device (for example, loudspeaker for the audio of played pre-recorded) and robot technology so that the angle walked about Color can be talked by resetting the drama lines for the session prerecorded with visitor, can talked and handed over visitor to provide While mutually, (animated) is driven with satiable (meetable) role of their eye of movement and mouth.

In numerous applications, the role to walk about just represents the role from film, video-game, cartoon etc..Visitor's phase Hope role that there is specific or single voice, such as the voice used in film.As a result, going on the stage run into visitor and and they During talk, they can not simply use themselves voice, but typically record drama platform for each role to walk about Word, to provide desired voice.The audio or sound device of airborne (onboard) are then controlled or triggered, with due course Between reset these lines.The face movement synchronous with audio playback can be provided by operation robot technology and eyes blink, To drive the head of role simultaneously.

In order to allow each role to walk about to be talked with visitor, it has to triggering be present and frequently appear in neighbouring access The effective means of the non-detectable audio of person.For example, trigger mechanism should not be that visitor is audible.One kind is realized after being use Platform operator, it selectively sends wireless control signal by the audio system to stage property, and controls audio and animation.However, It is unpractical in many cases to provide for the consistency operation person of each role that walks about.In other realizations, using drilling Member is operable to be referred to oar (finger paddle) performer into stage property and provides control, with cause role's face with it is current positive The track prerecorded that visitor resets is lip-sync.But the use for referring to oar is typically that visitor is visible, this can break Bad illusion or expectancy effect.

There are still for triggering walk about role device control to trigger audio playback and to trigger the drive of the mouth of role The demand of the effective means of dynamic (or triggering operation or the special efficacy of other based roles).Preferably, such new paragon will be listened Lose, and by be role observer it is non-detectable.In addition, it may be desirable to which performer is easy to triggering to drive or operate, together When relatively little of erroneous trigger is also provided, because if role speaks or triggered incorrect drama platform at the unsuitable moment Word, then can be invalid with interacting for the role that walks about.

The content of the invention

Following description provides Role Dilemma component or the system of walking about, it has enhancing control function with to the role that walks about The performer of (for example, role from film) provides the ability of noiseless and invisible triggering audio, animation, and/or special efficacy.Role Control assembly can allow the operator (or performer) for wearing stage property of walking about to trigger audio playback and trigger the driving of the face of role (or triggering the operation based on other roles or special efficacy), and without using finger oar or additional consistency operation person.

When control assembly senses " triggering " or trigger action, response often will navigate in dialog tree, to start The specific collection for the audio prerecorded is reset (for example, in role's head via the audio system provided in stage property of walking about Loudspeaker can greet " hello " to visitor, either if in different scenes later in dialog tree or in dialog tree, Then greet " goodbye ").In certain embodiments, the set of the audio prerecorded of selection is context-specific, and by upper Hereafter modulator is selected based on the input from operator (for example, owner, photographer etc.).For example, context input unit The operation of (radio communication device of the touch-screen such as with portrait (iconographic) list for providing available contexts) The visitor of room/film studio or the characteristic of participant that person's observable is being performed on the role for wearing stage property that wherein walks about, And by selecting one of multiple and context-sensitive icon/load button on input unit to carry out response.Context is adjusted Device processed receives context input, and the appropriate set for making to use it to the editing that retrieval is prerecorded is used for scene/performance (example Such as, obtained session or interaction are shifted or deflected towards the characteristic of particular visitors, such as wear the preceding youth of princess's equipment Phase girl or the people for celebrating their birthday).

More specifically, there is provided the control system for the audio system that the operation of being suitably selected for property provides in role's stage property of walking about (for example, sequentially playing audio file defined in the dialog tree that can be navigated according to the performer for wearing stage property).The control system System is included in the trigger mechanism that is provided in role's stage property of walking about, and the trigger mechanism can be walked about the performer of role's stage property by wearing Operation is to generate and transmit at least one trigger signal (for example, when they want to talk with by (forward, backward or scene saltus step) When tree navigation is to the next lines talked with).The system also includes controller, receives trigger signal (for example, wireless signal), and make For response, generate and transmit the control signal for the set for promoting audio system to reset the dialogue prerecorded (for example, processing triggering Signal is to navigate to certain dialog set).In addition, the system includes the triggering processing module that controller is run, for handling Trigger signal, and in response to such processing, the audio prerecorded of navigating is used to perform, the dialogue prerecorded with selection Set.

In certain embodiments, the trigger mechanism is included in the first and second pressure sensings separated in role's stage property of walking about Device.Then, triggering the processing at least one trigger signal that processing module is carried out includes：Compare first pressure sensor to be sensed First pressure and first threshold, and compare second pressure and the Second Threshold that second pressure sensor is sensed.Such In the case of, when the first and second threshold values by concurrently beyond when (when not being lucky pressing one marquis, to avoid erroneous trigger), Controller generates control signal.In such control system, first threshold can (and each pressure different with Second Threshold Value is adjustable with suitable specific actors).In addition, first pressure sensor can be located at the thumb of the gloves in the gloves for the role that walks about Refer in meat pad (pad), and allow performer easily to trigger dialogue tree navigation, second pressure sensor is located in the finger of gloves (forefinger of such as gloves or the outer surface for showing finger).

In the other embodiment of the control system, the trigger mechanism includes eye tracking sensor.In such sensing In device, (multiple) trigger signal is handled by triggering processing module, is moved with the pupil identified beyond the performer of pre-defined threshold value It is dynamic and/or mark performer eyes to blink so that the navigation of dialog tree can be based on performer to left and right, it is upper or under see and/or Performer's blink (for example, their eyes are kept closing more than preset time amount).Pupil movement can be processed so that work as mark Pupil movement in normal pupil outside point range when, start control signal, to avoid erroneous trigger.When the pupil of mark It is mobile in preset time period at least twice in normal pupil outside point range when, control signal can be started, because this also may be used Reduce the erroneous trigger as caused by being not intended to eyes movement.

In some cases, the trigger mechanism is included in the gesture recognition sensor installed on role's stage property of walking about.Triggering The processing for the trigger signal that processing module is carried out can relate to identify posture.Then, the audio prerecorded for performance is led Boat perform can the posture based on mark and the time also based on the posture that mark is received during the performance of performance (for example, taking Certainly in the time performed during performance, single posture can start different dialogue, such as wave, during the earlier scene of performance Start and greet, and start farewell later or in last scene).

In addition, in certain embodiments, control system may include that the context for receiving context selection signal is modulated Device.Then, acted as response, context modulator to select the audio prerecorded extremely based on context selection signal A few part is used to perform (or promoting controller so to do), and the set for the dialogue thus prerecorded is context-specific. In such embodiments, context selection signal can be generated by context input unit, and the context input unit can be by this The operator of context input unit is operated to show context graph target portrait list (Graphical User circle such as on touch-screen In face (GUI)) it is used to select.In many cases, context input unit is located therein wearing the performer for role's stage property of walking about Perform in performance or the room that is interacted with one or more visitors or use in film studio or wherein.

Brief description of the drawings

Fig. 1 is the functional block diagram of Role Dilemma system or component of walking about, and it has trigger mechanism and context modulation, to promote Enter the control or navigation of the driving of audio playback and/or such as lip and the stage property component of eyes movement；

Fig. 2 illustrates demonstration stage property gloves, and it has a pair of pressure sensors, can be used to allow stage property (such as Fig. 1 road Tool) performer/wearer optionally trigger wear stage property role control, with will pass through prerecord and drama perform Dialogue tree navigation；

Fig. 3 is the user interface that can be provided in the monitor/screen of performance controller, so that such as Fig. 2 gloves are presented Stage property gloves in the state of trigger mechanism that provides；

Fig. 4 illustrates a part for eye tracking sensor component, and it can be used to the wearer's selectivity for allowing stage property head Ground moves their (two) eyes, to trigger the control of diagonal color channel tool and its equipment, will pass through dialogue navigation or start Special efficacy；With

Fig. 5 shows the hand-held context input unit during operation, to show the one group of figure that can be provided on the touchscreen Mark/button, to promote the selection of owner, photographer or other operators to context.

Embodiment

Briefly, this description is directed to the method and system for the role for being used to control the wearing stage property walked about, to allow to grasp Author or performer (wearer of stage property) preferably operate the audio system or special efficacy/robot technology of stage property, with visitor Or observer's interaction.The Role Dilemma system will typically include one or more trigger mechanisms or component, for allowing role The wearer (" performer ") of stage property can trigger stage property output, such as audio playback or role's eye using airborne robot technology The driving of eyeball, face, ear etc..Such performer's control will typically sense affirmative action or the movement of performer, and conduct Response, triggering (or sensor signal) processing module (or processor) will promote controller generation control signal (triggering control), And transmit control signals to the sound and/or drive component of stage property.

In control assembly, it is possible to provide various trigger mechanisms or component with promote for dialogue tree navigation or triggering robot The control based on operator or performer of technology or other special efficacys.In some control assemblies, trigger mechanism includes a pair of simulations Pressure sensor or switch, it is linked to the triggering processing module of controller (in role and/or outside machine (or long-range/backstage) And connected via cordless communication network), it is allowed to performer carries out the scene through performance via the dialog tree associated with current scene Navigation, without the visible trigger action of visitor/observer (performer presses two sensors together).

The use of two separated sensor/switch also limits erroneous trigger (for example, visitor/observer and walking about Wearing stage property role between shake hands or " clapping the hands " during), and in some cases, two sensors are had to by just True triggering/activation (such as, the pressure of sensing exceeds threshold level) triggers (being moved in dialog tree) to start.In some realizations In, two pressure sensors are installed on the thumb and forefinger on the inside or non-outer surface of role or stage property gloves.Wear The performer for wearing gloves (or two gloves, if providing sensor in two gloves) can be by pressing theirs together Two fingers and the pressure sensor associated, and through the dialogue tree navigation with scene relating.For example, can be used left hand triggering with Dialogue is moved forward into (or being moved to later scene and dialog tree associate) in dialog tree, at the same the usable right hand trigger with Dialogue is moved rearwards (or being moved to previous scenario and dialog tree) in dialog tree.

In identical or different control assembly, trigger mechanism is included on stage property (for example, in role's head) offer Eye tracking sensor.Eye tracking sensor be linked to controller triggering processing module (in role and/or outside machine (or Remotely/backstage) and connected via cordless communication network).The tracking movement of performer's eyes allows performer to be closed via with current scene The dialog tree of connection carries out the navigation of the scene through performance, (predefined without the visible trigger action of visitor/observer Eyes move) because their eyes are hidden in after the eyes for the role that stage property head is provided.

For example, eye tracking sensor can be used to detect where the certain point that performer is actively watching in scene, Yi Ji Under certain situation, their eyes are opened or closed.Thus, such as leftward or rightward or blink eyes movement can be by performer Use, to be navigated through the drama of dialog tree or scene.For example, triggering processing module can be according to from eye tracking sensor Data determine that performer is currently just being seen to the left side, and controller can be used the information as triggering with dialog tree forward (or Navigate (or being moved to next (or previous) scene) backward).Opposite navigation can be by triggering of eyeing right.In other cases, may be used Navigation or the triggering special efficacy through dialog tree are triggered using the movement of two or more eyes or the action based on eyes.At some In the case of, controller can be to having been looked up by triggering the performer of processing module and and then having blinked and (or two or more be based on eye Any other movable combination of eyeball) response is set for out really, to trigger audio, animation or special efficacy.Eye tracking sensor can To be directed towards and/or focus on the camera of (two) eyes of performer, while other are realized and electrooculography (example can be used Such as, the polarity of the eyeball of performer is measured using the sensor integrated in the stage property scarf of role's head).

Trigger mechanism can replace taking the form of gesture recognition component, and it allows performer to run through dialog tree using natural manner Navigation.For example, performer can stretch out their arm (or make similar posture), and the posture can be detected or identify with Controller is promoted to jump to absolute scene (for example, " it is required that embracing " scene).In addition, performer can be simply by when specific In scene or while performance special scenes, the predefined posture of performance, and trigger resonator using posture (soundboard) prompt.For example, performer may move their hand to be brandished to visitor, and controller can by such as when The first track (for example, " hello ") is triggered when in the first scene (for example, welcoming or greet scene) and is worked as in the first scene (example Such as, close or leave scene) in when trigger the second different track (for example, " goodbye "), come determine how in scene (touch Hair processing module is identified) posture reacts.In this mode, single type posture can trigger and depend on current scene (or context) and the navigation in different dialog trees.

In one embodiment, gesture recognition component is included on the stage property of role (such as in one or two gloves Upper (for example, waved with detection or movement/posture of other hands), in stage property head (for example, nodded with detection, shake the head or other Head posture) or other places based on stage property) one or more accelerometers.Triggering processing module (or at gesture recognition Reason device (hardware/software)) it is configured as handling the signal from accelerometer, to detect different postures, they are typically The natural manner of performer is accepted as normal or it is expected the posture that role performs during scene.Then, controller can be true Determine the standing state (such as, when needing the combination of movement/posture to provide triggering) of current scene and/or other sensors, And these value/states are based on, the posture of the negligible identification of controller or the broadcasting of triggerable different scenes or audio clips The animation, and/or special efficacy that (for example, through dialogue tree navigation), such as airborne robot technology are provided.

Inventor, which is also recognized that, has many applications, wherein can it is expected to select or change the basic of the scene of performance or performance Or neutral drama, to be adapted to participate in visitor that is performance or being interacted with specifically walking about and wearing the role of stage property.This can quilt It is labeled as or is thought of as the context modulation of performance prerecorded.Remember these, Role Dilemma system may include that context is adjusted Component processed or system, its allow may just support wear stage property performer operator provide input, with selection with visitor or Visitor/observer organizes the context of interaction.When selecting context, controller can come from memory (all Tathagata by selection From performance database) the audio clips prerecorded neutral collection or more typically provide for one or more scenes Whole performance or dialogue the audio clips prerecorded context specific (or context enhancing) set, and to the input Make response.

In this mode, Role Dilemma system allow room in or film studio on (on-set) owner (or other operators) Observe visitor or perform the distinguishing feature or characteristic of participant.The feature observed and identified can be then passed to control Device (for example, context modulator or context input processor that the controller is run).Controller is such as by for angle Color sorting selects the context-specific dialogue set of performance, scene or a part for performance or scene, to be adapted to controller transmission Context selection, and act as the dialogue of displacement role, by it towards in advance recording related to the input of owner Hold deflection.

Role Dilemma system with context modulation can be adapted to balance (or use) inconspicuous device, such as via book Graphical user circle of plate, smart phone or the small touch-screen offer being arranged on other hand-held devices of radio communication is provided Face (GUI), pillar (prop), toy or automated system.The device is operable to show that operator/owner can select (to touch Touch) icon or button, to select (or multiple) context among multiple such contexts, for shifting or deflecting Dialogue is with the feature of suitable (multiple) visitor.For example, GUI can be configured or designed to allow together with the performer with wearing stage property The owner of work or other operators are special from the secret selection visitor/participant of portrait list (or using another input method) Property, such as people of participation birthday party, (it can further allow at such as princess, pirate, film angle the visitor of wearing stage property Selection between multiple stage property types of color etc.), type of personality (for example, shy visitor, rough visitor), age group etc.. In other cases, pillar or toy can be provided in film studio, to allow owner or other operators to change or select to be suitable to work as The context of preceding visitor/participant's characteristic.

The selection is typically wirelessly communicated to controller (that is, the system for being responsible for dialogue generation).Context selection/input Do not trigger new audio clips/speech of the audio system from role directly or promote along dialogue tree navigation.Instead It is that the action of context modulator is processing input, with from the set of multiple context-specific scenes prerecorded or drama Selected, to change whole contexts of the session between visitor and the performer for wearing stage property.In demonstration plot or reality In existing, the owner (or cameraman or other operators) in room can be observed, wherein wearing the room of role's performance of stage property Visitor just wearing princess's stage property.Then owner can use their hand-held device with its context input GUI, will The observation is delivered to controller, and controller is using its context modulator come the princess of dialogue that is prerecorded from memory selection Specific collection, so as to which " kingdom " state of visitor will be provided towards the result dialogue for merging benchmark displacement or deflection.

Understand the general introduction, with reference now to accompanying drawing come discuss in more detail these control concepts be probably it is useful, its provide System is realized and then proceeds to the trigger mechanism of control of the discussion for the role that walks about (for example, the navigation or triggering of dialog tree Animation or special efficacy) and for provide role presentation dialogue context modulation device specific implementation.

Fig. 1 is the functional block diagram of Role Dilemma system 100 of walking about, and it includes (to be not shown still by performer/impresario Will be understood as activate trigger mechanism 120) wear role's stage property 110 of walking about, with room perform or in film studio (interior or It is outdoor) 104 performance is provided or interacted with (multiple) visitor 102.Stage property 110 can be used to represent the role from film, Or it is used for receiving the visitor of the mechanism of such as theme park otherwise.Stage property 110 is suitable to playback of audio tracks, such as role Voice drama lines, and be further adapted for, with language performance (articulated) or with manual expression (animated), such as making The face that must be moved and the eyes for blinking/moving have and played the animation of audio sync.

Therefore, stage property 110 is shown as including robot technology (or special efficacy mechanism) 112 and audio system 114 (at some In embodiment, both can be positioned partially or entirely in inside the head or body of stage property 110) and for providing control signal 128 Controller/computer system 150 is (according to wired or wireless way, such as via with transceiver or wireless under airborne and/or machine The optional digital communications network 108 of transmitter 118, the transceiver or wireless launcher 118 are used for receiving such signal 128, and transmit trigger signal 127 and be used to be handled by performance controller 150, as discussed below).Audio system 114 includes raising Sound device 115 simultaneously provides dialogue suitable for playing audio clips 117 with the role for wearing stage property, and audio clips 117 can quilt It is stored in local storage 116 and is used to reset (for example, in response to control signal 128) later or can be buffered in when receiving In signal 128, for being reset by audio system 114 and its loudspeaker 115.

It is as shown and as described above, stage property 110 includes one or more trigger mechanisms 120, its be configurable to generate by The trigger signal 127 that performance controller 150 is used to handle is delivered to, and allows recording audio navigation of the performer through performance.For This, performance controller 150 is shown as including processor 152, for operation code or instructs to perform function described herein (such as specific purpose computing device, it is allowed to the wearing stage property that performer's navigation dialogue or otherwise control are walked about Role).The input of CPU152 operations such as wireless transceiver and output device 154, it is used to receiving trigger signal 127 and up and down Control signal 128 is simultaneously sent to stage property 110 by literary selection signal 136, to promote audio system 114 to reset special audio editing 117 and/or operation robot technology/special efficacy device 112.

Controller processor 152 further manages (or access) memory or data storage 156.In memory 156, The audio 170 prerecorded for (multiple) specific performance is stored, and can by the selective recovery of processor 152, for Reset on the audio system 114 of stage property 110.Audio 170 can be used in scene 174 and/or each scene 174 via providing Audio clips (dialogue/performer's lines) 175 come the dialog tree 172 of logic that navigates, and be arranged or be linked together.One In a little embodiments, context selection signal 136 is by (the software program or mould that processor 152 is run of context modulator 190 Block) processing, to select towards specific context displacement or the scene 174 or audio clips 175 that deflect (for example, visitor 102 is just Celebrate a birthday or just wear princess or pirate's costume is standby, as indicated by visitor's special characteristic 103).

Controller 150 includes the triggering (code or instruction that again, processor 152 can be run, to promote of processing module 160 Controller 150 performs some functions, such as generates control signal 128 and is navigated with dialog tree 172 of the selectivity through performance 170). Triggering processing module 160 is configured to receive and process the trigger signal 127 from trigger mechanism 120, to determine dialogue navigation Whether tree has started (or whether the triggering of robot technology/effect 112 has been utilized by performer by the performer of wearing stage property 110 Trigger mechanism 120 generates).If it does, then triggering processing module 160 will determine how to navigate through dialog tree 172, and pass through Stage property 110 is provided this information to (for example, audio system 114 is supplied to, for selecting the weight of audio clips 117 by signal 128 Put).Navigation through the audio (it can be arranged according to dialog tree 170) prerecorded can be flowed and control in various ways, And entitled " Simulated Conversation by Pre-Recorded Audio Navigator " United States Patent (USP) Shen It please be illustrated in more detail in publication number 2013/XXXXXXX for talking with several technologies navigated, it is merged by reference Herein.

Trigger mechanism 120 may include such as in two different finger (such as, thumbs of one of stage property 110 or two gloves Refer to and forefinger) on one or more pairs of intervals pressure sensor 122.Each in these sensors 122 can generate instruction The signal 127 of pressure/force, it is sent to controller 150 by transmitter 118.Then, triggering processing module 160 is acted to determine To the amplitude of each pressure/force applied of such as analog pressure sensor 122.Triggering processing module 160 may compare these The pressure threshold 180 stored in value and memory 156, to determine whether to have met or more than these threshold values.

Typically, module 160 is by only identifying or identifying when two sensors 122 have concurrently sensed beyond them Match somebody with somebody or the trigger action during pressure/force of different threshold values 180, to limit erroneous trigger.For example, when two sensors 122 are located at When on the different fingers of the gloves of stage property 110, triggering can be realized by pressing two sensors 122 together.Threshold value 180 can quilt Be set or adjusted to be adapted to specific actors because different performers may can (or it is expected) apply power in different range, with profit Triggering is activated with their finger.

Triggering can also associate with particular responses/action of stage property 110 or controller 150 (for example, navigate recorded drill Go out the dialog tree 172 of audio 170), and these responses 188 can be stored in memory 156, for by triggering processing module 160 recover.For example, the triggering that a pair of sensors 122 in being covered via left hand provides can cause in dialog tree 172 forward (or Navigate backward), and the triggering that a pair of sensors 122 in being covered via the right hand provides can cause in dialog tree 172 backward (or to Before) navigation.In other cases, it a pair of sensors 122 can be used to be used to talk with navigation, while activated using another pair 122 Robot technology/special efficacy 112.Controller 150 in response to triggering used by particular responses 188 do not limit the present invention because more Importantly, by the control of the operation of stage property 110 and its component via can concurrent activation a pair of pressure sensors 122 (for example, Two sensors are pressed relative to one another using two fingers according to completely or at least partially pairing or contiguous fashion by performer) It is supplied to performer (wearer of stage property 110).

Trigger mechanism 120 may also include one or more eye tracking sensors 124, and it will be typically installed at stage property In 124 head.Output from such sensor 124 is sent to controller 150 in signal 127, for by triggering Reason module 160 is handled.As will be discussed in more detail below, triggering processing module 160 (it may include that eyes track subroutine) can Process signal 127 is to determine the quantity of eyes movement and direction, and in some cases, it is determined that wearing the performance of stage property 110 The eyes of person/performer are opened or closed (that is, the part tracking blink as eyes following function).Module 160 can be used The eyes movement of these determinations moves (or blinking) threshold value 182 together with one group of predefined eye, to determine when to have been received by Triggering.

Reach for example, eye tracking sensor 124 can provide to be identified as to eye left or eye right by triggering processing module 160 More than the information 127 of the degree or amplitude (being moved to pupil outside " normal " eyellipse of definition etc.) of threshold value 182. Controller 150 can be to module 160 such triggering mark carry out response, to perform particular responses 188, so as to according to predefined Mode navigate running through dialog tree 172 (for example, but not by way of limitation, eye left and can trigger the forward/backward in tree 172 It is mobile, and eye right can trigger in tree 172 backward/move forward, and see triggerable special efficacy up or down or through dialogue The navigation of tree 172).

Trigger mechanism 120 can also include gesture recognition sensor 126, and signal 127 is sent to controller 150 by it, use Handled in by triggering processing module 160.In a realization of the system 100, using accelerometer as sensor 126, and And it is located in the gloves of stage property 110 or on gloves.Then, during performance, performer can move him according to predefined mode Hand, and the movement is sensed by gesture recognition sensor 126.Trigger processing module 160 processing from accelerometer or its The signal 127 of his sensor 126, and compare mark movement or posture and memory 156 in one group of predefined appearance storing Gesture 184.If one of posture and posture 184 of mark match, controller 150 can recover the response of the definition to the triggering 188, and specific function is performed, such as navigate through dialog tree 172 or redirected in dialog tree 172, to promote scene 174 to start Or audio clips 175 are promoted to play (if for example, performer is waving or similar to posture, " hello " or " goodbye ").

The audio that Role Dilemma system 100 is also adapted for allowing audio system 114 to be provided contextually is modulated with more It is good to adapt to (multiple) particular visitors 102.Therefore, scene 174 can be context-specific.In other words, for performing 170 Audio may include the more than one set (or subset) for the audio clips 175 of at least some scenes 174, and these audios Each in the set of editing 175 can be shifted or deflect into specific context, such as birthday, anniversary, wear stage property Visitor, the age of visitor and/or sex etc..Context modulator 190 is provided in controller 150, is come from processing The context selection signal 136 of room/film studio 104 (for example, coming from input unit 130) is performed, and as response, recovers or is lined up One of (queue up) context special scenes 174 (or audio clips or the set for talking with 175).

In fact, the observable of context modulation operations person 190 of the owner or photographer in such as room or in film studio 104 On visitor 102 one or more visitor's special characteristics 103 (such as their age, they whether celebrate spy Determine occasion, and/or whether they just wear the stage property or clothes for indicating that they are the bean vermicelli of performance, role etc.).Operator 190 Can then using or operation context input unit 130 generate context selection signal 136.Device 130 can be almost can For generating signal 136 and receiving any wired or wireless communication device of user's input from operator 109.For example, dress Put 130 can be with such as touch-screen or monitor input and output device 132 board or hand-held device (such as, Smart phone etc.).In the illustrated embodiment, graphical user interface (GUI) 134 is generated and shows using I/O devices 132, The context for being such as configured as promoting operator 109 using portrait list selects.

But in other cases, GUI134 can not be utilized to modulate context, and these feelings using signal 136 Condition can use pillar, toy or automated system, to allow owner or operator's selection and/or enabling signal 136.Up and down The ginseng of such as birthday celebration activity in the one or more predefined stage properties (for example, pirate, prince/princess etc.) of Wen Keyu instructions With the icons association of the neutrality of person or young child/basic context and multiple non-neutral contexts, or context can be with The association of the specific pillar or toy of owner or operator's " operation " (or in some cases, automated system can provide up and down Text modulation).Context modulation can by be related in the entertainment of owner or such as performer it is substantially any other people carry out, or It can be performed by automated system (not shown in Fig. 1, but those skilled in the art are appreciated that).In addition, " context modulation " is no It is limited to the selection or modulation for utilizing which audio clips within system 100.In some cases, perform element (including audio is cut Volume, special efficacy etc.) timing can be modulated such as other performances, or the output parameter of amplitude (or quantity), frequency etc. can By context input unit 130 (again, its can be based on GUI or can according to such as using pillar, toy or from The other modes of dynamicization system are realized) modulate or change.In some cases, context modulation can be used to control the synthesis of drama Or the one or more special efficacys of combination.In addition, two or more concurrently realized may be selected in the operator of context input unit 130 Context, the expectation performance context provided with realization to visitor/participant (both " birthday " and " shy " such as, are selected, With with birthday lines/audio clips and/or special efficacy etc. for shy children).

On realizing a pair of pressure sensors for trigger mechanism 122, Fig. 2 illustrates demonstration stage property gloves 200, and it can For allow the performer of stage property (such as stage property 110)/wearer selectively triggering wear stage property role control, so as to through Talk with tree navigation.As shown, stage property gloves 200 (it can be the right hand or left handed gloves, and right hand glove is illustrated that in Fig. 2) Including major part or main body 210, it is by the palm of suitable covering performer and covers their the back of the hand.Gloves 200 also include four Individual finger 212,214,216 and 218, (size and dimension) are suitable to all or part of four fingers of covering performer.Gloves 200 Also include the thumb 220 for being used to accommodate the thumb of performer.

In gloves 220, by the forefinger of gloves or show refer to 218 outer surface 219 (or part towards thumb) (on In or) the first analog pressure sensor 230 is provided and the second simulation is provided on the inner surface or meat pad 221 of gloves thumb 220 Pressure sensor 240, to provide trigger mechanism.In order that being used as trigger mechanism by the use of the two or paired sensor 230,240, grasp Gloves 200 are placed on them on hand by author, and then as indicated by arrows 250 move finger 218 and thumb 220 together, So that two sensors 230 and 240 apply forces against each other.When pressure exceeds each sensor (threshold value can be same to each other or different to each other) 230th, trigger event or state are identified during 240 preset threshold value, and controller can such as by dialog tree forward or to After navigate, to make response with predefined response.By the way that two sensors 230,240 are pressed together, this is to sensor by grasping Author's concurrent activation.

Forefinger sensor 230 can be located towards the bottom of finger 218 as shown or positioned at the bottom of finger 218 On, or the finger tip of finger 218 can be located closer to.By the way that sensor 230,240 to be placed on to the meat pad of thumb 220 or interior table On face 221 and on the outer surface 219 of forefinger 218, the people for wearing gloves 200 easily can put the two sensors 230,240 250 are put on adjacent contact surface, and applies pressure according to the acceptable mode of biotechnology, but relatively small mistake be present The chance of false triggering, because (two activities can all promote one such as wearing the people of gloves 200 with someone and shake hands or catch object Individual sensor sensing exceeds the pressure of threshold value, rather than both concurrently sense, and such as triggers processing module mark triggering state/event As required) when marquis normal activity during, the two parts of gloves 200 typically not concurrent contacts.

Fig. 3 illustrates the screen map for the GUI310 that can be generated and provide in the monitor of Role Dilemma system, is such as One of I/O devices 154 of controller 150 in system 100.GUI310 is actually available for being presented on touching of being provided in stage property gloves The sensor values of the measurement of hair mechanism, and it is additionally operable to explain the operation of the Role Dilemma system of this specification.

GUI310 is displayed side by side left hand image or left hand set 320 and right hand image or right hand set 340.Left hand set 320 is shown It is a pair of the pressure sensors 330 for including the form with the triggering of left forefinger and left thumb-activated to go out, and this is to sensor 330 Left hand trigger mechanism is provided, for dialog tree navigation or trigger other in check functions for role's stage property of walking about.Class As, right hand set 340 is shown as a pair of pressure sensors for including the form with right index finger triggering and right thumb-activated 350, and this second pair of sensor 350 provides right hand trigger mechanism, navigation or other controls triggered for dialog tree. As reference chart 2 is discussed above, this will be typically provided on the outer surface of the forefinger of gloves to pressure sensor 330,350 Upper half, while this lower half to pressure sensor 330,350 will typically lie in the inner surface of the thumb of stage property gloves Or on meat pad surface.This allows glove performer easily to press every a pair 330,350 of two sensors together, simultaneously The risk of both quilts of limitation while unintended activation.

GUI310 is configured as indicating the current operation status of the trigger mechanism based on gloves.Therefore, for two pair 330, Each sensor in 350 provides slider bar 323,332,343,352, and there is designator element to show for each sensor Activation threshold value is together with current pressure reading.At the operating time for GUI310 illustrated in figure 3, using display box 324, 334th, 344,354 current pressure reading is shown, each be zero (for example, two pair 330,350 sensors are by together Press or pressed towards other objects).GUI310 also includes display box 325,336,345,356, shows to press according to digital form Force snesor is set to the threshold value of each sensor in 330,350.

As shown, each threshold value is different from each other, because trigger mechanism can adjust particular operators, and triggers any The quantity of pressure needed for particular sensor can be equal, or more typically, by difference to promote the performer of wide scope to use.Example Such as, apply pressure to thumb sensor to be easier than applying pressure to forefinger sensor, and performer can utilize theirs " strong " hand (for example, they are right-handed person or left-handed person) is applied more pressure, and different threshold values can be set and stored in often In the memory of one sensor, to adjust role's gloves and their sensor to performer.But in other cases, it is each Threshold value can be arranged to equal and sufficiently low value, to allow each performer in pond easily to trigger pressure sensor, and There is no unsuitable erroneous trigger.

Erroneous trigger is further by requiring the control signal in performance controller generation such as dialogue navigation signal/action Before, two sensors of (so that pressure exceeds threshold value) sensor centering are concurrently triggered.For example, impresario can use their right side Hand is shaken hands with visitor, and this can promote to be applied to the sensing beyond threshold value shown in 345 in the pressure shown in 344 and 343 Device to 350 right hand forefinger sensor.However, triggering state or event are not identified by triggering processing module, because the right hand is to 350 In thumb pressure sensor concurrently triggered without using beyond the pressure 352,354 of its threshold value 356.On the contrary, with visitor While shaking hands, performer can move their left hand thumb and forefinger together, with trigger dialogue, and trigger processing module can Act to determine that left hand pressure sensor has both to 330 left index finger pressure sensor and left hand thumb pressure sensor Concurrently exceed the current pressure 323,324,332,334 of preset threshold value 325,336.As response, control signal can be generated to pass through Wear dialogue tree navigation (for example, in this example so that role says " hello " or " goodbye " while shaking hands).In some implementations In example, time threshold can also be applied in allow the triggering of control signal/action.For example, triggering processing module detectable one Two sensors in (forefinger sensor and thumb sensor) 330 or 350 are exceeded with their respective threshold, but can be with Triggering is not identified, unless reaching preset time period (for example, performer must not together press and keep (for example, reaching beyond threshold value 1 to 3 seconds etc.) their finger with generate triggering).

It is utilizing a simple movement towards forefinger pressing thumb to realize, utilization " thumb switching " this kind of in order to provide Control, each sensor and sensing device further can be used to be used for trigger mechanism.In certain embodiments, passed using two simulated pressures Sensor, in the meat pad of a thumb in gloves, another is in the part towards thumb of the finger of glove of such as forefinger. In another embodiment, magnet and hall effect sensor are matched (instead of two analog sensors) to detect when the hand of gloves Finger touches together or closely located.In another embodiment, by the use of capacitance type sensor to as pressure sensor it is right/triggering Mechanism.In this case, capacitance type sensor is had to, and position is closer to each other, and to realize electric capacity, and the change of electric capacity is felt Survey and using identifying trigger event/state.

GUI310 is further illustrated can provide additional triggers mechanism in one or two of stage property gloves 320,340. Particularly, show in the major part or main body of left hand set 320 for being intended to represent the gesture recognition sensor of such as accelerometer Go out symbol or image 370.Sensor representated by symbol/image 370 works to triggering processing module transmission signal, and As shown in GUI310, current state can be that left hand is waved.This can cause special efficacy or other events (such as to jump to when inspection Measure the specific lines in the scene triggered during posture, dialogue or dialog segments).

As described above, the precision of the control of posture and detection can be strengthened by triggering processing module, it is only allowed in such as In special scenes or scene it is limiting time, performance in some times provide the triggering based on each posture (for example, asking During the starting stage of time/welcome scene, only allow to wave posture to trigger " hello " or other welcome dialogues).But at it In the case of him, some postures can be always allowed to trigger control (such as talking with tree navigation) when detecting.This is for such as downward Impresario/performer of fist movement there is no a typical fault or the posture for being not intended to make can be it is useful (with any scene or In performance, triggering ", boy！" or matched with the posture other dialogue).

In some preferred embodiments, it has to identify two triggering states and promote to trigger processing module triggering control letter Number/action.For example, two postures (left hand and right hand posture) can be had to be identified, to generate triggering, or can be in mark base In providing in the predefined period before or after the triggering of pressure sensor or concurrently the triggering based on posture.It is such The combination for promoting the data of triggering can be useful for limitation erroneous trigger and increase triggering times, and this can be used to control away The operation of the role of dynamic wearing stage property.

In Fig. 1 124 at the trigger mechanism that shows can take the form of eye tracking sensor.Fig. 4 illustrate eyes with The part of track sensor cluster 410, it can be in the head of stage property using to track the movement of the eyes of performer, to allow performer to touch The control for the component of stage property is sent out so as to through dialogue tree navigation.Tracking camera 414 is provided to be received from the eyes 420 of performer Light 416, to track the pupil 424A-424C of performer movement.For example, camera 414 may be mounted to that in the head of stage property, and position When being put on for going on the stage, one of eyes of performer are focused on.It is readily useable the pupil of (stock equipment for being used for market survey etc.) Tracking technique can be used for the camera 414 with software (Fig. 1 triggering processing module), and the software is modified to provide described herein Triggering feature/tracking.

Eyes track or triggering processing module can be specifically configured to prevent or reduce when using eyes or pupil tracking The number of the erroneous trigger of detection.Identify, going on the stage need to their left side and the right watch or watch when, it is most of to drill Member by the head for rotating them to promote role/stage property head to rotate, and using during wearing the normal processes of stage property performance of head, Performer typically will be to the left and simple mobile to the right or not their eye/pupil.Thus, triggering processing module may be adapted to handle The output of camera 420 is tracked, to determine whether in normal/expected pupil (it is when performance to the pupil of performer in point range 430 Person simply attempt from the eyes of role look out when desired pupil 424A movement 432 predefined scope, and may include Do not feel or unintentionally eyes move).When mobile 432 defined in left and right pupil moving boundary 434,436 in scope 430 When (or outer), triggering is not identified or generated.

However, triggering processing module (pupil tracking software) can determine that performer has moved their eyes 420 and caused them Pupil 424B moved 440 to outside the left side or beyond left margin 434, or their pupil 424C has moved 444 to the right side Outside side or beyond right margin 436.In any one of these events, triggering processing module, which can identify, is related to left eye movement or right The mobile triggering of eye, and perform the response of the actionable definition with one of triggerings of the execution for the two marks of controller. For example, left pupil movement 440 can trigger, through dialog tree, (or forward) is mobile backward, and right pupil movement 444 can trigger such as Through dialog tree (or backward) mobile another action forward.Although it is not shown, pupil tracking can using (or be used as choosing Select) it is related to looking up or looking down outside mark normal range (NR) 430.In other words, it can perform pupil tracking so that will be predefined Any mobile logo outside normal range (NR) (it can be by testing to define for each performer) is triggering.

Triggering processing module can be programmed to further handle the entrance information for carrying out autotracking camera to limit (or elimination) Erroneous trigger.For example, substitution only once removes normal range (NR), triggering can not be identified, unless the outer pupil of performer's hold in range moves Dynamic 440 or 444 reach threshold time period (for example, keeping pupil to reach 1 to 2 seconds etc. as shown in 424B or 424C).In other feelings Under condition, when mark move twice (such as see to the left or to the right twice 440,444 or eye right/move 444 after to the left See/move 440 (vice versa)) when, it can detect or mark triggers.Typically, eyes movement twice is had to when predefined Between occur in section to be counted as a pair of triggering eyes movements (such as, it is desirable to received in 1 to 5 seconds since first time is mobile It is mobile to second).It is such to move triggering twice and be seen as " double-clicking " similarly to trigger with the double-click using mouse, with Even if cause when just utilizing eyes movement execution action, many performers will be felt in natural GUI/ interfaces or software application Action.

The data that can be used by triggering processing module can also be provided using the pupil tracking of camera 414, to determine when Performer blinks their eyes.Such mark can be used to trigger blinking for the eyes of role, such as by with robot skill The controller triggering of the control signal operation of art, to promote the eyes on stage property head to blink.In other cases, performer can close Their eyes simultaneously keep closing one's eyes, and are promptly exited from ongoing scene or performance with triggering dialogue navigation, special efficacy, or request.

In addition, using except dependent on tracking camera 414 in addition to other technologies, come perform pupil (or eyes) with Track.For example, electrooculography can be used to realize in Fig. 1 eye tracking sensor 124, it is measurement (such as three biographies Sensor is located at their approached on the face with the eyes of performer) processing of the change of the polarity (or potential) of their eyes.So Polarity or the processing of change of potential can be used to track eyes movement.For example, if eyes are from the central position towards an electricity Pole/sensor movement, then the electrode/sensor " sees " front of retina, and comparative electrode/sensor " sees " view The back side of film.Thus, electrical potential difference occurs between electrode/sensor, and determine/potential of record is to be used for current eye position The measurement put.Triggering processing module may be adapted to determine that eyes move using electrooculography, and determine when the movement Trigger predefined response (left and right, up or down in normal range (NR) or outside scope, and using controller with generate with Control signal corresponding to certain trigger).

As shown in fig. 1, Role Dilemma system 100 may include to perform the context modulator 190 in controller 150, its Input/data-signal from owner, photographer or the exercisable context input unit 130 of other operators 109 is handled, To provide visitor's special characteristic or context (being used for visitor 102).In addition, context modulator 109 can be based on input (what is shown at 174 for such as selecting and being lined up in the recording audio 170 of scene or performance is upper and lower for context or visitor's feature Literary specific dialogue) shift or deflect dialogue.In addition, the context that owner or other operators provide can be used to provide and walk about Role's stage property performance special efficacy or animation.By using context input unit 130, after owner or other operators can substitute Platform operator, and their the positive visitors for greeting and working together can more effectively be obtained from film studio or performance room for performing Or the contextual information of scene.

For example, context modulation can be provided by the meet-and-greet owner of operation context input unit 130.Owner is (for example, figure Owner 109 in 1) in the room for walking about the role for wearing stage property.Owner's observable is on visitor or the spy of guest Property or feature 103, and owner easily can trigger or select for visitor or visitor group context, to drill Go out/interest and characteristic personalization of the scene for them.When room/film studio 104 is performed in new visitor/group 102 entrance, input dress Touch feedback can be provided to alert the key entry contextual information of owner/operator 109 by such as vibrating by putting 130.

Context selection GUI134 can and then be provided on the touch-screen 132 of input unit 130, and owner 109 is optional One or more icons or button are selected, to provide the number of visitor's special characteristic 103 on context or visitor/groups 102 According to.Critical aspects are that this allows to start in performance or changes the context of performance/scene in one or more of performance point, Such as one or more scenes context modulation (subset of dialogue can be context-specific, and other can be It is neutral to be supplied to owner, and can be before scene starting point or even any during scene in some cases Time, context selection occurs).

It is defeated that Fig. 5 illustrates the demonstration context with smart phone or the form of similar hand-held device or panel plate of writing Enter device 510.Context input unit 510 includes touch-screen 520, is selected for allowing user to provide context, but other Device 510 may include keyboard, speech recognition or allow the user of such as owner or photographer to carry out other skills of context selection Art.Device 510 is configured as providing the radio communication of context selection or input to remote control (or controller in stage property), uses Handled in by context modulator to select context special scenes or dialogue.

In Figure 5, there is provided the sectional drawing of device 510, operate and input GUI to provide context in its touch-screen 520.At this In example, there is provided the portrait row of the selectable optional context (or visitor's special characteristic/characteristic) of operator of device 510 Table.Portrait list is shown as including representing nine icons of nine different contexts.The context (or context icon) Set includes neutral context 530, and it can also be default context, and neutral dialogue is displaceable or deflection is suitable for respectively Kind visitor, such as say the visitor of non-mother tongue and can it is expected to keep other relatively easy and uncomplicated groups (not have dialogue Very more spoken languages, except it is unexpected they be used for specific role).The list also includes birthday icon 532, and as desired, The context special scenes selected when selecting icon 532 will be shifted typically towards the celebration of birthday.

The list further comprises club or clubber 534, when visitor is identified as by the operator of device 510 During the member of the fan affiliations that can recognize that in the scene of performance or performance etc., the club or clubber 534 may be selected. In some cases, visitor can just wear their interest of instruction or they wish that performance provides context, such as The clothes of safety pin or cap, and club cap (clothes item) icon 536 may be selected in owner, with based on clothes object displacing pair The context of words (or performance element).Similarly, visitor can just wear stage property or they are very interested in particular topic Other designators (such as wearing princess's stage property or headwear to show that they just disguise oneself as princess).Icon 540 may be selected, to promote Context modulator is talked with towards the performance based on princess/scene displacement.More icons can be provided with allow such as pirate's costume it is standby, Other of pilot, sportsman etc. are similar to context.

In order to the context that is adapted to visitor and selects can also based on their individual character or they look by how Interacted with role.Therefore, context icon 542 can be selected using the example in Fig. 5 GUI, it is allowed to owner/operator's instruction Visitor can be shy, and dialogue can be shifted or deflected to illustrate visitor's characteristic.In other cases, individual character Displacement/context can be towards outgoing or noisy (or another individual character or the interaction for very energetic and interaction visitor Characteristic).Age of visitor is also based on to select context, such as using learning the child's icon 544 walked or children/green grass or young crops Juvenile icon 548 indicates that visitor is very young.Similar icon can be provided to indicate the sex of visitor.In other cases, Icon 546 may be selected so that dialogue/scene is displaced into larger visitor's group from single visitor in owner/operator of device 510. The number and type of context are close unlimited, and context described herein is intended to only be that how can use upper and lower selected works Select, trigger the dialogue tree navigation in the audio prerecorded for the performance that the role of the wearing stage property for walking about is provided Simple examples.

Although the present invention has been described and illustrated in some degree of particularity, it is to be appreciated that only making this as example It is open, and those skilled in the art can take many changes in the combination and arrangement of each several part, without departing from claimed hereinafter The spirit and scope of the present invention of protection.

Claims (12)

1. a kind of control system, the audio system provided in role's stage property of walking about is operated for selectivity, including：

Trigger mechanism, provided in this walks about role's stage property, the trigger mechanism can be by wearing the performer of role's stage property of walking about Operation, to generate and transmit at least one trigger signal；

Controller, for receiving trigger signal, and response is used as, transmission promotes the audio system to reset the dialogue prerecorded The control signal of set；With

Processing module is triggered, is run by the controller, for handling the trigger signal, and is used as response, navigates what is prerecorded Audio is used to perform, to select the set for the dialogue prerecorded,

Wherein the trigger mechanism is included in the first and second pressure sensors separated in role's stage property of walking about, and wherein The processing of at least one trigger signal of the triggering processing module includes：Compare the first pressure that the first pressure sensor is sensed Power and first threshold, and compare second pressure and Second Threshold that the second pressure sensor is sensed.

2. control system according to claim 1, wherein when concomitantly exceeding first and second threshold value, generate the control Signal.

3. control system according to claim 1, the wherein first threshold are different from the Second Threshold.

4. control system according to claim 1, wherein the first pressure sensor be located in the gloves of role's stage property of walking about, In the meat pad of the thumb of the gloves, and wherein the second pressure sensor is located in the finger of the gloves.

5. control system according to claim 1, the wherein trigger mechanism include eye tracking sensor, and described at least one Individual trigger signal is handled by the triggering processing module, to identify pupil movement or the mark beyond the performer of predefined threshold value The eyes of performer blink.

6. control system according to claim 5, wherein when mark pupil movement in normal pupil outside point range when, should Pupil movement starts the control signal.

7. control system according to claim 6, wherein when mark pupil movement in preset time period at least twice just Normal pupil outside point range when, start the control signal.

Know 8. control system according to claim 1, the wherein trigger mechanism are included in the posture installed on role's stage property of walking about Individual sensor.

9. the processing for the trigger signal that control system according to claim 8, wherein the triggering processing module are carried out includes mark Posture, and the posture based on mark and based on perform perform during when receive identified posture, come perform be used for drill The navigation of the audio prerecorded gone out.

10. control system according to claim 1, further comprise context modulator, for receiving context selection signal, And response is used as, at least a portion of the audio prerecorded for performance is selected, thus the dialogue prerecorded Set is context-specific.

11. control system according to claim 10, wherein the context selection signal are by the exercisable context of operator Input unit generation, and wherein the context input unit be located therein performer wear walk about role's stage property room in or In film studio.

12. control system according to claim 11, wherein the context input unit are suitable to display graphic user interface, wherein Each in context graph target portrait list can be selected by operator via graphic user interface, and each and difference Context relation.