CN111984125A - Stage lighting console operation method, medium and stage lighting console - Google Patents
Stage lighting console operation method, medium and stage lighting console Download PDFInfo
- Publication number
- CN111984125A CN111984125A CN202010911579.2A CN202010911579A CN111984125A CN 111984125 A CN111984125 A CN 111984125A CN 202010911579 A CN202010911579 A CN 202010911579A CN 111984125 A CN111984125 A CN 111984125A
- Authority
- CN
- China
- Prior art keywords
- user
- stage lighting
- operation instruction
- acquiring
- console
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 69
- 238000011017 operating method Methods 0.000 claims abstract description 23
- 210000005252 bulbus oculi Anatomy 0.000 claims description 50
- 210000001508 eye Anatomy 0.000 claims description 19
- 238000003062 neural network model Methods 0.000 claims description 17
- 239000013598 vector Substances 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 11
- 238000013136 deep learning model Methods 0.000 claims description 10
- 230000001815 facial effect Effects 0.000 claims description 10
- 238000012545 processing Methods 0.000 claims description 8
- 238000000605 extraction Methods 0.000 claims description 7
- 238000004891 communication Methods 0.000 claims description 4
- 238000011022 operating instruction Methods 0.000 claims description 3
- 238000012549 training Methods 0.000 description 15
- 230000009471 action Effects 0.000 description 5
- 230000008569 process Effects 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000008451 emotion Effects 0.000 description 1
- 230000004424 eye movement Effects 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 210000000056 organ Anatomy 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000007493 shaping process Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 230000001755 vocal effect Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/292—Multi-camera tracking
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/155—Coordinated control of two or more light sources
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/165—Controlling the light source following a pre-assigned programmed sequence; Logic control [LC]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Acoustics & Sound (AREA)
- Health & Medical Sciences (AREA)
- Computational Linguistics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides a stage lighting console, an operating method and medium thereof. The stage lighting console operation method comprises the following steps: displaying at least 2 operation objects by using different display screens of the stage lighting console; acquiring sight line information of a user; determining a target display screen according to the sight line information of the user; acquiring an alternative operation object in the target display screen; acquiring a control voice of a user; acquiring a first operation instruction according to the control voice of the user; the first operation instruction comprises an operation type or comprises an operation type and an operation object; generating a second operation instruction according to the first operation instruction and the alternative operation object; and operating the stage lighting console according to the second operation instruction. The stage lighting console operation method can improve the operation efficiency of a user on the stage lighting console.
Description
Technical Field
The invention belongs to the field of circuit devices for general electric light sources, relates to a control method, and particularly relates to an operation method and medium for a stage lighting console and the stage lighting console.
Background
The stage lighting is also called 'stage lighting', short for 'lighting', and belongs to one of the means of stage art modeling. Specifically, stage lighting refers to displaying an environment, a rendering atmosphere, and highlighting central characters with light colors and changes thereof according to actual needs by using stage lighting equipment (such as stage lamps, slides, control systems, etc.) and technical means, creating a spatial sense and a temporal sense of a stage, shaping an external image of stage performance, and providing necessary lighting effects (such as wind, rain, clouds, water, lightning), etc.
In practical application, an operator controls the corresponding lamp by operating the stage lighting control console so as to obtain stage lighting. In an existing operating method of a stage lighting console, an operator often needs to operate the stage lighting console through a plurality of display screens, a plurality of keys and/or a plurality of groups of push rods so as to realize programming of stage lighting. However, referring to fig. 1, the display screen, the buttons and/or the push rods of the stage lighting console 1 are often located at different positions, the width of the stage lighting console is generally about 2m to 4m, and the operator often needs to adjust the display screen, the buttons or the push rods at different positions when operating the stage lighting console, which results in lower efficiency of the existing operating method of the stage lighting console. For example, the previous operation is performed by the display 11, and the next operation is performed by the key 12, and it is difficult for the operator to easily and efficiently perform the operation on the stage lighting console.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, an object of the present invention is to provide a stage lighting console operating method, medium and stage lighting console, which are used to solve the problem of low efficiency in the existing stage lighting console operating method.
To achieve the above and other related objects, a first aspect of the present invention provides a stage lighting console operating method applied to a stage lighting console; the stage lighting console operation method comprises the following steps: displaying at least 2 operation objects by using different display screens of the stage lighting console; acquiring sight line information of a user; determining a target display screen according to the sight line information of the user; acquiring an alternative operation object in the target display screen; acquiring a control voice of a user; acquiring a first operation instruction according to the control voice of the user; the first operation instruction comprises an operation type or comprises an operation type and an operation object; generating a second operation instruction according to the first operation instruction and the alternative operation object; the operation type of the second operation instruction is obtained according to the operation type of the first operation instruction; the operation object of the second operation instruction is obtained according to the alternative operation object, or the alternative operation object and the operation object of the first operation instruction are obtained; and operating the stage lighting console according to the second operation instruction.
In an embodiment of the first aspect, an implementation method for acquiring gaze information of a user includes: acquiring eyeball information of a user by utilizing at least 2 eyeball tracking devices; wherein the positions of different eye tracking devices are different; and obtaining the sight line information of the user according to the eyeball information obtained by different eyeball tracking devices.
In an embodiment of the first aspect, an implementation method for obtaining eyeball information of a user by using at least 2 eyeball tracking devices includes: the eyeball tracking equipment is a camera; acquiring at least 2 facial images of a user by using at least 2 cameras; and processing the facial image by using a deep learning model to acquire eyeball information of the user.
In an embodiment of the first aspect, an implementation method for obtaining eyeball information of a user by using at least 2 eyeball tracking devices includes: the eyeball tracking device is an infrared device; sending out infrared light by using a sending module of the infrared equipment; the infrared light is reflected after reaching the eyeball of the user to form reflected light; receiving the reflected light by using a receiving module of the infrared equipment; and processing the reflected light to acquire eyeball information of the user.
In an embodiment of the first aspect, after obtaining the candidate operation object in the target display screen, the stage lighting console operation method further includes: and highlighting the alternative operation object in the target display screen.
In an embodiment of the first aspect, an implementation method for obtaining a first operation instruction according to a control voice of the user includes: carrying out feature extraction on the control voice of the user to obtain a feature vector corresponding to the control voice of the user; processing a feature vector corresponding to the control voice of the user by utilizing a neural network model to obtain a phoneme corresponding to the feature vector; acquiring an operation type and/or an operation object corresponding to the phoneme by using an operation instruction dictionary, and further acquiring the first operation instruction; the operation instruction dictionary comprises a plurality of words and phonemes corresponding to the words, and each word corresponds to one operation type or operation object.
In an embodiment of the first aspect, the method for implementing the operation on the stage lighting console according to the second operation instruction includes: acquiring voiceprint information of the user according to the control voice of the user; acquiring the operation authority of the user according to the voiceprint information of the user; and when the user has the operation right matched with the second operation instruction, operating the stage lighting console according to the second operation instruction.
In an embodiment of the first aspect, the operation object includes a lamp, a display screen, a key and/or a push rod.
A second aspect of the present invention provides a computer-readable storage medium having a computer program stored thereon; which when executed by a processor implements the stage light console operating method of the first aspect.
A third aspect of the invention provides a stage light console; the stage lighting console includes: a memory storing a computer program; the processor is in communication connection with the memory and executes the stage lighting console operation method of the first aspect when the computer program is called; and the at least 2 display screens are in communication connection with the memory and the processor and are used for displaying at least 2 operation objects.
As described above, the operating method and medium for a stage lighting console and the technical scheme of the stage lighting console of the present invention have the following beneficial effects:
the stage lighting console operation method comprises the steps that different display screens are used for displaying different operation objects, and a target display screen and alternative operation objects of the target display screen are obtained according to sight line information of a user; in addition, the stage lighting console operation method also obtains a first operation instruction according to the control voice of the user. On the basis, the stage lighting console operation method generates a second operation instruction according to the alternative operation object and the first operation instruction, and completes the operation of the stage lighting console according to the second operation instruction. Therefore, the stage lighting console operation method can complete the operation of the stage lighting console according to the sight information and the control voice of the user, is convenient for the user to operate the display screen, the push rod and/or the keys at different positions, and has high operation efficiency.
Drawings
Fig. 1 is a schematic structural diagram of a stage lighting console according to an embodiment of the present invention.
Fig. 2 is a flowchart illustrating an operation method of the stage lighting console according to an embodiment of the present invention.
Fig. 3 is a flowchart illustrating the operation method of the stage lighting console according to an embodiment of the invention in step S12.
Fig. 4A is a flowchart illustrating the step S121 of the stage lighting console operating method according to an embodiment of the present invention.
Fig. 4B is a flowchart illustrating the step S121 of the stage lighting console operating method according to another embodiment of the present invention.
Fig. 5A is a flowchart illustrating the operation method of the stage lighting console according to the present invention in step S16 in an embodiment.
Fig. 5B is a flowchart illustrating the operation method of the stage lighting console according to an embodiment of the present invention, wherein the neural network model is trained.
Fig. 6 is a flowchart illustrating the operation method of the stage lighting console according to the present invention in step S18 according to an embodiment of the present invention.
Fig. 7 is a flowchart illustrating a method for operating the light stage according to another embodiment of the present invention.
Fig. 8 is a schematic structural diagram of a stage lighting console according to an embodiment of the present invention.
Description of the element reference numerals
1 stage lighting console
11 display screen
12 push-button
800 stage lighting console
810 memory
820 processor
830 display screen
S11-S18
S121 to S122
S1211 a-S1212 a
S1211 b-S1213 b steps
Steps S161 to S163
S51-S54
S181 to S183
S71-S75
Detailed Description
The embodiments of the present invention are described below with reference to specific embodiments, and other advantages and effects of the present invention will be easily understood by those skilled in the art from the disclosure of the present specification. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention. It is to be noted that the features in the following embodiments and examples may be combined with each other without conflict.
It should be noted that the drawings provided in the following embodiments are only for illustrating the basic idea of the present invention, and the drawings only show the components related to the present invention rather than the number, shape and size of the components in actual implementation, and the type, quantity and proportion of the components in actual implementation may be changed freely, and the layout of the components may be more complicated. Moreover, in this document, relational terms such as "first," "second," and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions.
In practical application, an operator controls the corresponding lamp through the stage light control stage so as to obtain stage light. In an operation method of an existing stage lighting console, an operator often needs to operate a plurality of display screens, a plurality of keys and a plurality of groups of push rods to program stage lighting. However, referring to fig. 1, the display screen, the buttons and/or the push rod of the stage lighting console 1 are often located at different positions, and the width of the stage lighting console is generally about 2m to 4m, which results in a low efficiency of the operation method of the conventional stage lighting console. For example, the previous operation is performed by the display 11, and the next operation is performed by the key 12, and it is difficult for the operator to easily and efficiently perform the operation on the stage lighting console.
Aiming at the problem, the invention provides a stage lighting console operation method. The stage lighting console operation method comprises the steps that different display screens are used for displaying different operation objects, and a target display screen and alternative operation objects of the target display screen are obtained according to sight line information of a user; in addition, the stage lighting console operation method also obtains a first operation instruction according to the control voice of the user. On the basis, the stage lighting console operation method generates a second operation instruction according to the alternative operation object and the first operation instruction, and completes the operation of the stage lighting console according to the second operation instruction. Therefore, the stage lighting console operation method can complete the operation of the stage lighting console according to the sight information and the control voice of the user, is convenient for the user to operate the display screen, the push rod and/or the keys at different positions, and has high operation efficiency.
Referring to fig. 2, in an embodiment of the present invention, the stage lighting console operating method includes:
and S11, displaying at least 2 operation objects by using different display screens of the stage lighting console. The number of the display screens is 2 or more, and each display screen displays at least 1 operation object; the operation object may be displayed in the form of an icon, for example. In a specific application, the display screen can display icons of a plurality of lamps, icons of a plurality of push rods, icons of a plurality of keys and/or icons of a plurality of display screens. For example, an icon corresponding to the display screen 1 may be displayed on the display screen 1, and the operation object corresponding to the icon may be indicated as the display screen 1.
And S12, acquiring the sight line information of the user. The gaze information of the user comprises a gaze direction, a gaze time and/or a gaze focus of the user; wherein the gaze time refers to a time period for which the line of sight of the user stays at a certain display screen.
S13, determining a target display screen according to the sight line information of the user. For example, 1 or more display screens in the direction of the line of sight of the user may be acquired as the candidate display screens, and when the gaze time of the line of sight of the user on a certain candidate display screen is greater than a threshold value, the candidate display screen is the target display screen. Wherein, the threshold value can be set according to actual requirements, for example, 0.1 s. For another example, a display screen on which the user's gaze focus is located may be selected as the target display screen.
And S14, acquiring the alternative operation objects in the target display screen. The candidate operation objects may be all operation objects in the target display screen, or may be part of operation objects in the target display screen.
And S15, acquiring the control voice of the user. Specifically, the control voice of the user is emitted by the user and acquired by a microphone disposed near or on the stage lighting console. For example, the user may generate the control voice by speaking the word "turn page" or by speaking the phrase "close display screen".
S16, acquiring a first operation instruction according to the control voice of the user; the first operation instruction comprises an operation type or comprises an operation type and an operation object. The first operation instruction is in a text form, and in a specific application, the control voice of the user can be converted into the first operation instruction through a voice recognition technology, for example, a voice recognition algorithm based on a Deep Neural Network (DNN), a voice recognition algorithm based on a long-short term memory artificial neural network (LSTM), or the like.
The first operation instruction may include only operation types, for example: page turning, deleting, adding, opening, closing, adding, decreasing, and the like; the first operation instruction may also include an operation type and an operation object, for example: turning on the display screen 1, deleting the lamp 1, clearing the display screen 2 and the like.
S17, generating a second operation instruction according to the first operation instruction and the alternative operation object; the operation type of the second operation instruction is obtained according to the operation type of the first operation instruction; and the operation object of the second operation instruction is obtained according to the alternative operation object, or the alternative operation object and the operation object of the first operation instruction.
Specifically, when the first operation instruction only includes an operation type, the operation type of the second operation instruction is the same as the operation type of the first operation instruction, and the operation object of the second operation instruction refers to one operation object, which is matched with the operation type of the second operation instruction, in the candidate operation objects. For example, if the candidate operation object includes a key 1, a lamp 1, a display screen 1 and a push rod 1, the operation type of the second operation instruction is "press down"; at this time, since the operation type "press" is matched only to the operation object of the "key" type, the operation object matched to the operation type of the second operation instruction is "key 1", and thus it is understood that the second operation instruction is "key 1 press".
When the first operation instruction includes both the operation type and the operation object, if the operation object of the first operation instruction includes a plurality of operation objects, the operation object of the second operation instruction is obtained according to an intersection of the operation object of the first operation instruction and the candidate operation object. For example: the operating object of the first operating instruction is a 'push rod', and a specific operating object is difficult to determine through the first operating instruction due to the fact that the stage light console comprises a plurality of push rods; at this time, if the candidate operation object includes the key 1, the lamp 1, the display screen 1, and the push rod 1, it may be confirmed that the operation object of the second operation instruction is the push rod 1.
It should be noted that the first operation instruction and the second operation instruction are both operation instructions for the stage lighting console, and they are not different in nature.
And S18, operating the stage lighting console according to the second operation instruction.
As can be seen from the above description, the stage lighting console operation method according to this embodiment displays different operation objects by using different display screens, and obtains a target display screen and its alternative operation objects according to the sight information of a user; in addition, the stage lighting console operation method also obtains a first operation instruction according to the control voice of the user. On the basis, the stage lighting console operation method generates a second operation instruction according to the alternative operation object and the first operation instruction, and completes the operation of the stage lighting console according to the second operation instruction. Therefore, the stage lighting console operation method can complete the operation of the stage lighting console according to the sight information and the control voice of the user, is convenient for the user to operate the display screen, the push rod and/or the keys at different positions, and is high in operation efficiency.
In an embodiment of the present invention, the gaze information of the user includes a gaze focus of the user; the implementation method for acquiring the alternative operation object in the target display screen comprises the following steps: acquiring a sight focus of a user; and acquiring an operation object corresponding to the icon near the sight focus as the candidate operation object. The icons near the sight-line focus may be all icons in a circular range centered on the sight-line focus, or may be all icons in a geometric figure including the sight-line focus.
If the types of all the operation objects included in the candidate operation objects are different, the operation object of the second operation instruction may be obtained by matching the operation type in the second operation instruction and/or the operation object of the first operation instruction, for example: when the operation type in the second operation instruction is "push-up", the operation object is necessarily the push rod in the candidate operation object.
If the candidate operation objects comprise 2 or more operation objects with the same type, screening the candidate operation objects according to the distance between the candidate operation objects and the sight focus of the user, wherein the number of any type of operation objects in the screened candidate operation objects is 1; specifically, each type retains only one operation object closest to the user's gaze focus. For example, if the candidate operation object includes a key 1, a key 2, and a push rod 1, and the distance from the key 1 to the sight line focus is greater than the distance from the key 2 to the sight line focus, the candidate operation object only retains the key 2 and the push rod 1.
In this embodiment, the selection of the operation object of the second operation instruction is realized by matching the sight line information of the user with the control voice of the user, so that the selection process is greatly simplified compared with a mode of selecting the operation object only by eye movement or a voice instruction, and the operation efficiency of the stage lighting console is improved. In addition, the type of the second operation instruction can be obtained by controlling voice, and a user does not need to finish selection of the operation type through movement and staring of eyeballs, so that the operation efficiency of the stage lighting console is further improved.
Referring to fig. 3, in an embodiment of the present invention, an implementation method for acquiring gaze information of a user includes:
s121, obtaining eyeball information of a user by utilizing at least 2 eyeball tracking devices; wherein the positions of different eye tracking devices differ from each other. Preferably, the number of the eye tracking devices is the same as the number of the display screens, and one eye tracking device is arranged around each display screen. The eyeball information includes eyeball size, iris position, iris size, iris angle, and/or the like.
And S122, obtaining the sight line information of the user according to the eyeball information obtained by different eyeball tracking devices. Because the positions of different eye tracking devices are different, the eye information acquired by each eye tracking device is also different. The gaze direction, the gaze time, and the gaze focal point of the user can be obtained by comprehensively considering eyeball information obtained by different eyeball tracking devices, and the gaze direction, the gaze time, and the gaze focal point are the gaze information of the user in this embodiment. The method for obtaining the sight line information of the user according to the eyeball information of the user can be obtained by adopting the existing eyeball tracking technology, and the specific method is not described herein any more.
Referring to fig. 4A, in an embodiment of the present invention, the eye tracking device is a camera; one implementation method for acquiring eyeball information of a user by utilizing at least 2 eyeball tracking devices comprises the following steps:
s1211a, at least 2 facial images of the user are acquired with the at least 2 cameras. Wherein the facial image includes an eye image of the user, more specifically, an eyeball image and an iris image of the user.
S1212a, processing the facial image by using a deep learning model to obtain eyeball information of the user. The deep learning model is a trained deep learning model, and only 1 facial image can be processed each time, or 2 or more facial images can be processed each time.
In this embodiment, the method for training the deep learning model includes: step 1, acquiring first training data; the first training data includes a face image and eyeball information corresponding to the face image; the eyeball information corresponding to the face image can be obtained by manual labeling of a user. Step 2, training the deep learning model by using the first training data; step 2 may be implemented by using an existing training method, which is not described herein.
And after the deep learning model is trained, taking the face image as the input of the deep learning model, wherein the output of the deep learning model is the eyeball information of the user.
In an embodiment of the present invention, the eye tracking device is an infrared device, wherein the infrared device includes a transmitting module and a receiving module, such as an infrared eye sensor. Referring to fig. 4B, in this embodiment, an implementation method for acquiring eyeball information of a user by using at least 2 eyeball tracking devices includes:
s1211b, emitting infrared light by using a sending module of the infrared device; the infrared light is emitted after reaching the eyeball of the user to form emitted light. Preferably, the infrared ray is a bundle of rays consisting of a plurality of rays.
S1212b, receiving the reflected light by using a receiving module of the infrared device.
S1213b, the reflected light is processed to obtain eyeball information of the user. Specifically, the information such as the eyeball size, the iris position, the iris size or the iris angle of the user can be acquired according to the angle, the intensity, the spatial distribution and/or the arrival time of the reflected light.
In an embodiment of the present invention, after obtaining the candidate operation object in the target display screen, the stage lighting console operation method further includes: and highlighting the alternative operation object in the target display screen. For example, the current candidate operation object may be prompted to the user by enlarging or highlighting an icon of the candidate operation object, so as to assist the user in emitting the corresponding control voice.
Referring to fig. 5A, in an embodiment of the present invention, an implementation method for obtaining a first operation instruction according to a control voice of a user includes:
s161, performing feature extraction on the control voice of the user to obtain a feature vector corresponding to the control voice of the user. Specifically, the purpose of feature extraction is to extract a component having recognizability from the control speech of the user and remove the rest of irrelevant information such as background noise, emotion, and the like; the method for extracting the feature of the control speech can be implemented by using an existing speech signal feature extraction algorithm, for example, a feature extraction algorithm based on Mel Frequency Cepstrum Coefficient (MFCC), linear prediction analysis, and the like.
And S162, processing the feature vector corresponding to the control voice of the user by utilizing a neural network model to obtain the phoneme corresponding to the feature vector. Wherein, the phone is the minimum voice unit divided according to the natural attribute of the voice, and is analyzed according to the pronunciation action in the syllable, and one action constitutes one phone. More specifically, phonemes are classified into two broad categories, namely vowels and consonants. In this embodiment, the feature vector is used as an input of the neural network model, and an output of the neural network model is a phoneme corresponding to the feature vector.
S163, using an operation instruction dictionary to obtain the operation type and/or operation object corresponding to the phoneme, and further obtain the first operation instruction. The operation instruction dictionary comprises a plurality of words, and each word corresponds to an operation type or an operation object. The operation instruction dictionary is generated according to the operation types and operation objects commonly used in the operation process of the stage light console, and comprises words and phonemes matched with the words. The operation instruction dictionary can be written manually, and can also be generated and maintained in the modes of artificial intelligence, big data and the like. In this step, words matched with the phonemes can be obtained from the operation instruction dictionary according to the phonemes corresponding to the feature vectors; and then, acquiring an operation type or an operation object corresponding to the word, and further acquiring the first operation instruction.
Referring to fig. 5B, in the present embodiment, the method for training the neural network model includes:
s51, acquiring a first control voice of the user; the first control voice refers to a control voice used for training a neural network model. The first control voice comprises user voice corresponding to operation instructions of a large number of stage lamp light control consoles.
And S52, performing feature extraction on the first control voice to obtain a feature vector corresponding to the first control voice.
And S53, acquiring the phoneme of the first control voice.
And S54, acquiring second training data and training the neural network model by using the second training data. The method for implementing the training of the neural network model by using the second training data can be implemented by using a training method of an existing neural network model, and details are not repeated here.
In this embodiment, the first control voice used in training the neural network model includes user voice corresponding to an operation instruction of the stage lighting console, and the operation instruction dictionary is generated according to an operation type and an operation object commonly used in an operation process of the stage lighting console. Therefore, the embodiment can accurately acquire the operation instruction of the stage lighting console according to the control voice of the user, and is particularly suitable for the operation process of the stage lighting console.
Referring to fig. 6, in an embodiment of the invention, it is considered that the operating environment of the stage lighting console is often noisy, and the environment usually includes voices and noises of other people, which may affect the accuracy of the obtained first operation instruction. To solve this problem, in this embodiment, the implementation method for operating the stage lighting console according to the second operation instruction includes:
and S181, acquiring voiceprint information of the user according to the control voice of the user. Voiceprint (Voiceprint) is a spectrum of sound waves carrying verbal information displayed with an electro-acoustic instrument, which has characteristics of specificity and relative stability. The voiceprint of each user is different, so that the identity of the user can be identified through the voiceprint.
And S182, acquiring the operation authority of the user according to the voiceprint information of the user. For example, the operation authority of the stage lighting console may be only given to one user, and no other person has the operation authority. At this time, the operation authority of the user can be obtained according to the voiceprint information of the user.
And S183, when the user has the operation right matched with the second operation instruction, operating the stage lighting console according to the second operation instruction. Specifically, when the second operation instruction is from a user with an operation authority, the stage lighting console is operated according to the second operation instruction; otherwise, the second operation instruction is not executed to the stage lighting console.
In this embodiment, the voiceprint information of the user is processed to obtain the operation permission of the user, so as to determine whether the second operation instruction needs to be executed, and influence of control voice of other people on the operation of the stage lighting console can be avoided.
In an embodiment of the invention, it is considered that when a plurality of users watch the same screen or different screens at the same time, the sight information of the plurality of users is acquired in step S12, and further, the user without the operation authority may perform a misoperation on the stage lighting console. To solve this problem, the implementation method for operating the stage lighting console according to the second operation instruction in this embodiment includes:
acquiring face information of a user; wherein the face information of the user comprises the size of the face, the position information of the main facial organs and the like.
And carrying out face recognition on the user according to the face information of the user, and judging whether to execute the second operation instruction according to the face recognition result. Specifically, if the identified user has the operation authority matched with the second operation instruction, the stage lighting console is operated according to the second operation instruction; otherwise, the second operation instruction is not executed to the stage lighting console. The face recognition of the user according to the face information of the user can be implemented by using the existing method, which is not described herein again.
In an embodiment of the invention, the operation object includes a lamp, a display screen, a key and/or a push rod. Specifically, when the operation object is a lamp, the operation type includes setting a channel value, adding and/or deleting, and the like. When the operation object is a display screen, the operation type of the operation object comprises opening, closing, brightness adjustment and the like. When the operation object is a key, the operation type comprises lifting and pressing. When the operation object is a push rod, since the push rod can be continuously adjusted within a certain range, the adjustment range of the push rod can be divided into a plurality of sections: when the operation type of the push rod is pushing up, adjusting the position of the push rod to the previous section of the current position; when the operation type of the push rod is push-down, the position of the push rod is adjusted to the next stage of the current position.
Referring to fig. 7, in an embodiment of the present invention, the stage lighting console operating method includes:
and S71, acquiring the sight line information of the user by using the infrared eyeball sensor and/or the camera. The number of the infrared eyeball sensors and/or the cameras is preferably the same as the number of the display screens of the stage lighting console. The infrared eyeball sensor and/or the camera are/is arranged along the direction parallel to the stage lighting console.
S72, acquiring a target display screen according to the sight line information of the user, and acquiring the alternative operation object in the target display screen. For example, when the user gazes at the lamp list window a in the display screen 1, the acquired alternative operation objects include the display screen 1 and the lamp list window a. Preferably, the target display screen highlights the alternative operation object so as to prompt the operation object range at which the user is currently gazed.
S73, acquiring control voice of a user by using a microphone, and recognizing the control voice as a character command and then outputting the character command; wherein, the step S73 may implement the recognition of the control speech by using a neural network model implemented based on kaldi. In practical application, the neural network model is trained by adopting a large amount of labeled voice data, so that the recognition rate of the neural network model to the common Chinese and English words is more than 90%. Preferably, the neural network model is trained by using a large amount of specific voice data aiming at the stage lighting console operation instruction, so that the recognition rate of the neural network model to the stage lighting console operation instruction is more than 95%.
S74, acquiring a final complete operation instruction according to the alternative operation object and the operation instruction recognized by the voice in the step S73; the operation instruction is, for example: and deleting the lamp list window A, clearing the display screen 1 and the like.
And S75, operating the stage lighting console according to the complete operation instruction obtained in the step S74.
Based on the above description of the stage lighting console operating method, the present invention also provides a computer-readable storage medium having a computer program stored thereon. The computer program, when executed by the processor, implements the stage light console operating method of the present invention.
Based on the above description of the stage lighting console operation method, the present invention also provides a stage lighting console 800. Referring to fig. 8, in an embodiment of the present invention, the stage lighting console 800 includes: memory 810, processor 820, and at least 2 display screens 830. Wherein the memory 810 stores a computer program; the processor 820 is connected to the memory 810 in a communication manner, and executes the stage lighting console operation method according to the present invention when the computer program is called. The display screen 830 is communicatively connected to the memory 810 and the processor 820, and is configured to display at least 2 operation objects.
Optionally, the stage lighting console 800 further includes at least 2 eye tracking devices disposed thereon, and the eye tracking devices may be cameras or infrared devices; the eyeball tracking device is used for acquiring eyeball information of a user.
Optionally, the stage lighting console 800 further comprises a microphone for acquiring a control voice of the user.
The protection scope of the stage lighting console operation method according to the present invention is not limited to the execution sequence of the steps illustrated in this embodiment, and all the solutions implemented by adding, subtracting, and replacing the steps in the prior art according to the principles of the present invention are included in the protection scope of the present invention.
The stage lighting console operation method obtains a target display screen and obtains alternative operation objects according to sight information of a user; and the stage lighting console operation method acquires a first operation instruction according to the control voice of the user. On the basis, the stage lighting console operation method generates a second operation instruction according to the alternative operation object and the first operation instruction, and completes the operation of the stage lighting console according to the second operation instruction. Therefore, the stage lighting console operation method can complete the operation of the stage lighting console according to the sight information and the control voice of the user, is convenient for the user to operate the display screen, the push rod and/or the keys at different positions, and has high operation efficiency.
In some preferred schemes of the stage lighting console operation method, when the eyes of the user sweep over each object, the corresponding object highlights a prompt (such as highlight), the user obtains automatic interface feedback, and the experience is good; the user sees the operation object, and the operation object is visual and convenient; and the voice operation is combined, so that the speed is higher, the efficiency is higher and the experience is better. And the authority is filtered through voice voiceprint recognition, so that the operation is safer.
In conclusion, the present invention effectively overcomes various disadvantages of the prior art and has high industrial utilization value.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Any person skilled in the art can modify or change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (10)
1. The stage lighting console operation method is applied to a stage lighting console, and comprises the following steps:
displaying at least 2 operation objects by using different display screens of the stage lighting console;
acquiring sight line information of a user;
determining a target display screen according to the sight line information of the user;
acquiring an alternative operation object in the target display screen;
acquiring a control voice of a user;
acquiring a first operation instruction according to the control voice of the user; the first operation instruction comprises an operation type or comprises an operation type and an operation object;
generating a second operation instruction according to the first operation instruction and the alternative operation object; the operation type of the second operation instruction is obtained according to the operation type of the first operation instruction; the operation object of the second operation instruction is obtained according to the alternative operation object, or the alternative operation object and the operation object of the first operation instruction are obtained;
and operating the stage lighting console according to the second operation instruction.
2. A stage light console operating method according to claim 1, characterized in that the implementation method of obtaining the sight line information of the user comprises:
acquiring eyeball information of a user by utilizing at least 2 eyeball tracking devices; wherein the positions of different eye tracking devices are different;
and obtaining the sight line information of the user according to the eyeball information obtained by different eyeball tracking devices.
3. A stage light console operating method according to claim 2, wherein one implementation of obtaining eye information of a user using at least 2 eye tracking devices comprises:
the eyeball tracking equipment is a camera;
acquiring at least 2 facial images of a user by using at least 2 cameras;
and processing the facial image by using a deep learning model to acquire eyeball information of the user.
4. A stage light console operating method according to claim 2, wherein one implementation of obtaining eye information of a user using at least 2 eye tracking devices comprises:
the eyeball tracking device is an infrared device;
sending out infrared light by using a sending module of the infrared equipment; the infrared light is reflected after reaching the eyeball of the user to form reflected light;
receiving the reflected light by using a receiving module of the infrared equipment;
and processing the reflected light to acquire eyeball information of the user.
5. A stage light console operating method according to claim 1, characterized in that after acquiring the alternative operation object in the target display screen, the stage light console operating method further comprises:
and highlighting the alternative operation object in the target display screen.
6. A stage lighting console operation method according to claim 1, wherein the implementation method for obtaining the first operation instruction according to the control voice of the user comprises:
carrying out feature extraction on the control voice of the user to obtain a feature vector corresponding to the control voice of the user;
processing a feature vector corresponding to the control voice of the user by utilizing a neural network model to obtain a phoneme corresponding to the feature vector;
acquiring an operation type and/or an operation object corresponding to the phoneme by using an operation instruction dictionary, and further acquiring the first operation instruction; the operation instruction dictionary comprises a plurality of words and phonemes corresponding to the words, and each word corresponds to one operation type or operation object.
7. A stage light console operating method according to claim 1, characterized in that the implementation method of operating the stage light console according to the second operating instruction comprises:
acquiring voiceprint information of the user according to the control voice of the user;
acquiring the operation authority of the user according to the voiceprint information of the user;
and when the user has the operation right matched with the second operation instruction, operating the stage lighting console according to the second operation instruction.
8. A stage light console operating method according to claim 1, characterized in that: the operation object comprises a lamp, a display screen, a key and/or a push rod.
9. A computer-readable storage medium having stored thereon a computer program, characterized in that: the computer program, when executed by a processor, implements the stage light console operating method of any of claims 1-8.
10. A stage lighting console, characterized in that, stage lighting console includes:
a memory storing a computer program;
a processor, communicatively coupled to the memory, that executes the stage light console operating method of any of claims 1-8 when the computer program is invoked;
and the at least 2 display screens are in communication connection with the memory and the processor and are used for displaying at least 2 operation objects.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010911579.2A CN111984125A (en) | 2020-09-02 | 2020-09-02 | Stage lighting console operation method, medium and stage lighting console |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010911579.2A CN111984125A (en) | 2020-09-02 | 2020-09-02 | Stage lighting console operation method, medium and stage lighting console |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111984125A true CN111984125A (en) | 2020-11-24 |
Family
ID=73447964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010911579.2A Pending CN111984125A (en) | 2020-09-02 | 2020-09-02 | Stage lighting console operation method, medium and stage lighting console |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111984125A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040193413A1 (en) * | 2003-03-25 | 2004-09-30 | Wilson Andrew D. | Architecture for controlling a computer using hand gestures |
| CN1694043A (en) * | 2004-04-29 | 2005-11-09 | 国际商业机器公司 | System and method for selecting and activating a target object using a combination of eye gaze and key presses |
| CN105554987A (en) * | 2016-01-30 | 2016-05-04 | 广州彩熠灯光有限公司 | Control system and control method for 3D visualization and gesture adjustment stage lamp |
| US20200050280A1 (en) * | 2018-08-10 | 2020-02-13 | Beijing 7Invensun Technology Co., Ltd. | Operation instruction execution method and apparatus, user terminal and storage medium |
-
2020
- 2020-09-02 CN CN202010911579.2A patent/CN111984125A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20040193413A1 (en) * | 2003-03-25 | 2004-09-30 | Wilson Andrew D. | Architecture for controlling a computer using hand gestures |
| CN1694043A (en) * | 2004-04-29 | 2005-11-09 | 国际商业机器公司 | System and method for selecting and activating a target object using a combination of eye gaze and key presses |
| CN105554987A (en) * | 2016-01-30 | 2016-05-04 | 广州彩熠灯光有限公司 | Control system and control method for 3D visualization and gesture adjustment stage lamp |
| US20200050280A1 (en) * | 2018-08-10 | 2020-02-13 | Beijing 7Invensun Technology Co., Ltd. | Operation instruction execution method and apparatus, user terminal and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 范君艳等编著: "网络与信息安全基础", 北京理工大学出版社, pages: 140 - 149 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110211563B (en) | Chinese speech synthesis method, device and storage medium for scenes and emotion | |
| US11848000B2 (en) | Transcription revision interface for speech recognition system | |
| US11361751B2 (en) | Speech synthesis method and device | |
| US11854550B2 (en) | Determining input for speech processing engine | |
| JP3476006B2 (en) | Command boundary identification device, method and program storage device | |
| EP0974141B1 (en) | Extensible speech recognition system that provides a user with audio feedback | |
| KR20110095236A (en) | Multimodal unification of articulation for device interfacing | |
| RU2684475C2 (en) | Modification of visual content to facilitate improved speech recognition | |
| KR101819458B1 (en) | Voice recognition apparatus and system | |
| US11568853B2 (en) | Voice recognition method using artificial intelligence and apparatus thereof | |
| KR20080086791A (en) | Feeling recognition system based on voice | |
| KR20210155401A (en) | Speech synthesis apparatus for evaluating the quality of synthesized speech using artificial intelligence and method of operation thereof | |
| KR20210042523A (en) | An electronic apparatus and Method for controlling the electronic apparatus thereof | |
| US11900931B2 (en) | Information processing apparatus and information processing method | |
| Riad et al. | Signsworld; deeping into the silence world and hearing its signs (state of the art) | |
| KR102557092B1 (en) | Automatic interpretation and translation and dialogue assistance system using transparent display | |
| CN111984125A (en) | Stage lighting console operation method, medium and stage lighting console | |
| KR20210029354A (en) | Electronice device and control method thereof | |
| CN113990351A (en) | Sound correction method, sound correction device and non-transient storage medium | |
| WO2020116001A1 (en) | Information processing device and information processing method | |
| Kowshik et al. | Assistance For Visually Impaired Using Finger-Tip Text Reader Using Machine Learning | |
| Gorniak et al. | Augmenting user interfaces with adaptive speech commands | |
| Kaki | Mouse cursor's movements using voice controlled mouse pointer | |
| US20230386491A1 (en) | Artificial intelligence device | |
| JP7155676B2 (en) | Naming support device, robot, naming support method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |