CN112817451B - Multi-target positioning method and device based on steady-state visual evoked potential - Google Patents
Multi-target positioning method and device based on steady-state visual evoked potential Download PDFInfo
- Publication number
- CN112817451B CN112817451B CN202110118305.2A CN202110118305A CN112817451B CN 112817451 B CN112817451 B CN 112817451B CN 202110118305 A CN202110118305 A CN 202110118305A CN 112817451 B CN112817451 B CN 112817451B
- Authority
- CN
- China
- Prior art keywords
- target
- visual
- sequence
- visual stimulation
- feedback signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 331
- 238000000034 method Methods 0.000 title claims abstract description 101
- 230000000763 evoking effect Effects 0.000 title claims abstract description 36
- 230000000638 stimulation Effects 0.000 claims abstract description 210
- 108010076504 Protein Sorting Signals Proteins 0.000 claims abstract description 98
- 108091026890 Coding region Proteins 0.000 claims abstract description 67
- 230000009471 action Effects 0.000 claims description 29
- 238000004590 computer program Methods 0.000 claims description 13
- 230000004807 localization Effects 0.000 claims description 7
- 230000009269 systemic vascular permeability Effects 0.000 claims 1
- 230000000694 effects Effects 0.000 abstract description 17
- 230000000875 corresponding effect Effects 0.000 description 65
- 230000008569 process Effects 0.000 description 26
- 238000010586 diagram Methods 0.000 description 9
- 238000005516 engineering process Methods 0.000 description 9
- 210000004556 brain Anatomy 0.000 description 8
- 238000004891 communication Methods 0.000 description 5
- 238000012216 screening Methods 0.000 description 5
- 239000009891 weiqi Substances 0.000 description 5
- 230000004044 response Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000007177 brain activity Effects 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 238000012790 confirmation Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 210000002569 neuron Anatomy 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 230000004913 activation Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 210000003710 cerebral cortex Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001537 neural effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001242 postsynaptic effect Effects 0.000 description 1
- 210000004761 scalp Anatomy 0.000 description 1
- 238000002922 simulated annealing Methods 0.000 description 1
- 210000003625 skull Anatomy 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000004936 stimulating effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 210000000857 visual cortex Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F3/00—Board games; Raffle games
- A63F3/02—Chess; Similar board games
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to a multi-target positioning method based on steady-state visual evoked potentials, which comprises the following steps: acquiring a plurality of groups of first visual stimulation coding sequences; wherein each set of the first visual stimulus coding sequence corresponds to one of a plurality of first candidate locations, respectively; for each first candidate position, sending a first visual stimulation signal sequence according to each visual stimulation frequency in a first visual stimulation coding sequence corresponding to the current first candidate position; receiving a first target feedback signal sequence, and determining a corresponding first target visual stimulation coding sequence according to the frequency information of the received first target feedback signal sequence; determining a target location from the plurality of first candidate locations that matches the target user's gaze intent according to the first target visual stimulus encoding sequence. By adopting the method, the target position can be accurately positioned from a plurality of candidate positions in complex activities.
Description
Technical Field
The application relates to the technical field of brain-computer interfaces, in particular to a multi-target positioning method and device based on steady-state visual evoked potentials, a computer device and a storage medium.
Background
Since the "brain-computer interface" technology was introduced in the last 70 th century, through the development of the last half century, technical means, such as EEG (ElectroEncephaloGram), for capturing brain complex neural signals in real time and directly controlling external devices have appeared in the field of brain-computer interface technology. EEG is a method of recording brain activity using electrophysiological markers, in which the postsynaptic potentials generated simultaneously by a large number of neurons sum up during brain activity. It records the electrical wave changes during brain activity, which is a general reflection of the electrophysiological activity of brain neurons on the surface of the cerebral cortex or scalp.
Conventionally, EEG is widely used in spelling systems for people who cannot communicate with each other, in which a user visually targets a letter read by a computer, and information on the targeted object is transmitted back to the computer through EEG, thereby completing the reading of the letter. However, due to the low signal-to-noise ratio of the EEG signal, the information transfer rate is limited, typically around 1.0 bits/second. In this process, limited by the EEG detection efficiency and data transmission efficiency, the reading process of one letter is usually slow, and the reading difficulty is increased virtually.
In order to improve the transmission efficiency, SSVEP (Steady-State Visual Evoked Potentials) technology has been developed. SSVEP is the phenomenon that when subjected to a visual stimulus of a fixed frequency, the visual cortex of the human brain produces a continuous response that is related to the stimulus frequency (at the fundamental frequency or at multiples of the stimulus frequency).
The current SSVEP technology can process a small number of target objects and has limited application environments, such as keyboard typing. For the application requirements of multiple targets, the current SSVEP technology is insufficient, and cannot cope with application scenes of a large number of targets, such as playing chess. The reason for this is that chess activities usually involve more pieces and movement of pieces, which is far more complex than keyboard typing, and current SSVEP techniques cannot accurately handle such complex activities.
Disclosure of Invention
In view of the foregoing, it is desirable to provide a multi-objective positioning method, apparatus, computer device and storage medium based on steady-state visual evoked potentials, which can achieve multi-objective accurate positioning.
A multi-target positioning method based on steady-state visual evoked potentials, the method comprising:
acquiring a plurality of groups of first visual stimulation coding sequences; wherein each group of the first visual stimulus coding sequence respectively corresponds to one of the first candidate positions, and each group of the first visual stimulus coding sequence comprises at least two visual stimulus frequencies;
for each first candidate position, sending a first visual stimulation signal sequence according to each visual stimulation frequency in a first visual stimulation coding sequence corresponding to the current first candidate position;
receiving a first target feedback signal sequence, wherein each first target feedback signal in the first target feedback signal sequence is correspondingly sent out after a target user watches each first visual stimulation signal in the first visual stimulation signal sequence;
determining a corresponding target visual stimulation frequency sequence according to the received frequency information of the first target feedback signal sequence, and determining a corresponding first target visual stimulation coding sequence based on the target visual stimulation frequency sequence;
determining a target location from the plurality of first candidate locations that matches the target user's gaze intent according to the first target visual stimulus encoding sequence.
In one embodiment, obtaining multiple sets of first visual stimulus encoding sequences comprises:
selecting at least two visual stimulation frequencies with frequency intervals not smaller than an interval threshold value to form a basic code element set;
selecting a plurality of subsets from the basic code element set to form a coding set, wherein the number of the subsets in the coding set is not less than the number of the first candidate positions, and each subset forms a group of first visual stimulation coding sequences.
In one embodiment, the method further comprises:
calculating the distance between any two subsets in the coding set;
selecting a plurality of coding subsets which are equal to the number of the first candidate positions from the coding set according to the distance;
associating each of the encoded subsets with one of the first candidate locations, respectively.
In one embodiment, after determining a target location from the plurality of first candidate locations that matches the target user's gaze intent based on the first target visual stimulus encoding sequence, the method further comprises:
executing a corresponding preset task based on the target position; the preset task is an action sequence which is expected to be completed by a target user at the target position.
In one embodiment, after executing the corresponding preset task based on the target position, the method further includes:
acquiring a plurality of groups of second visual stimulation coding sequences; wherein each group of the second visual stimulus coding sequence respectively corresponds to one of a plurality of second candidate locations, and each group of the second visual stimulus coding sequence comprises at least one visual stimulus frequency;
for each second candidate position, sending a second visual stimulation signal sequence according to each visual stimulation frequency in a second visual stimulation coding sequence corresponding to the current second candidate position;
and receiving a second target feedback signal sequence, wherein each second target feedback signal in the second target feedback signal sequence is correspondingly sent out after a target user watches each second visual stimulation signal in the second visual stimulation signal sequence, and is used for indicating that the target positioning is finished after the current action sequence is executed, or indicating that the target positioning is carried out again.
In one embodiment, after receiving the second target feedback signal, the method further comprises:
when the received second target feedback signal sequence indicates that the execution of the current action sequence is finished, marking the execution of the current action sequence to be finished, and starting a next task period or finishing multi-target positioning;
and when the received second target feedback signal sequence indicates that the target positioning is carried out again, re-receiving the first target feedback signal sequence for carrying out the target positioning, and executing a corresponding preset task according to the positioning result.
In one embodiment, the visual stimulus frequency ranges between 5Hz to 30 Hz.
A multi-target localization apparatus based on steady-state visual evoked potentials, the apparatus comprising:
the coding module is used for acquiring a plurality of groups of first visual stimulation coding sequences; wherein each group of the first visual stimulus coding sequence respectively corresponds to one of a plurality of first candidate positions, and each group of the first visual stimulus coding sequence comprises at least two visual stimulus frequencies;
the stimulation module is used for sending a first visual stimulation signal sequence to each first candidate position according to each visual stimulation frequency in a first visual stimulation coding sequence corresponding to the current first candidate position;
the receiving module is used for receiving a first target feedback signal sequence, wherein each first target feedback signal in the first target feedback signal sequence is correspondingly sent out after a target user watches each first visual stimulation signal in the first visual stimulation signal sequence;
the determining module is used for determining a corresponding target visual stimulation frequency sequence according to the received frequency information of the first target feedback signal sequence and determining a corresponding first target visual stimulation coding sequence based on the target visual stimulation frequency sequence;
and the positioning module is used for determining a target position matched with the gazing intention of the target user from the plurality of first candidate positions according to the first target visual stimulus coding sequence.
A computer device comprising a memory and a processor, the memory storing a computer program, the processor implementing the following steps when executing the computer program:
acquiring a plurality of groups of first visual stimulation coding sequences; wherein each group of the first visual stimulus coding sequence respectively corresponds to one of the first candidate positions, and each group of the first visual stimulus coding sequence comprises at least two visual stimulus frequencies;
for each first candidate position, sending a first visual stimulation signal sequence according to each visual stimulation frequency in a first visual stimulation coding sequence corresponding to the current first candidate position;
receiving a first target feedback signal sequence, wherein each first target feedback signal in the first target feedback signal sequence is correspondingly sent out after a target user watches each first visual stimulation signal in the first visual stimulation signal sequence;
determining a corresponding target visual stimulation frequency sequence according to the received frequency information of the first target feedback signal sequence, and determining a corresponding first target visual stimulation coding sequence based on the target visual stimulation frequency sequence;
determining a target location from the plurality of first candidate locations that matches the target user's gaze intent according to the first target visual stimulus encoding sequence.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of:
acquiring a plurality of groups of first visual stimulation coding sequences; wherein each group of the first visual stimulus coding sequence respectively corresponds to one of the first candidate positions, and each group of the first visual stimulus coding sequence comprises at least two visual stimulus frequencies;
for each first candidate position, sending a first visual stimulation signal sequence according to each visual stimulation frequency in a first visual stimulation coding sequence corresponding to the current first candidate position;
receiving a first target feedback signal sequence, wherein each first target feedback signal in the first target feedback signal sequence is correspondingly sent out after a target user watches each first visual stimulation signal in the first visual stimulation signal sequence;
determining a corresponding target visual stimulation frequency sequence according to the received frequency information of the first target feedback signal sequence, and determining a corresponding first target visual stimulation coding sequence based on the target visual stimulation frequency sequence;
determining a target location from the plurality of first candidate locations that matches the target user's gaze intent according to the first target visual stimulus encoding sequence.
According to the multi-target positioning method, the device, the computer equipment and the storage medium based on the steady-state visual evoked potentials, a plurality of first candidate positions are respectively marked through a plurality of groups of first visual stimulation coding sequences, and each first candidate position corresponds to one first visual stimulation coding sequence; for each first candidate position, sequentially sending a first visual stimulation signal according to a first visual stimulation coding sequence corresponding to the current first candidate position; when a target user watches a specific first candidate position, a first target feedback signal is correspondingly sent out, and the specific first candidate position watched by the target user can be determined through a frequency sequence corresponding to the received first target feedback signal. By the method, the first candidate position determined by the target user can be accurately known under the condition of a plurality of targets. Based on the technology, the target user can realize multi-target accurate positioning, and then complete a series of complex operations, such as playing chess (including but not limited to go, chess, gobang and the like) based on the multi-target positioning method based on the steady-state visual evoked potential, or other similar complex activities requiring multi-target processing.
Drawings
FIG. 1 is a diagram of an embodiment of an application environment for a multi-objective localization method based on steady-state visual evoked potentials;
FIG. 2 is a schematic flow chart diagram illustrating a multi-objective localization method based on steady-state visual evoked potentials in one embodiment;
FIG. 3 is a schematic diagram of an interface for playing Weiqi according to an embodiment of the multi-objective steady-state visual evoked potential based positioning method;
FIG. 4 is a schematic diagram of an interface for playing Weiqi according to an embodiment of the multi-objective steady-state visual evoked potential based positioning method;
FIG. 5 is a schematic diagram illustrating an interface of an embodiment of a multi-objective steady-state visual evoked potential-based positioning method for playing Weiqi;
FIG. 6 is a schematic flow chart illustrating an embodiment of a multi-objective positioning method based on steady-state visual evoked potentials for playing chess;
FIG. 7 is a block diagram of a multi-target localization apparatus based on steady-state visual evoked potentials in one embodiment;
FIG. 8 is a diagram illustrating an internal structure of a computer device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
The multi-target positioning method based on the steady-state visual evoked potential can be applied to the application environment shown in fig. 1. The display 102 and the server 104 may communicate with each other, the target user 106 may receive a visual stimulation signal sent by the display 102, and the target user 106 may correspondingly send a feedback signal, such as a brain wave, based on the visual stimulation signal sent by the target position to be selected, which is watched by the target user 106; the feedback signal collecting device 108 may be disposed at a designated location of the brain of the user to collect the feedback signal, then the feedback signal collecting device 108 sends the collected feedback signal to the server 104, the server 104 confirms, according to the received feedback signal, the target location to be selected watched by the target user 106 in the application environment, the display 102 may be implemented by an LED display screen, a liquid crystal display screen, or other structures or devices that can emit visual stimulation signals with specific frequencies, the server 104 may be implemented by an independent server or a server cluster formed by a plurality of servers, and the feedback signal collecting device 108 may be a sensor or an electric wave collecting device, etc.
The present application is a scheme obtained by improving some problems existing in the above scenario. Before describing the multi-target positioning method based on steady-state visual evoked potential in the present application, taking chess as an example, the following explanations will be made for some terms involved in the embodiments of the present application:
basic code element: several independent signal frequencies capable of stimulating the human brain to send corresponding feedback signals, such as any signal frequency in the range of 5 Hz-30 Hz.
Visual stimulus coding sequence: the target user can correspondingly send a feedback signal after watching and receiving the visual stimulation signal corresponding to each visual stimulation frequency, and the target user can correspondingly send different feedback signal sequences based on different visual stimulation coding sequences.
Candidate positions: a plurality of positions selectable by the target user, for example positions in the board where each can fall.
Visual stimulus signal: the visual stimulation signal corresponds to the visual stimulation frequency and is sent out according to the visual stimulation frequency, the visual stimulation signal is sent out through the display, and the target user receives the visual stimulation signal through watching and correspondingly sends out a target feedback signal.
Target feedback signal: the target user determines the selected target position through visual fixation, for example, the position of the target user who wants to fall is determined through visual fixation, and a target feedback signal is correspondingly sent out based on the received visual stimulation signal.
Target visual stimulus frequency: and corresponding to the target feedback signals, each visual stimulation frequency corresponds to one visual stimulation signal, the target user sends out the target feedback signals according to the received visual stimulation signals, and the corresponding target visual stimulation frequency is determined according to the target feedback signals.
Target position: the candidate position corresponding to the first visual stimulation coding sequence determined according to the target visual stimulation frequency sequence is also the position watched by the target user, for example, the position where the target user wants to fall in the chess game.
Presetting a task: the target user obtains a preset action to be executed after obtaining the target position, such as a dropping action after determining a playing position in a game, or an action of selecting a certain target position to execute 'confirmation' or 'repent' in the playing process.
In one embodiment, as shown in fig. 2, a multi-objective positioning method based on steady-state visual evoked potentials is provided, which is illustrated by applying the method to the server in fig. 1, and comprises the following steps:
step S202, acquiring a plurality of groups of first visual stimulation coding sequences; each group of first visual stimulation coding sequences respectively corresponds to one first candidate position in the plurality of first candidate positions, and each group of first visual stimulation coding sequences comprises at least two visual stimulation frequencies.
Specifically, in this embodiment, the server distinguishes the plurality of candidate positions by using a first visual stimulus coding sequence, where each first visual stimulus coding sequence includes at least two visual stimulus frequencies, and the purpose of the server is to ensure the diversity of codes to meet the coding requirements of the plurality of first candidate positions.
Taking chess activities as an example, as shown in fig. 3, there are 19 × 19 — 361 points that can be dropped on the whole chessboard of the go, and the target user needs to select one target position from the 361 candidate positions as a dropping point, so each candidate position needs to be distinguished from other candidate positions to ensure the uniqueness of the target position. For activities with fewer targets, such as chess, with relatively few drop points, the required first visual stimulus encoding sequence may also be correspondingly reduced.
Step S204, for each first candidate position, a first visual stimulation signal sequence is sent according to each visual stimulation frequency in the first visual stimulation coding sequence corresponding to the current first candidate position.
Specifically, in order to enable a target user to realize positioning by watching a certain candidate position on a display, the server correspondingly sets a first visual stimulation coding sequence for each candidate position, and when the target user needs to watch the positioning, the server correspondingly sends out a visual stimulation signal sequence through the display.
Suppose that for a candidate position P, the corresponding first visual stimulus encoding sequence comprises four frequencies, which are f1、f2、f3And f4Then at the candidate position P the display correspondingly emits a stimulus signal sequence consisting of stimulus signal 1, stimulus signal 2, stimulus signal 3 and stimulus signal 4, and f1、f2、f3And f4The stimulus signals 1, 2, 3, and 4 correspond in order. I.e. the frequency of the stimulus signal 1 is f1The frequency of the stimulus signal 2 is f2… … and so on.
In one embodiment, the visual stimulation signal sequence received by the target user comes from the display, and when a plurality of candidate positions need to transmit the first visual stimulation signal sequence according to the visual stimulation frequency in the first visual stimulation coding sequence, the process can be realized through the stimulation unit corresponding to each candidate position on the display. Specifically, a stimulation unit is correspondingly arranged for each candidate position, if the current candidate position is a target position which can be selected by a target user, the stimulation unit is activated, and the stimulation unit correspondingly sends a first visual stimulation signal sequence through the display according to the visual stimulation frequency in the first visual stimulation coding sequence corresponding to the current candidate position provided by the server. As shown in fig. 4, a white square disposed at each position where the person can fall is a stimulation unit.
In the chess playing process, when the target user selects the position of the falling piece, the stimulation module corresponding to each candidate position capable of falling piece is activated to send a corresponding first visual stimulation signal sequence. And after the target position is selected, the currently activated stimulation module stops sending the first visual stimulation signal sequence and enters the next link. In the above process, the stimulation module remains inactive until receiving the next activation signal, and starts sending the first visual stimulation signal sequence again.
In one embodiment, the first candidate location periodically transmits the first visual stimulus signal sequence through the stimulus unit according to each visual stimulus frequency in the corresponding first visual stimulus encoding sequence. For example, a candidate location corresponds to a first visual stimulus encoding sequence of { f1，f2，f3，f4When visual positioning is performed, it is according to { f }1，f2，f3，f4Sending visual stimulation signals sequentially according to the frequency of the signals.
For example, during a complete visual stimulation cycle, the specific transmission process of the visual stimulation signal may be: waiting time t0Frequency of f1For a first visual stimulus signal duration of time t1Frequency of f2For a first visual stimulus signal duration of time t2Frequency of f3For a first visual stimulus signal duration of time t3Frequency of f4For a first visual stimulus signal duration of time t4. The waiting time includes visual delay and screen delay, and the duration of sending the visual stimulation signals corresponding to the visual stimulation frequencies may be equal or unequal. In order to enable the first visual stimulus signal sequence in the above method to be identified more accurately, a time interval t 'may also be set between any two adjacent visual stimulus signals in a visual stimulus signal sequence when each visual stimulus signal is transmitted, i.e. after the previous visual stimulus signal in a visual stimulus signal sequence is transmitted, a time interval t' is waited for, and then the next visual stimulus signal is transmitted. Therefore, the content, duration and sending period of each visual stimulation signal can ensure that the visual stimulation signal sequence sent by each candidate position can be accurately identified.
Step S206, receiving a first target feedback signal sequence, where each first target feedback signal in the first target feedback signal sequence is sent out correspondingly after the target user watches each first visual stimulation signal in the first visual stimulation signal sequence.
Specifically, for positioning, for example, determining a specific position for playing chess, the target user mainly focuses on a certain first candidate position, and since the first candidate position on the display sends a visual stimulation signal according to a corresponding first visual stimulation coding sequence, the visual stimulation signal includes a plurality of signals corresponding to the visual stimulation frequency in the first visual stimulation coding sequence. The brain of the target user can make corresponding feedback aiming at the visual stimulation signals received by the eyes, namely, corresponding feedback signals such as brain waves are sent out, and the server can correspondingly analyze the stimulation signals received by the target user after receiving the feedback signals.
For example, the first visual stimulus encoding sequence corresponding to the candidate position is { f1，f2，f3，f4And f, staring at the target position by the target user, wherein the receiving frequency is f1The target user correspondingly feeds back a stimulation signal 1 with a frequency f1'feedback signal 1'. According to the corresponding relation, the feedback signal received by the server is a feedback signal sequence composed of the feedback signal 1, the feedback signal 2, the feedback signal 3 and the feedback signal 4.
Step S208, determining a corresponding target visual stimulation frequency sequence according to the received frequency information of the first target feedback signal sequence, and determining a corresponding first target visual stimulation coding sequence based on the target visual stimulation frequency sequence.
Specifically, since there is a corresponding relationship between the frequency information of each feedback signal in the first target feedback signal sequence sent by the user and the frequency information of each stimulation signal in the first visual stimulation signal sequence received by the user by gazing at the target position, the server may determine the corresponding target visual stimulation frequency sequence according to the frequency information of the first target feedback signal sequence.
Step S210, according to the first target visual stimulus coding sequence, determining a target position matched with the gazing intention of the target user from a plurality of first candidate positions.
Specifically, based on the frequency information of the first target feedback signal sequence, the server may determine a target visual stimulus frequency sequence that the target user gazes at, and then, in combination with the correspondence between the first visual stimulus coding sequence and the candidate location, may determine a target location that the target user needs to determine by gazing at.
In the multi-target positioning method based on the steady-state visual evoked potential, a plurality of groups of first visual stimulus coding sequences are used for respectively marking a plurality of first candidate positions, and each first candidate position corresponds to one first visual stimulus coding sequence; for each first candidate position, sequentially sending a first visual stimulation signal according to a first visual stimulation coding sequence corresponding to the current first candidate position; when a target user watches a specific first candidate position, a first target feedback signal is correspondingly sent out, and the specific first candidate position watched by the target user can be determined through a frequency sequence corresponding to the received first target feedback signal. By the method, the first candidate position determined by the target user can be accurately known under the condition of a plurality of targets. Based on the technology, the target user can realize multi-target precise positioning, and then complete a series of complex operations, such as playing chess (including but not limited to go, chess, gobang and the like) based on the multi-target positioning method based on the steady-state visual evoked potential, or other similar complex activities needing to process multi-targets.
In one embodiment, a plurality of sets of first visual stimulus encoding sequences are obtained, the process comprising: selecting at least two visual stimulation frequencies with frequency intervals not smaller than an interval threshold value to form a basic code element set; and selecting a plurality of subsets from the basic code element set to form a coding set, wherein the number of the subsets in the coding set is not less than the number of the first candidate positions, and each subset forms a group of first visual stimulation coding sequences.
Specifically, in order to better ensure the quality of the received feedback signal, in the above embodiment, the server may filter out a plurality of visual stimulus frequencies that are easy to identify in advance as basic symbols before starting encoding, and the frequency interval between the visual stimulus frequencies is not less than the interval threshold, typically 1 Hz. Further, the server selects a plurality of different subsets with the number not less than the number of the candidate positions according to the number of the first candidate positions based on the basic code element to specifically code the plurality of candidate positions, so that each candidate position uniquely corresponds to one visual stimulation code sequence.
In the embodiment, the accuracy and the sensitivity of the multi-target positioning method based on the steady-state visual evoked potential can be further improved by screening the basic code elements before specific coding.
In one embodiment, the visual stimulus frequency ranges between 5Hz to 30 Hz.
In particular, due to the complexity of the human structure, the skull behaves as a low-pass filter giving a clearer feedback signal for stimulation signals with frequencies between 5Hz and 30 Hz. Further, in one embodiment, when the stimulation signal frequency is determined by the feedback signal frequency, the larger the difference between the frequencies, the better, and the threshold interval between the two visual stimulation frequencies is preferably not less than 1Hz, and beyond this value, although the frequency of the feedback signal can still be identified, the difficulty is greater, and the time is longer.
In the embodiment, the stimulation signal of the frequency band of 5Hz to 30Hz is adopted, so that the feedback signal can be clear and complete, and the accuracy of the method is improved.
In one embodiment, the method further comprises: calculating the distance between any two subsets in the coding set; selecting a plurality of code subsets which are equal to the number of the first candidate positions from the code set according to the distance; each of the encoded subsets is associated with a respective one of a plurality of first candidate locations.
In particular, for the basic symbol set composed of visual stimulation frequencies, the number of selectable subsets is large because of the large number of visual stimulation frequencies. For example, when eight visual stimulation frequencies of 8Hz, 9Hz, 10Hz, 11Hz, 12Hz, 13Hz, 14Hz, and 15Hz are used as basic symbols for the chessboard of go, if a subset of 3 visual stimulation frequencies is selected for encoding, there are 512 encoding schemes, and if a subset of 4 visual stimulation frequencies is selected for encoding, there are 4096 subsets. However, regardless of the subset of 3 visual stimulus frequencies or the subset of 4 visual stimulus frequencies, the number of subsets in the final constructed coding scheme should be larger than the number of candidate locations on the checkerboard. If the coding scheme corresponding to the subset consisting of 3 visual stimulus frequencies is adopted, at this time, because the go has only 361 candidate positions at most, the number of the required visual stimulus coding sequences is 361. In this case, 361 subsets of 512 subsets are selected to encode the positions of the weiqi candidates. If the coding scheme is corresponding to the subsets formed by 4 visual stimulation frequencies, 361 subsets are selected from 4096 subsets to code the candidate positions of the go. For the candidate positions in the go board, the subset consisting of 4 visual stimulation frequencies is adopted to code the candidate positions, and the method has the advantages that the Hamming distance between the coding sequences is larger, the obtained first target feedback signal sequence is identified more accurately, but the purpose of positioning multiple targets can be realized only by adopting the subset consisting of 3 visual stimulation frequencies to code the candidate positions. Further, in this embodiment, the selection problem of the coding sequence is regarded as a problem of seeking an optimal solution, and the subset required for coding each candidate position is the corresponding optimal solution. For example, when 361 solutions are selected from 512 solutions to encode a go board, 361 subsets (optimal solutions) with the minimum euclidean distance obtained by using two-norm calculation may be selected as specific encoding solutions, or 361 combinations of encoding sequences with the maximum euclidean distance may be obtained by using a simulated annealing algorithm as specific encoding solutions, where the different solving methods are used, and the obtained optimal solutions are not the same.
Therefore, the screened subsets are not completely the same based on the factors of different screening schemes, different numbers of visual stimulation frequencies included in each subset, and the like, and this embodiment does not specifically limit this, as long as the obtained subsets can make each first candidate position have a corresponding visual stimulation coding sequence.
In the above embodiment, the accuracy of the multi-target positioning method based on the steady-state visual evoked potential can be further improved by the double screening of the basic code elements and the subsets and the euclidean distance calculation based on the two normal forms.
In one embodiment, after determining a target location from the plurality of first candidate locations that matches the target user's gaze intent based on the first target visual stimulus encoding sequence, the method further comprises: executing a corresponding preset task based on the target position; the preset task is an action sequence which is expected to be completed by the target user at the target position.
Specifically, after the target user completes the target positioning according to the above method and the server obtains the target position watched by the target user, the server may execute the next preset action based on the target position, for example, in the above-mentioned example of playing chess, the target position determined by the target user is the position where the user wishes to perform the operation of falling, and after the target position is determined, the server may correspondingly execute the operation of falling and display the operation on the display. In a specific chess playing process, each target location is associated with a corresponding preset action, for example, for the chess playing process, a player on any side of the Chuhehan boundary selects a specific chess piece, such as 'pawn', and after a dropping position is selected, the corresponding action is necessarily to drop the chess piece at the specified position. This preset action is typically preset based on the activity of the application, such as a drop in a chess-playing activity.
In other application forms, the action may also be a preset sequence including a plurality of actions. This is not particularly limited in this embodiment.
In the above embodiment, the target user can complete a specific action sequence without other operations based on the target position, so that accurate control of complex activities is realized, and convenience and rapidness are achieved.
In one embodiment, after executing the corresponding preset task based on the target position, the method further includes: acquiring a plurality of groups of second visual stimulation coding sequences; each group of second visual stimulus coding sequences respectively corresponds to one second candidate position in the plurality of second candidate positions, and each group of second visual stimulus coding sequences comprises at least one visual stimulus frequency; for each second candidate position, sending a second visual stimulation signal sequence according to each visual stimulation frequency in a second visual stimulation coding sequence corresponding to the current second candidate position; and receiving a second target feedback signal sequence, wherein each second target feedback signal in the second target feedback signal sequence is correspondingly sent out after the target user watches each second visual stimulation signal in the second visual stimulation signal sequence, and is used for indicating and confirming that the target positioning is finished by executing the current action sequence or indicating and resetting the target.
In particular, since a complex activity may involve a plurality of positioning purposes, in the case of go, some positioning is intended to find a drop point and some positioning is intended to perform a specific sequence of actions associated with a specific target location, such as determining a drop or repentance. Wherein the target user needs to select one out of at most 361 candidate positions when determining the falling point, and only needs to select one out of several candidate positions when determining whether the current falling is completed. At this point, if the same coding scheme as the first visual stimulus coding sequence is continued, it takes a lot of time and is not necessary, and for this process, it is possible to change to a simpler coding scheme. As shown in fig. 5, after the executor selects the position where the chess needs to be played (finds the target position), further confirmation is needed, that is, the options of "select", "repent", "determine", "cancel", etc. above the interface, and after this process is completed, the current action of playing the chess by the executor can be completed formally, and the authority of playing the chess is transferred to other participating users.
Therefore, the server is correspondingly provided with different coding schemes for different positioning purposes, and for the purpose of determining whether the previous positioning process is completed, the server in the above embodiment is provided with a plurality of second visual stimulation coding sequences, and each second visual stimulation coding sequence corresponds to one of the second candidate positions. Positioning is accomplished based on the same principles as the method described previously. Meanwhile, the required visual stimulation frequency of the second visual stimulation coding sequence can be less than that of the first visual stimulation coding sequence, so that the length of the second visual stimulation signal sequence can be reduced, and the response efficiency of the second target feedback signal sequence is improved.
In the above embodiment, different positioning coding schemes are correspondingly set for different positioning purposes, so that the visual positioning response efficiency can be improved while the precise positioning of complex activities is ensured.
In one embodiment, after receiving the second target feedback signal, the method further includes: when the received second target feedback signal sequence indicates that the execution of the current action sequence is finished, marking that the execution of the current action sequence is finished, and starting a next task cycle or finishing multi-target positioning; and when the received second target feedback signal sequence indicates that the target positioning is carried out again, the first target feedback signal sequence is received again to carry out the target positioning, and a corresponding preset task is executed according to a positioning result.
Specifically, for the target user, the second target feedback signal sequence is used to indicate whether the purpose required to be achieved by the previous positioning process is completed, determined to be completed or not, if determined to be completed, the next link can be entered, and if not, the target user still needs to be repositioned. Still taking playing chess as an example, if the target user needs to confirm the falling point through the second visual stimulus coding sequence after obtaining the action of playing chess by the target position according to the first target feedback signal, at this time, the target user needs to confirm the above process through the second target feedback signal, that is, the second target feedback signal determines the corresponding second target position, so as to execute the corresponding action of confirming the falling or regrinding chess.
In the above embodiment, if an error occurs in the process of target location using the first visual stimulus coding sequence, or the target user wants to modify his own target location, it can still be accomplished by the second visual stimulus coding sequence and the second target feedback signal sequence, further improving the accuracy and adaptability of the above method.
It should be understood that, although the steps in the flowchart of fig. 2 are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not limited to being performed in the exact order illustrated and, unless explicitly stated herein, may be performed in other orders. Moreover, at least a portion of the steps in fig. 2 may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, which are not necessarily performed in sequence, but may be performed in turn or alternately with other steps or at least a portion of the other steps or stages.
FIG. 6 shows a specific embodiment of applying the multi-target positioning method based on steady-state visual evoked potential to the chess playing process. In this embodiment, since the play generally involves at least two players, the player who is the first player is prompted to select a drop according to the rules of play.
According to the different chess types, different processing flows are correspondingly arranged at the moment. Different positions of the chess pieces have different effects, so that the positions of the falling chess pieces are required to be distinguished, and meanwhile, the chess pieces are required to be distinguished. Since the chess is positioned on the chessboard, the positioning by the method aims to select a specific chess piece based on the candidate position, and after the chess piece is determined, the target position is determined from the optional dropping point by the method again. This is accomplished by a first visual stimulus encoding sequence in the method described above, and the child-drop point corresponds to a first candidate location in the method described above.
If the target user determines to put the current chess piece at the current target position, the target user determines to fall, judges whether the game is finished or not, exchanges the executive party if the game is not finished, and repeats the process until the game is finished. If the target user wants to regret, the process is reset, and the link of selecting the specific chess piece is entered again. This process is performed by the second visual stimulus code sequence in the above method, and the options such as "pick", "regret", "determine", "cancel" correspond to the second candidate position in the above method.
In the case of weiqi, the playing process is similar to that of chess except that the selection of pieces by the above method is not required. Similarly, the multi-target positioning method can also be applied to other chess types such as chess, gobang, Chinese checkers and the like.
In one embodiment, as shown in FIG. 7, there is provided a steady-state visual evoked potential based multi-target positioning apparatus 700, comprising: an encoding module 702, a stimulation module 704, a receiving module 706, a determining module 708, and a localization module 710, wherein:
a coding module 702, configured to obtain multiple groups of first visual stimulation coding sequences; each group of first visual stimulus coding sequences respectively corresponds to one first candidate position in the plurality of first candidate positions, and each group of first visual stimulus coding sequences comprises at least two visual stimulus frequencies;
a stimulation module 704, configured to send, for each first candidate position, a first visual stimulation signal sequence according to each visual stimulation frequency in the first visual stimulation coding sequence corresponding to the current first candidate position;
a receiving module 706, configured to receive a first target feedback signal sequence, where each first target feedback signal in the first target feedback signal sequence is sent out by a target user after watching each first visual stimulation signal in the first visual stimulation signal sequence;
a determining module 708, configured to determine a corresponding target visual stimulation frequency sequence according to the received frequency information of the first target feedback signal sequence, and determine a corresponding first target visual stimulation coding sequence based on the target visual stimulation frequency sequence;
and a positioning module 710 for determining a target location matching the target user's gaze intention from the plurality of first candidate locations according to the first target visual stimulus encoding sequence.
The multi-target positioning device based on the steady-state visual evoked potential marks a plurality of first candidate positions through a plurality of groups of first visual stimulation coding sequences, wherein each first candidate position corresponds to one first visual stimulation coding sequence; for each first candidate position, sequentially sending a first visual stimulation signal according to a first visual stimulation coding sequence corresponding to the current first candidate position; when a target user watches a specific first candidate position, a first target feedback signal is correspondingly sent out, and the specific first candidate position watched by the target user can be determined through a frequency sequence corresponding to the received first target feedback signal. By the method, the first candidate position determined by the target user can be accurately known under the condition of a plurality of targets. Based on the technology, the target user can realize multi-target precise positioning, and then complete a series of complex operations, such as playing chess (including but not limited to go, chess, gobang and the like) based on the multi-target positioning method based on the steady-state visual evoked potential, or other similar complex activities needing to process multi-targets.
In one embodiment, the encoding module is further configured to: selecting at least two visual stimulation frequencies with frequency intervals not smaller than an interval threshold value to form a basic code element set; and selecting a plurality of subsets from the basic code element set to form a coding set, wherein the number of the subsets in the coding set is not less than the number of the first candidate positions, and each subset forms a group of first visual stimulation coding sequences.
In the above embodiment, the accuracy and sensitivity of the multi-target positioning method based on steady-state visual evoked potentials can be further improved by screening the basic code elements before specific encoding.
In one embodiment, the encoding module is further configured to: calculating the distance between any two subsets in the coding set; selecting a plurality of code subsets which are equal to the number of the first candidate positions from the code set according to the distance; each of the encoded subsets is associated with a respective one of a plurality of first candidate locations.
In the above embodiments, the accuracy of the multi-target positioning method based on steady-state visual evoked potentials can be further improved by double screening of the basic symbols and the subsets and calculation of euclidean distances based on the two-norm.
In one embodiment, after determining a target location from the plurality of first candidate locations that matches the target user's gaze intent based on the first target visual stimulus encoding sequence, the apparatus is further configured to: executing a corresponding preset task based on the target position; the preset task is an action sequence which is expected to be completed by the target user at the target position.
In the above embodiment, the target user can complete a specific action sequence without other operations based on the target position, so that accurate control of complex activities is realized, and convenience and rapidness are achieved.
In an embodiment, after the corresponding preset task is executed based on the target position, the apparatus is further configured to: acquiring a plurality of groups of second visual stimulation coding sequences; wherein each group of the second visual stimulus coding sequences respectively corresponds to one of the second candidate positions, and each group of the second visual stimulus coding sequences comprises at least one visual stimulus frequency; for each second candidate position, sending a second visual stimulation signal sequence according to each visual stimulation frequency in a second visual stimulation coding sequence corresponding to the current second candidate position; and receiving a second target feedback signal sequence, wherein each second target feedback signal in the second target feedback signal sequence is correspondingly sent out after the target user watches each second visual stimulation signal in the second visual stimulation signal sequence, and is used for indicating that the target positioning is finished after the current action sequence is executed, or indicating that the target positioning is carried out again.
In the above embodiment, different positioning coding schemes are correspondingly set for different positioning purposes, so that the visual positioning response efficiency can be improved while the precise positioning of complex activities is ensured.
In one embodiment, after receiving the second target feedback signal sequence, the apparatus is further configured to: when the received second target feedback signal sequence indicates that the execution of the current action sequence is finished, marking the execution of the current action sequence to be finished, and starting a next task period or finishing multi-target positioning; and when the received second target feedback signal sequence indicates that the target positioning is carried out again, the first target feedback signal sequence is received again to carry out the target positioning, and a corresponding preset task is executed according to a positioning result.
In the above embodiment, if an error occurs in the process of positioning the target by using the first visual stimulus coding sequence, or the target user wants to modify his own target position, the error can still be completed by the second visual stimulus coding sequence and the second target feedback signal sequence, thereby further improving the accuracy and adaptability of the above method.
In one embodiment, the visual stimulation frequency in the device ranges from 5Hz to 30Hz, and further, in order to reduce the time for detecting and identifying, the frequency interval between any two visual stimulation frequencies can be not less than 1 Hz.
In the embodiment, the range of the visual stimulation frequency is limited, so that the feedback signal can be clear and complete, and the accuracy of the device is improved.
For specific limitations of the multi-target positioning device based on the steady-state visual evoked potential, reference may be made to the above limitations of the multi-target positioning method based on the steady-state visual evoked potential, and details thereof are not repeated here. The various modules of the steady-state visual evoked potential based multi-target positioning apparatus described above may be implemented in whole or in part by software, hardware, and combinations thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, which may be a terminal, and its internal structure diagram may be as shown in fig. 8. The computer device includes a processor, a memory, a communication interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for carrying out wired or wireless communication with an external terminal, and the wireless communication can be realized through WIFI, an operator network, NFC (near field communication) or other technologies. The computer program is executed by a processor to implement a multi-objective localization method based on steady-state visual evoked potentials. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen.
It will be appreciated by those skilled in the art that the configuration shown in fig. 8 is a block diagram of only a portion of the configuration associated with the present application, and is not intended to limit the computing device to which the present application may be applied, and that a particular computing device may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is further provided, which includes a memory and a processor, the memory stores a computer program, and the processor implements the steps of the above method embodiments when executing the computer program.
In an embodiment, a computer-readable storage medium is provided, on which a computer program is stored which, when being executed by a processor, carries out the steps of the above-mentioned method embodiments.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include at least one of non-volatile and volatile memory. Non-volatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, or the like. Volatile Memory can include Random Access Memory (RAM) or external cache Memory. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is specific and detailed, but not to be understood as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A multi-target positioning method based on steady-state visual evoked potentials (SVPs), the method comprising:
selecting at least two visual stimulation frequencies with frequency intervals not smaller than an interval threshold value to form a basic code element set;
selecting a plurality of subsets from the basic code element set to form a coding set; each subset constituting a set of first visual stimulus coding sequences;
obtaining a plurality of groups of first visual stimulation coding sequences from the coding set; wherein each group of the first visual stimulus coding sequence respectively corresponds to one of the first candidate positions, and each group of the first visual stimulus coding sequence comprises at least two visual stimulus frequencies; the number of the subsets in the encoding set is not less than the number of the first candidate positions; the multiple groups of first visual stimulation coding sequences meet the requirement that the Euclidean distance between any two groups of first visual stimulation coding sequences is minimum;
for each first candidate position, sending a first visual stimulation signal sequence according to each visual stimulation frequency in a first visual stimulation coding sequence corresponding to the current first candidate position;
receiving a first target feedback signal sequence, wherein each first target feedback signal in the first target feedback signal sequence is correspondingly sent out after a target user watches each first visual stimulation signal in the first visual stimulation signal sequence;
determining a corresponding target visual stimulation frequency sequence according to the received frequency information of the first target feedback signal sequence, and determining a corresponding first target visual stimulation coding sequence based on the target visual stimulation frequency sequence;
determining a target location from the plurality of first candidate locations that matches the target user's gaze intent according to the first target visual stimulus encoding sequence.
2. The method of claim 1, further comprising:
calculating the distance between any two subsets in the coding set;
selecting a plurality of code subsets which are equal to the number of the first candidate positions from the code set according to the distance;
associating each of the encoded subsets with one of the first candidate locations, respectively.
3. The method according to claim 1, wherein upon determining a target location from the plurality of first candidate locations that matches the target user's gaze intent based on the first target visual stimulus encoding sequence, the method further comprises:
executing a corresponding preset task based on the target position; the preset task is an action sequence which is expected to be completed by a target user at the target position.
4. The method of claim 3, wherein after executing the corresponding predetermined task based on the target location, the method further comprises:
acquiring a plurality of groups of second visual stimulation coding sequences; wherein each group of the second visual stimulus coding sequences respectively corresponds to one of a plurality of second candidate positions, and each group of the second visual stimulus coding sequences comprises at least one visual stimulus frequency;
for each second candidate position, sending a second visual stimulation signal sequence according to each visual stimulation frequency in a second visual stimulation coding sequence corresponding to the current second candidate position;
and receiving a second target feedback signal sequence, wherein each second target feedback signal in the second target feedback signal sequence is correspondingly sent out after a target user watches each second visual stimulation signal in the second visual stimulation signal sequence, and is used for indicating and confirming that the target positioning is finished by executing the current action sequence or indicating to carry out the target positioning again.
5. The method of claim 4, wherein after receiving the second target feedback signal sequence, the method further comprises:
when the received second target feedback signal sequence indicates that the execution of the current action sequence is finished, marking the execution of the current action sequence to be finished, and starting a next task period or finishing multi-target positioning;
and when the received second target feedback signal sequence indicates that the target positioning is carried out again, the first target feedback signal sequence is received again to carry out the target positioning, and a corresponding preset task is executed according to the positioning result.
6. The method according to any one of claims 1 to 5, wherein the visual stimulus frequency is in the range of 5Hz to 30 Hz.
7. A multi-target localization apparatus based on steady-state visual evoked potentials, said apparatus comprising:
the encoding module is used for selecting at least two visual stimulation frequencies with frequency intervals not smaller than an interval threshold value to form a basic code element set; selecting a plurality of subsets from the basic code element set to form a coding set; each subset constituting a set of first visual stimulus coding sequences; obtaining a plurality of groups of first visual stimulation coding sequences from the coding set; wherein each group of the first visual stimulus coding sequence respectively corresponds to one of the first candidate positions, and each group of the first visual stimulus coding sequence comprises at least two visual stimulus frequencies; the number of the subsets in the encoding set is not less than the number of the first candidate positions; the multiple groups of first visual stimulation coding sequences meet the requirement that the Euclidean distance between any two groups of first visual stimulation coding sequences is minimum;
the stimulation module is used for sending a first visual stimulation signal sequence to each first candidate position according to each visual stimulation frequency in a first visual stimulation coding sequence corresponding to the current first candidate position;
the receiving module is used for receiving a first target feedback signal sequence, wherein each first target feedback signal in the first target feedback signal sequence is correspondingly sent out after a target user watches each first visual stimulation signal in the first visual stimulation signal sequence;
the determining module is used for determining a corresponding target visual stimulation frequency sequence according to the received frequency information of the first target feedback signal sequence and determining a corresponding first target visual stimulation coding sequence based on the target visual stimulation frequency sequence;
and the positioning module is used for determining a target position matched with the gazing intention of the target user from the plurality of first candidate positions according to the first target visual stimulus coding sequence.
8. The apparatus of claim 7, wherein the encoding module is further configured to calculate a distance between any two subsets of the encoding set; selecting a plurality of code subsets which are equal to the number of the first candidate positions from the code set according to the distance; associating each of the encoded subsets with one of the first candidate locations, respectively.
9. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 6.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110118305.2A CN112817451B (en) | 2021-01-28 | 2021-01-28 | Multi-target positioning method and device based on steady-state visual evoked potential |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110118305.2A CN112817451B (en) | 2021-01-28 | 2021-01-28 | Multi-target positioning method and device based on steady-state visual evoked potential |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112817451A CN112817451A (en) | 2021-05-18 |
| CN112817451B true CN112817451B (en) | 2022-07-08 |
Family
ID=75859909
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110118305.2A Active CN112817451B (en) | 2021-01-28 | 2021-01-28 | Multi-target positioning method and device based on steady-state visual evoked potential |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112817451B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114003048B (en) * | 2021-12-31 | 2022-04-26 | 季华实验室 | Multi-target object motion control method and device, terminal equipment and medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063180A (en) * | 2010-10-29 | 2011-05-18 | 西安交通大学 | HHT-based high-frequency combined coding steady state visual evoked potential brain-computer interface method |
| CN105242784A (en) * | 2015-10-12 | 2016-01-13 | 中国医学科学院生物医学工程研究所 | Steady-state visual evoked potential brain-computer interface method based on cross modulation frequency |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101887307B (en) * | 2010-06-03 | 2011-12-07 | 西安交通大学 | Multi-frequency time sequence combined steady-stage visual evoked potential brain-computer interface method |
| JP5688154B2 (en) * | 2010-09-29 | 2015-03-25 | オフィス オブ ザ ナショナル ブロードキャスティング アンド テレコミュニケーションズ コミッション | Electrical device control system and method based on SSVEP |
| CN107748622A (en) * | 2017-11-08 | 2018-03-02 | 中国医学科学院生物医学工程研究所 | A kind of Steady State Visual Evoked Potential brain-machine interface method based on face perception |
| CN111712192B (en) * | 2018-01-18 | 2024-07-02 | 神经股份有限公司 | Brain-computer interface with adaptation to high-speed, accurate and intuitive user interactions |
-
2021
- 2021-01-28 CN CN202110118305.2A patent/CN112817451B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102063180A (en) * | 2010-10-29 | 2011-05-18 | 西安交通大学 | HHT-based high-frequency combined coding steady state visual evoked potential brain-computer interface method |
| CN105242784A (en) * | 2015-10-12 | 2016-01-13 | 中国医学科学院生物医学工程研究所 | Steady-state visual evoked potential brain-computer interface method based on cross modulation frequency |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112817451A (en) | 2021-05-18 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Lemus et al. | Neural codes for perceptual discrimination of acoustic flutter in the primate auditory cortex | |
| US9795883B2 (en) | Operational management of multi-media gaming devices | |
| US10390696B2 (en) | Dynamic computer images for improving visual perception | |
| US20190110726A1 (en) | Method and system for detection and analysis of cognitive flow | |
| CN112817451B (en) | Multi-target positioning method and device based on steady-state visual evoked potential | |
| JP2021018695A (en) | Information processing device and program | |
| CN117275673A (en) | Cognitive training equipment and method for improving distribution attention | |
| Castellar et al. | How Monitoring Other’s Actions Influences One’s Own Performance | |
| Li et al. | Explicit Awareness does not Modulate Retrograde Interference Effects in Sequence Learning | |
| CN108388338B (en) | Control method and system based on VR equipment | |
| US20150364051A1 (en) | Generating a comprehension indicator that indicates how well an individual understood the subject matter covered by a test | |
| Mayer et al. | Authentication schemes-comparison and effective password spaces | |
| Chu et al. | Player's attention and meditation level of input devices on mobile gaming | |
| Wang et al. | Assessing user mental workload for smartphone applications with built-in sensors | |
| CN112754457B (en) | Body fat health state acquisition method, device and system | |
| KR101177077B1 (en) | Server and method for providing game for assessment and enhancement of word memory ability | |
| Zhang et al. | Towards task-independent workload classification: shifting from binary to continuous classification | |
| KR20120005172A (en) | Server and method for providing game for assessment and enhancement of spatial memory ability | |
| JP2019109631A (en) | Information providing apparatus and information providing system | |
| Heuer et al. | Linear responses to stochastic motion signals in area MST | |
| KR101277302B1 (en) | Server and method for providing game for psycho motor ability | |
| An et al. | Exploring gaze behavior to assess performance in digital game-based learning systems | |
| KR101890374B1 (en) | Brain training method using eeg and problem and brain training apparatus using the same | |
| Rybar et al. | Automated detection of user deception in on-line questionnaires with focus on eye tracking use | |
| Gálvez-García et al. | Hand switching costs are not uniform across response components |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |