CN110784746B - Brain cognitive competence AI training system based on VR and electroencephalogram biofeedback technology - Google Patents

Brain cognitive competence AI training system based on VR and electroencephalogram biofeedback technology Download PDF

Info

Publication number
CN110784746B
CN110784746B CN201911078890.7A CN201911078890A CN110784746B CN 110784746 B CN110784746 B CN 110784746B CN 201911078890 A CN201911078890 A CN 201911078890A CN 110784746 B CN110784746 B CN 110784746B
Authority
CN
China
Prior art keywords
content providing
time
frequency resource
base station
output device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911078890.7A
Other languages
Chinese (zh)
Other versions
CN110784746A (en
Inventor
吕云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Chengdu Weiai New Economic And Technological Research Institute Co ltd
Original Assignee
Chengdu Weiai New Economic And Technological Research Institute Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Chengdu Weiai New Economic And Technological Research Institute Co ltd filed Critical Chengdu Weiai New Economic And Technological Research Institute Co ltd
Priority to CN201911078890.7A priority Critical patent/CN110784746B/en
Publication of CN110784746A publication Critical patent/CN110784746A/en
Application granted granted Critical
Publication of CN110784746B publication Critical patent/CN110784746B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Abstract

The invention provides a brain cognition ability AI training system based on VR and electroencephalogram biofeedback technology, which comprises VR output equipment and VR content providing equipment, wherein the VR output equipment and the VR content providing equipment are configured to perform the following operations: collecting brain wave data of a subject by a VR output device; establishing, by the VR output device, an RRC connection with the first base station; establishing, by the VR content providing device, an RRC connection with the second base station; the method comprises the steps that a core network is used for configuring common time-frequency resources for communication between devices in advance, and the core network informs the first base station and a second base station of the common time-frequency resources for communication between the devices; in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the first base station, an indication of the common time-frequency resources for inter-device communication to the VR output device.

Description

Brain cognitive competence AI training system based on VR and electroencephalogram biofeedback technology
Technical Field
The invention relates to the technical field of VR (virtual reality), in particular to a brain cognitive ability AI (artificial intelligence) training system based on VR and electroencephalogram biofeedback technology.
Background
Virtual Reality (abbreviated as VR) is a new practical technology developed in the 20 th century. The virtual reality technology comprises a computer, electronic information and simulation technology, and the basic realization mode is that the computer simulates a virtual environment so as to provide people with environmental immersion. With the continuous development of social productivity and scientific technology, VR technology is increasingly in great demand in various industries.
In the prior art, CN107329571B is a multichannel adaptive brain-computer interaction method for virtual reality application, the system is composed of three major components, namely a brain-computer interface client, a multichannel communication module and a virtual reality display module, the brain-computer interface client is connected with the brain of a user through an electroencephalogram acquisition device, and the acquired electroencephalogram signals are subjected to a classification recognition algorithm to obtain decoding information. Meanwhile, the brain-computer interface client is connected with the virtual reality display module through the multi-channel communication module. In the multi-channel communication module, a plurality of computer interface clients are simultaneously connected through a multi-thread synchronous communication technology, and the two-way communication between the clients and the display module is realized.
The information disclosed in this background section is only for enhancement of understanding of the general background of the invention and should not be taken as an acknowledgement or any form of suggestion that this information forms the prior art already known to a person skilled in the art.
Disclosure of Invention
The invention aims to provide a brain cognitive ability AI training system based on VR and electroencephalogram biofeedback technology, which can overcome the defects of the prior art.
In order to achieve the purpose, the invention provides a brain cognitive ability AI training system based on VR and electroencephalogram biofeedback technology, which is characterized in that: the brain cognitive ability AI training system based on VR and brain electricity biofeedback technique includes VR output device and VR content providing device, and VR output device and VR content providing device are configured to carry out the following operation: collecting brain wave data of a subject by a VR output device; establishing, by the VR output device, an RRC connection with the first base station; establishing, by the VR content providing device, an RRC connection with the second base station; the method comprises the steps that a core network is used for configuring common time-frequency resources for communication between devices in advance, and the core network informs the first base station and a second base station of the common time-frequency resources for communication between the devices; in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the first base station, an indication of the common time-frequency resources for inter-device communication to the VR output device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block; in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the second base station, an indication of the common time-frequency resources for inter-device communication to the VR content providing device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block; transmitting, by the VR output device, a synchronization signal to the VR content providing device on a common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the first base station; receiving, by the VR content providing device, a synchronization signal transmitted by the VR output device on a common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal; in response to completing synchronization with the VR output device, transmitting, by the VR content providing device, a synchronization complete message to the VR output device on a common time-frequency resource for inter-device communication; in response to receiving the synchronization completion message, transmitting, by the VR output device, electroencephalogram data to the VR content providing device on a common time-frequency resource for inter-device communication; and generating VR content by the VR content providing equipment based on the electroencephalogram data, and sending the VR content to VR output equipment by the VR content providing equipment on a public time-frequency resource for communication between the equipment.
In a preferred embodiment, the VR output device and the VR content providing device are configured to: if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a second time frequency resource for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a first time frequency resource for the VR output device to perform the inter-device communication from the first base station, wherein the mobile terminals belonging to the second base station all use the second time frequency resource to perform the inter-device communication, and the mobile terminals belonging to the first base station all use the first time frequency resource to perform the inter-device communication; broadcasting, by the first base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR output device, wherein the indication of the first time-frequency resource and the second time-frequency resource are included in a system information block; broadcasting, by the second base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR content providing device, wherein the indication of the first time-frequency resource and the second time-frequency resource is included in a system information block.
In a preferred embodiment, the VR output device and the VR content providing device are configured to: transmitting, by the VR output device, a synchronization signal on a first time-frequency resource to the VR content providing device in response to receiving the system information block broadcast by the first base station; receiving, by the VR content providing device, the synchronization signal transmitted by the VR output device on the first time-frequency resource in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal; in response to completing synchronization with the VR output device, sending, by the VR content providing device, a synchronization complete message to the VR output device on the second time-frequency resource; in response to receiving the synchronization completion message, transmitting, by the VR output device, electroencephalogram data to the VR content providing device on the first time-frequency resource; and generating VR content by the VR content providing equipment based on the electroencephalogram data, and sending the VR content to the VR output equipment by the VR content providing equipment on the second time-frequency resource.
In a preferred embodiment, the VR output device and the VR content providing device are configured to: if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a fourth time frequency resource which is specially used for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a third time frequency resource which is specially used for the VR output device to perform the inter-device communication from the first base station; the first base station sends the indication of the third time frequency resource and the fourth time frequency resource to VR output equipment through RRC signaling; and sending the indication of the third time frequency resource and the fourth time frequency resource to the VR content providing device through RRC signaling by the second base station.
In a preferred embodiment, the VR output device and the VR content providing device are configured to: transmitting, by the VR output device, a synchronization signal to the VR content providing device on a third time-frequency resource in response to receiving the RRC signaling sent by the first base station; receiving, by the VR content providing device, the synchronization signal transmitted by the VR output device on a third time-frequency resource in response to receiving the RRC signaling broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal; in response to completing synchronization with the VR output device, transmitting, by the VR content providing device, a synchronization complete message to the VR output device on a fourth time frequency resource; in response to receiving the synchronization completion message, the VR output device sends electroencephalogram data to the VR content providing device on a third time-frequency resource; and generating, by the VR content providing device, VR content based on the brain wave data, and transmitting, by the VR content providing device, the VR content to the VR output device on the fourth time-frequency resource.
The present invention provides a non-transitory computer-readable storage medium characterized by: a non-transitory computer-readable storage medium comprising code for a VR and electroencephalogram biofeedback technology based brain cognitive ability AI training system, the VR and electroencephalogram biofeedback technology based brain cognitive ability AI training system comprising a VR output device and a VR content providing device, the code capable of causing the VR output device and the VR content providing device to: collecting brain wave data of a subject by a VR output device; establishing, by the VR output device, an RRC connection with the first base station; establishing, by the VR content providing device, an RRC connection with the second base station; the method comprises the steps that a core network is used for configuring common time-frequency resources for communication between devices in advance, and the core network informs the first base station and a second base station of the common time-frequency resources for communication between the devices; in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the first base station, an indication of the common time-frequency resources for inter-device communication to the VR output device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block; in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the second base station, an indication of the common time-frequency resources for inter-device communication to the VR content providing device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block; transmitting, by the VR output device, a synchronization signal to the VR content providing device on a common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the first base station; receiving, by the VR content providing device, a synchronization signal transmitted by the VR output device on a common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal; in response to completing synchronization with the VR output device, transmitting, by the VR content providing device, a synchronization complete message to the VR output device on a common time-frequency resource for inter-device communication; in response to receiving the synchronization completion message, transmitting, by the VR output device, electroencephalogram data to the VR content providing device on a common time-frequency resource for inter-device communication; and generating VR content by the VR content providing equipment based on the electroencephalogram data, and sending the VR content to VR output equipment by the VR content providing equipment on a public time-frequency resource for communication between the equipment.
In a preferred embodiment, the code is capable of causing the VR output device and the VR content providing device to: if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a second time frequency resource for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a first time frequency resource for the VR output device to perform the inter-device communication from the first base station, wherein the mobile terminals belonging to the second base station all use the second time frequency resource to perform the inter-device communication, and the mobile terminals belonging to the first base station all use the first time frequency resource to perform the inter-device communication; broadcasting, by the first base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR output device, wherein the indication of the first time-frequency resource and the second time-frequency resource are included in a system information block; broadcasting, by the second base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR content providing device, wherein the indication of the first time-frequency resource and the second time-frequency resource is included in a system information block.
In a preferred embodiment, the code is capable of causing the VR output device and the VR content providing device to: transmitting, by the VR output device, a synchronization signal on a first time-frequency resource to the VR content providing device in response to receiving the system information block broadcast by the first base station; receiving, by the VR content providing device, the synchronization signal transmitted by the VR output device on the first time-frequency resource in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal; in response to completing synchronization with the VR output device, sending, by the VR content providing device, a synchronization complete message to the VR output device on the second time-frequency resource; in response to receiving the synchronization completion message, transmitting, by the VR output device, electroencephalogram data to the VR content providing device on the first time-frequency resource; and generating VR content by the VR content providing equipment based on the electroencephalogram data, and sending the VR content to the VR output equipment by the VR content providing equipment on the second time-frequency resource.
In a preferred embodiment, the code is capable of causing the VR output device and the VR content providing device to: if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a fourth time frequency resource which is specially used for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a third time frequency resource which is specially used for the VR output device to perform the inter-device communication from the first base station; the first base station sends the indication of the third time frequency resource and the fourth time frequency resource to VR output equipment through RRC signaling; and sending the indication of the third time frequency resource and the fourth time frequency resource to the VR content providing device through RRC signaling by the second base station.
In a preferred embodiment, the code is capable of causing the VR output device and the VR content providing device to: transmitting, by the VR output device, a synchronization signal to the VR content providing device on a third time-frequency resource in response to receiving the RRC signaling sent by the first base station; receiving, by the VR content providing device, the synchronization signal transmitted by the VR output device on a third time-frequency resource in response to receiving the RRC signaling broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal; in response to completing synchronization with the VR output device, transmitting, by the VR content providing device, a synchronization complete message to the VR output device on a fourth time frequency resource; in response to receiving the synchronization completion message, the VR output device sends electroencephalogram data to the VR content providing device on a third time-frequency resource; and generating, by the VR content providing device, VR content based on the brain wave data, and transmitting, by the VR content providing device, the VR content to the VR output device on the fourth time-frequency resource.
Compared with the prior art, the invention has the following advantages: the current implementation of VR technology includes integrating all modules in VR glasses or a helmet with VR function (such as the technology introduced in CN 105559228B), which results in very high manufacturing cost and heavy weight of VR system, and due to technical limitations, the integrated VR glasses or the helmet with VR function has weak computing power, which makes it difficult to provide users with good experience. In addition, the VR glasses are connected to the VR host by a wired connection, and the VR glasses are only used for outputting video and audio signals, which is problematic in that the range of motion of the user in the VR experience process is severely limited due to the presence of the cable, and the system requires a home to purchase one host, which makes the purchase cost of the home user high, and the personalized requirements of the home user are many, which results in that an enterprise needs to configure various products to meet the needs of the customer. To current prior art's problem, this application has provided a brain cognitive ability AI training system based on VR and brain electricity biofeedback technique, the system of this application relies on wireless communication technique to accomplish completely, the system of this application is the design that VR output device and VR content provided the equipment separation, so VR glasses cost is lower, owing to be wireless connection, so the system of this application allows a plurality of families to share a VR host computer simultaneously, the cost of a plurality of families' share host computer like this can make the purchase cost descend.
Drawings
Fig. 1 is a schematic diagram of a system architecture according to an embodiment of the present invention.
FIG. 2 is a system workflow diagram according to an embodiment of the invention.
Detailed Description
The following detailed description of the present invention is provided in conjunction with the accompanying drawings, but it should be understood that the scope of the present invention is not limited to the specific embodiments.
Throughout the specification and claims, unless explicitly stated otherwise, the word "comprise", or variations such as "comprises" or "comprising", will be understood to imply the inclusion of a stated element or component but not the exclusion of any other element or component.
Fig. 1 is a schematic diagram of a system architecture according to an embodiment of the present invention. As shown, the system of the present invention includes a VR output device, a VR content providing device, a first base station, and a second base station. The VR output equipment is communicated with the first base station, the VR content providing equipment is communicated with the second base station, the first base station and the second base station are connected with the core network interface, and the VR output equipment and the VR content providing equipment can be communicated with each other.
FIG. 2 is a system workflow diagram according to an embodiment of the invention. As shown, the VR output device and the VR content providing device are configured to:
step 101: collecting brain wave data of a subject by a VR output device (e.g., VR glasses);
step 102: establishing, by the VR output device, an RRC connection with the first base station;
step 103: establishing, by a VR content providing device (e.g., a laptop, a mainframe, etc.), an RRC connection with a second base station;
step 104: the method comprises the steps that a core network is used for configuring common time-frequency resources for communication between devices in advance, and the core network informs the first base station and a second base station of the common time-frequency resources for communication between the devices;
step 105: in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the first base station, an indication of the common time-frequency resources for inter-device communication to the VR output device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block;
step 106: in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the second base station, an indication of the common time-frequency resources for inter-device communication to the VR content providing device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block;
step 107: transmitting, by the VR output device, a synchronization signal to the VR content providing device on a common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the first base station;
step 108: receiving, by the VR content providing device, a synchronization signal transmitted by the VR output device on a common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal;
step 109: in response to completing synchronization with the VR output device, transmitting, by the VR content providing device, a synchronization complete message to the VR output device on a common time-frequency resource for inter-device communication;
step 110: in response to receiving the synchronization completion message, transmitting, by the VR output device, electroencephalogram data to the VR content providing device on a common time-frequency resource for inter-device communication;
step 111: VR content is generated by a VR content providing device based on brain wave data (how to generate VR content based on brain wave data is prior art, for example, the document CN107329571B mentioned in the background art, and CN108960937B also describes a method, which is not described in detail in this application since the technology itself is prior art), and is sent by the VR content providing device to a VR output device on a common time-frequency resource for inter-device communication.
In a preferred embodiment, the VR output device and the VR content providing device are configured to:
if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a second time frequency resource for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a first time frequency resource for the VR output device to perform the inter-device communication from the first base station, wherein the mobile terminals belonging to the second base station all use the second time frequency resource to perform the inter-device communication, and the mobile terminals belonging to the first base station all use the first time frequency resource to perform the inter-device communication;
broadcasting, by the first base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR output device, wherein the indication of the first time-frequency resource and the second time-frequency resource are included in a system information block;
broadcasting, by the second base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR content providing device, wherein the indication of the first time-frequency resource and the second time-frequency resource is included in a system information block.
In a preferred embodiment, the VR output device and the VR content providing device are configured to:
transmitting, by the VR output device, a synchronization signal on a first time-frequency resource to the VR content providing device in response to receiving the system information block broadcast by the first base station;
receiving, by the VR content providing device, the synchronization signal transmitted by the VR output device on the first time-frequency resource in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal;
in response to completing synchronization with the VR output device, sending, by the VR content providing device, a synchronization complete message to the VR output device on the second time-frequency resource;
in response to receiving the synchronization completion message, transmitting, by the VR output device, electroencephalogram data to the VR content providing device on the first time-frequency resource;
and generating VR content by the VR content providing equipment based on the electroencephalogram data, and sending the VR content to the VR output equipment by the VR content providing equipment on the second time-frequency resource.
In a preferred embodiment, the VR output device and the VR content providing device are configured to:
if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a fourth time frequency resource which is specially used for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a third time frequency resource which is specially used for the VR output device to perform the inter-device communication from the first base station;
the first base station sends the indication of the third time frequency resource and the fourth time frequency resource to VR output equipment through RRC signaling;
and sending the indication of the third time frequency resource and the fourth time frequency resource to the VR content providing device through RRC signaling by the second base station.
In a preferred embodiment, the VR output device and the VR content providing device are configured to:
transmitting, by the VR output device, a synchronization signal to the VR content providing device on a third time-frequency resource in response to receiving the RRC signaling sent by the first base station;
receiving, by the VR content providing device, the synchronization signal transmitted by the VR output device on a third time-frequency resource in response to receiving the RRC signaling broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal;
in response to completing synchronization with the VR output device, transmitting, by the VR content providing device, a synchronization complete message to the VR output device on a fourth time frequency resource;
in response to receiving the synchronization completion message, the VR output device sends electroencephalogram data to the VR content providing device on a third time-frequency resource;
and generating, by the VR content providing device, VR content based on the brain wave data, and transmitting, by the VR content providing device, the VR content to the VR output device on the fourth time-frequency resource.
The present invention provides a non-transitory computer-readable storage medium characterized by: a non-transitory computer-readable storage medium comprising code for a VR and electroencephalogram biofeedback technology based brain cognitive ability AI training system, the VR and electroencephalogram biofeedback technology based brain cognitive ability AI training system comprising a VR output device and a VR content providing device, the code capable of causing the VR output device and the VR content providing device to:
collecting brain wave data of a subject by a VR output device;
establishing, by the VR output device, an RRC connection with the first base station;
establishing, by the VR content providing device, an RRC connection with the second base station;
the method comprises the steps that a core network is used for configuring common time-frequency resources for communication between devices in advance, and the core network informs the first base station and a second base station of the common time-frequency resources for communication between the devices;
in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the first base station, an indication of the common time-frequency resources for inter-device communication to the VR output device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block;
in response to receiving the notification of the common time-frequency resources for inter-device communication, broadcasting, by the second base station, an indication of the common time-frequency resources for inter-device communication to the VR content providing device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block;
transmitting, by the VR output device, a synchronization signal to the VR content providing device on a common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the first base station;
receiving, by the VR content providing device, a synchronization signal transmitted by the VR output device on a common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal;
in response to completing synchronization with the VR output device, transmitting, by the VR content providing device, a synchronization complete message to the VR output device on a common time-frequency resource for inter-device communication;
in response to receiving the synchronization completion message, transmitting, by the VR output device, electroencephalogram data to the VR content providing device on a common time-frequency resource for inter-device communication;
and generating VR content by the VR content providing equipment based on the electroencephalogram data, and sending the VR content to VR output equipment by the VR content providing equipment on a public time-frequency resource for communication between the equipment.
In a preferred embodiment, the code is capable of causing the VR output device and the VR content providing device to:
if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a second time frequency resource for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a first time frequency resource for the VR output device to perform the inter-device communication from the first base station, wherein the mobile terminals belonging to the second base station all use the second time frequency resource to perform the inter-device communication, and the mobile terminals belonging to the first base station all use the first time frequency resource to perform the inter-device communication;
broadcasting, by the first base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR output device, wherein the indication of the first time-frequency resource and the second time-frequency resource are included in a system information block;
broadcasting, by the second base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR content providing device, wherein the indication of the first time-frequency resource and the second time-frequency resource is included in a system information block.
In a preferred embodiment, the code is capable of causing the VR output device and the VR content providing device to:
transmitting, by the VR output device, a synchronization signal on a first time-frequency resource to the VR content providing device in response to receiving the system information block broadcast by the first base station;
receiving, by the VR content providing device, the synchronization signal transmitted by the VR output device on the first time-frequency resource in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal;
in response to completing synchronization with the VR output device, sending, by the VR content providing device, a synchronization complete message to the VR output device on the second time-frequency resource;
in response to receiving the synchronization completion message, transmitting, by the VR output device, electroencephalogram data to the VR content providing device on the first time-frequency resource;
and generating VR content by the VR content providing equipment based on the electroencephalogram data, and sending the VR content to the VR output equipment by the VR content providing equipment on the second time-frequency resource.
In a preferred embodiment, the code is capable of causing the VR output device and the VR content providing device to:
if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a fourth time frequency resource which is specially used for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a third time frequency resource which is specially used for the VR output device to perform the inter-device communication from the first base station;
the first base station sends the indication of the third time frequency resource and the fourth time frequency resource to VR output equipment through RRC signaling;
and sending the indication of the third time frequency resource and the fourth time frequency resource to the VR content providing device through RRC signaling by the second base station.
In a preferred embodiment, the code is capable of causing the VR output device and the VR content providing device to:
transmitting, by the VR output device, a synchronization signal to the VR content providing device on a third time-frequency resource in response to receiving the RRC signaling sent by the first base station;
receiving, by the VR content providing device, the synchronization signal transmitted by the VR output device on a third time-frequency resource in response to receiving the RRC signaling broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal;
in response to completing synchronization with the VR output device, transmitting, by the VR content providing device, a synchronization complete message to the VR output device on a fourth time frequency resource;
in response to receiving the synchronization completion message, the VR output device sends electroencephalogram data to the VR content providing device on a third time-frequency resource;
and generating, by the VR content providing device, VR content based on the brain wave data, and transmitting, by the VR content providing device, the VR content to the VR output device on the fourth time-frequency resource.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
The foregoing descriptions of specific exemplary embodiments of the present invention have been presented for purposes of illustration and description. It is not intended to limit the invention to the precise form disclosed, and obviously many modifications and variations are possible in light of the above teaching. The exemplary embodiments were chosen and described in order to explain certain principles of the invention and its practical application to enable one skilled in the art to make and use various exemplary embodiments of the invention and various alternatives and modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims and their equivalents.

Claims (8)

1. A brain cognitive competence AI training system based on VR and brain electricity biofeedback technique which characterized in that: the brain cognitive ability AI training system based on VR and electroencephalogram biofeedback technology comprises VR output equipment and VR content providing equipment, wherein the VR output equipment and the VR content providing equipment are configured to perform the following operations:
collecting brain wave data of a subject by a VR output device;
establishing, by the VR output device, an RRC connection with the first base station;
establishing, by the VR content providing device, an RRC connection with the second base station;
the core network pre-configures common time-frequency resources for communication between devices, and notifies the common time-frequency resources for communication between devices to the first base station and the second base station;
in response to receiving a notification of common time-frequency resources for inter-device communication, broadcasting, by a first base station, an indication of the common time-frequency resources for inter-device communication to the VR output device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block;
in response to receiving a notification of common time-frequency resources for inter-device communication, broadcasting, by a second base station, an indication of the common time-frequency resources for inter-device communication to the VR content providing device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block;
transmitting, by a VR output device, a synchronization signal to the VR content providing device on the common time-frequency resource for inter-device communication in response to receiving a system information block broadcast by the first base station;
receiving, by a VR content providing device, a synchronization signal transmitted by the VR output device on the common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal;
in response to completing synchronization with the VR output device, transmitting, by a VR content providing device, a synchronization complete message to the VR output device on the common time-frequency resource for inter-device communication;
in response to receiving the synchronization completion message, transmitting, by a VR output device, the brain wave data to the VR content providing device on the common time-frequency resource for inter-device communication; generating, by a VR content providing device, VR content based on the brain wave data, and transmitting, by the VR content providing device, the VR content to the VR output device on the common time-frequency resource for inter-device communication,
the VR output device and VR content providing device are configured to:
if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a second time frequency resource for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a first time frequency resource for the VR output device to perform the inter-device communication from the first base station, wherein the mobile terminals belonging to the second base station all use the second time frequency resource to perform the inter-device communication, and the mobile terminals belonging to the first base station all use the first time frequency resource to perform the inter-device communication;
broadcasting, by a first base station, indications of the first and second time-frequency resources to the VR output device, wherein the indications of the first and second time-frequency resources are included in a system information block;
broadcasting, by a second base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR content providing device, wherein the indication of the first time-frequency resource and the second time-frequency resource is included in a system information block.
2. The brain cognitive ability AI training system based on VR and brain electrical biofeedback techniques of claim 1, wherein: the VR output device and VR content providing device are configured to:
transmitting, by a VR output device, a synchronization signal to the VR content providing device on the first time-frequency resource in response to receiving a system information block broadcast by the first base station;
receiving, by the VR content providing device, a synchronization signal transmitted by the VR output device on the first time-frequency resource and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal in response to receiving the system information block broadcast by the second base station; in response to completing synchronization with the VR output device, transmitting, by a VR content providing device, a synchronization complete message to the VR output device on the second time-frequency resource;
in response to receiving the synchronization completion message, transmitting, by a VR output device, the brain wave data to the VR content providing device on the first time-frequency resource;
and generating VR content by VR content providing equipment based on the electroencephalogram data, and sending the VR content to the VR output equipment by the VR content providing equipment on the second time-frequency resource.
3. The brain cognitive ability AI training system based on VR and brain electrical biofeedback techniques of claim 2, wherein: the VR output device and VR content providing device are configured to:
if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a fourth time frequency resource which is specially used for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a third time frequency resource which is specially used for the VR output device to perform the inter-device communication from the first base station;
sending, by the first base station, an indication of the third time-frequency resource and the fourth time-frequency resource to the VR output device via RRC signaling;
transmitting, by the second base station, the indication of the third time-frequency resource and the fourth time-frequency resource to the VR content providing device via RRC signaling.
4. The brain cognitive ability AI training system based on VR and brain electrical biofeedback techniques of claim 3, wherein: the VR output device and VR content providing device are configured to:
transmitting, by a VR output device, a synchronization signal to the VR content providing device on the third time-frequency resource in response to receiving RRC signaling transmitted by the first base station;
receiving, by the VR content providing device, a synchronization signal transmitted by the VR output device on the third time-frequency resource in response to receiving the RRC signaling broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal; in response to completing synchronization with the VR output device, transmitting, by a VR content providing device, a synchronization complete message to the VR output device on the fourth time frequency resource;
in response to receiving the synchronization completion message, transmitting, by a VR output device, the brain wave data to the VR content providing device on the third time-frequency resource;
generating, by a VR content providing device, VR content based on the brain wave data, and transmitting, by the VR content providing device, the VR content to the VR output device on the fourth time-frequency resource.
5. A non-transitory computer-readable storage medium, characterized in that: the non-transitory computer-readable storage medium includes code for a VR and electroencephalogram biofeedback technology based brain cognitive ability AI training system including a VR output device and a VR content providing device, the code capable of causing the VR output device and VR content providing device to:
collecting brain wave data of a subject by a VR output device;
establishing, by the VR output device, an RRC connection with the first base station;
establishing, by the VR content providing device, an RRC connection with the second base station;
the core network pre-configures common time-frequency resources for communication between devices, and notifies the common time-frequency resources for communication between devices to the first base station and the second base station;
in response to receiving a notification of common time-frequency resources for inter-device communication, broadcasting, by a first base station, an indication of the common time-frequency resources for inter-device communication to the VR output device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block;
in response to receiving a notification of common time-frequency resources for inter-device communication, broadcasting, by a second base station, an indication of the common time-frequency resources for inter-device communication to the VR content providing device, wherein the indication of the common time-frequency resources for inter-device communication is included in a system information block;
transmitting, by a VR output device, a synchronization signal to the VR content providing device on the common time-frequency resource for inter-device communication in response to receiving a system information block broadcast by the first base station;
receiving, by a VR content providing device, a synchronization signal transmitted by the VR output device on the common time-frequency resource for inter-device communication in response to receiving the system information block broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal;
in response to completing synchronization with the VR output device, transmitting, by a VR content providing device, a synchronization complete message to the VR output device on the common time-frequency resource for inter-device communication;
in response to receiving the synchronization completion message, transmitting, by a VR output device, the brain wave data to the VR content providing device on the common time-frequency resource for inter-device communication; generating, by a VR content providing device, VR content based on the brain wave data, and transmitting, by the VR content providing device, the VR content to the VR output device on the common time-frequency resource for inter-device communication,
the code is capable of causing the VR output device and VR content providing device to:
if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a second time frequency resource for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a first time frequency resource for the VR output device to perform the inter-device communication from the first base station, wherein the mobile terminals belonging to the second base station all use the second time frequency resource to perform the inter-device communication, and the mobile terminals belonging to the first base station all use the first time frequency resource to perform the inter-device communication;
broadcasting, by a first base station, indications of the first and second time-frequency resources to the VR output device, wherein the indications of the first and second time-frequency resources are included in a system information block;
broadcasting, by a second base station, an indication of the first time-frequency resource and the second time-frequency resource to the VR content providing device, wherein the indication of the first time-frequency resource and the second time-frequency resource is included in a system information block.
6. The non-transitory computer-readable storage medium of claim 5, wherein: the code is capable of causing the VR output device and VR content providing device to:
transmitting, by a VR output device, a synchronization signal to the VR content providing device on the first time-frequency resource in response to receiving a system information block broadcast by the first base station;
receiving, by the VR content providing device, a synchronization signal transmitted by the VR output device on the first time-frequency resource and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal in response to receiving the system information block broadcast by the second base station; in response to completing synchronization with the VR output device, transmitting, by a VR content providing device, a synchronization complete message to the VR output device on the second time-frequency resource;
in response to receiving the synchronization completion message, transmitting, by a VR output device, the brain wave data to the VR content providing device on the first time-frequency resource;
and generating VR content by VR content providing equipment based on the electroencephalogram data, and sending the VR content to the VR output equipment by the VR content providing equipment on the second time-frequency resource.
7. The non-transitory computer-readable storage medium of claim 6, wherein: the code is capable of causing the VR output device and VR content providing device to:
if the core network does not pre-configure the common time frequency resource for the inter-device communication, the first base station obtains a fourth time frequency resource which is specially used for the VR content providing device to perform the inter-device communication from the second base station, and the second base station obtains a third time frequency resource which is specially used for the VR output device to perform the inter-device communication from the first base station;
sending, by the first base station, an indication of the third time-frequency resource and the fourth time-frequency resource to the VR output device via RRC signaling;
transmitting, by the second base station, the indication of the third time-frequency resource and the fourth time-frequency resource to the VR content providing device via RRC signaling.
8. The non-transitory computer-readable storage medium of claim 7, wherein: the code is capable of causing the VR output device and VR content providing device to:
transmitting, by a VR output device, a synchronization signal to the VR content providing device on the third time-frequency resource in response to receiving RRC signaling transmitted by the first base station;
receiving, by the VR content providing device, a synchronization signal transmitted by the VR output device on the third time-frequency resource in response to receiving the RRC signaling broadcast by the second base station, and synchronizing, by the VR content providing device, with the VR output device based on the synchronization signal; in response to completing synchronization with the VR output device, transmitting, by a VR content providing device, a synchronization complete message to the VR output device on the fourth time frequency resource;
in response to receiving the synchronization completion message, transmitting, by a VR output device, the brain wave data to the VR content providing device on the third time-frequency resource;
generating, by a VR content providing device, VR content based on the brain wave data, and transmitting, by the VR content providing device, the VR content to the VR output device on the fourth time-frequency resource.
CN201911078890.7A 2019-11-07 2019-11-07 Brain cognitive competence AI training system based on VR and electroencephalogram biofeedback technology Active CN110784746B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911078890.7A CN110784746B (en) 2019-11-07 2019-11-07 Brain cognitive competence AI training system based on VR and electroencephalogram biofeedback technology

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911078890.7A CN110784746B (en) 2019-11-07 2019-11-07 Brain cognitive competence AI training system based on VR and electroencephalogram biofeedback technology

Publications (2)

Publication Number Publication Date
CN110784746A CN110784746A (en) 2020-02-11
CN110784746B true CN110784746B (en) 2021-07-13

Family

ID=69389832

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911078890.7A Active CN110784746B (en) 2019-11-07 2019-11-07 Brain cognitive competence AI training system based on VR and electroencephalogram biofeedback technology

Country Status (1)

Country Link
CN (1) CN110784746B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105934921A (en) * 2013-10-31 2016-09-07 华为技术有限公司 System and method for device-to-device synchronization
CN106200892A (en) * 2014-10-30 2016-12-07 联发科技股份有限公司 Virtual reality system, mobile device, Wearable device and the processing method of entry event
CN106560765A (en) * 2016-06-14 2017-04-12 深圳创达云睿智能科技有限公司 Method and device for content interaction in virtual reality
CN206363264U (en) * 2017-01-07 2017-07-28 北京国承万通信息科技有限公司 A kind of virtual reality system
WO2018127782A1 (en) * 2017-01-03 2018-07-12 Xing Zhou Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command
CN208781171U (en) * 2018-10-10 2019-04-23 广州土圭垚信息科技有限公司 A kind of cloud VR apparatus and system

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106993181B (en) * 2016-11-02 2019-03-05 大辅科技（北京）有限公司 More VR/AR equipment collaboration systems and Synergistic method
CN106345034A (en) * 2016-11-09 2017-01-25 武汉智普天创科技有限公司 Device based on brain electricity acquisition terminal for cognitive emotion regulation
CN206541288U (en) * 2017-01-07 2017-10-03 北京国承万通信息科技有限公司 A kind of virtual reality system, main frame and head-mounted display apparatus
US11863510B2 (en) * 2017-03-29 2024-01-02 Samsung Electronics Co., Ltd. Systems and methods for notification delivery
CN207198798U (en) * 2017-09-26 2018-04-06 河南黄烨科技有限公司 Wireless dummy reality headgear system based on Dual base stations space orientation technique

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105934921A (en) * 2013-10-31 2016-09-07 华为技术有限公司 System and method for device-to-device synchronization
CN106200892A (en) * 2014-10-30 2016-12-07 联发科技股份有限公司 Virtual reality system, mobile device, Wearable device and the processing method of entry event
CN106560765A (en) * 2016-06-14 2017-04-12 深圳创达云睿智能科技有限公司 Method and device for content interaction in virtual reality
WO2018127782A1 (en) * 2017-01-03 2018-07-12 Xing Zhou Wearable augmented reality eyeglass communication device including mobile phone and mobile computing via virtual touch screen gesture control and neuron command
CN206363264U (en) * 2017-01-07 2017-07-28 北京国承万通信息科技有限公司 A kind of virtual reality system
CN208781171U (en) * 2018-10-10 2019-04-23 广州土圭垚信息科技有限公司 A kind of cloud VR apparatus and system

Also Published As

Publication number Publication date
CN110784746A (en) 2020-02-11

Similar Documents

Publication Publication Date Title
US20130343560A1 (en) Method and Apparatus for Reducing Noise in Voices of Mobile Terminal
US20210160644A1 (en) Priority-based soundfield coding for virtual reality audio
CN105657127A (en) Sound sharing method, earphone and terminal
EP4228347A1 (en) Communication method and communication apparatus
WO2023103897A1 (en) Image processing method, apparatus and device, and storage medium
WO2021068493A1 (en) Method and apparatus for processing information
CN110535604A (en) A kind of speed matching method and device
CN104777894A (en) Information processing method and wearable electronic equipment
CN104079542A (en) Information processing method and device management server
CN104579919A (en) Message exchange method, related device and communication system
CN114500130A (en) Audio data pushing method, device and system, electronic equipment and storage medium
CN112364144A (en) Interaction method, device, equipment and computer readable medium
CN104617975A (en) Smart wearable electronic device and smart communication system with same
CN110784746B (en) Brain cognitive competence AI training system based on VR and electroencephalogram biofeedback technology
CN104735389A (en) Information processing method and equipment
CN102970062A (en) Wireless communication system and control method thereof
CN105634756A (en) Group adding method and system based on acoustic wave transmission technology
CN107071335B (en) A kind of data processing method and device, equipment
CN104299128B (en) Utilize the method for payment of smart television, mobile terminal and smart television
CN111857901A (en) Data processing method, method for generating session background, electronic device and medium
CN110798863B (en) VR interaction control method based on brain wave data
CN204903990U (en) Smart box
CN106209314A (en) Data transmission method, equipment and audio frequency apparatus
CN112770228A (en) Audio playing method and device, audio playing equipment, electronic equipment and medium
CN111104827A (en) Image processing method and device, electronic equipment and readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant