CN113989839A - System and method for synchronously analyzing animal neural signals and behavior videos based on timestamps - Google Patents
System and method for synchronously analyzing animal neural signals and behavior videos based on timestamps Download PDFInfo
- Publication number
- CN113989839A CN113989839A CN202111247839.1A CN202111247839A CN113989839A CN 113989839 A CN113989839 A CN 113989839A CN 202111247839 A CN202111247839 A CN 202111247839A CN 113989839 A CN113989839 A CN 113989839A
- Authority
- CN
- China
- Prior art keywords
- animal
- behavior
- data
- time
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
- G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/7867—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Library & Information Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Image Analysis (AREA)
Abstract
The invention discloses a system and a method for synchronously analyzing animal neural signals and behavior videos based on time stamps, which comprises the following steps: the video monitoring device monitors and collects animal behavior videos in real time; the behavior analysis system analyzes the animal behavior video to obtain a behavior analysis result; the nerve signal acquisition device is used for acquiring animal nerve signals in real time; the main control system is used for decoding and analyzing the animal nerve signals to obtain a nerve analysis result; the storage system synchronously stores the animal behavior video and the animal nerve signals in a streaming manner by marking a timestamp and stores the behavior analysis result and the nerve analysis result in an event recording manner; and the interactive control platform retrieves and acquires the animal behavior video and the animal nerve signal according to the marking time stamp or the behavior analysis result, and performs online or offline synchronous display and analysis.
Description
Technical Field
The invention belongs to the field of animal neural signal analysis, and particularly relates to a system and a method for synchronously analyzing animal neural signals and behavior videos based on time stamps.
Background
Animal neural signal analysis is an important content of brain science and information science research, and a specific research method is mainly a single concerned animal neural signal, and has the following problems: (1) the nerve signal data displayed singly has errors and cannot be correlated with animal behavior data in real time (cannot be linked with video). (2) The analysis of the backtracking signal is troublesome, and the collected data cannot be quickly retrieved based on time or data types during backtracking. (3) The problems of time and labor waste and the like exist in manual detection of animal behavior data, and automatic detection of animal behavior data cannot be realized. (4) The neural signal data and the animal behavior data are large in quantity, difficult to store and difficult to realize quick and effective retrieval, and the requirements of on-line analysis and off-line analysis cannot be met simultaneously. (5) The original data of cranial nerves and the data of animal behavior videos have no uniform identification and are not synchronously analyzed.
The prior patent document CN110811594A discloses a wireless wearable neural signal detection device, which synchronously detects a neuroelectrophysiological signal and a neuroelectrochemical signal through a flexible microelectrode array of a nerve nucleus implanted in a brain, and then performs conditioning analysis, analog-to-digital conversion, compression and transmission on the received neuroelectrophysiological signal and neuroelectrochemical signal by using a wearable detector. The detection device is only suitable for detecting nerve signals and cannot detect animal behavior data.
The prior patent document CN1438600A discloses an animal behavior and electrophysiological index monitoring and analyzing system, which utilizes a computer and a modern electronic technology to track and monitor the movement track of an experimental animal in a maze, controls related instruments connected to the computer to give corresponding experimental stimulation to the animal according to the movement track, records the movement track and records electrophysiological data in cooperation with related devices, so as to achieve the synchronization of the recorded behavior and electrophysiological data and automate the experiment.
Disclosure of Invention
In view of the above, the present invention provides a system and a method for analyzing animal neural signals and behavior videos synchronously based on time stamps, which realize the synchronous analysis of the neural signals and the behavior videos by marking the time stamps and storing the animal neural signals and the animal behavior videos.
In order to achieve the purpose, the invention provides the following technical scheme:
in a first aspect, the embodiment provides a synchronous analysis system of animal neural signals and behavior videos based on time stamps, which comprises
The video monitoring device is used for monitoring and acquiring animal behavior videos in real time and respectively distributing the animal behavior videos to the behavior analysis system, the storage system and the interactive control platform;
the behavior analysis system is used for performing behavior analysis according to the received animal behavior video and sending the obtained behavior analysis result to the storage system for storage;
the nerve signal acquisition device is used for acquiring animal nerve signals in real time and respectively sending the animal nerve signals to the computing main control system, the storage system and the interactive control platform;
the computing main control system is used for decoding and analyzing the received animal neural signals and sending the obtained neural analysis result to the storage system for storage;
the storage system is used for synchronously streaming and storing the received animal behavior video and the animal nerve signals in a time stamp marking mode and also used for carrying out evened storage on the behavior analysis result and the nerve analysis result according to a text structured form, wherein the evened storage comprises a time stamp;
the interactive control platform is used for synchronously displaying and analyzing the animal behavior video and the animal nerve signals acquired from the video monitoring device and the nerve signal acquisition device on line according to the marking time stamp; and retrieving and acquiring animal behavior videos and animal nerve signals from a storage system according to the marking time stamps or the behavior analysis results, and performing offline synchronous display and analysis.
In one embodiment, the behavioral analysis results include an action identification and the neural analysis results include a neural signal type.
In one embodiment, the storage system divides different data sets according to sampling date, wherein each data set comprises an event record index, a nerve signal data set and a behavior video data set;
the event record index is used for storing a behavior analysis result and a neural analysis result; the behavior analysis result is recorded in a json format structure, and each record comprises an action identifier, action occurrence time, action duration and a timestamp; the neural analysis result is structurally recorded in a json format, and each record includes a neural signal type, signal generation time, signal duration and a time stamp;
the neural signal data set and the behavior video data set are stored in the same mode and respectively comprise a plurality of data segments, each data segment comprises an index area and a data area, the index area comprises metadata, a timestamp index and corresponding offset thereof, and the metadata records data type, data duration, data starting time, data ending time and data length.
In one embodiment, the storage system stores data in the following manner:
firstly, performing time analysis and data type analysis on acquired data, directly creating an index and storing a data section in an original data set when the original data set matched with the data type exists in a storage system, or creating an index and storing a data section in a new data set after the data set is created; then, when the data amount of the data segment exceeds the rated time length, the data segment is newly created and stored, and the index information is updated.
In one embodiment, the process of the interactive control platform for online synchronous display and analysis of the animal behavior video and the animal neural signal acquired from the video monitoring device and the neural signal acquisition device according to the marking time stamp comprises the following steps:
the interactive control platform acquires animal nerve signals and marks a current timestamp to form a data cache queue;
the interactive control platform determines the delay time of video data and a plurality of key frames capable of retaining complete pictures, and marks all data between two adjacent key frames as the same time stamp, in the process of obtaining the animal behavior video, the system time of the current key frame arrival is obtained, the difference between the system time and the delay time is used as the occurrence time of the current key frame, the occurrence time is converted into the corresponding time stamp, the animal nerve signal corresponding to the time stamp is obtained from the data cache queue according to the time stamp, and the obtained animal behavior video and the animal nerve signal are synchronously displayed and analyzed on line.
In one embodiment, the interactive control platform retrieves and acquires the animal behavior video and the animal nerve signal from the storage system according to the marking time stamp and performs an offline synchronous display and analysis process, and comprises the following steps:
and according to the input time stamp, retrieving the animal behavior video and the animal nerve signals corresponding to the input time stamp in a storage system, and then acquiring the retrieved animal behavior video and the animal nerve signals, and synchronously displaying and analyzing the retrieved animal behavior video and the animal nerve signals offline.
In one embodiment, the interactive control platform retrieves and acquires animal behavior videos and animal nerve signals from a storage system according to the behavior analysis result and performs an offline synchronous display and analysis process, including:
according to the input behavior analysis result, the input behavior analysis result is retrieved in the storage system, a timestamp queue corresponding to the behavior analysis result is formed, after a required timestamp is selected from the timestamp queue, an animal behavior video and an animal nerve signal corresponding to the selected required timestamp are retrieved, and then the retrieved animal behavior video and the animal nerve signal are obtained and are synchronously displayed and analyzed in an off-line mode.
In a second aspect, the embodiment provides a synchronous analysis method of animal neural signals and behavioral videos based on time stamps, and the synchronous analysis method is implemented by adopting a synchronous analysis system of the videos.
Compared with the prior art, the invention has the beneficial effects that at least:
the method for synchronously displaying and analyzing the animal nerve signals and the behavior videos in real time is realized based on the timestamp marks of the animal behavior videos and the nerve signals, and retrieval playback based on the timestamp and the action marks and two synchronous analysis modes of online and offline are realized by establishing indexes to store a large amount of data such as the nerve signals, the animal videos and the like in order.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a synchronous analysis system of animal neural signals and behavior videos based on time stamps provided by an embodiment;
FIG. 2 is a storage file management diagram of a storage system according to an embodiment;
FIG. 3 is a schematic diagram of a data storage flow implemented by the storage system provided by the embodiment;
FIG. 4 is a flow diagram of an online synchronized display and analysis implemented by an interactive control platform provided by an embodiment;
FIG. 5 is a flowchart of an offline synchronized display and analysis in accordance with a time stamp implemented by an interactive control platform provided by an embodiment;
fig. 6 is a flowchart for synchronously displaying and analyzing offline according to a behavior analysis result implemented by the interactive control platform according to the embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the detailed description and specific examples, while indicating the scope of the invention, are intended for purposes of illustration only and are not intended to limit the scope of the invention.
Fig. 1 is a schematic structural diagram of a synchronous analysis system of animal neural signals and behavior videos based on time stamps provided by an embodiment. As shown in fig. 1, the synchronous analysis system provided in the embodiment includes six devices, namely, an interactive control platform, a video detection device, a behavior analysis system, a neural signal acquisition device, a computing main control system, and a storage system, and each device communicates with another device through an information exchange network formed by wired routers.
The video monitoring device is used for monitoring and acquiring animal behavior videos in real time and respectively sending the animal behavior videos to the behavior analysis system, the storage system and the interactive control platform; the behavior analysis system is used for intelligently analyzing animal behaviors according to the received animal behavior videos and sending obtained behavior analysis results to the storage system for storage; the nerve signal acquisition device is used for acquiring animal nerve signals in real time and respectively transmitting the animal nerve signals to the computing main control system, the storage system and the interactive control platform; the computing main control system is used for decoding and analyzing the received animal nerve signals and sending the obtained nerve analysis results to the storage system for storage; the storage system is used for synchronously streaming-storing the received animal behavior video and the animal nerve signals in a time stamp marking mode and also used for performing event storage on the behavior analysis result and the nerve analysis result according to a text structured form; the interactive control platform is used for synchronously displaying and analyzing the animal behavior video and the animal nerve signals acquired from the video monitoring device and the nerve signal acquisition device on line according to the marking time stamp; and retrieving and acquiring animal behavior videos and animal nerve signals from a storage system according to the marking time stamps or the behavior analysis results, and performing offline synchronous display and analysis.
In the synchronous analysis system, the interactive control platform is a desktop computer of a Windows system, and interacts with the storage system, and the video monitoring device and the neural signal acquisition device only need to have the functions of animal behavior video acquisition, animal neural signal acquisition and data interaction, and are not limited herein. The behavior analysis system and the calculation main control system mainly complete data analysis to obtain a behavior analysis result and a neural analysis result, and the specific form is not limited. Based on the method, the interactive control platform supports online and offline synchronous display and analysis by combining a specific data storage mode of the storage system, namely, data directional extraction, retrieval and analysis are carried out according to marks such as a marking time stamp and a behavior analysis result.
Fig. 2 is a schematic storage file management diagram of a storage system according to an embodiment. As shown in fig. 2, the storage system divides the different data sets (Datasets 1, Datasets 2, …, Datasets N) according to the sampling date, and each independent data set includes an event record index, a neural signal data set (neural signal Datasets), and a behavior video data set (behavior video Datasets).
The event record index is used for storing a behavior analysis result and a neural analysis result; the behavior analysis result is recorded in a json format structure, and each record contains detailed information of four types of data including action identification, action occurrence time, action duration and timestamp; the neural analysis result is recorded in a json format in a structured mode, and each record records the detailed information of four types of data, namely neural signal type, signal generation time, signal duration and time stamp. The action mark is data included in the behavior analysis result, and specifically includes actions of nodding head, lifting hands, lifting feet and the like of the animal. The neural signal type is data included in the neural analysis result, and may specifically include a peak potential signal Spike, a local field signal LFP, and the like.
The nerve signal data sets and the behavior video data sets adopt the same storage mode to store a large number of data segment files, namely each nerve signal data set and the behavior video data sets comprise a plurality of data segments, each data segment comprises an index area and a data area, wherein the index area comprises metadata, a timestamp index and corresponding offset thereof, and the metadata records information such as data type, data duration, data starting time, data ending time, data length and the like.
That is, the storage system provided by the embodiment performs streaming storage on received animal neural data and animal behavior videos, marks timestamps to synchronize the data, establishes indexes to enable fast retrieval in online and offline, and performs event storage on received behavior analysis results and neural analysis results. Therefore, synchronous verification of the neural signals and animal behaviors can be realized, and high efficiency and accuracy of neural signal analysis are ensured.
The storage system is based on the storage file management mode provided above, and the storage system adopts a data storage mode including: firstly, performing time analysis and data type analysis on acquired data, directly creating an index and storing a data section in an original data set when the original data set matched with the data type exists in a storage system, or creating an index and storing a data section in a new data set after the data set is created; then, when the data amount of the data segment exceeds the rated time length, the data segment is newly created and stored, and the index information is updated.
FIG. 3 is a schematic diagram of a data storage flow implemented by the storage system according to an embodiment. As shown in fig. 3, the storage system acquires animal behavior videos and animal nerve signals, which are collectively referred to as raw data, from the video monitoring system and the nerve signal acquisition device, that is, acquires the raw data, calculates a current timestamp and a data type, finds matched data sets according to the data type, and creates an index in the matched data sets and stores a data segment if the matched data sets exist; and if the matched data sets do not exist, newly building an index in the new data sets and storing the data segment after the data sets are built according to the data type and the timestamp carried by the data. And in the data storage process, setting a rated data time, if the data exceeds the rated time in 1 hour, newly building a data section and continuously storing, and after the data is stored in the rated data time, updating the index file information. And finishing the data storage.
And regarding the online synchronous analysis part, the video monitoring device collects video data, and the behavior analysis system records information such as action identification, action occurrence time, action duration time and the like according to the behavior analysis result. The main control system intelligently analyzes the cranial nerve data, and extracts nerve signals such as Spike potential signals (Spike) and local field signals (LFP) in the cranial nerve data as a nerve analysis result. The interactive control system synchronizes and displays the video data and the neural signal data in real time, and meanwhile, can retrieve the behavior analysis result and the neural analysis result in the storage system, thereby realizing the function of on-line synchronous analysis.
FIG. 4 is a flow diagram of an online synchronized display and analysis implemented by the interactive control platform provided by the embodiments. As shown in fig. 4, the interactive control platform displays and analyzes the animal behavior video and the animal neural signal obtained from the video monitoring device and the neural signal acquisition device synchronously on line according to the marked time stamp, and the specific process includes:
the method comprises the steps that an interactive control platform obtains animal nerve signals and marks current time stamps to form a data cache queue; the interactive control platform determines the delay time t of the video datadAnd a plurality of key frames I capable of retaining a complete picture, dividing time intervals by the key frames I, namely marking all video stream data between two adjacent key frames I as the same timestamp, acquiring the system time of the arrival of the current key frame I in the process of acquiring the animal behavior video, and taking the difference between the system time and the delay time as the occurrence time t of the current key frame1(t1＝t0-td) Will occur at time t1And converting the animal behavior video into a corresponding time stamp, acquiring the animal nerve signal corresponding to the time stamp from the data cache queue according to the time stamp, and performing online synchronous display and analysis on the acquired animal behavior video and the animal nerve signal.
Regarding the offline synchronous analysis part, by utilizing the large-scale and long-time storage characteristics of data of the storage system and establishing an index mode, the interactive control platform can acquire specific data in the storage system according to any time and specific action marks (such as animal nodding, left-handed lifting and the like), so that offline playback display of animal nerve signals and animal behavior videos is realized, and meanwhile, behavior analysis results and nerve analysis results in the storage system can be retrieved, so that the function of offline synchronous analysis is realized.
FIG. 5 is a flowchart for offline synchronized display and analysis according to a timestamp implemented by an interactive control platform provided by an embodiment. As shown in fig. 5, the process of retrieving, acquiring, and performing offline synchronous display and analysis of the animal behavior video and the animal neural signal by the interactive control platform according to the marked timestamp includes:
and according to the input time stamp, retrieving the animal behavior video and the animal nerve signals corresponding to the input time stamp in a storage system, and then acquiring the retrieved animal behavior video and the animal nerve signals, and synchronously displaying and analyzing the retrieved animal behavior video and the animal nerve signals offline.
Specifically, the interactive control platform sends a retrieval request according to the time stamp to the storage system, the storage system returns the time stamp which can be retrieved, a data analysis request containing the input time stamp is formed after the user selects the input time stamp, the storage system retrieves the input time stamp in the nerve signal data sets and the behavior video data sets after receiving the data analysis request, and if the retrieval fails, the time stamp to be retrieved is reselected; and after the retrieval is successful, the storage system returns data and sends the data to the interactive control platform to realize visual off-line synchronous display and analysis.
Fig. 6 is a flowchart for synchronously displaying and analyzing offline according to a behavior analysis result implemented by the interactive control platform according to the embodiment. As shown in fig. 6, the process of retrieving, acquiring, and performing offline synchronous display and analysis of animal behavior video and animal neural signals by the interactive control platform from the storage system according to the behavior analysis result includes:
the interaction control platform sends a data analysis request containing a behavior analysis result input by a user to the storage system, wherein the behavior analysis result can be any action mark, the storage system retrieves the input behavior analysis result in the storage system retrieval according to the input behavior analysis result after receiving the data analysis request, a timestamp queue corresponding to the behavior analysis result is formed because a plurality of timestamps correspond to the same action mark, the required timestamps are selected from the timestamp queue, the selected required timestamps are retrieved from the nerve signal data and the behavior video data, and after the required timestamps are retrieved, the data (the animal behavior video and the animal nerve signal) corresponding to the retrieved timestamps are transmitted back to the interaction control platform, so that the offline visual synchronous display and analysis of the animal behavior video and the animal nerve signal are realized.
The embodiment also provides a synchronous analysis method of animal neural signals and behavior videos based on the time stamp, the synchronous analysis system is adopted in the analysis method, and the specific process is as follows:
monitoring and acquiring animal behavior videos in real time by using a video monitoring device, and respectively sending the animal behavior videos to a behavior analysis system, a storage system and an interactive control platform;
performing behavior analysis by using a behavior analysis system according to the received animal behavior video, and sending the obtained behavior analysis result to a storage system for storage;
the method comprises the following steps of collecting animal nerve signals in real time by using a nerve signal collecting device, and respectively sending the animal nerve signals to a computing main control system, a storage system and an interactive control platform;
decoding and analyzing the received animal nerve signals by using a computing main control system, and sending the obtained nerve analysis result to a storage system for storage;
the method comprises the steps that a storage system is used for carrying out synchronous streaming storage on received animal behavior videos and animal nerve signals in a time stamp marking mode, and also carrying out event storage on behavior analysis results and nerve analysis results, wherein the event storage comprises time stamps;
synchronously displaying and analyzing animal behavior videos and animal nerve signals acquired from a video monitoring device and a nerve signal acquisition device on line by using an interactive control platform according to the marking time stamp; and retrieving and acquiring animal behavior videos and animal nerve signals from a storage system according to the marking time stamps or the behavior analysis results, and performing offline synchronous display and analysis.
In the synchronous analysis system and method provided by the above embodiments, there is a certain time delay in the transmission of the animal behavior video, but the neural signals and the animal behavior video are marked based on the time stamp in the data storage, so that it can be ensured that the interactive control platform synchronously displays the animal neural signals and the video behavior signals. During data backtracking, the data can be retrieved in a storage system according to any time information and specific action marks (such as animal nodding, left-handed lifting and the like), offline playing and analysis are achieved, and a closed loop of acquisition, display, storage and analysis is formed.
In the synchronous analysis system and method provided by the above embodiments, by using the large-scale and long-time storage characteristics of data of the storage system and the related storage mode, the interactive control platform can acquire specific data in the storage system according to any time and specific action signs (such as animal nodding, left-handed lifting, and the like), thereby realizing the offline playback analysis of animal nerve signals and behavior videos. The storage system provides two inquiry modes according to time and action marks, so that a user can conveniently call out specified time data or specific action data for further analysis, for example, the time and the channel of action potential in the original data of the nerve signals are analyzed when the animal holds the left hand, and data are provided for the analysis of the data of the brain nerve signals.
The synchronous analysis system and method provided by the embodiment realize real-time synchronous display and analysis of animal nerve signals and animal behavior videos based on timestamp marks of the animal behavior videos and the nerve signals, realize directional retrieval and playback of identifiers based on timestamps, action marks and the like by establishing indexes to store a large amount of data such as the animal nerve signals, the animal behavior videos and the like in order, and realize two synchronous analysis modes of online and offline.
The above-mentioned embodiments are intended to illustrate the technical solutions and advantages of the present invention, and it should be understood that the above-mentioned embodiments are only the most preferred embodiments of the present invention, and are not intended to limit the present invention, and any modifications, additions, equivalents, etc. made within the scope of the principles of the present invention should be included in the scope of the present invention.
Claims (8)
1. A system for analyzing animal neural signals and behavior videos synchronously based on time stamps, which is characterized by comprising:
the video monitoring device is used for monitoring and acquiring animal behavior videos in real time and respectively sending the animal behavior videos to the behavior analysis system, the storage system and the interactive control platform;
the behavior analysis system is used for performing behavior analysis according to the received animal behavior video and sending the obtained behavior analysis result to the storage system for storage;
the nerve signal acquisition device is used for acquiring animal nerve signals in real time and respectively sending the animal nerve signals to the computing main control system, the storage system and the interactive control platform;
the computing main control system is used for decoding and analyzing the received animal neural signals and sending the obtained neural analysis result to the storage system for storage;
the storage system is used for synchronously streaming and storing the received animal behavior video and the animal nerve signals in a time stamp marking mode and also used for carrying out evened storage on the behavior analysis result and the nerve analysis result according to a text structured form, wherein the evened storage comprises a time stamp;
the interactive control platform is used for synchronously displaying and analyzing the animal behavior video and the animal nerve signals acquired from the video monitoring device and the nerve signal acquisition device on line according to the marking time stamp; and retrieving and acquiring animal behavior videos and animal nerve signals from a storage system according to the marking time stamps or the behavior analysis results, and performing offline synchronous display and analysis.
2. The system of claim 1, wherein the behavioral analysis results include action identification and the neural analysis results include neural signal type.
3. The system for synchronously analyzing animal neural signals and behavioral videos based on time stamps according to claim 1, wherein the storage system divides different data sets according to sampling dates, and each data set comprises an event record index, a neural signal data set and a behavioral video data set;
the event record index is used for storing a behavior analysis result and a neural analysis result; the behavior analysis result is recorded in a json format structure, and each record comprises an action identifier, action occurrence time, action duration and a timestamp; the neural analysis result is structurally recorded in a json format, and each record includes a neural signal type, signal generation time, signal duration and a time stamp;
the neural signal data set and the behavior video data set are stored in the same mode and respectively comprise a plurality of data segments, each data segment comprises an index area and a data area, the index area comprises metadata, a timestamp index and corresponding offset thereof, and the metadata records data type, data duration, data starting time, data ending time and data length.
4. The system for synchronously analyzing animal neural signals and behavioral videos based on time stamps according to claim 1 or 3, characterized in that the storage system performs data storage by adopting the following modes:
firstly, performing time analysis and data type analysis on acquired data, directly creating an index and storing a data section in an original data set when the original data set matched with the data type exists in a storage system, or creating an index and storing a data section in a new data set after the data set is created; then, when the data amount of the data segment exceeds the rated time length, the data segment is newly created and stored, and the index information is updated.
5. The system for synchronously analyzing animal nerve signals and behavior videos based on time stamps according to claim 1 or 3, wherein the process of synchronously displaying and analyzing the animal behavior videos and the animal nerve signals acquired from the video monitoring device and the nerve signal acquisition device on line by the interactive control platform according to the time stamps comprises the following steps:
the interactive control platform acquires animal nerve signals and marks a current timestamp to form a data cache queue;
the interactive control platform determines the delay time of video data and a plurality of key frames capable of retaining complete pictures, and marks all data between two adjacent key frames as the same time stamp, in the process of obtaining the animal behavior video, the system time of the current key frame arrival is obtained, the difference between the system time and the delay time is used as the occurrence time of the current key frame, the occurrence time is converted into the corresponding time stamp, the animal nerve signal corresponding to the time stamp is obtained from the data cache queue according to the time stamp, and the obtained animal behavior video and the animal nerve signal are synchronously displayed and analyzed on line.
6. The system for synchronously analyzing animal neural signals and behavioral videos based on time stamps according to claim 1 or 3, wherein the interactive control platform retrieves and acquires the animal behavioral videos and the animal neural signals from the storage system according to the time stamps and carries out an offline synchronous display and analysis process, and comprises the following steps:
and according to the input time stamp, retrieving the animal behavior video and the animal nerve signals corresponding to the input time stamp in a storage system, and then acquiring the retrieved animal behavior video and the animal nerve signals, and synchronously displaying and analyzing the retrieved animal behavior video and the animal nerve signals offline.
7. The system for synchronously analyzing animal neural signals and behavioral videos based on time stamps according to claim 1 or 3, wherein the interactive control platform retrieves and acquires the animal behavioral videos and the animal neural signals from the storage system according to the behavioral analysis results and carries out an offline synchronous display and analysis process, and comprises the following steps:
according to the input behavior analysis result, the input behavior analysis result is retrieved in the storage system, a timestamp queue corresponding to the behavior analysis result is formed, after a required timestamp is selected from the timestamp queue, an animal behavior video and an animal nerve signal corresponding to the selected required timestamp are retrieved, and then the retrieved animal behavior video and the animal nerve signal are obtained and are synchronously displayed and analyzed in an off-line mode.
8. A method for synchronously analyzing animal neural signals and behavioral videos based on time stamps, which is implemented by using the video synchronous analysis system of any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111247839.1A CN113989839A (en) | 2021-10-26 | 2021-10-26 | System and method for synchronously analyzing animal neural signals and behavior videos based on timestamps |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111247839.1A CN113989839A (en) | 2021-10-26 | 2021-10-26 | System and method for synchronously analyzing animal neural signals and behavior videos based on timestamps |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113989839A true CN113989839A (en) | 2022-01-28 |
Family
ID=79741612
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111247839.1A Pending CN113989839A (en) | 2021-10-26 | 2021-10-26 | System and method for synchronously analyzing animal neural signals and behavior videos based on timestamps |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113989839A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115955552A (en) * | 2023-03-15 | 2023-04-11 | 国网吉林省电力有限公司信息通信公司 | Security monitoring system based on 5G wireless communication network |
-
2021
- 2021-10-26 CN CN202111247839.1A patent/CN113989839A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115955552A (en) * | 2023-03-15 | 2023-04-11 | 国网吉林省电力有限公司信息通信公司 | Security monitoring system based on 5G wireless communication network |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11432757B2 (en) | Method for hosting mobile access to high-resolution electroencephalography data | |
| US7343417B2 (en) | System and method for rating media information | |
| WO2021000909A1 (en) | Curriculum optimisation method, apparatus, and system | |
| CN103919537B (en) | Emotion record analysis guidance system and its implementation | |
| US9646649B2 (en) | Medical image data information exchange system | |
| JP2013114648A (en) | Server apparatus, information terminal and program | |
| CN104811810B (en) | Based on smart television real-time region audience ratings and rating share statistical system and method | |
| CN113989839A (en) | System and method for synchronously analyzing animal neural signals and behavior videos based on timestamps | |
| US11709859B2 (en) | Systems and methods for enabling situational awareness for events via data visualization | |
| CN111641699B (en) | Local area rehabilitation Internet of things system for rehabilitation station | |
| CN104298748A (en) | Device and method for face search in videos | |
| CN113347502A (en) | Video review method, video review device, electronic equipment and medium | |
| CN114446439A (en) | Motion risk assessment method and system based on wearable equipment | |
| CN106354606A (en) | Application program exception handling method and device | |
| CN112617861A (en) | Electroencephalogram centralized monitoring system for neonatal intensive care unit | |
| US20100026798A1 (en) | Method and System for Capturing Physiological and Video Data and Subsequently Marking the Data While Viewing the Video | |
| CN114640884B (en) | Online video playing quality analysis method, system and computer storage medium | |
| CN117278776A (en) | Multichannel video content real-time comparison method and device, equipment and storage medium | |
| CN110704447A (en) | Method for monitoring and evaluating contribution degree of laboratory equipment instrument | |
| CN106940720B (en) | Multi-source information processing method and system based on healthy Internet of things | |
| CN114021842A (en) | Remote education data acquisition and analysis method, equipment and computer storage medium | |
| CN111311468A (en) | Human body temperature acquisition and processing method and system | |
| CN112905811A (en) | Teaching audio and video pushing method and system based on student classroom behavior analysis | |
| US20140325574A1 (en) | Perceptors and methods pertaining thereto | |
| CN116822805B (en) | Education video quality monitoring method based on big data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |