CN109471532B - Multi-channel human-computer environment test data synchronization platform experiment design system and method - Google Patents
Multi-channel human-computer environment test data synchronization platform experiment design system and method Download PDFInfo
- Publication number
- CN109471532B CN109471532B CN201811289878.6A CN201811289878A CN109471532B CN 109471532 B CN109471532 B CN 109471532B CN 201811289878 A CN201811289878 A CN 201811289878A CN 109471532 B CN109471532 B CN 109471532B
- Authority
- CN
- China
- Prior art keywords
- stimulation
- recording
- stimulation material
- area
- human
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention provides an experimental design system and method for a multi-channel man-machine environment test data synchronization platform, wherein the experimental design system comprises: the stimulation material recording module and the stimulation attribute adjusting module; the stimulation material recording module forms a stimulation material recording area on a human-computer interaction interface of the multichannel human-computer interaction data synchronization system, and is used for recording stimulation materials and editing a stimulation material recording mode; the stimulation material recording area is provided with a recording way based on screen experimental design, virtual reality and field research; the stimulation attribute adjusting module forms a stimulation material attribute adjusting area on a human-computer interaction interface of the multichannel human-computer interaction data synchronization system, and is used for adjusting and/or editing the attribute information of the stimulation material recorded through the stimulation material recording area so as to display the stimulation material to the examinee based on the adjusted and/or edited attribute information of the stimulation material; the stimulation material entry area and the stimulation material property adjustment area are located at different positions within the same display interface.
Description
Technical Field
The invention relates to the field of human-computer interaction, in particular to an experimental design system and method for a multichannel human-computer environment test data synchronization platform.
Background
Human-Computer Interaction (HCI) refers to a process of exchanging information between a person and a Computer for completing a certain task in a certain interactive manner by using a certain dialogue language between the person and the Computer.
In the scientific research fields such as psychological research, laboratory application research, military research, automobile driving research and the like, the simulation of practical application scenes is often needed to collect relevant data of people, so that the scientific research is realized by using a human-computer interaction technology, and the method is a research direction with high research value.
The current human-computer interaction data system is a single-channel human-computer interaction data system for monitoring and analyzing a physiological index, and the monitoring and analyzing principle is as follows: the method comprises the steps of monitoring single physiological indexes (such as skin electricity) or other indexes (such as behavior indexes and eye movement indexes) of a human body through collection media such as sensors, uploading monitoring results to a computer, carrying out data analysis on the collected physiological indexes through a computer program, and finally obtaining experiment results, wherein the experiment results are used for technical support of related scientific research projects and the like. With the development of new scientific technologies, such as virtual/augmented reality and simulation technologies, eye tracking and eye control interaction technologies, electroencephalogram measurement and brain-computer interaction interface technologies, human-computer interaction and artificial intelligence, cognitive neuroscience, big data, cloud computing and other technologies, deep cross fusion is achieved, and the single-channel human-computer interaction data system cannot meet the requirements of scientific research and application development.
An experiment design module is arranged in the man-machine interaction data system and used for carrying out early-stage design on each experiment project in the system. In the man-machine interaction data synchronization system, after corresponding design data is completed in the experimental design module, results based on the experimental design data can be generated in each subsequent physiological module. A complete and rational design of the experiment plays a crucial role for the whole experiment. However, at present, the experimental design module in the human-computer interaction data system is arranged in the same module as a single data monitoring module (such as a behavior data analysis module or a physiological data analysis module) or is dispersed in different modules, so that not only is the design mode single, but also experimental projects are difficult to integrate, and therefore, the functionality and the integrity in the experimental design process cannot be effectively utilized, and needs to be further improved.
Disclosure of Invention
In view of this, embodiments of the present invention provide a system and method for designing an experiment of a multi-channel human-machine environment test data synchronization platform, so as to obviate or mitigate one or more of the disadvantages in the prior art.
The technical scheme of the invention is as follows:
according to one aspect, the invention provides an experiment design system of a multi-channel man-machine environment test data synchronization platform, comprising: the stimulation material recording module and the stimulation attribute adjusting module;
the stimulation material recording module forms a stimulation material recording area on a human-computer interaction interface of the multichannel human-computer interaction and human-computer environment test data synchronization system, and is used for selecting a stimulation material recording mode and recording and editing stimulation materials; the stimulation material recording area is provided with recording ways based on screen experimental design, Virtual Reality (VR) and field research respectively;
the stimulation attribute adjusting module forms a stimulation material attribute adjusting area on a human-computer interaction interface of the multichannel human-computer interaction and human-computer environment test data synchronization system, and is used for adjusting and/or editing the attribute information of the stimulation material recorded through the stimulation material recording area so as to display the stimulation material to the examinee based on the adjusted and/or edited attribute information of the stimulation material;
the stimulation material entry area and the stimulation material property adjustment area are located at different positions within the same display interface.
Preferably, the experiment design system further comprises: a global design module; the global design module forms a global setting area on a human-computer interaction interface of the multi-channel human-computer interaction data synchronization system, and the global setting area is used for setting and/or editing the stimulation material.
Preferably, the global setting area comprises at least one of the following setting items: the screen settings of the presentation of the stimulation material, the resolution adjustment of the screen, whether the stimulation material appears randomly, whether real-time marking is allowed.
Preferably, a first file importing function operation indication mark and a screen recording function operation indication mark are arranged under an entering way based on screen experimental design, the first file importing function operation indication mark is used for importing a picture or a video file and storing the picture or the video file according to a set storage path, and the screen recording function operation indication mark is used for recording a screen through a camera device to generate a screen recording file and storing the screen recording file according to the set storage path; a second file importing function operation indication mark and a virtual reality recording function operation indication mark are arranged under an entry way based on virtual reality, the second file importing function operation indication mark is used for importing a panoramic picture or a video file and storing the panoramic picture or the video file according to a set storage path, and the virtual reality recording function operation indication mark is used for recording a screen through a panoramic camera to generate a virtual reality screen recording file and storing the virtual reality screen recording file according to the set storage path; an eye tracker entry and/or a field camera entry are arranged under an entry path based on field research, so that field stimulation material entry is carried out through the eye tracker entry and/or the field camera entry.
Preferably, the stimulation material entry means comprises stimulation material entry by copying and pasting the stimulation material.
Preferably, the stimulation material entry area also displays a time axis for presenting the entered stimulation materials on the time axis in the entry order of the entered stimulation materials.
Preferably, the stimulation material comprises a picture, video and/or screen-recorded file; for picture and/or video type stimulation material, the attribute information comprises at least one of the following information: the method comprises the following steps of (1) selecting stimulation materials, selecting a mouse, selecting a random playing groups, selecting a random playing, and marking names; for the stimulating material of the screen recording file type, the attribute information comprises at least one of the following information: the name of the recorded stimulation material, the switching mode of the stimulation material, whether the stimulation material participates in recording, the group of random playing is set, and the name of a mark is sent out.
Preferably, the stimulation property adjustment module determines the property information of the stimulation material based on the entry manner of the stimulation material.
According to another aspect of the present invention, there is also provided a design method for an experiment of a multi-channel human-computer environment test data synchronization platform, the method comprising the following steps: forming a stimulation material recording area on a human-computer interaction interface of the multi-channel human-computer interaction and human-computer environment test data synchronization system, wherein the stimulation material recording area is used for selecting a stimulation material recording mode and recording and editing stimulation materials; an input way based on screen experimental design, virtual reality and field research is arranged in the stimulation material input area; forming a stimulation material attribute adjusting area on a human-computer interaction interface of the multichannel human-computer interaction and human-computer environment test data synchronization system, wherein the stimulation material attribute adjusting area is used for adjusting and/or editing the attribute information of the stimulation material recorded through the stimulation material recording area so as to display the stimulation material to the examinee based on the adjusted and/or edited attribute information of the stimulation material; the stimulation material entry area and the stimulation material property adjustment area are located at different positions within the same display interface.
According to another aspect of the present invention, there is also provided a computer readable storage medium having a computer program stored thereon, wherein the program, when executed by a processor, performs the steps of the method as previously described.
The multi-channel human-computer environment test data synchronization platform experiment design system and method provided by the embodiment of the invention not only centralize the design mode of experiment design, but also have flexible experiment design data input mode and approach, are beneficial to finishing related experiment data in the same interface, realize the integrity of the experiment design process, and are particularly suitable for a multi-channel human-computer interaction data synchronization system.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
It will be appreciated by those skilled in the art that the objects and advantages that can be achieved with the present invention are not limited to the specific details set forth above, and that these and other objects that can be achieved with the present invention will be more clearly understood from the detailed description that follows.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the principles of the invention. In the drawings:
fig. 1 is a schematic structural diagram of an experiment design system for a multi-channel human-computer environment test data synchronization platform according to an embodiment of the present invention.
FIG. 2 is a schematic diagram of a display interface of the experimental design system according to an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the following embodiments and accompanying drawings. The exemplary embodiments and descriptions of the present invention are provided to explain the present invention, but not to limit the present invention.
It should be noted that, in order to avoid obscuring the present invention with unnecessary details, only the structures and/or processing steps closely related to the scheme according to the present invention are shown in the drawings, and other details not so relevant to the present invention are omitted.
It should be emphasized that the term "comprises/comprising" when used herein, is taken to specify the presence of stated features, elements, steps or components, but does not preclude the presence or addition of one or more other features, elements, steps or components.
It is also noted herein that the term "coupled," if not specifically stated, may refer herein to not only a direct connection, but also an indirect connection in which an intermediate is present.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the drawings, the same reference numerals denote the same or similar parts, or the same or similar steps.
FIG. 1 is a schematic structural diagram of an experiment design system for a multi-channel human-computer environment test data synchronization platform in the embodiment of the present invention. As shown in fig. 1, the experimental design system at least includes: a stimulation material recording module and a stimulation attribute adjusting module.
The stimulation material recording module is used for forming a stimulation material recording area on a human-computer interaction interface of the multichannel human-computer interaction data synchronization system, and is used for selecting a stimulation material recording mode and recording and editing stimulation materials; the stimulation material recording area is provided with recording ways based on screen experimental design, virtual reality and field research respectively. In embodiments of the present invention, a stimulating material (or stimulus) refers to a material that is used by a subject to view to provide a stimulating condition to the subject to monitor the physiological or motor response of the subject when viewing the stimulating material. The stimulus material may be, for example, pictures, videos, etc., but the present invention is not limited thereto.
The stimulation attribute adjusting module is used for forming a stimulation material attribute adjusting area on a human-computer interaction interface of the multichannel human-computer interaction data synchronization system, and is used for adjusting and/or editing the attribute information of the stimulation material recorded through the stimulation material recording area so as to display the stimulation material to the examinee based on the adjusted and/or edited attribute information of the stimulation material.
In a preferred embodiment of the invention, the stimulation material entry area and the stimulation material property adjustment area are located at different positions within the same display interface.
In another embodiment of the present invention, as shown in fig. 1, the experimental design system may further include a global design module, which is configured to form a global setting area on the human-computer interaction interface of the multi-channel human-computer interaction data synchronization system, and is configured to set and/or edit all the stimulation materials. Preferably, the stimulation material recording area, the stimulation material property adjusting area and the global setting area can be located at different positions in the same display interface of the multi-channel human-computer interaction data synchronization system.
In the stimulation material recording area, stimulation materials such as pictures, videos and screen recording can be added (namely recorded) in a recording way based on screen experimental design; stimulating materials such as 360-degree panoramic pictures, videos and virtual recording screens can be added in a virtual reality recording way; under the recording approach of field study, stimulation materials such as G2 and scene cameras can be added. These stimulation materials support a single introduction and/or a batch introduction, and optionally, the introduced stimulation materials can be deleted. The recorded stimulation material can be stored according to a set storage path. In an embodiment of the present invention, the stimulation material entry area may further include a preview function icon for previewing the entered stimulation material.
In an embodiment of the present invention, in the stimulation material recording area, a first file importing function operation indication mark and a screen recording function operation indication mark may be provided in a recording path designed based on a screen experiment, where the first file importing function operation indication mark is used to import a picture or a video file and store the picture or the video file according to a set storage path, and the screen recording function operation indication mark is used to record a screen by using a camera device to generate a screen recording file and store the screen recording file according to the set storage path. As an example, the first file import function operation instruction mark may be a file import function key, and the screen recording function operation instruction mark may be a screen recording function key. First entry function icons can be arranged below the file import function keys and the screen recording function keys, the first entry function icons can comprise stimulation material adding (such as pictures and videos) icons and screen recording icons, different types of stimulation materials can be added after corresponding function icons are clicked, and storage is carried out according to a set storage path.
In the stimulation material recording area, a second file importing function operation indication mark and a virtual reality recording function operation indication mark can be arranged in a virtual reality recording way, the second file importing function operation indication mark is used for importing a panoramic picture (such as a 360-degree panoramic picture) or a video file and storing the panoramic picture or the video file according to a set storage path, and the virtual reality recording function operation indication mark is used for recording a screen through a panoramic camera, generating a virtual reality recording screen file and storing the virtual reality recording screen file according to the set storage path. As an example, the second file import function operation indication mark may be a file function key, the virtual reality recording function operation indication mark may be a VR recording function key, a second entry function icon may be further disposed below the two function keys, the second entry function icon may include an add stimulus material icon and a VR screen recording icon, different types of stimulus materials are added after clicking the corresponding function icon, and the stimulus materials are stored according to a set storage path.
In addition, in an embodiment of the present invention, the stimulus material recording means includes recording the stimulus material by copying and pasting the stimulus material. More specifically, the stimulation material can be copied in an entry way based on screen experimental design and in an entry way of virtual reality, and the copying way is to directly select the stimulation material copying and batch copying in the interface. The specific method for directly selecting the copy stimulation material is to click a target picture, select copy by a right mouse button and select paste at a target position; the specific method for copying the stimulation materials in batches comprises the steps of selecting one of the targets, pressing a right mouse button to copy after pressing CTRL + other targets, and selecting and pasting at the target position. In this embodiment, preferably, the stimulation material recording area further displays a time axis for presenting the recorded stimulation materials on the time axis in the recording order of the recorded stimulation materials, i.e. the introduced stimulation materials are presented on the time axis in the sequence of introduction. In an embodiment of the present invention, the attribute of the stimulation material obtained by replication is consistent with that of the original stimulation material, and if the attribute of the original stimulation material or the copied stimulation material is modified, the same stimulation material is changed, and a stimulation material that is different from the stimulation material already existing in the current experimental design is introduced, where the stimulation material is an independent stimulation attribute, and after the replication and introduction of the stimulation material are respectively selected, the attribute of the introduced stimulation material is not changed when the attribute of the original stimulation material is modified. In addition, the order of the stimulation materials can be selected and adjusted in the current interactive interface, the stimulation materials with the order needing to be adjusted are selected, the left button of the mouse is clicked, and the mouse is dragged to the target position. In addition, the stimulus material can be selected for previewing, wherein the previewing of the stimulus material comprises previewing of a single stimulus material and previewing of all stimulus materials, the mode of previewing the single stimulus material is to select the target stimulus material, the mode of previewing the stimulus material is selected by the right key, and the mode of previewing all stimulus materials is to select the preview function icon. In addition, a deletion operation may be performed on the stimulation material.
In an embodiment of the invention, under an entry way of field research, an eye tracker entry and/or a field camera device entry may be arranged in the stimulation material entry area, field stimulation material entry may be performed by clicking the eye tracker entry or the field camera device entry, and after field stimulation material entry is completed, a preview function icon may be clicked to perform scene preview.
In embodiments of the present invention, the stimulation material property adjustment zone is used to adjust and/or edit the relevant property information of the stimulation material.
For the picture stimulus material, the attribute information thereof may include at least one of the following attribute information: the name of the stimulation material, the size of the stimulation material, the position of the stimulation material, the background color of the stimulation material, the switching mode of the stimulation material, whether the stimulation participates in recording, whether a mouse appears when the stimulation appears, the group of random playing is set, the name of a mark is given out, and the like. In addition, the attribute information of the stimulation material may further include the same number of stimulation materials as the current stimulation material.
In the attribute information, the name of the stimulation material can be edited.
Under the entry way based on screen experimental design, the size displayed by the stimulation material comprises the original size and the adaptive screen size; under the approach of virtual reality entry, 360 ° and 2D presentations can be selected, wherein 360 ° is a 360 ° full-surrounding panoramic type in the presentation process, and 180 ° plane scenes are presented in 2D.
Under the input way based on the screen experimental design, a Sudoku selection item can be set aiming at the position presented by the stimulation material, and the position presented by the stimulation material is selected according to the position of the Sudoku; under the virtual reality approach to entry, there is no such option. That is, the stimulation property adjustment module may determine the property information of the stimulation material based on the entry manner of the stimulation material.
Under the input way based on screen experimental design, aiming at the background color presented by the stimulation material, a color selection item can be set, a color adjusting frame pops up after the color selection item is clicked, and a color selecting area, a hue selecting area, a three-primary-color light adjusting strip and a standard color selecting area are arranged in the color adjusting frame, so that the selection and the operation of experimenters are facilitated; under the virtual reality approach of entry, there is no such color choice.
Under an entry way based on screen experimental design, presentation time, a keyboard and/or a mouse can be selected according to a stimulation material switching mode, and presentation time can be input in the presentation time, namely, the stimulation is automatically switched to the next stimulation after the stimulation is presented for a long time; the keyboard switching can be the switching of stimulating materials by pressing a space key and a right key on the keyboard; the mouse switching may be switching of the stimulation material by a single mouse. The three switching modes can be selected singly or in any combination; under the virtual reality recording approach, stimulation material switching based on presentation time and/or a wireless handle can be selected for the stimulation material switching mode.
The attribute of 'whether the stimulus participates in recording' can comprise options of 'yes' and 'no', when a target file which is used as stimulus material is selected and then the 'no' option is clicked, an icon which does not participate in recording is displayed on the target file and does not participate in recording; in addition, when the stimulus material introduced by introduction or dragging or the like is involved in recording, the stimulus material cannot be deleted, while the stimulus material obtained by duplication is deleted after being involved in recording; the stimulation material which has participated in the recording can still be copied, and the copied stimulation material can be presented at the tail end of the time axis; the stimulus materials which participate in the recording can also modify the sequence on the time axis and the attribute of the stimulus materials, when all the records in the project are deleted, all the stimulus materials can show an unlocked state, and new stimulus materials can be introduced again; when the stimulus material participates in the recording, the stimulus material will assume a locked state, for example a locked icon will be presented on the stimulus material.
For the "whether a mouse is presented when a stimulus is presented" attribute, yes and no options may be set.
For the "set randomly played group" attribute, the stimulation material that needs to be randomized is added to the randomized group, and the group in which the stimulation appears can be selected, and an experimental design may contain a plurality of randomized groups, and a random group may contain a plurality of stimulation materials.
"issuing a tag name" means a tag name that is issued when a different stimulus occurs, and has a function of real-time tagging.
In the embodiment of the present invention, the video attribute information may be substantially identical to the picture attribute information, and will not be described herein again.
The screen recording attribute information may include at least one of the following attribute information: recording the name of the stimulation material, switching the mode of the stimulation material, judging whether the stimulation material participates in recording, setting the group of random playing, sending out the name of a mark and other attributes.
In the embodiment of the present invention, the global setting area may include a screen setting for presenting the stimulation material, a resolution adjustment of the screen, whether the stimulation material appears randomly, whether real-time marking is allowed, and other stimulation material attribute settings, and may further edit the stimulation material, for example, edit a marked mark value.
Aiming at the screen setting of presentation of the stimulation material, when a plurality of screens exist, the screen on which the stimulation material is presented in the recording process can be selected; in addition, an identification screen function icon can be arranged, and the current screen can be displayed by clicking the identification screen function icon; when a single screen, the current screen is defaulted.
For "resolution adjustment of a screen", it means a resolution of a displayable screen, and the resolution is adjusted.
For the attribute of 'whether the stimulus material appears randomly', when the attribute setting item is in an open state, the stimulus material which needs to be random can be edited, and only in the open state, the stimulus material can be presented under the attribute list.
For the attribute of 'whether the real-time marking is allowed' or not, after the attribute is selected to be allowed, a marking mode can be popped up and selected, and the marking mode is automatic or manual; when manual is selected, the real-time marker is displayed under the attribute list, and the marker value can be edited.
Fig. 2 is a schematic diagram of a display interface 10 of an experimental design system according to an embodiment of the invention. Shown in fig. 2 are a stimulation material entry area 100, a stimulation material property adjustment area 110, a global settings area 120, and a preview area 130. The stimulation material entry area 100 also shows the different stimulation material entry pathways and a time axis 101 on which the entered stimulation material is presented 101. The layout of the regions in fig. 2 is only an example, and although not shown in fig. 2, other display contents may be provided on the display interface.
Based on the experiment design system for the multi-channel human-computer environment test data synchronization platform, the invention not only centralizes the design mode of experiment design, but also has flexible input mode and way of experiment design data, is beneficial to finishing related experiment data in the same interface, realizes the integrity of the experiment design process, and is particularly suitable for a multi-channel human-computer interaction data synchronization system.
Correspondingly, the invention also provides an experimental design method for the multichannel human-computer environment test data synchronization platform, which comprises the following steps:
forming a stimulation material input area on a human-computer interaction interface of the multi-channel human-computer interaction and human-computer environment test data synchronization system, and inputting stimulation materials and editing stimulation material input modes; an input way based on screen experimental design, virtual reality and field research is arranged in the stimulation material input area;
forming a stimulation material attribute adjusting area on a human-computer interaction interface of the multichannel human-computer interaction and human-computer environment test data synchronization system, wherein the stimulation material attribute adjusting area is used for adjusting and/or editing the attribute information of the stimulation material recorded through the stimulation material recording area so as to display the stimulation material to the examinee based on the adjusted and/or edited attribute information of the stimulation material; wherein the stimulation material entry area and the stimulation material property adjustment area are located at different positions within the same display interface.
The present invention also relates to a storage medium, on which computer program code may be stored, which when executed may implement various embodiments of the method of the present invention, the storage medium may be a tangible storage medium, such as an optical disk, a U-disk, a floppy disk, a hard disk, etc.
It is to be understood that the invention is not limited to the specific arrangements and instrumentality described above and shown in the drawings. A detailed description of known methods is omitted herein for the sake of brevity. In the above embodiments, several specific steps are described and shown as examples. However, the method processes of the present invention are not limited to the specific steps described and illustrated, and those skilled in the art can make various changes, modifications and additions or change the order between the steps after comprehending the spirit of the present invention.
Those of ordinary skill in the art will appreciate that the various illustrative components, systems, and methods described in connection with the embodiments disclosed herein may be implemented as hardware, software, or combinations of both. Whether this is done in hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, plug-in, function card, or the like. When implemented in software, the elements of the invention are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted by a data signal carried in a carrier wave over a transmission medium or a communication link. A "machine-readable medium" may include any medium that can store or transfer information. Examples of a machine-readable medium include electronic circuits, semiconductor memory devices, ROM, flash memory, Erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, Radio Frequency (RF) links, and so forth. The code segments may be downloaded via computer networks such as the internet, intranet, etc.
It should also be noted that the exemplary embodiments mentioned in this patent describe some methods or systems based on a series of steps or devices. However, the present invention is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, may be performed in an order different from the order in the embodiments, or may be performed simultaneously.
The software may be disposed in Random Access Memory (RAM), memory, Read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
Features that are described and/or illustrated with respect to one embodiment may be used in the same way or in a similar way in one or more other embodiments and/or in combination with or instead of the features of the other embodiments in the present invention.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and various modifications and changes may be made to the embodiment of the present invention by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (8)
1. The utility model provides a synchronous platform experiment design system of multichannel man-machine environment test data which characterized in that includes: the stimulation material recording module and the stimulation attribute adjusting module;
the stimulation material recording module forms a stimulation material recording area on a human-computer interaction interface of the multichannel human-computer interaction data synchronization system, and is used for selecting a stimulation material recording mode and recording and editing stimulation materials; the stimulation material recording area is provided with recording ways based on screen experimental design, virtual reality and field research respectively;
the stimulation attribute adjusting module forms a stimulation material attribute adjusting area on a human-computer interaction interface of the multichannel human-computer interaction data synchronization system, and is used for adjusting and/or editing the attribute information of the stimulation material recorded through the stimulation material recording area so as to display the stimulation material to the examinee based on the adjusted and/or edited attribute information of the stimulation material;
the stimulation material recording area and the stimulation material attribute adjusting area are positioned at different positions in the same display interface;
wherein, the stimulating material is a material for providing stimulating conditions for the examinee to view so as to monitor the physiological or action response of the examinee when seeing the stimulating material; the stimulation material comprises pictures, videos and/or screen recording files; for picture and/or video type stimulation material, the attribute information comprises at least one of the following information: the method comprises the following steps of (1) selecting stimulation materials, selecting a mouse, selecting a random playing groups, selecting a random playing, and marking names; for the stimulating material of the screen recording file type, the attribute information comprises at least one of the following information: the name of the recorded stimulation material, the switching mode of the stimulation material, whether the stimulation material participates in recording, the group of random playing is set, and the name of a mark is sent out.
2. The experiment design system of claim 1, further comprising: a global design module;
the global design module forms a global setting area on a human-computer interaction interface of the multi-channel human-computer interaction data synchronization system, and is used for setting and/or editing a screen of a stimulation material, adjusting the resolution of the screen, judging whether the stimulation material appears randomly and judging whether real-time marking is allowed;
the stimulation material entry area, the stimulation material property adjustment area and the global setting area are located at different positions in the same display interface.
3. The experimental design system of claim 1, wherein:
a first file importing function operation indication mark and a screen recording function operation indication mark are arranged under an entering way based on screen experimental design, the first file importing function operation indication mark is used for importing pictures or video files and storing the pictures or the video files according to a set storage path, and the screen recording function operation indication mark is used for recording a screen through a camera device to generate a screen recording file and storing the screen recording file according to the set storage path;
a second file importing function operation indication mark and a virtual reality recording function operation indication mark are arranged under an entry way based on virtual reality, the second file importing function operation indication mark is used for importing a panoramic picture or a video file and storing the panoramic picture or the video file according to a set storage path, and the virtual reality recording function operation indication mark is used for recording a screen through a panoramic camera to generate a virtual reality screen recording file and storing the virtual reality screen recording file according to the set storage path;
an eye tracker entry and/or a field camera entry are arranged under an entry path based on field research, so that field stimulation material entry is carried out through the eye tracker entry and/or the field camera entry.
4. The experimental design system of claim 1, wherein:
the stimulation material recording mode comprises the step of recording stimulation materials by copying and pasting the stimulation materials.
5. The experimental design system of claim 4, wherein:
the stimulation material recording area is also provided with a time axis for presenting the recorded stimulation materials on the time axis according to the recording sequence of the recorded stimulation materials.
6. The system of claim 1, wherein the stimulation property adjustment module determines the property information of the stimulation material based on a manner of entry of the stimulation material.
7. A multi-channel man-machine environment test data synchronization platform experiment design method is characterized by comprising the following steps:
forming a stimulation material recording area on a human-computer interaction interface of the multi-channel human-computer interaction and human-computer environment test data synchronization system, wherein the stimulation material recording area is used for selecting a stimulation material recording mode and recording and editing stimulation materials; an input way based on screen experimental design, virtual reality and field research is arranged in the stimulation material input area;
forming a stimulation material attribute adjusting area on a human-computer interaction interface of the multichannel human-computer interaction and human-computer environment test data synchronization system, wherein the stimulation material attribute adjusting area is used for adjusting and/or editing the attribute information of the stimulation material recorded through the stimulation material recording area so as to display the stimulation material to the examinee based on the adjusted and/or edited attribute information of the stimulation material;
the stimulation material recording area and the stimulation material attribute adjusting area are positioned at different positions in the same display interface;
wherein the stimulating material is a material that is used to provide a stimulating condition to a subject for viewing by the subject to monitor a physiological or motor response of the subject when the stimulating material is viewed by the subject.
8. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method as claimed in claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811289878.6A CN109471532B (en) | 2018-10-31 | 2018-10-31 | Multi-channel human-computer environment test data synchronization platform experiment design system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811289878.6A CN109471532B (en) | 2018-10-31 | 2018-10-31 | Multi-channel human-computer environment test data synchronization platform experiment design system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109471532A CN109471532A (en) | 2019-03-15 |
| CN109471532B true CN109471532B (en) | 2022-04-12 |
Family
ID=65666507
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811289878.6A Active CN109471532B (en) | 2018-10-31 | 2018-10-31 | Multi-channel human-computer environment test data synchronization platform experiment design system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109471532B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111966724B (en) * | 2020-06-29 | 2022-04-12 | 北京津发科技股份有限公司 | Interactive behavior data acquisition and analysis method and device based on human-computer interaction interface area automatic identification technology |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105078455A (en) * | 2014-05-15 | 2015-11-25 | 中国科学院上海生命科学研究院 | Functional magnetic resonance imaging synchronous monitoring and triggering stimulation control system |
| CN105664332A (en) * | 2016-04-14 | 2016-06-15 | 北京阳光易德科技股份有限公司 | Psychological stress training system and method |
| CN108042147A (en) * | 2015-08-07 | 2018-05-18 | 北京环度智慧智能技术研究所有限公司 | A kind of stimulus information provides device |
| CN108056774A (en) * | 2017-12-29 | 2018-05-22 | 中国人民解放军战略支援部队信息工程大学 | Experimental paradigm mood analysis implementation method and its device based on visual transmission material |
| CN207462082U (en) * | 2017-02-23 | 2018-06-08 | 北京同方神火联合科技发展有限公司 | Lie detection system with visual stimulus detection function |
| CN108478224A (en) * | 2018-03-16 | 2018-09-04 | 西安电子科技大学 | Intense strain detecting system and detection method based on virtual reality Yu brain electricity |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8392250B2 (en) * | 2010-08-09 | 2013-03-05 | The Nielsen Company (Us), Llc | Neuro-response evaluated stimulus in virtual reality environments |
-
2018
- 2018-10-31 CN CN201811289878.6A patent/CN109471532B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105078455A (en) * | 2014-05-15 | 2015-11-25 | 中国科学院上海生命科学研究院 | Functional magnetic resonance imaging synchronous monitoring and triggering stimulation control system |
| CN108042147A (en) * | 2015-08-07 | 2018-05-18 | 北京环度智慧智能技术研究所有限公司 | A kind of stimulus information provides device |
| CN105664332A (en) * | 2016-04-14 | 2016-06-15 | 北京阳光易德科技股份有限公司 | Psychological stress training system and method |
| CN207462082U (en) * | 2017-02-23 | 2018-06-08 | 北京同方神火联合科技发展有限公司 | Lie detection system with visual stimulus detection function |
| CN108056774A (en) * | 2017-12-29 | 2018-05-22 | 中国人民解放军战略支援部队信息工程大学 | Experimental paradigm mood analysis implementation method and its device based on visual transmission material |
| CN108478224A (en) * | 2018-03-16 | 2018-09-04 | 西安电子科技大学 | Intense strain detecting system and detection method based on virtual reality Yu brain electricity |
Non-Patent Citations (2)
| Title |
|---|
| The influence of stimulus material on attention and performance in the visual expectation paradigm;Manuel Teubert等;《International Journal of Behavioral Development》;20120915;第36卷(第5期);第374-380页 * |
| 视听时序知觉的认知与神经机制 ——来自心理物理与电生理研究的证据;袁祥勇;《中国博士学位论文全文数据库 哲学与人文科学辑》;20151130;F102-9 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109471532A (en) | 2019-03-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20200177845A1 (en) | Systems and methods for video monitoring using linked devices | |
| Niehorster et al. | GlassesViewer: Open-source software for viewing and analyzing data from the Tobii Pro Glasses 2 eye tracker | |
| JP6348504B2 (en) | Biological sample split screen display and system and method for capturing the records | |
| US9880709B2 (en) | System and method for creating and displaying previews of content items for electronic works | |
| CN103999119A (en) | Image processing apparatus, image processing system, image processing method, and program | |
| US20170315790A1 (en) | Interactive multimodal display platform | |
| JP2016511846A (en) | Selection and display of biomarker expression | |
| CN103839562A (en) | Video creation system | |
| CN112738402B (en) | Shooting method, shooting device, electronic equipment and medium | |
| Tung et al. | Spherical photography and virtual tours for presenting crime scenes and forensic evidence in New Zealand courtrooms | |
| CN109471532B (en) | Multi-channel human-computer environment test data synchronization platform experiment design system and method | |
| CN114339375A (en) | Video playing method, method for generating video directory and related product | |
| CN112698775B (en) | Image display method and device and electronic equipment | |
| CN109299345B (en) | Project preview system and method for multi-channel human-computer environment test data synchronization platform | |
| CN109885799A (en) | Content delivery method and device | |
| Kerwin et al. | Virtual mastoidectomy performance evaluation through multi-volume analysis | |
| CN106774886A (en) | Zooming effect in eye tracking interface | |
| CN115936998A (en) | Picture splicing method and device, electronic equipment and storage medium | |
| Li et al. | An empirical evaluation of labelling method in augmented reality | |
| Wigness | Superlabel: A superpixel labeling interface for semantic image annotation | |
| Voßkühler | OGAMA description (for Version 2.5) | |
| CN113724894B (en) | Method and device for analyzing ultrastructural pathology data and electronic equipment | |
| KR20140136713A (en) | Methods and apparatuses of an learning simulation model using images | |
| WO2021258349A1 (en) | Test configuration method and apparatus for unmanned aerial vehicle, and terminal device | |
| US11805229B2 (en) | Video search interfacing apparatus for effectively searching for multiple recorded video channels |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |