WO2019144709A1 - Method for constructing dream reproducing model, dream reproducing method, and devices - Google Patents

Method for constructing dream reproducing model, dream reproducing method, and devices Download PDF

Info

Publication number
WO2019144709A1
WO2019144709A1 PCT/CN2018/119764 CN2018119764W WO2019144709A1 WO 2019144709 A1 WO2019144709 A1 WO 2019144709A1 CN 2018119764 W CN2018119764 W CN 2018119764W WO 2019144709 A1 WO2019144709 A1 WO 2019144709A1
Authority
WO
WIPO (PCT)
Prior art keywords
brain wave
dream
wave data
value
perceptible
Prior art date
Application number
PCT/CN2018/119764
Other languages
French (fr)
Chinese (zh)
Inventor
王倩
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2019144709A1 publication Critical patent/WO2019144709A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/217Validation; Performance evaluation; Active pattern learning techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • G06F2218/08Feature extraction

Definitions

  • the embodiments of the present disclosure relate to the field of computer application technologies, and in particular, to a method for constructing a dream reproduction model, a method and apparatus for reproducing a dream.
  • the embodiment of the present specification provides a method for constructing a dream reproduction model, a method and device for reproducing a dream, and the technical solution is as follows:
  • a method for constructing a dream reproduction model comprising:
  • each of the training samples uses the extracted feature value of the brain wave data as an input value to extract the perceptible object
  • the eigenvalue is a tag value
  • the training sample is trained by using a supervised learning algorithm to obtain a dream reproduction model.
  • the dream reproduction model takes the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as an output value.
  • a method for dream reproduction comprising:
  • a perceptible object having the highest similarity to the output value is determined to generate a dream reproduction result.
  • a device for constructing a dream reproduction model includes:
  • a data obtaining module configured to obtain at least one set of correspondences between the perceptible object and the brain wave data when the user perceives the perceptible object
  • a sample obtaining module configured to perform feature extraction on each group of the corresponding relationships, respectively, to obtain a training sample set, wherein each of the training samples extracts the characteristic value of the brain wave data as an input value, to extract the
  • the feature value of the perceptible object is a tag value
  • a sample training module configured to train the training sample by using a supervised learning algorithm, to obtain a dream reproduction model, wherein the dream reproduction model uses the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as output value.
  • a dream recreating apparatus comprising:
  • the brain wave acquisition module is configured to obtain brain wave data of the user in a sleep state
  • a feature extraction module configured to perform feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data
  • An output module configured to input the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value
  • a reproducing module configured to determine, from the correspondence, a perceptible object having the highest similarity with the output value, to generate a dream reproduction result.
  • a computer apparatus includes a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the program when the program is executed.
  • a computer apparatus includes a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the program when the program is executed Any one of the embodiments provides a method of dream reproduction.
  • each training sample extracts the characteristic value of the brain wave data as an input value
  • the characteristic value of the perceptible object is a tag value
  • the training sample is trained by using a supervised learning algorithm to obtain a dream reproduction model
  • the dream recurrence model takes the eigenvalue of the brain wave data as the input value
  • the eigenvalue of the sensible object is the output value.
  • the dream recurrence model can realize the user's brain wave data reproduction in the sleep state. Dreamland, satisfying the user experience.
  • any of the embodiments of the present specification does not need to achieve all of the above effects.
  • FIG. 1 is a schematic diagram of an application scenario for implementing dream replay according to an exemplary embodiment of the present disclosure
  • FIG. 2 is a flowchart of a method for constructing a dream reproduction model according to an exemplary embodiment of the present specification
  • FIG. 3 is a flowchart of a dream reproduction method according to an exemplary embodiment of the present specification
  • FIG. 4 is a block diagram of an embodiment of a device for constructing a dream reproduction model according to an exemplary embodiment of the present specification
  • FIG. 5 is a block diagram of an embodiment of a dream recreating apparatus according to an exemplary embodiment of the present specification
  • FIG. 6 is a schematic diagram showing a hardware structure of a more specific computing device provided by an embodiment of the present specification.
  • Modern medicine believes that when the human body sleeps, various stimulating factors inside and outside the body, such as psychological, physiological, pathological, environmental factors, etc., are produced by the specific cortex of the brain. That is to say, when the person is dreaming, the cerebral cortex is excited. The state, which will produce brain waves, and the brain waves have a certain degree of correspondence with human consciousness activities, for example, when a person sees two different images, or hears two different melody music, the nerves of the cerebral cortex The activities are different, so that the brain waves generated are different. Similarly, when people dream of different scenes, the neural activity of the cerebral cortex is different, and the generated brain waves are also different. Based on this, the present invention proposes to realize the use of brain wave data. The dream reappears.
  • FIG. 1 is a schematic diagram of an application scenario for implementing dream reproduction according to an exemplary embodiment of the present disclosure.
  • the user 110, the brain wave sensor 120, and the computer 130 are included, wherein the brain wave sensor 120 is worn on the head of the user 110 for collecting brain wave data of the user 110, and collecting the brain.
  • the radio wave data is sent to the computer 130.
  • the brain wave sensor 120 collects the brain wave data of the user 110 when the user 110 perceives the perceptible object, for example, when the user 110 sees an image.
  • the brain wave data and the related information of the perceptible object corresponding to the brain wave data are sent to the computer 130, and the computer 130 performs training based on the received brain wave data and the related information of the perceptible object to obtain a dream reproduction model.
  • the dream recurrence model can take the brain wave data related information as input and the object-related information as the output. It can be understood by those skilled in the art that in order to obtain a dream reproduction model, several samples are needed, that is, it is required to collect brain wave data generated by several users when they perceive different perceptible objects.
  • the brain wave sensor 120 can be used to collect the brain wave data generated by the user in the sleep state, and then the brain wave sensor 120 transmits the brain wave data to the computer 130, and the computer 130 can be based on the dream.
  • the reproduction model outputs relevant information of the perceptible object corresponding to the electroencephalogram data, and then the dream reproduction result can be generated based on the related information of the perceptible object.
  • the user 110 wakes up, the above-mentioned dream reproduction result can be viewed by the computer 130 to realize the "re-warming" dream.
  • the present specification shows that the following embodiments are respectively described from the construction of the dream reproduction model and the realization of the dream reproduction based on the dream reproduction model.
  • a flowchart of a method for constructing a dream reproduction model may include the following steps:
  • Step 202 Obtain a correspondence between at least one set of brainwave data including the perceptible object and the user when perceiving the perceptible object.
  • the perceptible object may be a single image or an image frame intercepted in the video. It can be understood by those skilled in the art that the essence of the single image and the image frame are images. For convenience of description, in the embodiment of the present specification, the perceptible object may be an image.
  • the set of perceptible objects may be preset, for example, the set includes 1000 different images, and each perceptible object in the set of perceptible objects is sequentially provided to the user 110, for example, in a specific environment.
  • the each perceptible object is played in a slideshow, and when the user 110 is provided with the perceptible object, the brainwave data of the user 110 when the perceptible object is perceived is synchronously acquired.
  • a correspondence relationship between the perceptible object and the brain wave data when the user 110 perceives the perceptible object is obtained, for example, 1000 correspondences are obtained.
  • the user 110 may be provided with a perceptible object according to a preset rule, for example every 5 seconds, and continuously collected during the entire process of providing the first perceptible object to the last perceptible object.
  • the brain wave data of the user 110 and then, according to the extraction rule corresponding to the preset rule, for example, according to the acquisition time of the brain wave data, intercepting a piece of brain wave data every 5 seconds, and then establishing brain wave data and perceptible The correspondence between objects.
  • a plurality of correspondences including the perceptible object and the brain wave data when the user 110 perceives the perceptible object can be acquired.
  • a video may be provided to the user 110, and the brain wave data of the user 110 is continuously collected during the whole process of the user 110 viewing the video, and then the image in the video is intercepted at the same time interval. Frames, as well as brainwave data, can then establish a correspondence between brainwave data and perceptible objects.
  • the two embodiments described above are only used as two alternative implementations.
  • Corresponding relationship of brain wave data for example, when the user 110 performs activities according to the will of the user, the brain wave data of the user 110 is collected, and the retinal imaging of the user 110 is synchronously acquired, and the brain wave data and the retinal imaging can be established based on the acquisition time.
  • the retinal imaging can be equivalent to the perceptible object perceived by the user.
  • the brain wave sensor 120 illustrated in FIG. 1 may also have the function of acquiring retinal imaging, or by another separate wearable smart chip (not shown in FIG. 1). It is responsible for collecting the retinal imaging of the user 110, which is not limited in this embodiment of the present specification.
  • Step 204 Perform feature extraction on each group correspondence, and obtain a training sample set, wherein each training sample uses the extracted feature value of the brain wave data as an input value, and the extracted feature value of the perceptible object is obtained. Tag value.
  • each training sample in the training sample set includes the feature value of the extracted brain wave data and the extracted feature value of the perceptible object, and based on the related description of the application scenario shown in FIG. 1 above, the actual dream is heavy.
  • the perceptible object perceived by the user 110 is determined by the collected brain wave data of the user 110 in the sleep state. Therefore, each of the above training samples uses the characteristic value of the brain wave data as an input value to extract.
  • the eigenvalue of the perceived object is the tag value.
  • the real signal of any frequency can be expressed as a sum of a series of periodic functions, and the process of expressing the real signal as a series of periodic functions is to analyze the real signal.
  • the process of each cycle is equivalent to the composition of the real signal.
  • the present specification proposes a complex transformation of brain wave data, for example, complex transformation of brain wave data by Fourier transform, and brain wave
  • the data is represented as a sum of at least one complex variable function, and the at least one complex variable function can be used as an eigenvalue of brain wave data, for example, the characteristic value of the mentioned brain wave data is (a 1 f 1 (sinx), a 2 f 2 (sinx), a 3 f 3 (sinx)).
  • the manner of extracting the feature values of the brain wave data described above is only an optional implementation manner.
  • the feature values of the brain wave data may also be extracted by other means, for example, by correlation.
  • the eigenvalues of the brainwave data are extracted by analysis, AR parameter estimation, Butterworth low-pass filtering, genetic algorithm, etc.
  • the specific type of the extracted feature values can be determined by an actual algorithm, for example, extracted by Butterworth low-pass filtering algorithm.
  • the eigenvalue is the square of the signal amplitude
  • the eigenvalue extracted by the AR parameter estimation algorithm is the power spectral density, which is not described in the embodiment of the present specification.
  • color statistics can be performed on the perceptible object, and the number of pixels corresponding to each color value in the perceptible object is obtained, and the obtained number of pixel points is expressed as 2 N -dimensional vector, where N is the number of color bits of the image, that is, the 2 N -dimensional vector can be used as the feature value of the perceptible object, for example, the extracted feature values are (y 1 , y 2 , y 3 , ... y 2 ⁇ N ).
  • the dimension of the extracted feature values is different, and the training is unified for the subsequent training of the training samples.
  • the color statistics of images with different color bits can be mapped to a unified vector space.
  • "unified" means that the dimensions of the vectors obtained based on the color statistics result are the same.
  • the larger the dimension of the vector the higher the complexity of training the training sample and the larger the calculation amount. Therefore, in the embodiment of the present specification, the object characteristics are guaranteed.
  • a vector space with a small number of dimensions can be set as much as possible.
  • the images may be first set to the same color number, and then the feature extraction is performed according to the above description.
  • the step of mapping each color statistical result to the unified vector space is performed.
  • Step 206 Training the training sample by using a supervised learning algorithm to obtain a dream recurrence model.
  • the dream recurrence model takes the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as an output value.
  • the training sample obtained in step 204 can be trained by using a supervised learning algorithm to obtain a dream reproduction model, and the dream reproduction model uses the characteristic value of the brain wave data as an input value to perceive the object.
  • the eigenvalue is used as the output value.
  • the training-to-dream reproduction model can be understood as a functional relationship between the input value and the output value, wherein the output value is affected by all or part of the input value, and therefore, the output value and the input value
  • the functional relationship between them can be exemplified as follows:
  • x 1 , x 2 , ... x M represent M input values, that is, characteristic values of M brain wave data, and y represents an output value, and may also perceive the feature value of the object, and may specifically be in the perceptible object.
  • the form of the dream reproduction model can be selected according to actual training needs, such as a linear regression model, a logistic regression model, and the like.
  • the embodiment of the present specification does not limit the selection of the model and the specific training algorithm.
  • different users may have different perceptions of the same perceptible object. Therefore, in this embodiment, different dream re-creation models are separately constructed for different users; further, the same user is in his or her own psychology and physiology. In different states, the sensing ability of the same perceptible object may be different. Therefore, in the embodiment of the present specification, different dream recurrence models are separately constructed for different time segments of the same user. In addition, in the actual application, there may be other implementation manners, for example, the same dream reproduction model is constructed for different users, and the embodiment of the present specification does not specifically limit this.
  • the technical solution provided by the embodiments of the present disclosure performs feature extraction for each group of correspondences by obtaining at least one set of corresponding relationships between the perceptible objects and the brain wave data when the user perceives the perceptible objects.
  • each training sample extracts the characteristic value of the brain wave data as an input value, and the eigenvalue of the object is a tag value
  • the training sample is trained by using a supervised learning algorithm to obtain a dream Recurring the model
  • the dream recurrence model takes the eigenvalue of the brain wave data as an input value
  • the eigenvalue of the sensible object is an output value
  • the brain can be realized by using the user in a sleep state through the dream reproduction model
  • the radio wave data reproduces the user's dream and satisfies the user experience.
  • a flowchart of a method for reproducing a dream may include the following steps:
  • Step 302 Obtain brainwave data of the user in a sleep state.
  • the brain wave data of the user in the sleep state can be obtained by the brain wave sensor 120 illustrated in FIG. 1 according to a preset rule, for example, every one minute, or every two minutes.
  • Step 304 Perform feature extraction on the obtained brain wave data to obtain characteristic values of brain wave data.
  • step 204 For a detailed description of this step, refer to the related description in step 204 in the foregoing embodiment shown in FIG. 2, and details are not described herein again.
  • Step 306 Input the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value.
  • the feature value of the brain wave data extracted in step 304 can be input into the dream reproduction model to obtain a corresponding output value, and the output is obtained.
  • the value can be a feature value of the perceptible object.
  • Step 308 From the correspondence, determine a perceptible object having the highest similarity with the output value to generate a dream reproduction result.
  • the feature value of each perceptible object in the training sample set may be similarly calculated with the output value in step 306, and the feature value of the perceptible object with the highest similarity to the output value may be determined, and then, Then, in the corresponding relationship described in the embodiment shown in FIG. 2 above, the perceptible object having the highest similarity with the output value may be determined, and the dream reproduction result may be generated based on the determined perceptible object.
  • the dream reproduction result can be displayed to the user, for example, the determined plurality of images are played in a slide show in the order of the acquisition time of the brain wave data.
  • the above-mentioned perceptible object having the highest similarity with the output value may be one or more, which is not limited in the embodiment of the present specification.
  • the specific manner of calculating the similarity between the output value and the feature value of the perceptible object may be a Euclidean distance algorithm, a cosine similarity calculation algorithm, and the like, which are not limited in the embodiment of the present specification.
  • the technical solution provided by the embodiment of the present invention obtains the feature value of the brain wave data by obtaining the brain wave data of the user in a sleep state, and obtains the feature value of the brain wave data, and inputs the feature value into the dream state. Reproducing the model, obtaining the corresponding output value, and then determining the perceptible object having the highest similarity to the output value from the correspondence between the pre-acquired object containing the perceptible object and the brainwave data when the user perceives the perceptible object In order to generate dreams to reproduce the results, thereby realizing the user to "relive" the dream based on the dream reappearing results.
  • the embodiment of the present specification further provides a device for constructing a dream reproduction model, which is shown in FIG. 4, which is a dream reproduction model according to an exemplary embodiment of the present specification.
  • FIG. 4 is a dream reproduction model according to an exemplary embodiment of the present specification.
  • a block diagram of an embodiment of a device which may include a data acquisition module 41, a sample acquisition module 42, and a sample training module 43.
  • the data obtaining module 41 may be configured to obtain at least one group of correspondences between the perceptible object and the brain wave data when the user perceives the perceptible object;
  • the sample obtaining module 42 may be configured to perform feature extraction on each group of the corresponding relationships to obtain a training sample set, wherein each of the training samples extracts the characteristic value of the brain wave data as an input value to extract The feature value of the perceived object is the tag value;
  • the sample training module 43 can be configured to train the training sample by using a supervised learning algorithm to obtain a dream reproduction model, wherein the dream reproduction model uses the feature value of the brain wave data as an input value to perceive the characteristics of the object. The value is used as the output value.
  • the data acquisition module 41 may include (not shown in FIG. 4):
  • a collecting submodule configured to synchronously collect brain wave data when the user perceives the perceptible object when the user is provided with the perceptible object.
  • the sample acquisition module 42 can include (not shown in FIG. 4):
  • a first decomposition sub-module configured to perform complex transformation decomposition on brain wave data in each of the corresponding correspondences, and represent the brain wave data as a sum of at least one complex function
  • a first determining submodule configured to use the at least one complex variable function as a feature value of the brain wave data.
  • the perceptible object is an image
  • the sample acquisition module 42 may include (not shown in FIG. 4):
  • a statistic sub-module configured to perform color statistics on each image in the corresponding relationship, to obtain a number of pixels corresponding to each color value in the image
  • the second determining sub-module is configured to represent the obtained number of pixel points as a 2N-dimensional vector, where N is a color number of bits of the image.
  • the apparatus may also include (not shown in Figure 4):
  • a mapping module for mapping color statistical results of images having different color bits to a unified vector space.
  • different dream recurrence models are constructed separately for different users.
  • the data acquisition module 41, the sample acquisition module 42, and the sample training module 43 are three functionally independent modules, which may be simultaneously configured in the device as shown in FIG. 4, or may be separately configured in the device. Therefore, the structure shown in FIG. 4 should not be construed as limiting the embodiment of the present specification.
  • the embodiment of the present specification further provides a dream recreating device.
  • FIG. 5 it is a block diagram of an embodiment of a dream recreating device according to an exemplary embodiment of the present specification.
  • the brain wave acquisition module 51, the feature extraction module 52, the output module 53, and the reproduction module 54 may be included.
  • the brain wave acquisition module 51 can be used to obtain brain wave data of the user in a sleep state
  • the feature extraction module 52 may be configured to perform feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data
  • the output module 53 can be configured to input the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value
  • the reproducing module 54 may be configured to determine, from the correspondence, a perceptible object having the highest similarity with the output value to generate a dream reproduction result.
  • the feature extraction module 52 can include (not shown in FIG. 5):
  • a second decomposition sub-module configured to perform complex transformation decomposition on the obtained brain wave data, and represent the brain wave data as a sum of at least one complex variable function
  • a third determining submodule configured to use the at least one complex variable function as a feature value of the brain wave data.
  • the reproduction module 54 can include (not shown in FIG. 5):
  • a fourth determining submodule configured to determine a reference feature value of each perceptible object in the correspondence relationship
  • a calculation submodule configured to separately calculate a similarity between the output value and a reference feature value of each perceptible object
  • a fifth determining sub-module for determining a perceptible object having the highest similarity to generate a dream reproduction result
  • the brain wave acquisition module 51, the feature extraction module 52, the output module 53, and the reproduction module 54 are four functionally independent modules, which can be simultaneously configured in the device as shown in FIG. 5, or separately.
  • the configuration shown in FIG. 5 is not to be construed as limiting the scope of the embodiments of the present specification.
  • the embodiment of the present specification further provides a computer device including at least a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processing
  • the method for constructing the aforementioned dream recurrence model is implemented when the program is executed, and the method includes: obtaining at least one set of correspondences between the at least one set of the perceptible object and the brain wave data when the user perceives the perceptible object; Performing feature extraction on each set of the corresponding relationships, obtaining a training sample set, wherein each of the training samples extracts the feature value of the brain wave data as an input value, to extract the feature value of the perceptible object a tag value; training the training sample with a supervised learning algorithm to obtain a dream recurrence model, wherein the dream recurrence model takes the eigenvalue of the brain wave data as an input value, and uses the eigenvalue of the perceptible object as an output value .
  • the embodiment of the present specification further provides a computer device including at least a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the
  • the method includes at least: obtaining brain wave data of a user in a sleep state; performing feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data; Entering the feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value; and determining, from the correspondence, the perceptible object having the highest similarity with the output value to generate a dream reproduction result .
  • FIG. 6 is a schematic diagram showing a hardware structure of a more specific computing device provided by an embodiment of the present specification.
  • the device may include a processor 610, a memory 620, an input/output interface 630, a communication interface 640, and a bus 650.
  • the processor 610, the memory 620, the input/output interface 630, and the communication interface 640 implement a communication connection between the devices via the bus 650.
  • the processor 610 can be implemented by using a general-purpose CPU (Central Processing Unit), a microprocessor, an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits for performing correlation.
  • the program is implemented to implement the technical solutions provided by the embodiments of the present specification.
  • the memory 620 can be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, or the like.
  • the memory 620 can store the operating system and other applications.
  • the technical solutions provided by the embodiments of the present specification are implemented by software or firmware, the related program codes are saved in the memory 620 and executed by the processor 610.
  • the input/output interface 630 is used to connect an input/output module to implement information input and output.
  • the input/output/module can be configured as a component in the device (not shown in Figure 6) or externally to the device to provide the corresponding functionality.
  • the input device may include a keyboard, a mouse, a touch screen, a microphone, various types of sensors, and the like, and the output device may include a display, a speaker, a vibrator, an indicator light, and the like.
  • the communication interface 640 is used to connect a communication module (not shown in FIG. 6) to implement communication interaction between the device and other devices.
  • the communication module can communicate by wired means (such as USB, network cable, etc.), or can communicate by wireless means (such as mobile network, WIFI, Bluetooth, etc.).
  • Bus 650 includes a path for transferring information between various components of the device, such as processor 610, memory 620, input/output interface 630, and communication interface 640.
  • the above device only shows the processor 610, the memory 620, the input/output interface 630, the communication interface 640, and the bus 650, in a specific implementation, the device may also include necessary for normal operation. Other components.
  • the above-mentioned devices may also include only the components necessary for implementing the embodiments of the present specification, and do not necessarily include all the components shown in the drawings.
  • the embodiment of the present specification further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the foregoing dream reproduction model is constructed.
  • the method at least includes: obtaining at least one set of correspondences between the perceptible objects and the brainwave data of the user when the user perceives the perceptible objects; performing feature extraction on each set of the corresponding relationships, respectively, to obtain a training sample set, wherein And each of the training samples uses the extracted feature value of the brain wave data as an input value, and the extracted feature value of the perceptible object is a tag value; and the training sample is trained by using a supervised learning algorithm, A dream reproduction model is obtained.
  • the dream reproduction model takes the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as an output value.
  • the embodiment of the present specification further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the foregoing dream reproduction method is implemented.
  • the method at least includes: obtaining brain wave data of a user in a sleep state; performing feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data; and inputting the feature value of the obtained brain wave data into the The dream reproduces the model to obtain a corresponding output value; from the correspondence, the perceptible object having the highest similarity with the output value is determined to generate a dream reproduction result.
  • Computer readable media includes both permanent and non-persistent, removable and non-removable media.
  • Information storage can be implemented by any method or technology.
  • the information can be computer readable instructions, data structures, modules of programs, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device.
  • computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.
  • the embodiments of the present specification can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solution of the embodiments of the present specification may be embodied in the form of a software product in essence or in the form of a software product, which may be stored in a storage medium such as a ROM/RAM. Disks, optical disks, and the like, including instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the embodiments of the present specification or embodiments.
  • a computer device which may be a personal computer, server, or network device, etc.
  • the system, device, module or unit illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product having a certain function.
  • a typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, and a game control.
  • the various embodiments in the specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments.
  • the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
  • the device embodiments described above are merely illustrative, and the modules described as separate components may or may not be physically separated, and the functions of the modules may be the same in the implementation of the embodiments of the present specification. Or implemented in multiple software and/or hardware. It is also possible to select some or all of the modules according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Dermatology (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Evolutionary Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Neurology (AREA)
  • Neurosurgery (AREA)
  • Human Computer Interaction (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

A method for constructing a dream reproducing model, a dream reproducing method, and devices. The dream reproducing method comprises: obtaining brainwave data of a user in a sleep state (302); performing feature extraction on the obtained brainwave data, to obtain a feature value of the brainwave data (304); inputting the obtained feature value of the brainwave data into the dream reproducing model, to obtain a corresponding output value (306); and determining, from the correlation, a perceptible object having the highest similarity with the output value, to generate a dream reproducing result (308).

Description

梦境重现模型的构建方法、梦境重现方法及装置Dream reconstruction model construction method, dream reproduction method and device 技术领域Technical field
本说明书实施例涉及计算机应用技术领域,尤其涉及一种梦境重现模型的构建方法、梦境重现方法及装置。The embodiments of the present disclosure relate to the field of computer application technologies, and in particular, to a method for constructing a dream reproduction model, a method and apparatus for reproducing a dream.
背景技术Background technique
现代医学认为,梦是人体睡眠时,体内外各种刺激因素,例如心理、生理、病理、环境因素等作用于大脑特定的皮层所产生的,其形式可以为影像、声音、思想、感觉等。研究表明,美好的梦境在一定程度上可以带给人主观上较为愉悦的感受,人甚至可以在梦境中找到解决实际问题的灵感,但由于梦境的产生不受人体主观意识控制,从而人体从睡眠状态醒来后,通常不会记忆起完整清晰的梦境。Modern medicine believes that dreams are caused by various stimulating factors in the body, such as psychology, physiology, pathology and environmental factors, which are applied to specific cortex of the brain during sleep. The form can be image, sound, thought, feeling and so on. Studies have shown that a beautiful dream can bring a subjectively more pleasant feeling to a certain extent. People can even find inspiration in solving dreams in real dreams, but because the dream is not controlled by the subjective consciousness of the human body, the human body sleeps. When the state wakes up, it usually does not remember a complete and clear dream.
发明内容Summary of the invention
针对上述技术问题,本说明书实施例提供一种梦境重现模型的构建方法、梦境重现方法及装置,技术方案如下:For the above technical problem, the embodiment of the present specification provides a method for constructing a dream reproduction model, a method and device for reproducing a dream, and the technical solution is as follows:
根据本说明书实施例的第一方面,提供一种梦境重现模型的构建方法,所述方法包括:According to a first aspect of the embodiments of the present specification, a method for constructing a dream reproduction model is provided, the method comprising:
获得至少一组包含可感知对象与用户在感知所述可感知对象时的脑电波数据的对应关系;Obtaining at least one set of correspondences between the perceptible objects and the brain wave data when the user perceives the perceptible objects;
分别对每一组所述对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的所述脑电波数据的特征值为输入值,以提取到的所述可感知对象的特征值为标签值;Performing feature extraction on each of the corresponding correspondences to obtain a training sample set, wherein each of the training samples uses the extracted feature value of the brain wave data as an input value to extract the perceptible object The eigenvalue is a tag value;
利用有监督学习算法对所述训练样本进行训练,得到梦境重现模型,所述梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。The training sample is trained by using a supervised learning algorithm to obtain a dream reproduction model. The dream reproduction model takes the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as an output value.
根据本说明书实施例的第二方面,提供一种梦境重现方法,所述方法包括:According to a second aspect of the embodiments of the present specification, a method for dream reproduction is provided, the method comprising:
获得用户在睡眠状态下的脑电波数据;Obtaining brain wave data of the user in a sleep state;
对所获得的脑电波数据进行特征提取,得到所述脑电波数据的特征值;Performing feature extraction on the obtained brain wave data to obtain characteristic values of the brain wave data;
将所得到的脑电波数据的特征值输入所述梦境重现模型,得到对应的输出值;Inputting the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value;
从所述对应关系中,确定与所述输出值具有最高相似度的可感知对象,以生成梦境重现结果。From the correspondence, a perceptible object having the highest similarity to the output value is determined to generate a dream reproduction result.
根据本说明书实施例的第三方面,提供一种梦境重现模型的构建装置,所述装置包括:According to a third aspect of the embodiments of the present specification, a device for constructing a dream reproduction model is provided, and the device includes:
数据获取模块,用于获得至少一组包含可感知对象与用户在感知所述可感知对象时的脑电波数据的对应关系;a data obtaining module, configured to obtain at least one set of correspondences between the perceptible object and the brain wave data when the user perceives the perceptible object;
样本获取模块,用于分别对每一组所述对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的所述脑电波数据的特征值为输入值,以提取到的所述可感知对象的特征值为标签值;a sample obtaining module, configured to perform feature extraction on each group of the corresponding relationships, respectively, to obtain a training sample set, wherein each of the training samples extracts the characteristic value of the brain wave data as an input value, to extract the The feature value of the perceptible object is a tag value;
样本训练模块,用于利用有监督学习算法对所述训练样本进行训练,得到梦境重现模型,所述梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。a sample training module, configured to train the training sample by using a supervised learning algorithm, to obtain a dream reproduction model, wherein the dream reproduction model uses the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as output value.
根据本说明书实施例的第四方面,提供一种梦境重现装置,所述装置包括:According to a fourth aspect of the embodiments of the present specification, a dream recreating apparatus is provided, the apparatus comprising:
脑电波获取模块,用于获得用户在睡眠状态下的脑电波数据;The brain wave acquisition module is configured to obtain brain wave data of the user in a sleep state;
特征提取模块,用于对所获得的脑电波数据进行特征提取,得到所述脑电波数据的特征值;a feature extraction module, configured to perform feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data;
输出模块,用于将所得到的脑电波数据的特征值输入所述梦境重现模型,得到对应的输出值;An output module, configured to input the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value;
重现模块,用于从所述对应关系中,确定与所述输出值具有最高相似度的可感知对象,以生成梦境重现结果。And a reproducing module, configured to determine, from the correspondence, a perceptible object having the highest similarity with the output value, to generate a dream reproduction result.
根据本说明书实施例的第五方面,提供一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述程序时实现本说明书一个或多个实施例提供的任一项梦境重现模型的构建方法。According to a fifth aspect of embodiments of the present specification, a computer apparatus includes a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the program when the program is executed A method of constructing any of the dream recurrence models provided by one or more embodiments of the specification.
根据本说明书实施例的第六方面,提供一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述程序时实现本说明书一个或多个实施例提供的任一项梦境重现方法。According to a sixth aspect of embodiments of the present specification, a computer apparatus includes a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the program when the program is executed Any one of the embodiments provides a method of dream reproduction.
本说明书实施例所提供的技术方案,通过获得至少一组包含可感知对象与用户在感 知可感知对象时的脑电波数据的对应关系,分别对每一组对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的脑电波数据的特征值为输入值,以可感知对象的特征值为标签值,利用有监督学习算法对训练样本进行训练,得到梦境重现模型,该梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值为输出值,后续,通过该梦境重现模型即可实现利用用户在睡眠状态下的脑电波数据重现用户梦境,满足用户体验。According to the technical solution provided by the embodiments of the present disclosure, by obtaining at least one set of correspondences between the perceptible objects and the brain wave data when the user perceives the perceptible objects, feature extraction is performed on each group of correspondences to obtain a training sample set. Wherein, each training sample extracts the characteristic value of the brain wave data as an input value, and the characteristic value of the perceptible object is a tag value, and the training sample is trained by using a supervised learning algorithm to obtain a dream reproduction model, The dream recurrence model takes the eigenvalue of the brain wave data as the input value, and the eigenvalue of the sensible object is the output value. Subsequently, the dream recurrence model can realize the user's brain wave data reproduction in the sleep state. Dreamland, satisfying the user experience.
应当理解的是,以上的一般描述和后文的细节描述仅是示例性和解释性的,并不能限制本说明书实施例。The above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the embodiments.
此外,本说明书实施例中的任一实施例并不需要达到上述的全部效果。Moreover, any of the embodiments of the present specification does not need to achieve all of the above effects.
附图说明DRAWINGS
为了更清楚地说明本说明书实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本说明书实施例中记载的一些实施例,对于本领域普通技术人员来讲,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present specification or the technical solutions in the prior art, the drawings to be used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a few embodiments described in the embodiments of the present specification, and other drawings can be obtained from those skilled in the art based on these drawings.
图1为本说明书一示例性实施例示出的实现梦境重现的应用场景示意图;FIG. 1 is a schematic diagram of an application scenario for implementing dream replay according to an exemplary embodiment of the present disclosure; FIG.
图2为本说明书一示例性实施例示出的梦境重现模型的构建方法的流程图;2 is a flowchart of a method for constructing a dream reproduction model according to an exemplary embodiment of the present specification;
图3为本说明书一示例性实施例示出的梦境重现方法的流程图;FIG. 3 is a flowchart of a dream reproduction method according to an exemplary embodiment of the present specification; FIG.
图4为本说明书一示例性实施例示出的梦境重现模型的构建装置的实施例框图;4 is a block diagram of an embodiment of a device for constructing a dream reproduction model according to an exemplary embodiment of the present specification;
图5为本说明书一示例性实施例示出的梦境重现装置的实施例框图;FIG. 5 is a block diagram of an embodiment of a dream recreating apparatus according to an exemplary embodiment of the present specification; FIG.
图6示出了本说明书实施例所提供的一种更为具体的计算设备硬件结构示意图。FIG. 6 is a schematic diagram showing a hardware structure of a more specific computing device provided by an embodiment of the present specification.
具体实施方式Detailed ways
为了使本领域技术人员更好地理解本说明书实施例中的技术方案,下面将结合本说明书实施例中的附图,对本说明书实施例中的技术方案进行详细地描述,显然,所描述的实施例仅仅是本说明书的一部分实施例,而不是全部的实施例。基于本说明书中的实施例,本领域普通技术人员所获得的所有其他实施例,都应当属于保护的范围。In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present specification, the technical solutions in the embodiments of the present specification will be described in detail below with reference to the accompanying drawings in the embodiments of the present specification. The examples are only a part of the embodiments of the specification, and not all of the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in this specification should fall within the scope of protection.
现代医学认为,梦是人体睡眠时,体内外各种刺激因素,例如心理、生理、病理、 环境因素等作用于大脑特定的皮层所产生的,也就是说,人在做梦时,大脑皮层处于兴奋状态,从而将产生脑电波,而脑电波与人的意识活动具有某种程度的对应,例如,人在看到两幅不同的图像,或者听到两段旋律不同的音乐时,大脑皮层的神经活动不同,从而所产生的脑电波不同,同样的,人做梦梦到不同的场景时,大脑皮层的神经活动不同,从而所产生的脑电波也不同,基于此,本发明提出利用脑电波数据实现梦境重现。Modern medicine believes that when the human body sleeps, various stimulating factors inside and outside the body, such as psychological, physiological, pathological, environmental factors, etc., are produced by the specific cortex of the brain. That is to say, when the person is dreaming, the cerebral cortex is excited. The state, which will produce brain waves, and the brain waves have a certain degree of correspondence with human consciousness activities, for example, when a person sees two different images, or hears two different melody music, the nerves of the cerebral cortex The activities are different, so that the brain waves generated are different. Similarly, when people dream of different scenes, the neural activity of the cerebral cortex is different, and the generated brain waves are also different. Based on this, the present invention proposes to realize the use of brain wave data. The dream reappears.
请参见图1,为本说明书一示例性实施例示出的实现梦境重现的应用场景示意图。如图1所示,包括用户110、脑电波传感器120,以及计算机130,其中,脑电波传感器120被佩戴在用户110的头部,用于采集用户110的脑电波数据,并将采集到的脑电波数据发送给计算机130,具体为:在用户110处于清醒状态时,脑电波传感器120采集用户110在感知到可感知对象,例如用户110看到一幅图像时,用户110的脑电波数据,将该脑电波数据,以及该脑电波数据对应的可感知对象的相关信息发送给计算机130,由计算机130基于接收到的脑电波数据与可感知对象的相关信息进行训练,得到梦境重现模型,该梦境重现模型可以以脑电波数据相关信息为输入,以可感知对象相关信息为输出。本领域技术人员可以理解的是,为了得到梦境重现模型,需要若干样本,也即需要采集若干条用户在感知不同的可感知对象时,所产生的脑电波数据。Please refer to FIG. 1 , which is a schematic diagram of an application scenario for implementing dream reproduction according to an exemplary embodiment of the present disclosure. As shown in FIG. 1, the user 110, the brain wave sensor 120, and the computer 130 are included, wherein the brain wave sensor 120 is worn on the head of the user 110 for collecting brain wave data of the user 110, and collecting the brain. The radio wave data is sent to the computer 130. Specifically, when the user 110 is in the awake state, the brain wave sensor 120 collects the brain wave data of the user 110 when the user 110 perceives the perceptible object, for example, when the user 110 sees an image. The brain wave data and the related information of the perceptible object corresponding to the brain wave data are sent to the computer 130, and the computer 130 performs training based on the received brain wave data and the related information of the perceptible object to obtain a dream reproduction model. The dream recurrence model can take the brain wave data related information as input and the object-related information as the output. It can be understood by those skilled in the art that in order to obtain a dream reproduction model, several samples are needed, that is, it is required to collect brain wave data generated by several users when they perceive different perceptible objects.
在训练得到梦境重现模型后,则可以使用脑电波传感器120采集用户在睡眠状态下所产生的脑电波数据,继而脑电波传感器120将该脑电波数据发送至计算机130,计算机130则可以基于梦境重现模型输出与该脑电波数据对应的可感知对象的相关信息,继而则可以基于该可感知对象的相关信息生成梦境重现结果。待用户110醒来后,则可以通过计算机130查看上述梦境重现结果,实现“重温”梦境。After the training to obtain the dream reproduction model, the brain wave sensor 120 can be used to collect the brain wave data generated by the user in the sleep state, and then the brain wave sensor 120 transmits the brain wave data to the computer 130, and the computer 130 can be based on the dream. The reproduction model outputs relevant information of the perceptible object corresponding to the electroencephalogram data, and then the dream reproduction result can be generated based on the related information of the perceptible object. After the user 110 wakes up, the above-mentioned dream reproduction result can be viewed by the computer 130 to realize the "re-warming" dream.
基于图1所示的应用场景,本说明书示出下述实施例分别从梦境重现模型的构建,与基于梦境重现模型实现梦境重现两个方面进行描述。Based on the application scenario shown in FIG. 1, the present specification shows that the following embodiments are respectively described from the construction of the dream reproduction model and the realization of the dream reproduction based on the dream reproduction model.
首先,从梦境重现模型的构建这一方面进行描述:First, describe this aspect of the construction of the Dream Reproduction Model:
请参见图2,为本说明书一示例性实施例示出的梦境重现模型的构建方法的流程图,可以包括以下步骤:Referring to FIG. 2, a flowchart of a method for constructing a dream reproduction model according to an exemplary embodiment of the present disclosure may include the following steps:
步骤202:获得至少一组包含可感知对象与用户在感知可感知对象时的脑电波数据的对应关系。Step 202: Obtain a correspondence between at least one set of brainwave data including the perceptible object and the user when perceiving the perceptible object.
在本说明书实施例中,可感知对象可以为单幅图像,也可以为视频中截取的一幅图像帧,本领域技术人员可以理解的是,单幅图像与图像帧的本质都是图像,因此,为了 描述方便,在本说明书实施例中,即称可感知对象可以为图像。In the embodiment of the present specification, the perceptible object may be a single image or an image frame intercepted in the video. It can be understood by those skilled in the art that the essence of the single image and the image frame are images. For convenience of description, in the embodiment of the present specification, the perceptible object may be an image.
在一实施例中,可以预设可感知对象集合,例如,该集合包括1000张不同的图像,依次将该可感知对象集合中的每一可感知对象提供给用户110,例如,在特定环境下,以幻灯片形式播放该每一可感知对象,并在向用户110提供可感知对象时,同步采集用户110在感知该可感知对象时的脑电波数据。通过该种处理,每采集一次脑电波数据,即可获得一条包含可感知对象与用户110感知该可感知对象时的脑电波数据的对应关系,例如,获得1000条该对应关系。In an embodiment, the set of perceptible objects may be preset, for example, the set includes 1000 different images, and each perceptible object in the set of perceptible objects is sequentially provided to the user 110, for example, in a specific environment. The each perceptible object is played in a slideshow, and when the user 110 is provided with the perceptible object, the brainwave data of the user 110 when the perceptible object is perceived is synchronously acquired. Through such processing, each time the brain wave data is collected, a correspondence relationship between the perceptible object and the brain wave data when the user 110 perceives the perceptible object is obtained, for example, 1000 correspondences are obtained.
在一实施例中,可以按照预设规则,例如每隔5秒钟,向用户110提供一个可感知对象,并在提供第一个可感知对象至最后一个可感知对象的整个过程中,持续采集用户110的脑电波数据,之后,按照与上述预设规则对应的提取规则,例如按照脑电波数据的采集时间,每隔5秒钟,截取一段脑电波数据,之后,建立脑电波数据与可感知对象之间的对应关系。通过该种处理,最终也可以获取到多条包含可感知对象与用户110感知该可感知对象时的脑电波数据的对应关系。In an embodiment, the user 110 may be provided with a perceptible object according to a preset rule, for example every 5 seconds, and continuously collected during the entire process of providing the first perceptible object to the last perceptible object. The brain wave data of the user 110, and then, according to the extraction rule corresponding to the preset rule, for example, according to the acquisition time of the brain wave data, intercepting a piece of brain wave data every 5 seconds, and then establishing brain wave data and perceptible The correspondence between objects. Through such processing, finally, a plurality of correspondences including the perceptible object and the brain wave data when the user 110 perceives the perceptible object can be acquired.
在一实施例中,也可以向用户110提供一段视频,并在用户110观看该视频的整个过程中,持续采集用户110的脑电波数据,之后,按照同样的时间间隔,截取该视频中的图像帧,以及脑电波数据,之后,则可以建立起脑电波数据与可感知对象之间的对应关系。In an embodiment, a video may be provided to the user 110, and the brain wave data of the user 110 is continuously collected during the whole process of the user 110 viewing the video, and then the image in the video is intercepted at the same time interval. Frames, as well as brainwave data, can then establish a correspondence between brainwave data and perceptible objects.
需要说明的是,上述描述的两个实施例仅仅作为两种可选的实现方式,在实际应用中,还可以存在其他方式获取到至少一组包含可感知对象与用户在感知可感知对象时的脑电波数据的对应关系,例如,可以在用户110按照自主意志进行活动时,采集用户110的脑电波数据,并同步采集用户110的视网膜成像,基于采集时间,即可建立脑电波数据与视网膜成像的对应关系,该视网膜成像即可等同于用户感知到的可感知对象。It should be noted that the two embodiments described above are only used as two alternative implementations. In an actual application, there may be other manners to obtain at least one set of the object that includes the perceptible object and the user when perceiving the perceptible object. Corresponding relationship of brain wave data, for example, when the user 110 performs activities according to the will of the user, the brain wave data of the user 110 is collected, and the retinal imaging of the user 110 is synchronously acquired, and the brain wave data and the retinal imaging can be established based on the acquisition time. Corresponding relationship, the retinal imaging can be equivalent to the perceptible object perceived by the user.
本领域技术人员可以理解的是,按照上述描述,图1中所示例的脑电波传感器120还可以具有采集视网膜成像的功能,或者是由另一单独的可佩戴智能芯片(图1中并未示出)负责采集用户110的视网膜成像,本说明书实施例对此不作限制。It will be understood by those skilled in the art that, according to the above description, the brain wave sensor 120 illustrated in FIG. 1 may also have the function of acquiring retinal imaging, or by another separate wearable smart chip (not shown in FIG. 1). It is responsible for collecting the retinal imaging of the user 110, which is not limited in this embodiment of the present specification.
步骤204:分别对每一组对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的脑电波数据的特征值为输入值,以提取到的可感知对象的特征值为标签值。Step 204: Perform feature extraction on each group correspondence, and obtain a training sample set, wherein each training sample uses the extracted feature value of the brain wave data as an input value, and the extracted feature value of the perceptible object is obtained. Tag value.
本说明书实施例中,针对步骤202获得的每一组对应关系,分别对每一组对应关系 中的可感知对象与用户感知该可感知对象时的脑电波数据进行特征提取,得到训练样本集合,该训练样本集合中的每一条训练样本则包括提取到的脑电波数据的特征值与提取到的可感知对象的特征值,并且基于上述图1所示应用场景的相关描述,在实际的梦境重现过程中,是通过采集到的用户110在睡眠状态下的脑电波数据确定用户110感知到的可感知对象,因此,上述每一条训练样本则以脑电波数据的特征值为输入值,以提取到的可感知对象的特征值为标签值。In the embodiment of the present specification, for each set of correspondences obtained in step 202, feature extraction is performed on the perceptible object in each set of correspondences and the brain wave data in which the user perceives the perceptible object, to obtain a training sample set. Each training sample in the training sample set includes the feature value of the extracted brain wave data and the extracted feature value of the perceptible object, and based on the related description of the application scenario shown in FIG. 1 above, the actual dream is heavy. In the present process, the perceptible object perceived by the user 110 is determined by the collected brain wave data of the user 110 in the sleep state. Therefore, each of the above training samples uses the characteristic value of the brain wave data as an input value to extract. The eigenvalue of the perceived object is the tag value.
提取脑电波数据的特征值:Extract the characteristic values of brain wave data:
在一实施例中,通过复变的数学概念可知,任一频率的实信号都可以表示成一系列周期函数的和,而将实信号表示成一系列周期函数和的过程则是对该实信号进行分析的过程,每一周期函数则相当于该实信号的组成成分,基于此,本说明书提出对脑电波数据进行复变分解,例如利用傅里叶变换对脑电波数据进行复变分解,将脑电波数据表示为至少一个复变函数的和,该至少一个复变函数则可以作为脑电波数据的特征值,例如,所提到的脑电波数据的特征值为(a 1f 1(sinx),a 2f 2(sinx),a 3f 3(sinx))。 In an embodiment, by the mathematical concept of complex transformation, the real signal of any frequency can be expressed as a sum of a series of periodic functions, and the process of expressing the real signal as a series of periodic functions is to analyze the real signal. The process of each cycle is equivalent to the composition of the real signal. Based on this, the present specification proposes a complex transformation of brain wave data, for example, complex transformation of brain wave data by Fourier transform, and brain wave The data is represented as a sum of at least one complex variable function, and the at least one complex variable function can be used as an eigenvalue of brain wave data, for example, the characteristic value of the mentioned brain wave data is (a 1 f 1 (sinx), a 2 f 2 (sinx), a 3 f 3 (sinx)).
需要说明的是,上述描述的提取脑电波数据特征值的方式仅仅作为一种可选的实现方式,在实际应用中,还可以通过其他方式提取脑电波数据的特征值,例如,可以通过相关性分析、AR参数估计、Butterworth低通滤波、遗传算法等等方式提取脑电波数据的特征值,所提取到的特征值的具体类型可以由实际算法决定,例如,采用Butterworth低通滤波算法提取到的特征值则为信号幅度的平方值,采用AR参数估计算法提取到的特征值则为功率频谱密度,本说明书实施例不再一一介绍。It should be noted that the manner of extracting the feature values of the brain wave data described above is only an optional implementation manner. In practical applications, the feature values of the brain wave data may also be extracted by other means, for example, by correlation. The eigenvalues of the brainwave data are extracted by analysis, AR parameter estimation, Butterworth low-pass filtering, genetic algorithm, etc. The specific type of the extracted feature values can be determined by an actual algorithm, for example, extracted by Butterworth low-pass filtering algorithm. The eigenvalue is the square of the signal amplitude, and the eigenvalue extracted by the AR parameter estimation algorithm is the power spectral density, which is not described in the embodiment of the present specification.
提取可感知对象的特征值:Extract the feature values of the perceptible object:
以可感知对象为图像为例,在一实施例中,可以对可感知对象进行颜色统计,得到可感知对象中每种颜色值对应的像素点个数,将所得到的像素点个数表示为2 N维向量,其中N为图像的色彩位数,即,该2 N维向量即可作为该可感知对象的特征值,例如,所提取到的特征值为(y 1、y 2、y 3、……y 2^N)。 Taking the perceptible object as an example, in an embodiment, color statistics can be performed on the perceptible object, and the number of pixels corresponding to each color value in the perceptible object is obtained, and the obtained number of pixel points is expressed as 2 N -dimensional vector, where N is the number of color bits of the image, that is, the 2 N -dimensional vector can be used as the feature value of the perceptible object, for example, the extracted feature values are (y 1 , y 2 , y 3 , ... y 2^N ).
进一步,考虑到不同图像的色彩位数可能不同,例如8位图像与16位图像,从而,所提取到的特征值的维数也就不同,为了后续对训练样本进行训练的统一化,规整化,可以将具有不同色彩位数的图像的颜色统计结果映射至统一的向量空间,这里所说的“统一”是指基于颜色统计结果所得到向量的维数相同。Further, considering that the number of color bits of different images may be different, for example, an 8-bit image and a 16-bit image, the dimension of the extracted feature values is different, and the training is unified for the subsequent training of the training samples. The color statistics of images with different color bits can be mapped to a unified vector space. Here, "unified" means that the dimensions of the vectors obtained based on the color statistics result are the same.
此外,需要说明的是,向量的维数越大,后续对训练样本进行训练的复杂度也就越 高,计算量也就越大,因此,在本说明书实施例中,在保证可感知对象特征值的精细度满足用户期望时,可以尽可能地设定一个维数较小的向量空间。In addition, it should be noted that the larger the dimension of the vector, the higher the complexity of training the training sample and the larger the calculation amount. Therefore, in the embodiment of the present specification, the object characteristics are guaranteed. When the fineness of the value satisfies the user's expectation, a vector space with a small number of dimensions can be set as much as possible.
需要说明的是,在实际应用中,针对不同色彩位数的图像,可以首先将这些图像同一设置为相同的色彩位数,继而再按照上述描述进行特征提取,在得到颜色统计结果后,则无需再执行将每一颜色统计结果映射至统一向量空间的步骤。It should be noted that, in practical applications, for images of different color digits, the images may be first set to the same color number, and then the feature extraction is performed according to the above description. The step of mapping each color statistical result to the unified vector space is performed.
步骤206:利用有监督学习算法对训练样本进行训练,得到梦境重现模型,梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。Step 206: Training the training sample by using a supervised learning algorithm to obtain a dream recurrence model. The dream recurrence model takes the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as an output value.
在本说明书实施例中,可以利用有监督学习算法对步骤204中得到的训练样本进行训练,得到梦境重现模型,该梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。可以理解的是,训练的到梦境重现模型实质上可以理解为输入值与输出值之间的函数关系,其中,输出值会受到输入值中的全部或部分影响,因此,输出值与输入值之间的函数关系可以如下示例:In the embodiment of the present specification, the training sample obtained in step 204 can be trained by using a supervised learning algorithm to obtain a dream reproduction model, and the dream reproduction model uses the characteristic value of the brain wave data as an input value to perceive the object. The eigenvalue is used as the output value. It can be understood that the training-to-dream reproduction model can be understood as a functional relationship between the input value and the output value, wherein the output value is affected by all or part of the input value, and therefore, the output value and the input value The functional relationship between them can be exemplified as follows:
y=f(x 1,x 2,…x M) y=f(x 1 ,x 2 ,...x M )
其中,x 1,x 2,…x M表示M个输入值,也即M个脑电波数据的特征值,y则表示输出值,也即可感知对象的特征值,具体可以为可感知对象中每种颜色值对应的像素点个数之间的比例关系。 Wherein, x 1 , x 2 , ... x M represent M input values, that is, characteristic values of M brain wave data, and y represents an output value, and may also perceive the feature value of the object, and may specifically be in the perceptible object. The proportional relationship between the number of pixels corresponding to each color value.
需要说明的是,该梦境重现模型的形式可以根据实际训练需求选择,例如线性回归模型(linear regression model)、逻辑斯谛回归模型(logistic regression model)等等。本说明书实施例对模型的选择及具体的训练算法均不作限定。It should be noted that the form of the dream reproduction model can be selected according to actual training needs, such as a linear regression model, a logistic regression model, and the like. The embodiment of the present specification does not limit the selection of the model and the specific training algorithm.
此外,需要说明的是,不同用户对同一可感知对象的感知能力可能不同,因此,本说明书实施例中提出针对不同用户分别构建不同的梦境重现模型;进一步,同一用户在自身心理、生理处于不同状态下,对同一可感知对象的感知能力可能不同,因此,本说明书实施例中还提出针对同一用户的不同时间段,分别构建不同的梦境重现模型。另外,在实际应用中,还可以存在其他可实现方式,例如,针对不同用户均构建同一梦境重现模型,本说明书实施例对此并不作具体限制。In addition, it should be noted that different users may have different perceptions of the same perceptible object. Therefore, in this embodiment, different dream re-creation models are separately constructed for different users; further, the same user is in his or her own psychology and physiology. In different states, the sensing ability of the same perceptible object may be different. Therefore, in the embodiment of the present specification, different dream recurrence models are separately constructed for different time segments of the same user. In addition, in the actual application, there may be other implementation manners, for example, the same dream reproduction model is constructed for different users, and the embodiment of the present specification does not specifically limit this.
由上述实施例可见,本说明书实施例提供的技术方案,通过获得至少一组包含可感知对象与用户在感知可感知对象时的脑电波数据的对应关系,分别对每一组对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的脑电波数据的特征值为输入值,以可感知对象的特征值为标签值,利用有监督学习算法对训练样本进行训练, 得到梦境重现模型,该梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值为输出值,后续,通过该梦境重现模型即可实现利用用户在睡眠状态下的脑电波数据重现用户梦境,满足用户体验。It can be seen from the foregoing embodiments that the technical solution provided by the embodiments of the present disclosure performs feature extraction for each group of correspondences by obtaining at least one set of corresponding relationships between the perceptible objects and the brain wave data when the user perceives the perceptible objects. Obtaining a training sample set, wherein each training sample extracts the characteristic value of the brain wave data as an input value, and the eigenvalue of the object is a tag value, and the training sample is trained by using a supervised learning algorithm to obtain a dream Recurring the model, the dream recurrence model takes the eigenvalue of the brain wave data as an input value, and the eigenvalue of the sensible object is an output value, and subsequently, the brain can be realized by using the user in a sleep state through the dream reproduction model The radio wave data reproduces the user's dream and satisfies the user experience.
至此,完成梦境重现模型的构建这一方面的相关描述。So far, the relevant description of the construction of the dream reproduction model is completed.
其次,从基于梦境重现模型实现梦境重现这一方面进行描述:Secondly, it describes the realization of dream reappearance based on the dream recurrence model:
请参见图3,为本说明书一示例性实施例示出的梦境重现方法的流程图,可以包括以下步骤:Referring to FIG. 3, a flowchart of a method for reproducing a dream according to an exemplary embodiment of the present disclosure may include the following steps:
步骤302:获得用户在睡眠状态下的脑电波数据。Step 302: Obtain brainwave data of the user in a sleep state.
在本说明书实施例中,可以按照预设规则,例如每隔一分钟、或每隔两分钟等通过图1中所示例的脑电波传感器120获得用户在睡眠状态下的脑电波数据。In the embodiment of the present specification, the brain wave data of the user in the sleep state can be obtained by the brain wave sensor 120 illustrated in FIG. 1 according to a preset rule, for example, every one minute, or every two minutes.
步骤304:对所获得的脑电波数据进行特征提取,得到脑电波数据的特征值。Step 304: Perform feature extraction on the obtained brain wave data to obtain characteristic values of brain wave data.
本步骤的详细描述可以参见上述图2所示实施例中步骤204中的相关描述,在此不再详述。For a detailed description of this step, refer to the related description in step 204 in the foregoing embodiment shown in FIG. 2, and details are not described herein again.
步骤306:将所得到的脑电波数据的特征值输入梦境重现模型,得到对应的输出值。Step 306: Input the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value.
由上述图2所示实施例中描述的梦境重现模型可知,在本步骤中,可以将步骤304中提取到的脑电波数据的特征值输入梦境重现模型,得到对应的输出值,该输出值可以为可感知对象的特征值。It can be seen from the dream re-creation model described in the embodiment shown in FIG. 2 that, in this step, the feature value of the brain wave data extracted in step 304 can be input into the dream reproduction model to obtain a corresponding output value, and the output is obtained. The value can be a feature value of the perceptible object.
步骤308:从对应关系中,确定与输出值具有最高相似度的可感知对象,以生成梦境重现结果。Step 308: From the correspondence, determine a perceptible object having the highest similarity with the output value to generate a dream reproduction result.
在本说明书实施例中,可以将训练样本集中每一可感知对象的特征值与步骤306中的输出值进行相似度计算,确定与该输出值相似度最高的可感知对象的特征值,继而,则可以在上述图2所示实施例描述的对应关系中,确定与该输出值具有最高相似度的可感知对象,基于所确定的可感知对象即可生成梦境重现结果。In the embodiment of the present specification, the feature value of each perceptible object in the training sample set may be similarly calculated with the output value in step 306, and the feature value of the perceptible object with the highest similarity to the output value may be determined, and then, Then, in the corresponding relationship described in the embodiment shown in FIG. 2 above, the perceptible object having the highest similarity with the output value may be determined, and the dream reproduction result may be generated based on the determined perceptible object.
得到训练样本集中每一可感知对象的特征值的具体过程可以参见上述图2所示实施例中的相关描述,在此不再详述。For a specific process of obtaining the feature values of each perceptible object in the training sample set, refer to the related description in the embodiment shown in FIG. 2 above, which will not be described in detail herein.
进一步可以向用户展示梦境重现结果,例如,按照脑电波数据的采集时间的先后顺序,以幻灯片形式播放确定的多张图像。Further, the dream reproduction result can be displayed to the user, for example, the determined plurality of images are played in a slide show in the order of the acquisition time of the brain wave data.
本领域技术人员可以理解的是,上述与输出值具有最高相似度的可感知对象可以为一个或多个,本说明书实施例对此不作限制。It can be understood by those skilled in the art that the above-mentioned perceptible object having the highest similarity with the output value may be one or more, which is not limited in the embodiment of the present specification.
在上述描述中,计算输出值与可感知对象的特征值之间相似度的具体方式可以为欧式距离算法、余弦相似度计算算法,等等,本说明书实施例对此不作限制。In the above description, the specific manner of calculating the similarity between the output value and the feature value of the perceptible object may be a Euclidean distance algorithm, a cosine similarity calculation algorithm, and the like, which are not limited in the embodiment of the present specification.
由上述实施例可见,本说明书实施例提供的技术方案,通过获得用户在睡眠状态下的脑电波数据,对该脑电波数据进行特征提取,得到脑电波数据的特征值,将该特征值输入梦境重现模型,得到对应的输出值,之后,从预先获取到的包含可感知对象与用户感知可感知对象时的脑电波数据的对应关系中,确定与该输出值具有最高相似度的可感知对象,以生成梦境重现结果,从而实现了用户基于梦境重现结果“重温”梦境。It can be seen from the above embodiments that the technical solution provided by the embodiment of the present invention obtains the feature value of the brain wave data by obtaining the brain wave data of the user in a sleep state, and obtains the feature value of the brain wave data, and inputs the feature value into the dream state. Reproducing the model, obtaining the corresponding output value, and then determining the perceptible object having the highest similarity to the output value from the correspondence between the pre-acquired object containing the perceptible object and the brainwave data when the user perceives the perceptible object In order to generate dreams to reproduce the results, thereby realizing the user to "relive" the dream based on the dream reappearing results.
至此,完成基于梦境重现模型实现梦境重现这一方面的相关描述。So far, a description has been completed on the realization of dream reproduction based on the dream reproduction model.
相应于上述梦境重现模型的构建方法实施例,本说明书实施例还提供一种梦境重现模型的构建装置,参见图4所示,为本说明书一示例性实施例示出的梦境重现模型的构建装置的实施例框图,该装置可以包括:数据获取模块41、样本获取模块42,以及样本训练模块43。Corresponding to the embodiment of the method for constructing the dream reproduction model, the embodiment of the present specification further provides a device for constructing a dream reproduction model, which is shown in FIG. 4, which is a dream reproduction model according to an exemplary embodiment of the present specification. A block diagram of an embodiment of a device, which may include a data acquisition module 41, a sample acquisition module 42, and a sample training module 43.
其中,数据获取模块41,可以用于获得至少一组包含可感知对象与用户在感知所述可感知对象时的脑电波数据的对应关系;The data obtaining module 41 may be configured to obtain at least one group of correspondences between the perceptible object and the brain wave data when the user perceives the perceptible object;
样本获取模块42,可以用于分别对每一组所述对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的所述脑电波数据的特征值为输入值,以提取到的所述可感知对象的特征值为标签值;The sample obtaining module 42 may be configured to perform feature extraction on each group of the corresponding relationships to obtain a training sample set, wherein each of the training samples extracts the characteristic value of the brain wave data as an input value to extract The feature value of the perceived object is the tag value;
样本训练模块43,可以用于利用有监督学习算法对所述训练样本进行训练,得到梦境重现模型,所述梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。The sample training module 43 can be configured to train the training sample by using a supervised learning algorithm to obtain a dream reproduction model, wherein the dream reproduction model uses the feature value of the brain wave data as an input value to perceive the characteristics of the object. The value is used as the output value.
在一实施例中,所述数据获取模块41可以包括(图4中未示出):In an embodiment, the data acquisition module 41 may include (not shown in FIG. 4):
提供子模块,用于依次将预设的可感知对象集合中的每一可感知对象提供给用户;Providing a sub-module for sequentially providing each perceptible object in the preset perceptible object set to the user;
采集子模块,用于在向所述用户提供所述可感知对象时,同步采集所述用户在感知所述可感知对象时的脑电波数据。And a collecting submodule, configured to synchronously collect brain wave data when the user perceives the perceptible object when the user is provided with the perceptible object.
在一实施例中,所述样本获取模块42可以包括(图4中未示出):In an embodiment, the sample acquisition module 42 can include (not shown in FIG. 4):
第一分解子模块,用于对每一组所述对应关系中的脑电波数据进行复变分解,将所 述脑电波数据表示为至少一个复变函数的和;a first decomposition sub-module, configured to perform complex transformation decomposition on brain wave data in each of the corresponding correspondences, and represent the brain wave data as a sum of at least one complex function;
第一确定子模块,用于将所述至少一个复变函数作为所述脑电波数据的特征值。a first determining submodule configured to use the at least one complex variable function as a feature value of the brain wave data.
在一实施例中,所述可感知对象为图像,所述样本获取模块42可以包括(图4中未示出):In an embodiment, the perceptible object is an image, and the sample acquisition module 42 may include (not shown in FIG. 4):
统计子模块,用于对每一组所述对应关系中的图像进行颜色统计,得到所述图像中每种颜色值对应的像素点个数;a statistic sub-module, configured to perform color statistics on each image in the corresponding relationship, to obtain a number of pixels corresponding to each color value in the image;
第二确定子模块,用于将所得到的像素点个数表示为2N维向量,其中N为图像的色彩位数。The second determining sub-module is configured to represent the obtained number of pixel points as a 2N-dimensional vector, where N is a color number of bits of the image.
在一实施例中,所述装置还可以包括(图4中未示出):In an embodiment, the apparatus may also include (not shown in Figure 4):
映射模块,用于将具有不同色彩位数的图像的颜色统计结果映射至统一的向量空间。A mapping module for mapping color statistical results of images having different color bits to a unified vector space.
在一实施例中,针对不同用户分别构建不同的梦境重现模型。In an embodiment, different dream recurrence models are constructed separately for different users.
可以理解的是,数据获取模块41、样本获取模块42,以及样本训练模块43作为三种功能独立的模块,既可以如图4所示同时配置在装置中,也可以分别单独配置在装置中,因此图4所示的结构不应理解为对本说明书实施例方案的限定。It can be understood that the data acquisition module 41, the sample acquisition module 42, and the sample training module 43 are three functionally independent modules, which may be simultaneously configured in the device as shown in FIG. 4, or may be separately configured in the device. Therefore, the structure shown in FIG. 4 should not be construed as limiting the embodiment of the present specification.
此外,上述装置中各个模块的功能和作用的实现过程具体详见上述梦境重现模型的构建方法中对应步骤的实现过程,在此不再赘述。In addition, the implementation process of the functions and functions of the modules in the foregoing apparatus is specifically described in the implementation process of the corresponding steps in the method for constructing the dream reproduction model, and details are not described herein.
相应于上述梦境重现方法实施例,本说明书实施例还提供一种梦境重现装置,参见图5所示,为本说明书一示例性实施例示出的梦境重现装置的实施例框图,该装置可以包括:脑电波获取模块51、特征提取模块52、输出模块53,以及重现模块54。Corresponding to the above embodiment of the dream reproduction method, the embodiment of the present specification further provides a dream recreating device. Referring to FIG. 5, it is a block diagram of an embodiment of a dream recreating device according to an exemplary embodiment of the present specification. The brain wave acquisition module 51, the feature extraction module 52, the output module 53, and the reproduction module 54 may be included.
其中,脑电波获取模块51,可以用于获得用户在睡眠状态下的脑电波数据;The brain wave acquisition module 51 can be used to obtain brain wave data of the user in a sleep state;
特征提取模块52,可以用于对所获得的脑电波数据进行特征提取,得到所述脑电波数据的特征值;The feature extraction module 52 may be configured to perform feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data;
输出模块53,可以用于将所得到的脑电波数据的特征值输入所述梦境重现模型,得到对应的输出值;The output module 53 can be configured to input the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value;
重现模块54,可以用于从所述对应关系中,确定与所述输出值具有最高相似度的可感知对象,以生成梦境重现结果。The reproducing module 54 may be configured to determine, from the correspondence, a perceptible object having the highest similarity with the output value to generate a dream reproduction result.
在一实施例中,所述特征提取模块52可以包括(图5中未示出):In an embodiment, the feature extraction module 52 can include (not shown in FIG. 5):
第二分解子模块,用于对所获得的脑电波数据进行复变分解,将所述脑电波数据表示为至少一个复变函数的和;a second decomposition sub-module, configured to perform complex transformation decomposition on the obtained brain wave data, and represent the brain wave data as a sum of at least one complex variable function;
第三确定子模块,用于将所述至少一个复变函数作为所述脑电波数据的特征值。And a third determining submodule configured to use the at least one complex variable function as a feature value of the brain wave data.
在一实施例中,所述重现模块54可以包括(图5中未示出):In an embodiment, the reproduction module 54 can include (not shown in FIG. 5):
第四确定子模块,用于确定所述对应关系中每一可感知对象的参考特征值;a fourth determining submodule, configured to determine a reference feature value of each perceptible object in the correspondence relationship;
计算子模块,用于分别计算所述输出值与所述每一可感知对象的参考特征值之间的相似度;a calculation submodule, configured to separately calculate a similarity between the output value and a reference feature value of each perceptible object;
第五确定子模块,用于确定具有最高相似度的可感知对象,以生成梦境重现结果。A fifth determining sub-module for determining a perceptible object having the highest similarity to generate a dream reproduction result.
可以理解的是,脑电波获取模块51、特征提取模块52、输出模块53,以及重现模块54作为四种功能独立的模块,既可以如图5所示同时配置在装置中,也可以分别单独配置在装置中,因此图5所示的结构不应理解为对本说明书实施例方案的限定。It can be understood that the brain wave acquisition module 51, the feature extraction module 52, the output module 53, and the reproduction module 54 are four functionally independent modules, which can be simultaneously configured in the device as shown in FIG. 5, or separately. The configuration shown in FIG. 5 is not to be construed as limiting the scope of the embodiments of the present specification.
此外,上述装置中各个模块的功能和作用的实现过程具体详见上述梦境重现方法中对应步骤的实现过程,在此不再赘述。In addition, the implementation process of the functions and functions of the modules in the foregoing apparatus is specifically described in the implementation process of the corresponding steps in the above-mentioned dream reproduction method, and details are not described herein again.
相应于上述梦境重现模型的构建方法实施例,本说明书实施例还提供一种计算机设备,其至少包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,处理器执行所述程序时实现前述的梦境重现模型的构建方法,该方法至少包括:获得至少一组包含可感知对象与用户在感知所述可感知对象时的脑电波数据的对应关系;分别对每一组所述对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的所述脑电波数据的特征值为输入值,以提取到的所述可感知对象的特征值为标签值;利用有监督学习算法对所述训练样本进行训练,得到梦境重现模型,所述梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。Corresponding to the embodiment of the method for constructing the dream reproduction model, the embodiment of the present specification further provides a computer device including at least a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processing The method for constructing the aforementioned dream recurrence model is implemented when the program is executed, and the method includes: obtaining at least one set of correspondences between the at least one set of the perceptible object and the brain wave data when the user perceives the perceptible object; Performing feature extraction on each set of the corresponding relationships, obtaining a training sample set, wherein each of the training samples extracts the feature value of the brain wave data as an input value, to extract the feature value of the perceptible object a tag value; training the training sample with a supervised learning algorithm to obtain a dream recurrence model, wherein the dream recurrence model takes the eigenvalue of the brain wave data as an input value, and uses the eigenvalue of the perceptible object as an output value .
相应于上述梦境重现方法实施例,本说明书实施例还提供一种计算机设备,其至少包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,处理器执行所述程序时实现前述的梦境重现方法,该方法至少包括:获得用户在睡眠状态下的脑电波数据;对所获得的脑电波数据进行特征提取,得到所述脑电波数据的特征值;将所得到的脑电波数据的特征值输入所述梦境重现模型,得到对应的输出值;从所述对应关系中,确定与所述输出值具有最高相似度的可感知对象,以生成梦境重现结果。Corresponding to the above embodiment of the dream reproduction method, the embodiment of the present specification further provides a computer device including at least a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the The foregoing method for reproducing a dream is implemented, the method includes at least: obtaining brain wave data of a user in a sleep state; performing feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data; Entering the feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value; and determining, from the correspondence, the perceptible object having the highest similarity with the output value to generate a dream reproduction result .
图6示出了本说明书实施例所提供的一种更为具体的计算设备硬件结构示意图,该设备可以包括:处理器610、存储器620、输入/输出接口630、通信接口640和总线650。其中处理器610、存储器620、输入/输出接口630和通信接口640通过总线650实现彼此之间在设备内部的通信连接。FIG. 6 is a schematic diagram showing a hardware structure of a more specific computing device provided by an embodiment of the present specification. The device may include a processor 610, a memory 620, an input/output interface 630, a communication interface 640, and a bus 650. The processor 610, the memory 620, the input/output interface 630, and the communication interface 640 implement a communication connection between the devices via the bus 650.
处理器610可以采用通用的CPU(Central Processing Unit,中央处理器)、微处理器、应用专用集成电路(Application Specific Integrated Circuit,ASIC)、或者一个或多个集成电路等方式实现,用于执行相关程序,以实现本说明书实施例所提供的技术方案。The processor 610 can be implemented by using a general-purpose CPU (Central Processing Unit), a microprocessor, an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits for performing correlation. The program is implemented to implement the technical solutions provided by the embodiments of the present specification.
存储器620可以采用ROM(Read Only Memory,只读存储器)、RAM(Random Access Memory,随机存取存储器)、静态存储设备,动态存储设备等形式实现。存储器620可以存储操作系统和其他应用程序,在通过软件或者固件来实现本说明书实施例所提供的技术方案时,相关的程序代码保存在存储器620中,并由处理器610来调用执行。The memory 620 can be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, or the like. The memory 620 can store the operating system and other applications. When the technical solutions provided by the embodiments of the present specification are implemented by software or firmware, the related program codes are saved in the memory 620 and executed by the processor 610.
输入/输出接口630用于连接输入/输出模块,以实现信息输入及输出。输入输出/模块可以作为组件配置在设备中(图6中未示出),也可以外接于设备以提供相应功能。其中输入设备可以包括键盘、鼠标、触摸屏、麦克风、各类传感器等,输出设备可以包括显示器、扬声器、振动器、指示灯等。The input/output interface 630 is used to connect an input/output module to implement information input and output. The input/output/module can be configured as a component in the device (not shown in Figure 6) or externally to the device to provide the corresponding functionality. The input device may include a keyboard, a mouse, a touch screen, a microphone, various types of sensors, and the like, and the output device may include a display, a speaker, a vibrator, an indicator light, and the like.
通信接口640用于连接通信模块(图6中未示出),以实现本设备与其他设备的通信交互。其中通信模块可以通过有线方式(例如USB、网线等)实现通信,也可以通过无线方式(例如移动网络、WIFI、蓝牙等)实现通信。The communication interface 640 is used to connect a communication module (not shown in FIG. 6) to implement communication interaction between the device and other devices. The communication module can communicate by wired means (such as USB, network cable, etc.), or can communicate by wireless means (such as mobile network, WIFI, Bluetooth, etc.).
总线650包括一通路,在设备的各个组件(例如处理器610、存储器620、输入/输出接口630和通信接口640)之间传输信息。 Bus 650 includes a path for transferring information between various components of the device, such as processor 610, memory 620, input/output interface 630, and communication interface 640.
需要说明的是,尽管上述设备仅示出了处理器610、存储器620、输入/输出接口630、通信接口640以及总线650,但是在具体实施过程中,该设备还可以包括实现正常运行所必需的其他组件。此外,本领域的技术人员可以理解的是,上述设备中也可以仅包含实现本说明书实施例方案所必需的组件,而不必包含图中所示的全部组件。It should be noted that although the above device only shows the processor 610, the memory 620, the input/output interface 630, the communication interface 640, and the bus 650, in a specific implementation, the device may also include necessary for normal operation. Other components. In addition, it will be understood by those skilled in the art that the above-mentioned devices may also include only the components necessary for implementing the embodiments of the present specification, and do not necessarily include all the components shown in the drawings.
相应于上述梦境重现模型的构建方法实施例,本说明书实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现前述的梦境重现模型的构建方法。该方法至少包括:获得至少一组包含可感知对象与用户在感知所述可感知对象时的脑电波数据的对应关系;分别对每一组所述对应关系进行特征提取,获得训 练样本集合,其中,每条训练样本以提取到的所述脑电波数据的特征值为输入值,以提取到的所述可感知对象的特征值为标签值;利用有监督学习算法对所述训练样本进行训练,得到梦境重现模型,所述梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。Corresponding to the embodiment of the method for constructing the dream reproduction model, the embodiment of the present specification further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the foregoing dream reproduction model is constructed. method. The method at least includes: obtaining at least one set of correspondences between the perceptible objects and the brainwave data of the user when the user perceives the perceptible objects; performing feature extraction on each set of the corresponding relationships, respectively, to obtain a training sample set, wherein And each of the training samples uses the extracted feature value of the brain wave data as an input value, and the extracted feature value of the perceptible object is a tag value; and the training sample is trained by using a supervised learning algorithm, A dream reproduction model is obtained. The dream reproduction model takes the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as an output value.
相应于上述梦境重现方法实施例,本说明书实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现前述的梦境重现方法。该方法至少包括:获得用户在睡眠状态下的脑电波数据;对所获得的脑电波数据进行特征提取,得到所述脑电波数据的特征值;将所得到的脑电波数据的特征值输入所述梦境重现模型,得到对应的输出值;从所述对应关系中,确定与所述输出值具有最高相似度的可感知对象,以生成梦境重现结果。Corresponding to the above embodiment of the dream reproduction method, the embodiment of the present specification further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the foregoing dream reproduction method is implemented. The method at least includes: obtaining brain wave data of a user in a sleep state; performing feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data; and inputting the feature value of the obtained brain wave data into the The dream reproduces the model to obtain a corresponding output value; from the correspondence, the perceptible object having the highest similarity with the output value is determined to generate a dream reproduction result.
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。Computer readable media includes both permanent and non-persistent, removable and non-removable media. Information storage can be implemented by any method or technology. The information can be computer readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read only memory. (ROM), electrically erasable programmable read only memory (EEPROM), flash memory or other memory technology, compact disk read only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, Magnetic tape cartridges, magnetic tape storage or other magnetic storage devices or any other non-transportable media can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary storage of computer readable media, such as modulated data signals and carrier waves.
通过以上的实施方式的描述可知,本领域的技术人员可以清楚地了解到本说明书实施例可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本说明书实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本说明书实施例各个实施例或者实施例的某些部分所述的方法。It can be clearly understood by those skilled in the art that the embodiments of the present specification can be implemented by means of software plus a necessary general hardware platform. Based on such understanding, the technical solution of the embodiments of the present specification may be embodied in the form of a software product in essence or in the form of a software product, which may be stored in a storage medium such as a ROM/RAM. Disks, optical disks, and the like, including instructions for causing a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods described in various embodiments of the embodiments of the present specification or embodiments.
上述实施例阐明的系统、装置、模块或单元,具体可以由计算机芯片或实体实现,或者由具有某种功能的产品来实现。一种典型的实现设备为计算机,计算机的具体形式可以是个人计算机、膝上型计算机、蜂窝电话、相机电话、智能电话、个人数字助理、媒体播放器、导航设备、电子邮件收发设备、游戏控制台、平板计算机、可穿戴设备或者这些设备中的任意几种设备的组合。The system, device, module or unit illustrated in the above embodiments may be implemented by a computer chip or an entity, or by a product having a certain function. A typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver, and a game control. A combination of a tablet, a tablet, a wearable device, or any of these devices.
本说明书中的各个实施例均采用递进的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于装置实施例而言,由于其基本相似于方法实施例,所以描述得比较简单,相关之处参见方法实施例的部分说明即可。以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的模块可以是或者也可以不是物理上分开的,在实施本说明书实施例方案时可以把各模块的功能在同一个或多个软件和/或硬件中实现。也可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性劳动的情况下,即可以理解并实施。The various embodiments in the specification are described in a progressive manner, and the same or similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment. The device embodiments described above are merely illustrative, and the modules described as separate components may or may not be physically separated, and the functions of the modules may be the same in the implementation of the embodiments of the present specification. Or implemented in multiple software and/or hardware. It is also possible to select some or all of the modules according to actual needs to achieve the purpose of the solution of the embodiment. Those of ordinary skill in the art can understand and implement without any creative effort.
以上所述仅是本说明书实施例的具体实施方式,应当指出,对于本技术领域的普通技术人员来说,在不脱离本说明书实施例原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也应视为本说明书实施例的保护范围。The above is only a specific embodiment of the embodiments of the present specification, and it should be noted that those skilled in the art can make some improvements and refinements without departing from the principles of the embodiments of the present specification. Improvements and retouching should also be considered as protection of embodiments of the present specification.

Claims (20)

  1. 一种梦境重现模型的构建方法,所述方法包括:A method for constructing a dream reproduction model, the method comprising:
    获得至少一组包含可感知对象与用户在感知所述可感知对象时的脑电波数据的对应关系;Obtaining at least one set of correspondences between the perceptible objects and the brain wave data when the user perceives the perceptible objects;
    分别对每一组所述对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的所述脑电波数据的特征值为输入值,以提取到的所述可感知对象的特征值为标签值;Performing feature extraction on each of the corresponding correspondences to obtain a training sample set, wherein each of the training samples uses the extracted feature value of the brain wave data as an input value to extract the perceptible object The eigenvalue is a tag value;
    利用有监督学习算法对所述训练样本进行训练,得到梦境重现模型,所述梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。The training sample is trained by using a supervised learning algorithm to obtain a dream reproduction model. The dream reproduction model takes the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as an output value.
  2. 根据权利要求1所述的方法,所述获得至少一组包含可感知对象与用户在感知所述可感知对象时的脑电波数据的对应关系,包括:The method according to claim 1, wherein the obtaining at least one set of correspondences between the perceptible object and the brainwave data of the user when the user perceives the perceptible object comprises:
    依次将预设的可感知对象集合中的每一可感知对象提供给用户;Providing each perceptible object in the preset set of perceptible objects to the user in turn;
    在向所述用户提供所述可感知对象时,同步采集所述用户在感知所述可感知对象时的脑电波数据。When the user is provided with the perceptible object, brain wave data of the user when the perceptible object is perceived is synchronously acquired.
  3. 根据权利要求1所述的方法,所述对每一组所述对应关系进行特征提取,包括:The method according to claim 1, wherein the feature extraction is performed for each group of the corresponding relationships, including:
    对每一组所述对应关系中的脑电波数据进行复变分解,将所述脑电波数据表示为至少一个复变函数的和;Performing complex transformation decomposition on the brain wave data in each of the corresponding correspondences, and expressing the brain wave data as a sum of at least one complex variable function;
    将所述至少一个复变函数作为所述脑电波数据的特征值。The at least one complex variable function is used as a feature value of the brain wave data.
  4. 根据权利要求1所述的方法,所述可感知对象为图像,所述对每一组所述对应关系进行特征提取,包括:The method according to claim 1, wherein the perceptible object is an image, and the extracting the feature for each set of the corresponding relationship comprises:
    对每一组所述对应关系中的图像进行颜色统计,得到所述图像中每种颜色值对应的像素点个数;Performing color statistics on the images in each of the corresponding correspondences to obtain the number of pixels corresponding to each color value in the image;
    将所得到的像素点个数表示为2N维向量,其中N为图像的色彩位数。The number of obtained pixel points is expressed as a 2N-dimensional vector, where N is the number of color bits of the image.
  5. 根据权利要求4所述的方法,还包括:The method of claim 4 further comprising:
    将具有不同色彩位数的图像的颜色统计结果映射至统一的向量空间。Map color statistics of images with different color bits to a uniform vector space.
  6. 根据权利要求1所述的方法,针对不同用户分别构建不同的梦境重现模型。According to the method of claim 1, different dream reproduction models are separately constructed for different users.
  7. 一种基于如权利要求1至6任一项所述的梦境重现模型的梦境重现方法,所述方法包括:A dream reproduction method based on the dream reproduction model according to any one of claims 1 to 6, the method comprising:
    获得用户在睡眠状态下的脑电波数据;Obtaining brain wave data of the user in a sleep state;
    对所获得的脑电波数据进行特征提取,得到所述脑电波数据的特征值;Performing feature extraction on the obtained brain wave data to obtain characteristic values of the brain wave data;
    将所得到的脑电波数据的特征值输入所述梦境重现模型,得到对应的输出值;Inputting the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value;
    从所述对应关系中,确定与所述输出值具有最高相似度的可感知对象,以生成梦境重现结果。From the correspondence, a perceptible object having the highest similarity to the output value is determined to generate a dream reproduction result.
  8. 根据权利要求7所述的方法,所述对所获得的脑电波数据进行特征提取,得到所述脑电波数据的特征值,包括:The method according to claim 7, wherein the feature extraction of the obtained brain wave data is performed to obtain characteristic values of the brain wave data, including:
    对所获得的脑电波数据进行复变分解,将所述脑电波数据表示为至少一个复变函数的和;Performing complex transformation decomposition on the obtained brain wave data, and expressing the brain wave data as a sum of at least one complex variable function;
    将所述至少一个复变函数作为所述脑电波数据的特征值。The at least one complex variable function is used as a feature value of the brain wave data.
  9. 根据权利要求7所述的方法,所述从所述对应关系中,确定与所述输出值具有最高相似度的可感知对象,以生成梦境重现结果,包括:The method according to claim 7, wherein the determining, from the correspondence, the perceptible object having the highest similarity with the output value to generate a dream reproduction result comprises:
    确定所述对应关系中每一可感知对象的参考特征值;Determining a reference feature value of each perceptible object in the correspondence relationship;
    分别计算所述输出值与所述每一可感知对象的参考特征值之间的相似度;Calculating a similarity between the output value and a reference feature value of each perceptible object;
    确定具有最高相似度的可感知对象,以生成梦境重现结果。The perceptible object with the highest similarity is determined to generate a dream reproduce result.
  10. 一种梦境重现模型的构建装置,所述装置包括:A device for constructing a dream reproduction model, the device comprising:
    数据获取模块,用于获得至少一组包含可感知对象与用户在感知所述可感知对象时的脑电波数据的对应关系;a data obtaining module, configured to obtain at least one set of correspondences between the perceptible object and the brain wave data when the user perceives the perceptible object;
    样本获取模块,用于分别对每一组所述对应关系进行特征提取,获得训练样本集合,其中,每条训练样本以提取到的所述脑电波数据的特征值为输入值,以提取到的所述可感知对象的特征值为标签值;a sample obtaining module, configured to perform feature extraction on each group of the corresponding relationships, respectively, to obtain a training sample set, wherein each of the training samples extracts the characteristic value of the brain wave data as an input value, to extract the The feature value of the perceptible object is a tag value;
    样本训练模块,用于利用有监督学习算法对所述训练样本进行训练,得到梦境重现模型,所述梦境重现模型以脑电波数据的特征值作为输入值,以可感知对象的特征值作为输出值。a sample training module, configured to train the training sample by using a supervised learning algorithm, to obtain a dream reproduction model, wherein the dream reproduction model uses the feature value of the brain wave data as an input value, and uses the feature value of the perceptible object as output value.
  11. 根据权利要求10所述的装置,所述数据获取模块包括:The apparatus according to claim 10, wherein the data acquisition module comprises:
    提供子模块,用于依次将预设的可感知对象集合中的每一可感知对象提供给用户;Providing a sub-module for sequentially providing each perceptible object in the preset perceptible object set to the user;
    采集子模块,用于在向所述用户提供所述可感知对象时,同步采集所述用户在感知所述可感知对象时的脑电波数据。And a collecting submodule, configured to synchronously collect brain wave data when the user perceives the perceptible object when the user is provided with the perceptible object.
  12. 根据权利要求10所述的装置,所述样本获取模块包括:The apparatus according to claim 10, wherein the sample acquisition module comprises:
    第一分解子模块,用于对每一组所述对应关系中的脑电波数据进行复变分解,将所述脑电波数据表示为至少一个复变函数的和;a first decomposition sub-module, configured to perform complex transformation decomposition on brain wave data in each set of the correspondence relationship, and represent the brain wave data as a sum of at least one complex variable function;
    第一确定子模块,用于将所述至少一个复变函数作为所述脑电波数据的特征值。a first determining submodule configured to use the at least one complex variable function as a feature value of the brain wave data.
  13. 根据权利要求10所述的装置,所述可感知对象为图像,所述样本获取模块包括:The apparatus according to claim 10, wherein the perceptible object is an image, and the sample obtaining module comprises:
    统计子模块,用于对每一组所述对应关系中的图像进行颜色统计,得到所述图像中每种颜色值对应的像素点个数;a statistic sub-module, configured to perform color statistics on each image in the corresponding relationship, to obtain a number of pixels corresponding to each color value in the image;
    第二确定子模块,用于将所得到的像素点个数表示为2N维向量,其中N为图像的色彩位数。The second determining sub-module is configured to represent the obtained number of pixel points as a 2N-dimensional vector, where N is a color number of bits of the image.
  14. 根据权利要求13所述的装置,还包括:The apparatus of claim 13 further comprising:
    映射模块,用于将具有不同色彩位数的图像的颜色统计结果映射至统一的向量空间。A mapping module for mapping color statistical results of images having different color bits to a unified vector space.
  15. 根据权利要求10所述的装置,针对不同用户分别构建不同的梦境重现模型。According to the apparatus of claim 10, different dream reproduction models are separately constructed for different users.
  16. 一种基于如权利要求10至15任一项所述的梦境重现模型的梦境重现装置,所述装置包括:A dream recreating apparatus based on the dream reproduction model according to any one of claims 10 to 15, the apparatus comprising:
    脑电波获取模块,用于获得用户在睡眠状态下的脑电波数据;The brain wave acquisition module is configured to obtain brain wave data of the user in a sleep state;
    特征提取模块,用于对所获得的脑电波数据进行特征提取,得到所述脑电波数据的特征值;a feature extraction module, configured to perform feature extraction on the obtained brain wave data to obtain a feature value of the brain wave data;
    输出模块,用于将所得到的脑电波数据的特征值输入所述梦境重现模型,得到对应的输出值;An output module, configured to input the obtained feature value of the brain wave data into the dream reproduction model to obtain a corresponding output value;
    重现模块,用于从所述对应关系中,确定与所述输出值具有最高相似度的可感知对象,以生成梦境重现结果。And a reproducing module, configured to determine, from the correspondence, a perceptible object having the highest similarity with the output value, to generate a dream reproduction result.
  17. 根据权利要求16所述的装置,所述特征提取模块包括:The apparatus of claim 16, the feature extraction module comprising:
    第二分解子模块,用于对所获得的脑电波数据进行复变分解,将所述脑电波数据表示为至少一个复变函数的和;a second decomposition sub-module, configured to perform complex transformation decomposition on the obtained brain wave data, and represent the brain wave data as a sum of at least one complex variable function;
    第三确定子模块,用于将所述至少一个复变函数作为所述脑电波数据的特征值。And a third determining submodule configured to use the at least one complex variable function as a feature value of the brain wave data.
  18. 根据权利要求16所述的装置,所述重现模块包括:The apparatus according to claim 16, wherein the reproducing module comprises:
    第四确定子模块,用于确定所述对应关系中每一可感知对象的参考特征值;a fourth determining submodule, configured to determine a reference feature value of each perceptible object in the correspondence relationship;
    计算子模块,用于分别计算所述输出值与所述每一可感知对象的参考特征值之间的相似度;a calculation submodule, configured to separately calculate a similarity between the output value and a reference feature value of each perceptible object;
    第五确定子模块,用于确定具有最高相似度的可感知对象,以生成梦境重现结果。A fifth determining sub-module for determining a perceptible object having the highest similarity to generate a dream reproduction result.
  19. 一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述程序时实现如权利要求1至6任一项所述的方法。A computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the program to implement the method of any one of claims 1 to method.
  20. 一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其中,所述处理器执行所述程序时实现如权利要求7至9任一项所述的 方法。A computer device comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the program to implement the method of any one of claims 7 to 9 method.
PCT/CN2018/119764 2018-01-29 2018-12-07 Method for constructing dream reproducing model, dream reproducing method, and devices WO2019144709A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810082506.X 2018-01-29
CN201810082506.XA CN108363487B (en) 2018-01-29 2018-01-29 Construction method of dream reproduction model, and dream reproduction method and device

Publications (1)

Publication Number Publication Date
WO2019144709A1 true WO2019144709A1 (en) 2019-08-01

Family

ID=63007199

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/119764 WO2019144709A1 (en) 2018-01-29 2018-12-07 Method for constructing dream reproducing model, dream reproducing method, and devices

Country Status (3)

Country Link
CN (1) CN108363487B (en)
TW (1) TWI714926B (en)
WO (1) WO2019144709A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112017773A (en) * 2020-08-31 2020-12-01 吾征智能技术(北京)有限公司 Disease cognition model construction method based on nightmare and disease cognition system

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108363487B (en) * 2018-01-29 2020-04-07 阿里巴巴集团控股有限公司 Construction method of dream reproduction model, and dream reproduction method and device
CN109589484A (en) * 2018-11-29 2019-04-09 中国地质大学(武汉) A kind of the pet intelligent interaction device and method of dreamland influence
CN109770896A (en) * 2019-01-08 2019-05-21 平安科技(深圳)有限公司 Dreamland image reproducing method, device and storage medium, server
CN113208621A (en) * 2021-04-06 2021-08-06 北京脑陆科技有限公司 Dreaming interaction method and system based on EEG signal
CN113208627A (en) * 2021-04-07 2021-08-06 北京脑陆科技有限公司 Dreaming environment discrimination method and system based on electroencephalogram EEG signals

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160077547A1 (en) * 2014-09-11 2016-03-17 Interaxon Inc. System and method for enhanced training using a virtual reality environment and bio-signal data
CN106560158A (en) * 2016-11-23 2017-04-12 深圳创达云睿智能科技有限公司 Zen meditation feedback training method and device based on electroencephalogram
CN108042145A (en) * 2017-11-28 2018-05-18 广州视源电子科技股份有限公司 Emotional state recognition methods and system, emotional state identification equipment
CN108363487A (en) * 2018-01-29 2018-08-03 阿里巴巴集团控股有限公司 Construction method, dreamland replay method and the device of dreamland playback model

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4735199A (en) * 1986-01-14 1988-04-05 Dilullo John D Dream detection method and system
CN100355392C (en) * 2006-03-28 2007-12-19 北京大学 System for monitoring and intervening sleep and dream, and processing method therefor
CN100580700C (en) * 2007-03-26 2010-01-13 浙江大学 Implicit writing analysis method based on pivot characteristic in implicit writing analysis system
US9451883B2 (en) * 2009-03-04 2016-09-27 The Regents Of The University Of California Apparatus and method for decoding sensory and cognitive information from brain activity
CN104125386B (en) * 2013-04-25 2018-04-17 宏达国际电子股份有限公司 Image processor and its image treatment method
CN106620990A (en) * 2016-11-24 2017-05-10 深圳创达云睿智能科技有限公司 Method and device for monitoring mood
CN107545049B (en) * 2017-08-18 2022-10-14 腾讯科技(深圳)有限公司 Picture processing method and related product

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160077547A1 (en) * 2014-09-11 2016-03-17 Interaxon Inc. System and method for enhanced training using a virtual reality environment and bio-signal data
CN106560158A (en) * 2016-11-23 2017-04-12 深圳创达云睿智能科技有限公司 Zen meditation feedback training method and device based on electroencephalogram
CN108042145A (en) * 2017-11-28 2018-05-18 广州视源电子科技股份有限公司 Emotional state recognition methods and system, emotional state identification equipment
CN108363487A (en) * 2018-01-29 2018-08-03 阿里巴巴集团控股有限公司 Construction method, dreamland replay method and the device of dreamland playback model

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112017773A (en) * 2020-08-31 2020-12-01 吾征智能技术(北京)有限公司 Disease cognition model construction method based on nightmare and disease cognition system
CN112017773B (en) * 2020-08-31 2024-03-26 吾征智能技术(北京)有限公司 Disease cognitive model construction method and disease cognitive system based on nightmare

Also Published As

Publication number Publication date
TWI714926B (en) 2021-01-01
CN108363487A (en) 2018-08-03
CN108363487B (en) 2020-04-07
TW201933049A (en) 2019-08-16

Similar Documents

Publication Publication Date Title
WO2019144709A1 (en) Method for constructing dream reproducing model, dream reproducing method, and devices
Marín-Morales et al. Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors
US10313818B2 (en) HRTF personalization based on anthropometric features
US11257266B2 (en) Intelligent augmented reality (IAR) platform-based communication system via servers
Al-Barrak et al. NeuroPlace: Categorizing urban places according to mental states
Ghose et al. UbiHeld: ubiquitous healthcare monitoring system for elderly and chronic patients
US9585581B1 (en) Real-time biometric detection of oscillatory phenomena and voltage events
US20150378433A1 (en) Detecting a primary user of a device
CN114222960A (en) Multimodal input for computer-generated reality
Li Data visualization as creative art practice
Raheel et al. Emotion recognition in response to traditional and tactile enhanced multimedia using electroencephalography
Kietzmann et al. Representational dynamics of facial viewpoint encoding
Kaufmann et al. Distortions in the brain? ERP effects of caricaturing familiar and unfamiliar faces
Mostafavi Architecture, biometrics, and virtual environments triangulation: a research review
Al-Barrak et al. NeuroPlace: making sense of a place
Gilad-Gutnick et al. Recognizing facial slivers
CN106687944A (en) Activity based text rewriting using language generation
Bhattacharya Increase of universality in human brain during mental imagery from visual perception
Cai Ambient diagnostics
Ayesha ReViSe: An end-to-end framework for remote measurement of vital signs
Koh et al. Your Memory Palace in the Metaverse with AI
Wu et al. Integration of affective computing techniques and soft computing for developing a human affective recognition system for U-learning systems
CN110148468B (en) Method and device for reconstructing dynamic face image
Suchalova et al. The Research on Controlling Virtual Reality by EEG Sensor
JP6659011B2 (en) Search system, data collection device and search program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18902354

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18902354

Country of ref document: EP

Kind code of ref document: A1