CN113421141A

CN113421141A - Shopping processing method and device based on brain-computer and brain nerve signals and electronic equipment

Info

Publication number: CN113421141A
Application number: CN202010746881.7A
Authority: CN
Inventors: 裴龙凯
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-07-29
Filing date: 2020-07-29
Publication date: 2021-09-21

Abstract

The embodiment of the invention provides a shopping processing method and device based on brain-computer and brain-nerve signals and electronic equipment, wherein the method comprises the steps of acquiring consciousness content information containing commodity information to be purchased through a brain-computer signal extraction interface; sending the commodity information to a server, and receiving commodity content information returned by the server; generating a feedback signal according to the commodity content information, and sending the feedback signal to the brain through a brain-computer signal feedback interface so that a user can perceive the commodity content information; and acquiring consciousness content information containing a ordering decision through a brain-computer signal extraction interface, and sending an ordering instruction to the server according to the ordering decision. The embodiment of the invention realizes the feedback from the recognition of the shopping decision to the commodity content information and the complete closed-loop shopping link finally confirmed by the user, thereby ensuring that the user can conveniently carry out shopping and improving the shopping experience of the user.

Description

Shopping processing method and device based on brain-computer and brain nerve signals and electronic equipment

Technical Field

The application relates to a shopping processing method and device based on brain-computer and brain-nerve signals and electronic equipment, and belongs to the technical field of computers.

Background

The brain-computer interface technology is an extremely important key technology for promoting social development in the future and is one of the most active research directions in the field of current neural engineering. The existing brain-computer interface technology is preliminarily formed, and has practical application in the fields of biomedicine, nerve rehabilitation, intelligent robots and the like through recognition and interaction of human brain consciousness.

At present, the brain-computer interface technology is mainly applied to the medical field, and is used for performing auxiliary intervention on activities of a human body and the like to improve the perfection of body functions. However, how to combine the brain-computer interface technology with the daily activities of people to improve the daily activities of people has no better solution for a while.

Disclosure of Invention

The embodiment of the invention provides a shopping processing method and device based on brain-computer and brain-nerve signals and electronic equipment, so that the shopping based on human brain idea can be realized through a brain-computer interface technology, and the shopping convenience of a user is improved.

In order to achieve the above object, an embodiment of the present invention provides a brain-based shopping processing method, including: acquiring consciousness content information containing commodity information to be purchased through a brain-computer signal extraction interface;

sending the commodity information to a server, and receiving commodity content information returned by the server;

generating a feedback signal according to the commodity content information;

sending the feedback signal to the brain through a brain-computer signal feedback interface so that the user can perceive the commodity content information;

and acquiring consciousness content information containing ordering decisions through a brain-computer signal extraction interface so as to send ordering instructions to the server according to the ordering decisions.

The embodiment of the invention also provides a shopping processing method based on brain, which comprises the following steps:

acquiring a visual image of a commodity to be purchased, which is contained by a user, through a brain-computer signal extraction interface;

extracting a commodity image of the commodity from the visual image;

sending a query request containing the commodity image to a server;

receiving commodity content information returned by the server;

generating a feedback signal according to the commodity content information;

The embodiment of the invention also provides a shopping processing method based on the cranial nerve signal, which comprises the following steps:

acquiring a first cranial nerve signal, decoding the first cranial nerve signal, and generating first consciousness content information of a user;

if the first consciousness content information contains a purchase decision of a specified commodity, commodity information of the specified commodity in the first consciousness content is contained in a commodity query request and sent to a server;

receiving commodity content information returned by the server;

encoding the commodity content information to generate a second cranial nerve signal;

and inputting the second cranial nerve signal to a cranial neuron, and stimulating the brain of the user to generate perception content corresponding to the commodity content information.

determining commodity information to be purchased in the acquired user consciousness through a consciousness processing module of the brain-computer;

determining commodity content provided by a service provider based on the commodity information;

converting, by the awareness processing module, the commodity content into feedback information for brain recognition of the user;

outputting the feedback information to the brain.

The embodiment of the invention also provides a shopping processing device based on brain, which comprises:

the consciousness content information acquisition module is used for acquiring consciousness content information containing information of commodities to be purchased through the brain-computer signal extraction interface;

the server interaction module is used for sending the commodity information to a server and receiving the commodity content information returned by the server;

the feedback module is used for generating a feedback signal according to the commodity content information and sending the feedback signal to the brain through a brain-computer signal feedback interface so that a user can perceive the commodity content information;

and the ordering processing module is used for acquiring consciousness content information containing ordering decisions through a brain-computer signal extraction interface so as to send ordering instructions to the server according to the ordering decisions.

the visual image acquisition module is used for acquiring a visual image of a commodity to be purchased, which is contained by a user, through the brain-computer signal extraction interface;

the server interaction module is used for extracting the commodity image of the commodity from the visual image, sending a query request containing the commodity image to a server and receiving commodity content information returned by the server;

The embodiment of the invention also provides a shopping processing device based on the cranial nerve signal, which comprises:

the consciousness content information acquisition module is used for acquiring a first cranial nerve signal, decoding the first cranial nerve signal and generating first consciousness content information of a user;

the server interaction module is used for sending the commodity information of the specified commodity in the first consciousness content to a server in a commodity query request if the first consciousness content information contains a purchase decision of the specified commodity;

and the feedback module is used for receiving the commodity content information returned by the server, coding the commodity content information, generating a second cranial nerve signal, inputting the second cranial nerve signal to a cranial nerve cell, and stimulating the brain of the user to generate perception content corresponding to the commodity content information.

An embodiment of the present invention further provides an electronic device, including:

a memory for storing a program;

and the processor is used for operating the program stored in the memory so as to execute the brain-based shopping processing method.

a memory for storing a program;

and the processor is used for operating the program stored in the memory so as to execute the shopping processing method based on the cranial nerve signal.

The shopping processing method and device based on brain-computer and brain-neural signals and the electronic equipment in the embodiment of the invention realize feedback from the recognition of shopping decision to commodity content information and a complete closed-loop shopping link finally confirmed by a user after order placement based on a brain-computer interface technology, so that the user can conveniently and rapidly shop, and the shopping experience of the user is improved.

The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.

Drawings

Fig. 1 is a schematic structural diagram of a brain-computer apparatus according to an embodiment of the present invention;

FIG. 2 is a flow chart of a method for processing brain-based shopping according to an embodiment of the present invention;

FIG. 3 is a second flowchart of a brain-based shopping processing method according to an embodiment of the present invention;

FIG. 4 is a flow chart of a shopping processing method based on cranial nerve signals according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of an application scenario according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of a shopping processing device based on a brain-computer device according to an embodiment of the present invention;

FIG. 7 is a second schematic structural diagram of a shopping processing device based on brain-computer equipment according to an embodiment of the present invention;

FIG. 8 is a schematic structural diagram of a shopping processing device for cranial nerve signals according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

The technical solution of the present invention is further illustrated by some specific examples.

Brain-Computer Interface (BCI) technology is a communication control system that does not rely on the normal output channels of the peripheral nerves and muscles of the Brain. The technology mainly comprises the steps of collecting and analyzing cranial nerve signals of a person in different states, and then identifying the cranial nerve signals, so that a direct communication and control channel is established between the brain of the person and a computer or other electronic equipment, and a brand-new information exchange and control technology is realized.

In the brain-computer interface technology, the brain refers to the brain or nervous system in the form of organic life. The machine refers to any processing or computing device, which may be in the form of an implanted chip to an external wearable device or a combination of both. The interface is an intermediary for information exchange, can be a software program or a hardware chip or a circuit, is used as a part of a brain-computer system, and is used for converting brain nerve signals and equipment signals, so that the brain nerve signals can be extracted from the brain nerves to identify consciousness content, and external information or signals can be converted into the brain nerve signals to be input into brain nerve cells to stimulate the brain to generate perception, thereby forming information feedback to the brain.

The brain nerve signal may be a nerve electrical signal directly acquired through an electrode implanted in a human body to be connected to a brain nerve, a brain wave signal acquired outside the brain, or a combination of both. The following modes can be included in the aspect of acquiring the brain nerve signals:

and (3) intrusion: the electrode is directly implanted into the cerebral cortex in modes of operation and the like, so that high-quality nerve signals can be obtained; non-invasive: the brain information is recorded and interpreted only by a wearable device attached to the scalp without invading the brain; during the activity of neurons of the brain, electromagnetic waves, namely brain waves, are emitted, and brain nerve signals are identified by collecting the brain waves; semi-invasive: the brain-machine interface is implanted inside the cranial cavity, but outside the cerebral cortex, in a way that is mainly based on cortical electroencephalogram (ECoG) for information analysis.

A system architecture of a brain-computer device is introduced below, as shown in fig. 1, which is a schematic structural diagram of the brain-computer device according to the embodiment of the present invention, and the brain-computer device may include the following four components: the device comprises a brain nerve signal acquisition module, a brain nerve signal analysis module, computer equipment and a brain nerve signal feedback module. The brain neural signal analysis module can further comprise a signal preprocessing unit, a signal feature extraction unit, a feature analysis unit and the like. The original brain nerve signals mainly come from implanted electrodes or wearable equipment or the combination of the implanted electrodes and the wearable equipment, and accordingly, feedback to the brain can be achieved by implanting the electrodes to output the brain nerve signals to the brain, namely, the electrodes input electric signals, magnetic signals, electromagnetic signals and the like to neurons of the brain to trigger the brain to present some information contents. Since the brain itself controls sense organs, in terms of signal acquisition and information feedback, information acquisition and feedback can be performed from multiple aspects such as vision, hearing, touch, taste, smell and the like, that is, on one hand, the visual information seen by the user or the sensed taste or smell and the like can be acquired, and on the other hand, the user can generate some visual pictures, touch, taste and the like by stimulating neurons of the brain.

The computer device in fig. 1 may be a microchip or a small computer device mounted on a wearable device, or may be a desktop computer or the like connected by wire or wireless, and the computer device is mainly used for performing coordination control on the entire system and performing further processing on the acquired information and the information that needs to be fed back, and may be connected to a cloud server through the internet to perform various networked communications or transaction processing based on a network platform. The brain nerve signal acquisition module, the brain nerve signal analysis module and the brain nerve signal feedback module can be realized by independent hardware circuits or chips and the like, and can also be a software module and/or a hardware module running on computer equipment.

The signal preprocessing unit is used for filtering, amplifying and the like of the acquired cranial nerve signals. The signal feature extraction unit is used for extracting features of the cranial nerve signals, wherein the feature extraction can be carried out from multiple aspects, and can be carried out from the aspects of time domain features and/or frequency domain features. The feature analysis unit may perform processing by using a machine learning model, perform training by using the machine learning model, convert the brain neural signal features into computer data, where the data may include various data such as video, audio, image, and text, so as to realize conversion from human brain signals to computer data, and after the data is converted into computer data, perform subsequent transaction processing by using a computer device, including interaction with a server on a network side or transmission to other brain devices via a network. Correspondingly, in the aspect of information feedback to the brain, the brain neural signal feedback module can also perform feature coding on information to be fed back to the brain in a machine learning model mode, then generate corresponding brain neural signals, and stimulate brain neurons to generate various consciousness or perception through the cooperation of wearing equipment or the implantation of electrodes.

Through the brain-computer interface system, on one hand, the conversion from brain nerve signals to computer data which can be processed by a computer can be realized, on the other hand, the conversion from the computer data to the brain nerve information can be realized, so that the feedback is sent to the brain, the user can perceive various information, and through the functions of the two aspects, a complete closed loop feedback is realized,

in the embodiment of the invention, based on the brain-computer interface technology, a network shopping mode based on idea is provided. The consciousness of shopping comes from the thinking activity of the brain of the user, the thinking activity can generate a brain nerve signal, then the brain nerve signal is collected through a brain-computer interface, and the brain nerve signal is further analyzed through processing logic in the brain-computer interface, so that consciousness content corresponding to the brain nerve signal is analyzed, and the consciousness content can exist in a computer-readable information form, such as text, audio, video, images, codes or other forms of computer-readable data. After the brain-computer equipment analyzes the consciousness content, the information in the consciousness content can be judged, and after the shopping willingness and the related information of the commodity to be purchased are judged, the information can be sent to a server of an online shopping platform, so that commodity retrieval is carried out, and some commodity content information, such as commodity display pages, commodity videos or pictures, commodity introduction texts, commodity price information and the like, is acquired. In addition, the display contents can also comprise information such as smell, sound, touch and the like, and the commodity content information can be one commodity or a plurality of commodities. Based on the commodity content information, the brain machine can encode the commodity content information to generate a brain nerve signal, and then the brain nerve signal is output to the human brain as a feedback signal, the brain nerve signal can stimulate the brain nerve to generate feedback of various senses, for example, any one or more of vision, touch, hearing, smell and taste can be generated, and a user can select or confirm the commodity to be purchased through brain consciousness according to the feedback, namely, the ordering decision is formed. Similarly, the ordering decision is consciousness content information identified after the brain-computer interface collects brain nerve signals, and after the consciousness content information is obtained, an ordering instruction can be sent to the server, so that commodity transaction is completed.

The process comprises the steps of identifying the purchasing decision, feeding back the commodity content information and finally ordering and confirming the user, so that a complete closed-loop shopping link is formed based on a brain-computer interface technology, the user can conveniently shop, and the shopping experience of the user is improved.

In the above-described technology, the brain-computer device may perform various processes based on consciousness content information decoded from the brain nerve signal after acquiring the brain nerve signal, and may use the intensity of the brain nerve signal as a criterion for performing the processes. For example, the strength of the brain wave signal or the current strength of the brain nerve electrical signal is used as an auxiliary judgment basis for confirming the purchase decision, that is, on the basis of identifying the purchase decision, whether the willingness of the user to purchase the decision is confirmed or not is also determined according to the strength of the corresponding brain nerve signal, and when the strength of the brain nerve signal is determined to be greater than a preset threshold, the shopping operation is triggered.

In addition, since the thinking habits of the users have a certain personalization, the recognition of the human brain-conscious content and the corresponding processing can also have a certain personalization. For example, for a user, when the user looks at a certain product for more than a certain time, the user may have an intention to purchase the product, while for another user, the user may look at the product only by observing the product and may not be interested in the product. Based on the individualization of the thinking habit, the individualization judgment of the shopping decision can be formed.

In addition, the brain-computer interface of the embodiment of the invention can flexibly set or switch the working mode according to the application scene. For example, in the case of a meeting, the user may switch to the meeting mode to turn off the function related to shopping or other information feedback, or in the case of driving, the user may switch to the driving mode to provide the user with an information feedback method matching the driving mode.

In addition, in the aspect of feeding back the commodity content information to the user, in addition to the feedback display to the human brain, the commodity content information may be displayed through an external display device of the user, for example, the commodity content information may be transmitted to a mobile phone of the user for display.

Example one

As shown in fig. 2, which is a schematic flow diagram of a brain-based shopping processing method according to an embodiment of the present invention, the method may be applied to a brain-based device used by a user, and the brain-based device may also be used as an intelligent terminal to install various APPs besides performing interface processing between human brains, and connect to various network platforms through a network to provide various services for the user. The method can comprise the following steps:

s101: consciousness content information including commodity information of a commodity to be purchased is acquired through the brain-computer signal extraction interface. In the computer device of the user, a shopping APP communicating with a server of the e-commerce platform may be installed, and the shopping APP can acquire consciousness content information of the user from a computer signal extraction interface specified by the computer device. The consciousness content information is information obtained by analyzing the acquired cranial nerve signals through a brain machine device, and is information in the form of computer data analyzed through a cranial nerve signal analysis module, taking the brain machine device shown in fig. 1 as an example. The brain-computer signal extraction interface may be an interface function provided by an operating system of the brain-computer device, and the shopping APP may acquire the intention information of the user by calling the interface function. In order to increase safety, the brain-computer signal extraction interface can be set to be in a closed state generally for the shopping APP, and when a user needs shopping, the brain-computer signal extraction interface is opened through manual operation or through an idea instruction, so that consciousness content information is read to the shopping APP. After acquiring the consciousness content information, the shopping APP can extract content related to shopping, such as the intention of the user for shopping, commodity information to be purchased or inquired, and the like.

The generation process of the consciousness content information described above may include the following processes: first, brain nerve signals are acquired by brain machines in such a manner that brain wave signals can be acquired by wearable equipment or directly acquired nerve electrical signals can be acquired by implanting electrodes or a combination of both. Then, signal features of the cranial nerve signals are extracted, which may specifically include time domain features and/or frequency domain features and the like. Then, based on the intention recognition model, according to the signal characteristics of the cranial nerve signals, the consciousness content information is recognized, wherein the intention recognition model can be the machine learning model described above, and the intention recognition model can recognize the consciousness content information of the user by training through the training sample. And finally, the recognized consciousness content information is input and output from the brain-computer signal extraction interface and is read by the shopping APP.

S102: and sending the commodity information to the server and receiving the commodity content information returned by the server. The shopping APP in the computer equipment can send a commodity query request to a server of the e-commerce platform, wherein the commodity query request contains the obtained commodity information. After the e-commerce platform searches, the e-commerce platform returns commodity content information to the computer equipment. The product content information may be a product display page, a product video or picture, a product introduction text, product price information, or the like, or may include information such as smell, sound, and touch, and the product content information may be one product or a plurality of products.

S103: and generating a feedback signal according to the commodity content information, and sending the feedback signal to the brain through a brain-computer signal feedback interface so that the user can perceive the commodity content information. As mentioned above, various senses of the human body are derived from brain neuron signals, and therefore, an important function as a brain machine is to feed back information to a user, form brain neuron signals serving as feedback signals based on what the user needs to sense, and then trigger the brain to generate senses. Specifically, the step may include: the commodity content information is subjected to neural signal coding, the neural signal is converted into a brain neural signal serving as a feedback signal through a brain machine, and then the brain neural signal is output to the brain through a brain machine signal feedback interface, wherein the neural signal coding comprises the following steps: neural signal encoding of any one or more of visual, tactile, auditory, olfactory, and gustatory senses. These encoding processes may be accomplished by the brain neural signal feedback module shown in fig. 1. The brain-computer signal feedback interface can be an interface function provided by an operating system of the brain-computer device, and the shopping APP can send information content required to be output to the brain nerve signal feedback module by calling the interface function. In some application scenarios, the above commodity content information may be directly presented to the user in the form of a visual image, that is, the user is allowed to form a visual perception effect, so that the user can browse the relevant information of the commodity and decide whether to make a final order purchase.

S104: and acquiring consciousness content information containing a ordering decision through a brain-computer signal extraction interface so as to send an ordering instruction to the server according to the ordering decision. After the user perceives the relevant information of the commodity, if the user decides to buy, the order placing instruction can be sent out through consciousness. The principle of this step is the same for the identification of the ordering decision as in step S101. The ordering instruction may include a selection of a payment method, a delivery method, a product specification, and the like, in addition to confirmation of the ordering operation, and it is needless to say that some information such as the payment method or the delivery method may be executed based on a preset setting of the user, or may not be included in the ordering instruction. After the server receives the ordering instruction, commodity transaction can be completed according to the ordering instruction, and a consciousness-based shopping process is realized.

In addition, as another way of confirming ordering, after the user perceives the commodity content information, ordering can be triggered through limb confirmation operation and/or voice confirmation operation, namely, an ordering instruction for a specified commodity is sent to the server in response to the limb confirmation operation and/or voice confirmation operation of the user. In this way, the ordering operation can be completed directly through the external sensor without recognizing the consciousness content, and of course, after the ordering decision of the user is recognized on the basis of recognizing the consciousness content, the ordering instruction can be confirmed by utilizing the body confirmation operation and/or the voice confirmation operation so as to avoid misoperation. Specifically, the user's voice input may be recognized by detecting a body motion by a body-sensing device, or detecting a voice input by a voice-detecting device, or the like, such as a microphone, a bone sensor, or detecting a motion of a mouth-type or tongue muscle.

The shopping processing method based on the brain-computer interface technology of the embodiment of the invention realizes the feedback from the identification of the shopping decision to the commodity content information and the complete closed-loop shopping link of the final ordering confirmation of the user based on the brain-computer interface technology, thereby ensuring that the user can conveniently shop and improving the shopping experience of the user.

Example two

As shown in fig. 3, which is a second flowchart of the brain-based shopping processing method according to the embodiment of the present invention, the method may be applied to a brain-based device used by a user, and the brain-based device may also be used as an intelligent terminal to install various APPs besides performing interface processing between human brains, and connect to various network platforms through a network to provide various services for the user. The method can comprise the following steps:

s201: and acquiring a visual image containing a commodity to be purchased through a brain-computer signal extraction interface. In the first embodiment, a processing flow triggered by a user after making a purchase decision for a certain commodity is exemplarily described, in a scenario shown in the first embodiment, the user may be more specific to information of a commodity to be purchased, but a scenario related to the present embodiment may be that the user sees a real commodity in life, so as to make a purchase decision, that is, a purchase decision made based on a visual image, in this case, the user may have less knowledge of commodity information, and need to obtain more commodity information through interaction with a server or perform comparison of related commodities, and so on. For example, a user walks on the street and sees that a pair of sports shoes worn by a certain pedestrian is very popular and thus wants to buy a pair by himself. Thus, the user may have a visual image of the item on the one hand and an intent to purchase the item as well. The brain-computer signal extraction interface may be an interface function provided by an operating system of the brain-computer device, and the shopping APP may acquire the intention information of the user by calling the interface function. It should be noted that, in the embodiment of the present invention, the shopping APP is only one of the implementation schemes, and a separate APP does not need to be installed, but the brain-computer device directly performs processing based on the awareness content information, and completes interaction with the e-commerce platform. The visual image may be extracted in the same manner as in the first embodiment, that is, the brain neural signal is obtained through a brain machine, then the signal feature of the brain neural signal is extracted, and then the visual image is identified according to the signal feature of the brain neural signal based on a machine learning model. Finally, the recognized visual image can be input and output from the brain-computer signal extraction interface for being read by the shopping APP. In this embodiment, the recognition of the visual image can be performed by using different machine learning models, so that different forms of computer data can be recognized.

S202: and extracting the commodity image of the commodity from the visual image, sending an inquiry request containing the commodity image to the server, and receiving the searched commodity content information returned by the server. Wherein extracting the commodity image from the visual image may include: and taking the commodity at the focus position in the visual image as a commodity to be purchased by the user, and extracting a commodity image. Since the user may be more concerned about purchasing the goods, it typically appears in the visual image at the visual focus. In addition, since there are many objects included in the visual image of the user in daily life, the product that the user wants to purchase may be identified by combining with other conscious content information of the user. For example, if a user sees a visual image that a certain pedestrian wears a pair of favorite sports shoes, the user can consciously form the conscious content of "want to buy the sports shoes of the previous person" or more specifically "want to buy the red sports shoes worn by the previous high boy" in the brain as the commodity identification information, so that the brain-computer device can more easily find the commodity image of the commodity to be bought from the visual image after obtaining the commodity identification information.

S203: and generating a feedback signal according to the commodity content information, and sending the feedback signal to the brain through a brain-computer signal feedback interface so that the user can perceive the commodity content information. The processing procedure in this step is the same as the processing principle of making the user perceive the commodity content information in step S103 in the first embodiment.

S204: and acquiring consciousness content information containing a ordering decision through a brain-computer signal extraction interface so as to send an ordering instruction to the server according to the ordering decision. The processing procedure in this step is the same as the processing principle of the ordering operation performed in step S104 in the first embodiment.

Through the processing process, the user can complete the whole shopping process from seeing a commodity object to be purchased to finishing commodity identification, commodity information feedback, final ordering processing and the like based on the idea, and the user can conveniently and conveniently shop at any time and any place in daily life.

As another application scenario, the user may send the commodity content information obtained from the server to another user for asking opinions, and then decide whether to purchase the commodity. Specifically, the method may further include: in step S202, after obtaining the commodity content information returned by the server, the user may send the commodity content information to the brain of another user, and obtain a feedback opinion of the other user for the commodity; and generating a corresponding feedback signal according to the feedback opinions, and sending the feedback signal to the brain through a brain-computer signal feedback interface so that the user can perceive the feedback opinions. The above-mentioned process of the user sending the commodity content information to the brain of another user may be controlled by means of the intention-based recognition to forward the received commodity content information to another user. The feedback opinions of the other user can be fed back to the current user in the form of text messages or voice messages, and are displayed to the user through a brain-computer signal feedback interface of the brain computer. For example, the user sees a good looking high-heeled shoe to buy a girlfriend, but does not determine whether the girlfriend likes, in which case the user can send the commodity content information acquired from the server as the girlfriend of the user, let her see whether or not to like, and then finally decide whether or not to purchase. In this embodiment, by introducing a process of soliciting an opinion of another user, the user can obtain more comprehensive information before purchasing a commodity, thereby purchasing a satisfactory commodity.

EXAMPLE III

As shown in fig. 4, which is a schematic flow chart of a shopping processing method based on cranial nerve signals according to an embodiment of the present invention, the method includes:

s301: and acquiring a first cranial nerve signal, decoding the first cranial nerve signal, and generating first consciousness content information of the user. Wherein acquiring the first cranial nerve signal may comprise: acquiring a nerve electrical signal emitted by a brain nerve cell as a first brain nerve signal through the implanted electrode, and/or acquiring a brain wave signal emitted by the brain nerve cell as the first brain nerve signal through the wearable device. The acquisition and decoding process of the brain nerve signals can be completed by the brain-computer device of fig. 1, and the generated first consciousness content information is in a data form which can be identified and processed by a computer, for example, the data form can be video, audio, image, text, and the like.

S302: and if the first consciousness content information contains a purchase decision for the specified commodity, extracting commodity information of the specified commodity from the first consciousness content, and sending a commodity inquiry request containing the commodity information to the server. The purchasing decision as referred to herein refers to a state of consciousness that the specified item is or may be purchased, and may be a mere interest in the specified item or a clear intention to explicitly purchase the specified item.

S303: and receiving commodity content information returned by the server, encoding the commodity content information, generating a second cranial nerve signal, inputting the second cranial nerve signal to a cranial nerve cell, and stimulating the brain of a user to generate perception content corresponding to the commodity content information. Wherein stimulating the brain of the user to generate the perception content corresponding to the commodity content information may include: the user's brain is stimulated to produce the perception content of any one or more of sight, touch, hearing, smell and taste corresponding to the commodity content information. After the user perceives the commodity content information, the user may decide whether to place an order according to the commodity content information, and therefore, step S304 may be further included. S304: and acquiring a third cranial nerve signal, decoding the cranial nerve signal to generate second consciousness content information of the user, and if the second consciousness content information contains an ordering decision, sending an ordering instruction for the specified commodity to the server. In order to avoid the user from placing an order by mistake, the system may further include a process of confirming the order by intention confirmation information. Specifically, in this step, if the second conscious content information contains an order placing decision, it is further detected whether the second conscious content information contains intention confirmation information, and if the second conscious content information contains the intention confirmation information, an order placing instruction for the specified commodity is sent to the server. For example, a word or a string of numbers can be preset by the user as the intention confirmation information, and the user can default the word or the numbers in the brain after the order placing decision is generated, so that the brain is triggered to recognize the intention confirmation information, finally the order placing decision of the user is confirmed, and then an order placing instruction is sent to the server.

As another way of confirming ordering, after the user perceives the commodity content information, ordering may be triggered by a body confirmation operation and/or a voice confirmation operation, that is, an ordering instruction for a specified commodity is sent to the server in response to the body confirmation operation and/or the voice confirmation operation of the user. In this way, the ordering operation can be completed directly through the external sensor without recognizing the consciousness content, and of course, after the ordering decision of the user is recognized on the basis of recognizing the consciousness content, the ordering instruction can be confirmed by utilizing the body confirmation operation and/or the voice confirmation operation so as to avoid misoperation. Specifically, a body motion is detected by a body-sensing device, or a voice input or the like is detected by a voice detection device, such as a microphone, a bone sensor, or a voice input of a user is recognized by detecting a motion of a mouth-type or tongue muscle.

In addition, in the determination of the ordering decision, for the commodities repeatedly purchased or frequently purchased by the user, the determination process of the ordering decision can be simplified, namely, after the user is identified to have the content of the ordering awareness, an ordering instruction is sent to the server without detecting the intention confirmation information. Further, after the purchase intention of the user for a certain product is recognized, the product which is repeatedly purchased or frequently purchased by the user can directly trigger the ordering process, and the mechanism can be applied to the above embodiments.

The shopping processing method based on the brain nerve signal, provided by the embodiment of the invention, is based on a brain-computer interface technology, and realizes feedback from the recognition of a purchasing decision to commodity content information and a complete closed-loop shopping link finally confirmed by a user, so that the user can conveniently and rapidly carry out shopping, and the shopping experience of the user is improved.

Example four

The technical solution of the embodiment of the present invention is further explained by an application scenario. As shown in fig. 5, which is a schematic view of an application scenario of an embodiment of the present invention, in the application scenario, as shown in view (r), a male user sees a billboard at a bus station and focuses his eyes on a high-heeled shoe worn by a model in the billboard shown in view (r), and then imagines a picture shown in view (c) in the brain, and a female friend wears the high-heeled shoe in a happy state. Along with the consciousness process, the brain computer equipment worn by the user can decode the brain nerve signals of the user, acquire the visual image, extract the image of the high-heeled shoe according to the focal position in the visual image, and then recognize the picture that the user imagines that a girl puts on the high-heeled shoe, so that the user is judged to have the intention of purchasing the high-heeled shoe. Then, the brain-computer device can send the image of the high-heeled shoe to a server of the e-commerce platform for inquiry, then the brain-computer device receives display pages of the same high-heeled shoe returned by the server, the display pages are coded into brain nerve signals serving as feedback signals and are fed back to the brain of the user, so that the user can display a picture shown in a diagram (r) in the brain, then the user can select a commodity to be purchased based on consciousness after checking, the consciousness content is decoded by the brain-computer device to form a placing order instruction and is sent to the server to finish the shopping process, and finally, as shown in the diagram (c), the user successfully places the order.

EXAMPLE five

As shown in fig. 6, which is a schematic structural diagram of a brain-computer device based shopping processing apparatus according to an embodiment of the present invention, the apparatus may be applied to a brain-computer device used by a user, and the apparatus includes:

and the consciousness content information acquisition module 11 is used for acquiring consciousness content information containing information of the commodity to be purchased through the brain-computer signal extraction interface. The brain-computer signal extraction interface may be an interface function provided by an operating system of the brain-computer device, and the consciousness content information obtaining module 11 may obtain the intention information of the user by calling the interface function.

And the server interaction module 12 is used for sending the commodity information to the server and receiving the commodity content information returned by the server. Specifically, the server interaction module 12 may send a commodity query request including the obtained commodity information to a server of the e-commerce platform, and the e-commerce platform server returns the commodity content information to the computer device after retrieving. The commodity content information may be a commodity display page, a commodity video or picture, a commodity introduction text, commodity price information, and the like, and may further include information such as smell, sound, and touch, and the commodity content information may be one commodity or a plurality of commodities

And the feedback module 13 is configured to generate a feedback signal according to the commodity content information, and send the feedback signal to the brain through a brain-computer signal feedback interface, so that the user can perceive the commodity content information. Specifically, the partial processing may include encoding neural signals of the commodity content information, converting the neural signals into brain neural signals serving as feedback signals through a brain machine, and outputting the brain neural signals to the brain through a brain machine signal feedback interface, where the neural signal encoding includes: neural signal encoding of any one or more of visual, tactile, auditory, olfactory, and gustatory senses.

And the ordering processing module 14 is configured to acquire consciousness content information including an ordering decision through the brain-computer signal extraction interface, and send an ordering instruction to the server according to the ordering decision. After the user perceives the relevant information of the commodity, if the user decides to buy, the order placing instruction can be sent out through consciousness. After the server receives the ordering instruction, commodity transaction can be completed according to the ordering instruction, and a consciousness-based shopping process is realized.

The shopping processing device based on the brain computer of the embodiment of the invention realizes the feedback from the recognition of the purchasing decision to the commodity content information and the complete closed-loop shopping link of the final ordering confirmation of the user, thereby enabling the user to conveniently shop and improving the shopping experience of the user.

EXAMPLE six

As shown in fig. 7, which is a second schematic structural diagram of a brain-computer-based shopping processing apparatus according to an embodiment of the present invention, the apparatus can be applied to a brain-computer device used by a user, and the apparatus includes:

the visual image obtaining module 21 is configured to obtain a visual image of a commodity to be purchased, which is included in the user, through the brain-computer signal extraction interface. The brain-computer signal extraction interface may be an interface function provided by an operating system of the brain-computer device, and the visual image may be extracted in the same manner as in the first embodiment, that is, the brain-computer acquires the brain nerve signal, extracts the signal feature of the brain nerve signal, and then identifies the visual image according to the signal feature of the brain nerve signal based on a machine learning model.

And the server interaction module 22 extracts the commodity image of the commodity from the visual image, sends a query request containing the commodity image to the server, and receives the commodity content information returned by the server. Wherein extracting the commodity image from the visual image may include: and taking the commodity at the focus position in the visual image as a commodity to be purchased by the user, and extracting a commodity image.

And the feedback module 23 is configured to generate a feedback signal according to the commodity content information, and send the feedback signal to the brain through a brain-computer signal feedback interface, so that the user perceives the commodity content information. The process of signal feedback to the brain may be consistent with the feedback process in embodiment one.

And the ordering processing module 24 is used for acquiring consciousness content information containing an ordering decision through the brain-computer signal extraction interface and sending an ordering instruction to the server according to the ordering decision. This part of the ordering process may be identical to the ordering process in embodiment one. Through the processing device, the user can complete shopping processing from seeing a commodity object to be purchased to finishing commodity identification, commodity information feedback, final ordering processing and the like based on idea, and the user can conveniently and conveniently shop at any time and any place in daily life.

EXAMPLE seven

As shown in fig. 8, which is a schematic structural diagram of a shopping processing device for cranial nerve signals according to an embodiment of the present invention, the device includes:

and the consciousness content information acquiring module 31 is configured to acquire the first cranial nerve signal, decode the first cranial nerve signal, and generate first consciousness content information of the user. Wherein acquiring the first cranial nerve signal may comprise: acquiring a nerve electrical signal emitted by a brain nerve cell as a first brain nerve signal through the implanted electrode, and/or acquiring a brain wave signal emitted by the brain nerve cell as the first brain nerve signal through the wearable device. The acquisition and decoding process of the brain nerve signals can be completed by the brain-computer device of fig. 1, and the generated first consciousness content information is in a data form which can be identified and processed by a computer, for example, the data form can be video, audio, image, text, and the like.

And the server interaction module 32 is used for extracting the commodity information of the specified commodity from the first consciousness content and sending a commodity inquiry request containing the commodity information to the server if the first consciousness content information contains a purchase decision of the specified commodity. The purchasing decision as referred to herein refers to a state of consciousness that the specified item is or may be purchased, and may be a mere interest in the specified item or a clear intention to explicitly purchase the specified item.

And the feedback module 33 receives the commodity content information returned by the server, encodes the commodity content information, generates a second cranial nerve signal, inputs the second cranial nerve signal to a cranial nerve cell, and stimulates the brain of the user to generate perception content corresponding to the commodity content information. Wherein stimulating the brain of the user to generate the perception content corresponding to the commodity content information may include: the user's brain is stimulated to produce the perception content of any one or more of sight, touch, hearing, smell and taste corresponding to the commodity content information.

In addition, the method can further comprise the following steps: and the ordering processing module 34 is configured to acquire the third cranial nerve signal, decode the third cranial nerve signal, generate second consciousness content information of the user, and send an ordering instruction for the specified commodity to the server if the second consciousness content information includes an ordering decision. In order to avoid the user from placing an order by mistake, the system may further include a process of confirming the order by intention confirmation information. Specifically, in this step, if the second conscious content information contains an order placing decision, it is further detected whether the second conscious content information contains intention confirmation information, and if the second conscious content information contains the intention confirmation information, an order placing instruction for the specified commodity is sent to the server.

The shopping processing device based on the brain neural signals, disclosed by the embodiment of the invention, is based on a brain-computer interface technology, and realizes the feedback from the recognition of a purchasing decision to the commodity content information and the complete closed-loop shopping link of the final ordering confirmation of a user, so that the user can conveniently and rapidly carry out shopping, and the shopping experience of the user is improved.

Example eight

s401: and determining the information of the commodity to be purchased in the acquired user consciousness through a consciousness processing module of the brain machine. The consciousness processing module may be the brain-computer device or the processing module thereof in the foregoing embodiments, or may be a device which is provided in the surrounding environment and senses the brain waves of the user to perform recognition processing of consciousness content and perform information feedback to the brain, or the like.

S402: and determining commodity contents provided by the service provider based on the commodity information. The service provider may be an e-commerce platform or some merchant or store in the surrounding environment.

S403: converting, by the awareness processing module, the commodity content into feedback information for brain recognition of the user.

S404: outputting the feedback information to the brain. After outputting the feedback information to the user' S brain, the user is triggered to generate a perception of the feedback information, and the following S405 may be performed if the user finally decides to purchase the goods.

S405: and sending a commodity ordering instruction to the service provider. The service provider may be an e-commerce platform to which the user can send via the internet, or may be some merchant or store around the user to which the user can send order instructions by means of short-range communication.

For the process of finally sending the order instruction, in order to avoid misoperation, a confirmation processing link may be added, and the user may confirm the order instruction by means of physical manipulation, voice instruction and consciousness confirmation, that is, the step may include: and sending a commodity ordering instruction to the service provider in response to the limb confirmation operation and/or the voice confirmation operation and/or the user awareness confirmation operation of the user. The user consciousness confirmation operation can be some consciousness contents preset by a user, such as sentences or phrases set by the user, and the like. The body motion may be detected by a body-sensing device for a body confirmation operation, a voice input or the like by a voice detection device for a voice confirmation operation, such as a microphone, a bone sensor, or a voice input of the user recognized by detecting the motion of a mouth-shaped or tongue muscle.

In addition, before the ordering instruction is finally confirmed to be sent, the method can further comprise the steps of sending the commodity content information to the brain of another user, and obtaining a feedback opinion of the other user for the commodity; outputting the feedback opinion to the brain. The commodity content information is sent to another user to ask for the feedback opinion of the other user, and after listening to the feedback opinion of the other user, the decision is made. It should be noted that the above-mentioned commodity content information may be sent to other users, so as to solicit feedback opinions of other users.

Example nine

The foregoing embodiment describes a flow process and a device structure of a brain-based shopping processing method and a brain neural signal-based shopping processing method, and the functions of the method and the device can be implemented by an electronic device, as shown in fig. 9, which is a schematic structural diagram of the electronic device according to the embodiment of the present invention, and specifically includes: a memory 110 and a processor 120.

And a memory 110 for storing a program.

In addition to the programs described above, the memory 110 may also be configured to store other various data to support operations on the electronic device. Examples of such data include instructions for any application or method operating on the electronic device, contact data, phonebook data, messages, pictures, videos, and so forth.

The memory 110 may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

A processor 120, coupled to the memory 110, for executing the program in the memory 110 to perform the operation steps of the brain-based shopping processing method and/or the brain neural signal-based shopping processing method described in the foregoing embodiments.

Furthermore, the processor 120 may also include various modules described in the foregoing embodiments to perform processes of the brain-based shopping processing method and/or the brain neural signal-based shopping processing method, and the memory 110 may be used, for example, to store data required for the modules to perform operations and/or output data.

The detailed description of the above processing procedure, the detailed description of the technical principle, and the detailed analysis of the technical effect are described in the foregoing embodiments, and are not repeated herein.

Further, as shown, the electronic device may further include: communication components 130, power components 140, audio components 150, display 160, and other components. Only some of the components are schematically shown in the figure and it is not meant that the electronic device comprises only the components shown in the figure.

The communication component 130 is configured to facilitate wired or wireless communication between the electronic device and other devices. The electronic device may access a wireless network based on a communication standard, such as WiFi, a mobile communication network, such as 2G, 3G, 4G/LTE, 5G, or a combination thereof. In an exemplary embodiment, the communication component 130 receives a broadcast signal or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 130 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

The power supply component 140 provides power to the various components of the electronic device. The power components 140 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for an electronic device.

The audio component 150 is configured to output and/or input audio signals. For example, the audio component 150 includes a Microphone (MIC) configured to receive external audio signals when the electronic device is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 110 or transmitted via the communication component 130. In some embodiments, audio assembly 150 also includes a speaker for outputting audio signals.

The display 160 includes a screen, which may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The aforementioned program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A brain-based shopping processing method comprises the following steps:

acquiring consciousness content information containing commodity information to be purchased through a brain-computer signal extraction interface;

generating a feedback signal according to the commodity content information;

2. The method of claim 1, wherein the method further comprises:

acquiring cranial nerve signals through a brain machine;

extracting signal features of the cranial nerve signals;

generating consciousness content information containing commodity information to be purchased according to the signal characteristics of the cranial nerve signals;

and outputting the consciousness content information from the brain-computer signal extraction interface.

3. The method of claim 1, wherein the generating a feedback signal from the merchandise content information comprises:

encoding neural signals of the commodity content information, and converting the neural signals into brain neural signals serving as feedback signals through a brain machine;

through brain machine signal feedback interface, send the feedback signal to the brain, include:

outputting the neural signal to the brain through a brain-computer signal feedback interface, wherein the neural signal coding comprises: neural signal encoding of any one or more of visual, tactile, auditory, olfactory, and gustatory senses.

4. A brain-based shopping processing method comprises the following steps:

extracting a commodity image of the commodity from the visual image;

sending a query request containing the commodity image to a server;

receiving commodity content information returned by the server;

generating a feedback signal according to the commodity content information;

5. The method of claim 4, wherein extracting the item image of the item from the visual image comprises:

and taking the commodity at the focus position in the visual image as a commodity to be purchased by the user, and extracting a commodity image.

6. The method of claim 4, further comprising:

sending the commodity content information to the brain of another user, and acquiring a feedback opinion of the other user for the commodity;

generating a feedback signal corresponding to the feedback opinion;

and sending a feedback signal corresponding to the feedback opinion to the brain through a brain-computer signal feedback interface so that the user can perceive the feedback opinion.

7. A shopping processing method based on cranial nerve signals comprises the following steps:

receiving commodity content information returned by the server;

8. The method of claim 7, wherein after inputting the second brain neural signal to the brain neurons, further comprising:

acquiring a third cranial nerve signal;

decoding the third cranial nerve signal to generate second consciousness content information of the user;

sending an order placing instruction for the specified commodity to the server if the second conscious content information contains an order placing decision.

9. The method of claim 8, wherein, if the second awareness content information includes an ordering decision, sending an ordering instruction to the server for the specified good comprises:

detecting whether the second conscious content information includes intent confirmation information if the second conscious content information includes a placing decision;

and if the intention confirmation information is contained, sending an ordering instruction for the specified commodity to the server.

10. The method of claim 7, wherein after generating the second brain neural signal and inputting to the brain neurons, further comprising:

and sending an ordering instruction for the specified commodity to the server in response to the limb confirmation operation and/or the voice confirmation operation of the user.

11. A brain-based shopping processing method comprises the following steps:

outputting the feedback information to the brain.

12. The method of claim 11, further comprising:

and sending a commodity ordering instruction to the service provider.

13. The method of claim 12, wherein issuing a merchandise order instruction to the facilitator comprises: and sending a commodity ordering instruction to the service provider in response to the limb confirmation operation and/or the voice confirmation operation and/or the user awareness confirmation operation of the user.

14. The method of claim 11, further comprising:

sending the commodity content information to the brain of another user to obtain the feedback opinion of the other user for the commodity;

outputting the feedback opinion to the brain.

15. A brain-based shopping processing apparatus comprising:

16. A brain-based shopping processing apparatus comprising:

17. A shopping processing device based on cranial nerve signals, comprising:

18. The apparatus of claim 17, further comprising:

and the ordering processing module is used for acquiring a third cranial nerve signal, decoding the third cranial nerve signal to generate second consciousness content information of the user, and sending an ordering instruction aiming at the specified commodity to the server if the second consciousness content information contains an ordering decision.

19. An electronic device, comprising:

a memory for storing a program;

a processor for executing the program stored in the memory to perform the brain-based shopping processing method according to any one of claims 1 to 6 and 11 to 14.

20. An electronic device, comprising:

a memory for storing a program;

a processor for executing the program stored in the memory to execute the method for shopping processing based on cranial nerve signals according to any one of claims 7 to 10.