CN108573403A - A kind of multidimensional vision purchase guiding system and method - Google Patents
A kind of multidimensional vision purchase guiding system and method Download PDFInfo
- Publication number
- CN108573403A CN108573403A CN201810229361.1A CN201810229361A CN108573403A CN 108573403 A CN108573403 A CN 108573403A CN 201810229361 A CN201810229361 A CN 201810229361A CN 108573403 A CN108573403 A CN 108573403A
- Authority
- CN
- China
- Prior art keywords
- user
- shopping guide
- signal
- intelligent
- article
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0281—Customer communication at a business location, e.g. providing product or service information, consulting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1601—Constructional details related to the housing of computer displays, e.g. of CRT monitors, of flat displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0269—Targeted advertisements based on user profile or attribute
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The invention discloses a kind of multidimensional vision purchase guiding systems and method, system to include：Input module, at least one input signal for obtaining user, input signal include picture signal, touch signal, hand signal, voice signal and brain wave signal；Intelligent shopping guide module, for carrying out intelligent shopping guide according at least one input signal, intelligent shopping guide includes that the eye tracking of user, the speech recognition of user, AI intelligent sounds explain and publicise dummy model display control with article；Air display screen, the dummy model for showing article by way of being imaged air.The present invention has provided round-the-clock commodity explanation to the user and counseling services, service quality height and user experience are good；The phonetic order of user's focus of attention and user is identified by intelligent shopping guide, can be that user's progress AI intelligent sounds are explained and publicised and are 360 degree of dummy models without dead angle of user's Dynamic Display article, more intuitively, dimension is more rich and interactivity is stronger, can be widely applied to field of intelligent control.
Description
Technical field
The present invention relates to field of intelligent control, especially a kind of multidimensional vision purchase guiding system and method.
Background technology
In the information age with rapid changepl. never-ending changes and improvements, in order to meet the life requirement on people's fast pace, large and medium-sized supermarket or quotient
Field is equal will not only to make efforts in itself management, logistics management, price control, storage controlling etc., improve itself city
Field competitiveness, will also be set out, the desire to purchase of consumer is met with peak efficiency from the consumer's point of view.For this purpose, one in market
As have Shopping Guide and provide commodity explanation and object consulting for customer, still, this mode increase the management of shoppers' guide at
This, and it is king-sized in client's amount, and Shopping Guide can not be that each client adequately be explained, and affect clothes
Quality of being engaged in and user experience.In addition, this mode is more single, client can only be made by way of the oral explanation of shoppers' guide
Understand commodity, fail to show explanation and the dummy models of commodity etc. combine for client provide more intuitively, dimension it is richer
The rich and stronger user experience of interactivity is insufficient to the attraction of client.
Invention content
In order to solve the above technical problems, it is an object of the invention to：It is good to provide a kind of at low cost, round-the-clock and user experience
Multidimensional vision purchase guiding system and method.
The first technical solution for being taken of the present invention is：
A kind of multidimensional vision purchase guiding system, including：
Input module, at least one input signal for obtaining user, the input signal include picture signal, touch
Signal, hand signal, voice signal and brain wave signal；
Intelligent shopping guide module, for carrying out intelligent shopping guide, the intelligent shopping guide packet according at least one input signal
Include the eye tracking of user, the speech recognition of user, AI intelligent sounds explain and publicise dummy model display control with article；
Air display screen, the dummy model for showing article by way of being imaged air.
Further, further include showcase, the air display screen is arranged in a composition plane of showcase.
Further, the exhibition booth of the true model for placing article or article is equipped in the showcase.
Further, atmosphere lamp and status indicator lamp, the input terminal and state of the atmosphere lamp are additionally provided on the showcase
The input terminal of indicator light is connect with the output end of intelligent shopping guide module.
Further, power module and loudspeaker are additionally provided in the showcase, output end and the intelligence of the power module are led
The input terminal connection of module is purchased, the output end of the intelligent shopping guide module and the input terminal of loudspeaker connect.
Further, the intelligent shopping guide module includes：
Gesture identification unit, the gesture for identifying user according to the hand signal of acquisition；
Speech talkback unit, the phonetic order for identifying user according to the voice signal of acquisition；
Image identification unit, for carrying out eye tracking and human facial expression recognition according to the picture signal of acquisition；
Brain wave signal recognition unit, the E.E.G for identifying user according to the brain wave signal of acquisition；
Touch signal recognition unit, the touching instruction for identifying user according to the touch signal of acquisition；
Analytic unit, for according to the gesture of user, the phonetic order of user, eye tracking and human facial expression recognition knot
At least one of touching instruction of fruit, the E.E.G of user and user carries out shopping guide's intellectual analysis；
AI units, for carrying out AI intelligent controls and article to the dummy model of article according to the result of shopping guide's intellectual analysis
AI intelligent sounds explain and publicise, wherein AI intelligent controls include the zoom control of the dummy model of article, view angle switch control and face
Colour change controls.
Further, the intelligent shopping guide module further includes：
Selecting unit selects at least one of color, type, size, size and the brand of article for user；
Quick Response Code payment unit, for being paid after user chooses the article to be bought by scanning the two-dimensional code；
Storage unit, for store the gesture of user, the phonetic order of user, eye tracking and human facial expression recognition knot
Fruit, the E.E.G of user, the touching instruction of user, the result of shopping guide's intellectual analysis and AI intelligent sounds explain and publicise content.
Further, the intelligent shopping guide module is also associated with background server, and the background server is used to lead with intelligence
Module telecommunication is purchased, the long-range dummy model for storing AI intelligent sounds and explaining and publicising content and article is remote by intelligent shopping guide module
The display content of process control air display screen and according to the data of intelligent shopping guide module carry out big data analysis.
Further, the input module includes camera, touch screen, body-sensing device, voice acquisition module and E.E.G acquisition
At least one of equipment.
The second technical solution for being taken of the present invention is：
A kind of multidimensional vision shopping guide method, includes the following steps：
At least one input signal of user is obtained, the input signal includes picture signal, touch signal, gesture letter
Number, voice signal and brain wave signal；
Carry out intelligent shopping guide according at least one input signal, the intelligent shopping guide include user eye tracking,
The dummy model display control with article is explained and publicised in the speech recognition of user, AI intelligent sounds；
Show the dummy model of article by way of air imaging on air display screen according to the result of intelligent shopping guide.
The beneficial effects of the invention are as follows：A kind of multidimensional vision purchase guiding system of the present invention and method, believe according to the image of user
Number, touch signal, hand signal, voice signal and E.E.G letter at least one of carry out intelligent shopping guide, intelligent shopping guide include use
The speech recognition at family and AI intelligent sounds are explained and publicised, and are explained and publicised without shoppers' guide just by the speech recognition and AI intelligent sounds of user
Round-the-clock commodity explanation in 24 hours and object counseling services can be needed to provide to the user according to user, reduce shoppers' guide
Management cost and not by client measure size limited, service quality height and user experience are good；Intelligent shopping guide includes the eye of user
Ball tracking, the speech recognition of user, AI intelligent sounds explain and publicise the dummy model display control with article, are identified by intelligent shopping guide
The phonetic order of user's focus of attention and user can be that the corresponding AI intelligent sounds of user's progress are explained and publicised and in AI speech sound eeplainings
While it is sharp on air display screen according to the picture signal of user, touch signal, hand signal, voice signal or brain wave signal
Be 360 degree of dummy models without dead angle of user's Dynamic Display respective articles with air imaging technique, more intuitively, dimension it is more rich
It is stronger with interactivity, substantially increase the attraction to client.
Description of the drawings
Fig. 1 is a kind of overall structure block diagram of multidimensional vision purchase guiding system of the present invention；
Fig. 2 is a kind of step flow chart of multidimensional vision shopping guide method of the present invention；
Fig. 3 is the internal module block diagram of intelligent shopping guide module of the present invention；
Fig. 4 is a kind of specific embodiment structural schematic diagram of multidimensional vision purchase guiding system of the present invention；
Fig. 5 is a kind of specific embodiment flow chart of multidimensional vision shopping guide method of the present invention.
Specific implementation mode
With reference to figure 1, a kind of multidimensional vision purchase guiding system of the invention, including：
Input module, at least one input signal for obtaining user, the input signal include picture signal, touch
Signal, hand signal, voice signal and brain wave signal；
Intelligent shopping guide module, for carrying out intelligent shopping guide, the intelligent shopping guide packet according at least one input signal
Include the eye tracking of user, the speech recognition of user, AI intelligent sounds explain and publicise dummy model display control with article；
Air display screen, the dummy model for showing article by way of being imaged air.
It is further used as preferred embodiment, further includes showcase, the air display screen is arranged the one of showcase
In a composition plane.
It is further used as preferred embodiment, the true model for placing article or article is equipped in the showcase
Exhibition booth.
It is further used as preferred embodiment, atmosphere lamp and status indicator lamp, the atmosphere are additionally provided on the showcase
The input terminal of the input terminal and status indicator lamp that enclose lamp is connect with the output end of intelligent shopping guide module.
It is further used as preferred embodiment, power module and loudspeaker, the power supply mould are additionally provided in the showcase
The output end of block is connect with the input terminal of intelligent shopping guide module, and the output end of the intelligent shopping guide module and the input terminal of loudspeaker connect
It connects.
It is further used as preferred embodiment, the intelligent shopping guide module includes：
Gesture identification unit, the gesture for identifying user according to the hand signal of acquisition；
Speech talkback unit, the phonetic order for identifying user according to the voice signal of acquisition；
Image identification unit, for carrying out eye tracking and human facial expression recognition according to the picture signal of acquisition；
Brain wave signal recognition unit, the E.E.G for identifying user according to the brain wave signal of acquisition；
Touch signal recognition unit, the touching instruction for identifying user according to the touch signal of acquisition；
Analytic unit, for according to the gesture of user, the phonetic order of user, eye tracking and human facial expression recognition knot
At least one of touching instruction of fruit, the E.E.G of user and user carries out shopping guide's intellectual analysis；
AI units, for carrying out AI intelligent controls and article to the dummy model of article according to the result of shopping guide's intellectual analysis
AI intelligent sounds explain and publicise, wherein AI intelligent controls include the zoom control of the dummy model of article, view angle switch control and face
Colour change controls.
It is further used as preferred embodiment, the intelligent shopping guide module further includes：
Selecting unit selects at least one of color, type, size, size and the brand of article for user；
Quick Response Code payment unit, for being paid after user chooses the article to be bought by scanning the two-dimensional code；
Storage unit, for store the gesture of user, the phonetic order of user, eye tracking and human facial expression recognition knot
Fruit, the E.E.G of user, the touching instruction of user, the result of shopping guide's intellectual analysis and AI intelligent sounds explain and publicise content.
With reference to figure 1, it is further used as preferred embodiment, the intelligent shopping guide module is also associated with background server,
The background server is used to explain and publicise content and the void of article with intelligent shopping guide module telecommunication, the long-range AI intelligent sounds that store
Analog model, by the display content of intelligent shopping guide module remote control air display screen and according to the data of intelligent shopping guide module
Carry out big data analysis.
It is further used as preferred embodiment, the input module includes camera, touch screen, body-sensing device, voice
At least one of acquisition module and E.E.G collecting device.
With reference to figure 2, a kind of multidimensional vision shopping guide method of the present invention includes the following steps：
At least one input signal of user is obtained, the input signal includes picture signal, touch signal, gesture letter
Number, voice signal and brain wave signal；
Carry out intelligent shopping guide according at least one input signal, the intelligent shopping guide include user eye tracking,
The dummy model display control with article is explained and publicised in the speech recognition of user, AI intelligent sounds；
Show the dummy model of article by way of air imaging on air display screen according to the result of intelligent shopping guide.
The present invention is further explained and is illustrated with specific embodiment with reference to the accompanying drawings of the specification.
With reference to figure 1, a kind of multidimensional vision purchase guiding system is present embodiments provided, which includes mainly input module, intelligence
It can shopping guide's module, power module, background server and the air display screen being arranged on one side of showcase.
Wherein, the showcase is made of several planes and/or curved surface, and in some embodiments, the showcase can
To be cuboid, it is made of six planes.In further embodiments, the showcase can be the variant of cuboid, such as
In cuboid, it is made of curved surface there are one face.Alternatively, showcase can be other polyhedral shapes.In some embodiments
In, the space that multiple faces of the showcase surround can be a confined space, can also be an open space, such as can be with
It is the cuboid of an open-top.The exhibition booth of the true model for placing article or article is equipped in showcase.
Air display screen is arranged in a composition plane of showcase, and air display screen can be transparent liquid crystal touch screen
Deng.The air display screen can be plane screen either Curved screen.The air display screen, for showing at least one article
Dummy model, the dummy model, be goods for sale (such as automobile) virtual two-dimensional or threedimensional model, i.e., in a computer
The model generated by image processing software.In some embodiments, the air display screen can be used for display two dimensional image
Or word.In some embodiments, it is air display screen that showcase, which has multiple faces, can show the article in different directions
Dummy model.In further embodiments, partial air display screen can show the information other than dummy model, such as two
Tie up image, character introduction, product LOGO etc..Preferably, there are two types of operating modes for the air display screen：One is standby works
Operation mode, at this time air display screen can show the standby pictures such as dynamic advertising or game video；Another kind is shopping guide's pattern, this
When air display screen can provide intelligent shopping guide service to the user.In addition, air display screen can also provide accordingly on display interface
Software push buttons selected for user, as operating mode/standby mode switching push button, Quick Response Code payment button, color switching
Button, view angle switch button etc..
Input module, at least one input signal for obtaining user, in order to be interacted with user.Such as Fig. 1 institutes
Show, the input module of the present embodiment may include camera, touch screen, body-sensing device, voice acquisition module and E.E.G collecting device.
Camera, the image for capturing user (potential customers for mainly needing purchase commodity).Preferably, described to take the photograph
It is more accurate to obtain as the camera for the RGB-D that can acquire two-dimension human face image information and depth information simultaneously can be used in head
User images.
Body-sensing device, the hand signal (signal for such as capturing certain part commodity progress view angle switch) for capturing user.
Preferably, the body-sensing device can be Kinect somatosensory sensor.
Voice acquisition module, the voice signal for acquiring user.By taking automobile shopping guide as an example, the voice signal of user can be with
It is the phonetic order signal of the users such as " opening car door ", " opening interior air-conditioning ", " changing body color into black ".Preferably,
Voice acquisition module can be the voice capture devices such as sound pick-up, microphone.
E.E.G collecting device, the brain wave signal for acquiring user, in order to identify the idea or idea of user.E.E.G is adopted
TGAM modules or other brain-wave sensors can be used to realize in collection equipment.
Touch screen inputs touching instruction for user by way of touch.Preferably, touch screen can be attached to air exhibition
It is combined into one in display screen or with air display screen.
Intelligent shopping guide module, picture signal, hand signal, voice signal, touch signal and E.E.G for receiving user
Signal, and according at least one of the picture signal of user, hand signal, voice signal, touch signal and brain wave signal into
Row intelligent shopping guide, the intelligent shopping guide include the phonetic order knowledge of the eye tracking of user, the human facial expression recognition of user, user
Not, the E.E.G of user, touching instruction identification, AI intelligent sounds explain and publicise the dummy model display control with article.Intelligent shopping guide mould
Block is the core of whole system, can provide various dimensions, various visual angles and the strong intelligent shopping guide service of interactivity to the user.Wherein, it uses
The eye tracking at family mainly identify user focus of attention where (at the part for seeing concern, the eyeball of user can with not
The case where seeing concern part is different, as eyeball residence time is different), in order to which air display screen is directly by the virtual of article
Models switching to user's focus of attention (such as recognizes the vehicle body of user's concern automobile, is then directly switch into the virtual mould of vehicle body
Type)；The human facial expression recognition of user mainly identifies the current mood (such as happy, unhappy) of user, the identification of both
It is all based on the image of camera acquisition.The phonetic order of user identifies, primarily to being wrapped in the voice signal of identification user
The phonetic order contained, in order to be operated accordingly to the dummy model shown by air display screen, such as color switching.It touches
Signal identification is touched, for identification the touching instruction of user, it is corresponding in order to be carried out to the dummy model shown by air display screen
Operation, such as color switching.E.E.G identifies, the idea or idea of user is mainly identified, in order to air display screen institute
The dummy model of display is operated accordingly, such as color switching.AI intelligent sounds are explained and publicised, and refer to trained by machine learning
To AI models serve as the role of existing shoppers' guide, provide the detailed of respective articles according to the demand of the instruction of user or user
It introduces and explains.As long as the precision height and dimension of training are abundant enough, which round-the-clock can be carried with 24 hours for client
For the service of explaining and publicising accordingly, chat robots but more intelligent are similar to, the quantity of shoppers' guide is greatly reduced.Article it is virtual
Model display control, zoom control, view angle switch control, colour switching control of the main dummy model including article etc..
In some embodiments, the data of the dummy model of the article are storable in intelligent shopping guide module.In further embodiments,
The data of the dummy model of the article can by real time or in non real-time by a manner of internet, WIFI or USB interface etc. under
It is downloaded in intelligent shopping guide module.
The intelligent shopping guide module respectively can be by wired or wireless between input module and air display screen
The connection types such as mode transmission data, including but not limited to HDMI, VGA, USB, WIFI, bluetooth and infrared signal.The intelligence
It is equipped with the driver module of driving air display screen in shopping guide's module, and is powered by power module.The intelligent shopping guide
Module can be software, hardware, firmware and combinations thereof.For example, intelligent shopping guide module can be but not limited to smart phone, tablet
Computer, laptop, smartwatch, computer, industrial personal computer etc..
As shown in figure 3, the concrete composition unit in intelligent shopping guide module includes mainly gesture identification unit, speech talkback list
Member, image identification unit, brain wave signal recognition unit, touch signal recognition unit, analytic unit and AI units.Wherein, gesture
Recognition unit, the gesture for identifying user according to the hand signal of acquisition；Speech talkback unit, for the voice according to acquisition
The phonetic order of signal identification user；Image identification unit, for carrying out eye tracking and face according to the picture signal of acquisition
Expression Recognition；Brain wave signal recognition unit, the E.E.G for identifying user according to the brain wave signal of acquisition；Touch signal identification is single
Member, the touching instruction for identifying user according to the touch signal of acquisition.Analytic unit, for the gesture according to user, user
Phonetic order, at least one in eye tracking and the result of human facial expression recognition, the E.E.G of user and the touching instruction of user
Kind carries out shopping guide's intellectual analysis.The content that analytic unit carries out shopping guide's intellectual analysis include the eyeball action of user, facial expression,
Phonetic order, touching instruction, meaning (such as representing the gesture that need to switch color), idea or idea representated by body-sensing gesture,
Need the content of progress AI speech sound eeplainings.AI units, for according to the result of shopping guide's intellectual analysis to the dummy model of article into
The AI intelligent sounds of row AI intelligent controls and article are explained and publicised.Wherein, it is to be based on being stored in advance in that the AI intelligent sounds of article, which are explained and publicised,
Intelligent shopping guide module local or article detailed content (such as history, sales volume, performance, feature and the after-sale service obtained from internet
Deng) carry out, user can be selected or be obtained the content understood required for oneself by modes such as touch, gesture, voices.And AI
Intelligent control includes the zoom control of the dummy model of article, view angle switch control and colour switching control etc..For example, AI is intelligent
Control can be according to input signals such as the gesture of user or voices come the dummy model that zooms in or out.
In some embodiments, intelligent shopping guide module can also include selecting unit, for selection by the user the color of article,
At least one of type, size, size and brand realize personalized shopping guide's service.
In some embodiments, intelligent shopping guide module can also include Quick Response Code payment unit, be bought when user chooses
Commodity after, which can generate or present for paying the bill and being linked to Third-party payment on air display screen
The Quick Response Code of platform (such as wechat payment platform), so that user carries out payment operation flexibly and conveniently.
In some embodiments, intelligent shopping guide module can also include storage unit, the storage unit storage user's
Gesture, the phonetic order of user, eye tracking and the result of human facial expression recognition, the E.E.G of user, user touching instruction, lead
The result and AI intelligent sounds for purchasing intellectual analysis explain and publicise content.
In some embodiments, intelligent shopping guide module can also be connected with background server, the background server be used for
Intelligent shopping guide module telecommunication, the long-range dummy model for storing AI intelligent sounds and explaining and publicising content and article, passes through intelligent shopping guide
The display content of module remote control air display screen and according to the data of intelligent shopping guide module carry out big data analysis (as use
Behavioural analysis, the mood analysis at family etc.).
It will be clear for those skilled in the art that the multidimensional vision purchase guiding system can also include for fixing the exhibition
Show the support construction of cabinet.Wherein, support construction can be cabinet, holder or hanger etc..Support construction is not in the present invention
Being limited to specific shape, either the structure air display screen can be installed or upward mounted on the side of easy displaying.
With reference to Fig. 4, present embodiment illustrates a kind of concrete structures of multidimensional vision purchase guiding system, which includes showcase
100, air display screen 200, intelligent shopping guide module (including analytic unit 301, driver module 302 and power module
303), support construction 400 (support construction is cabinet in the present embodiment), loudspeaker 500, status indicator lamp and atmosphere lamp 600.Its
In, intelligent shopping guide module and loudspeaker 500 are installed in inside support construction 400, and showcase 100 is embedded in support construction 400.
The air display screen 200 constitutes one of showcase 100 face.And status indicator lamp and atmosphere lamp 600 are installed in branch
The top edge of support structure 400, the status indicator lamp are used to indicate the state (such as standby or working condition) of air display screen.
The atmosphere lamp 400 can have it is multiple, main function be promoted multidimensional vision purchase guiding system lighting effects.As shown in figure 4, can
To see that multiple faces of showcase 100 are constituted a spacial flex, the material object of commodity or commodity is placed for businessman or storekeeper etc.
Model 700.The module frame chart of the present embodiment is as shown in Figure 1, wherein user is operated by air display screen, intelligent shopping guide module
Air display screen 200, loudspeaker 500, status indicator lamp and atmosphere lamp 600 are controlled according to the input signal of air display screen.It is answering
In, businessman or storekeeper etc. can be as needed, and the color of status indicator lamp or atmosphere lamp 600 is arranged, for example, be set as it is red,
Blue, green or multiple color convert etc. in turn.The sound of loudspeaker broadcasting can also be arranged in businessman or storekeeper etc., such as sets
Set music, voice prompt, AI intelligent sounds explain and publicise the feedback sound etc. of content or user's interactive mode.
With reference to Fig. 5, a kind of multidimensional vision shopping guide method is present embodiments provided.In the present embodiment, with one kind in Fig. 1
The present embodiment is illustrated for multidimensional vision purchase guiding system.The multidimensional vision purchase guiding system includes input module, intelligence
Shopping guide's module, power module and the air display screen being arranged on one side of showcase.Wherein, showcase is put down by several
Face and/or curved surface composition, several described planes and/or curved surface surround a sky for showing physical goods or model
Between, the air display screen is arranged at least one side of showcase.The air display screen is at least one for showing
The dummy model of article.Input module includes camera, touch screen, body-sensing device, voice acquisition module and E.E.G collecting device.
Camera, the image for capturing user (potential customers for mainly needing purchase commodity).Body-sensing device, for capturing user
Hand signal (such as capture certain part commodity carry out view angle switch signal).Voice acquisition module, the language for acquiring user
Sound signal.E.E.G collecting device, the brain wave signal for acquiring user, in order to identify the idea or idea of user.Touch screen,
Touching instruction is inputted by way of touch for user.Intelligent shopping guide module, for being believed according to picture signal, the gesture of user
Number, at least one of voice signal, touch signal and brain wave signal carry out intelligent shopping guide, the intelligent shopping guide includes user's
Eye tracking, the human facial expression recognition of user, the phonetic order identification of user, the identification of the E.E.G of user, touching instruction, AI intelligence
Voice explains and publicises the dummy model display control with article.
As shown in figure 5, the method for the present embodiment includes the following steps：
S1, user enter corresponding mould by touching operating mode/standby mode switching push button selection of air display screen
Formula：If selection enters operating mode, S2 is thened follow the steps；If selection enters standby mode, shown in air display screen standby
Picture.Wherein, standby picture can show advertisement, game or other content.
S2, air display screen show at least one two dimension or three dimensional virtual models of article.Such as it is shown in showcase
When the mock-up of automobile, three dimensional virtual models (the three-dimensional mould herein of the screen display automobile can be shown in air
Type refers to the three dimensional virtual models generated by image software).
S3, intelligent shopping guide module pass through the picture signal of input module acquisition user, touch signal, hand signal, voice
At least one of signal and brain wave signal signal.
S4, intelligent shopping guide module carry out intelligent shopping guide according at least one signal of acquisition and the dummy model of article.
The step S4 can be further subdivided into following steps：
S41, according to the picture signal of user carry out user eye tracking and user human facial expression recognition, to analyze use
The focus and mood at family.The user's focus analyzed may make air display screen directly to cut the dummy model of article
Shift to user's focus of attention (such as recognizing the vehicle body that user pays close attention to automobile, be then directly switch into the dummy model of vehicle body)；And
The user mood analyzed is possibly stored to be uploaded to background server etc. locally or through internet, using as subsequently to user
The data basis analyzed of behavior.
S42, the phonetic order that user is identified according to the voice signal of user, and according to the phonetic order of user to article
Dummy model carries out control operation.By taking automobile shopping guide as an example, interior sky can be opened according to " opening interior air-conditioning " phonetic order
It adjusts, body color is become by black etc. according to " body color is become black " phonetic order.
S43, control operation is carried out to the dummy model of article according to the hand signal of user.It, can by taking automobile shopping guide as an example
The dummy model of automobile is zoomed in and out and (do not limited by material object, can infinitely scale) according to the hand signal of user, visual angle is cut
Change with body color change etc..
S44, control operation is carried out to the dummy model of article according to the touch signal of user.It, can by taking automobile shopping guide as an example
According to user touch on air display screen corresponding button the dummy model of automobile is zoomed in and out (do not limited by material object, can
Unlimited scaling), view angle switch and body color change etc..
S45, control operation is carried out to the dummy model of article according to the brain wave signal of user.It, can by taking automobile shopping guide as an example
Idea or idea representated by user's brain wave signal the dummy model of automobile is zoomed in and out (do not limited by material object, can
Unlimited scaling), view angle switch and body color change etc..
S46, according at least one in the picture signal of user, touch signal, hand signal, voice signal and brain wave signal
Kind provides the service of explaining and publicising of AI intelligent sounds to the user.By taking automobile shopping guide as an example, it can need to be visitor by AI models according to client
The detailed contents such as performance, price, sales volume and the history of the well-known automobile of certain domestic money are explained at family in detail, to replace shoppers' guide to serve as
The role of 24 hours round-the-clock shopping guide AI.
For the step number in above-described embodiment, it is arranged only for the purposes of illustrating explanation, it is suitable between step
Sequence does not do any restriction, and the execution sequence of each step in embodiment can be adapted to according to the understanding of those skilled in the art
Property adjustment.
Those skilled in the art can be with it will be appreciated that the present invention can apply to carry out automobile, food, knapsack, hand
The intelligent shopping guide of the commodity such as table, mobile phone and displaying.
In conclusion the present invention has the following advantages compared with the existing technology：
1) being explained and publicised by the speech recognition of user and AI intelligent sounds can be according to the needs of user without shoppers' guide
User provides round-the-clock commodity explanation in 24 hours and object counseling services, reduces the management cost of shoppers' guide and not by visitor
The limitation of size is measured at family, and service quality height and user experience are good.
2) user's focus of attention is analyzed by intelligent shopping guide, user's focus of attention institute can be switched to automatically for user
, more intelligence and conveniently；The mood that user is analyzed by intelligent shopping guide provides subsequently to carry out analysis to the behavior of user
Data source.
3) according to the picture signal of user, touch signal, hand signal, voice signal or brain wave signal in air display screen
On using air imaging technique be 360 degree of dummy models without dead angle of user's Dynamic Display respective articles, more intuitively, dimension more
Abundant and interactivity is stronger, substantially increases the attraction to client.
4) it is additionally arranged background server, remote control can be carried out to the display content of air display screen and to shopping guide's module
Data are further analyzed, more convenient it is not necessary that air display screen can be managed and be controlled at the scene.
It is to be illustrated to the preferable implementation of the present invention, but the present invention is not limited to the embodiment above, it is ripe
Various equivalent variations or replacement can also be made under the premise of without prejudice to spirit of that invention by knowing those skilled in the art, this
Equivalent deformation or replacement are all contained in the application claim limited range a bit.
Claims (10)
1. a kind of multidimensional vision purchase guiding system, it is characterised in that：Including：
Input module, at least one input signal for obtaining user, the input signal include picture signal, touch letter
Number, hand signal, voice signal and brain wave signal；
Intelligent shopping guide module, for carrying out intelligent shopping guide according at least one input signal, the intelligent shopping guide includes using
The eye tracking at family, the speech recognition of user, AI intelligent sounds explain and publicise the dummy model display control with article；
Air display screen, the dummy model for showing article by way of being imaged air.
2. a kind of multidimensional vision purchase guiding system according to claim 1, it is characterised in that：Further include showcase, the sky
Gas display screen is arranged in a composition plane of showcase.
3. a kind of multidimensional vision purchase guiding system according to claim 2, it is characterised in that：It is equipped with and is used in the showcase
Place the exhibition booth of the true model of article or article.
4. a kind of multidimensional vision purchase guiding system according to claim 3, it is characterised in that：It is additionally provided with atmosphere on the showcase
Enclose lamp and status indicator lamp, the output of the input terminal of the atmosphere lamp and the input terminal of status indicator lamp with intelligent shopping guide module
End connection.
5. a kind of multidimensional vision purchase guiding system according to claim 2, it is characterised in that：It is additionally provided with electricity in the showcase
The output end of source module and loudspeaker, the power module is connect with the input terminal of intelligent shopping guide module, the intelligent shopping guide module
Output end and loudspeaker input terminal connect.
6. a kind of multidimensional vision purchase guiding system according to claim 1, it is characterised in that：The intelligent shopping guide module packet
It includes：
Gesture identification unit, the gesture for identifying user according to the hand signal of acquisition；
Speech talkback unit, the phonetic order for identifying user according to the voice signal of acquisition；
Image identification unit, for carrying out eye tracking and human facial expression recognition according to the picture signal of acquisition；
Brain wave signal recognition unit, the E.E.G for identifying user according to the brain wave signal of acquisition；
Touch signal recognition unit, the touching instruction for identifying user according to the touch signal of acquisition；
Analytic unit, for according to the gesture of user, the phonetic order of user, eye tracking and human facial expression recognition result,
At least one of the E.E.G of user and the touching instruction of user carry out shopping guide's intellectual analysis；
AI units, the AI for carrying out AI intelligent controls and article to the dummy model of article according to the result of shopping guide's intellectual analysis
Intelligent sound is explained and publicised, wherein AI intelligent controls include that the zoom control of the dummy model of article, view angle switch control and color become
Change control.
7. a kind of multidimensional vision purchase guiding system according to claim 6, it is characterised in that：The intelligent shopping guide module is also wrapped
It includes：
Selecting unit selects at least one of color, type, size, size and the brand of article for user；
Quick Response Code payment unit, for being paid after user chooses the article to be bought by scanning the two-dimensional code；
Storage unit, for store the gesture of user, the phonetic order of user, eye tracking and human facial expression recognition result,
The E.E.G of user, the touching instruction of user, the result of shopping guide's intellectual analysis and AI intelligent sounds explain and publicise content.
8. a kind of multidimensional vision purchase guiding system according to claim 1, it is characterised in that：The intelligent shopping guide module also connects
It is connected to background server, the background server is used to declare with intelligent shopping guide module telecommunication, the long-range AI intelligent sounds that store
The dummy model for saying content and article, by the display content of intelligent shopping guide module remote control air display screen and according to intelligence
The data of energy shopping guide's module carry out big data analysis.
9. according to a kind of multidimensional vision purchase guiding system of claim 1-8 any one of them, it is characterised in that：The input module
Including at least one of camera, touch screen, body-sensing device, voice acquisition module and E.E.G collecting device.
10. a kind of multidimensional vision shopping guide method, it is characterised in that：Include the following steps：
At least one input signal of user is obtained, the input signal includes picture signal, touch signal, hand signal, language
Sound signal and brain wave signal；
Intelligent shopping guide is carried out according at least one input signal, the intelligent shopping guide includes the eye tracking of user, user
Speech recognition, AI intelligent sounds explain and publicise the dummy model display control with article；
Show the dummy model of article by way of air imaging on air display screen according to the result of intelligent shopping guide.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810229361.1A CN108573403A (en) | 2018-03-20 | 2018-03-20 | A kind of multidimensional vision purchase guiding system and method |
| PCT/CN2019/078624 WO2019179409A1 (en) | 2018-03-20 | 2019-03-19 | Multidimensional visual shopping guide system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810229361.1A CN108573403A (en) | 2018-03-20 | 2018-03-20 | A kind of multidimensional vision purchase guiding system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108573403A true CN108573403A (en) | 2018-09-25 |
Family
ID=63574472
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810229361.1A Pending CN108573403A (en) | 2018-03-20 | 2018-03-20 | A kind of multidimensional vision purchase guiding system and method |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108573403A (en) |
| WO (1) | WO2019179409A1 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109685568A (en) * | 2018-12-21 | 2019-04-26 | 广东美的白色家电技术创新中心有限公司 | Product introduction method and device |
| CN109683711A (en) * | 2018-12-21 | 2019-04-26 | 广东美的白色家电技术创新中心有限公司 | Product introduction method and device |
| CN109725725A (en) * | 2018-12-29 | 2019-05-07 | 出门问问信息科技有限公司 | The information processing method of smart-interactive terminal and smart-interactive terminal |
| WO2019179409A1 (en) * | 2018-03-20 | 2019-09-26 | 广东康云多维视觉智能科技有限公司 | Multidimensional visual shopping guide system and method |
| CN110969053A (en) * | 2018-09-29 | 2020-04-07 | 深圳市神州云海智能科技有限公司 | Lottery buyer classification method and device and lottery robot |
| CN111402885A (en) * | 2020-04-22 | 2020-07-10 | 北京万向新元科技有限公司 | Interactive method and system based on voice and air imaging technology |
| WO2020151430A1 (en) * | 2019-01-23 | 2020-07-30 | 广东康云科技有限公司 | Air imaging system and implementation method therefor |
| WO2020151431A1 (en) * | 2019-01-21 | 2020-07-30 | 广东康云科技有限公司 | Data processing method and system for intelligent vehicle viewing |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6189246B1 (en) * | 1999-07-27 | 2001-02-20 | Ravi Gorthala | Three dimensional advertising billboard |
| CN202855246U (en) * | 2012-08-09 | 2013-04-03 | 陈滟滪 | Holographic mall shopping guide advertisement player |
| CN103116859A (en) * | 2013-02-06 | 2013-05-22 | 深圳华尔兹科技有限公司 | 3D (Three dimensions) shopping guide machine |
| CN105353582A (en) * | 2015-12-01 | 2016-02-24 | 浙江优创信息技术有限公司 | Holographic projection display system and operation method based on the same |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104898581B (en) * | 2014-03-05 | 2018-08-24 | 青岛海尔机器人有限公司 | A kind of holographic intelligent central control system |
| CN108573403A (en) * | 2018-03-20 | 2018-09-25 | 广东康云多维视觉智能科技有限公司 | A kind of multidimensional vision purchase guiding system and method |
-
2018
- 2018-03-20 CN CN201810229361.1A patent/CN108573403A/en active Pending
-
2019
- 2019-03-19 WO PCT/CN2019/078624 patent/WO2019179409A1/en active Application Filing
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6189246B1 (en) * | 1999-07-27 | 2001-02-20 | Ravi Gorthala | Three dimensional advertising billboard |
| CN202855246U (en) * | 2012-08-09 | 2013-04-03 | 陈滟滪 | Holographic mall shopping guide advertisement player |
| CN103116859A (en) * | 2013-02-06 | 2013-05-22 | 深圳华尔兹科技有限公司 | 3D (Three dimensions) shopping guide machine |
| CN105353582A (en) * | 2015-12-01 | 2016-02-24 | 浙江优创信息技术有限公司 | Holographic projection display system and operation method based on the same |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2019179409A1 (en) * | 2018-03-20 | 2019-09-26 | 广东康云多维视觉智能科技有限公司 | Multidimensional visual shopping guide system and method |
| CN110969053A (en) * | 2018-09-29 | 2020-04-07 | 深圳市神州云海智能科技有限公司 | Lottery buyer classification method and device and lottery robot |
| CN110969053B (en) * | 2018-09-29 | 2023-12-22 | 深圳市神州云海智能科技有限公司 | Method and device for classifying players and lottery robot |
| CN109685568A (en) * | 2018-12-21 | 2019-04-26 | 广东美的白色家电技术创新中心有限公司 | Product introduction method and device |
| CN109683711A (en) * | 2018-12-21 | 2019-04-26 | 广东美的白色家电技术创新中心有限公司 | Product introduction method and device |
| CN109685568B (en) * | 2018-12-21 | 2022-02-08 | 广东美的白色家电技术创新中心有限公司 | Product display method and device |
| CN109683711B (en) * | 2018-12-21 | 2022-12-20 | 广东美的白色家电技术创新中心有限公司 | Product display method and device |
| CN109725725A (en) * | 2018-12-29 | 2019-05-07 | 出门问问信息科技有限公司 | The information processing method of smart-interactive terminal and smart-interactive terminal |
| CN109725725B (en) * | 2018-12-29 | 2022-08-12 | 出门问问信息科技有限公司 | Intelligent interactive terminal and information processing method of intelligent interactive terminal |
| WO2020151431A1 (en) * | 2019-01-21 | 2020-07-30 | 广东康云科技有限公司 | Data processing method and system for intelligent vehicle viewing |
| WO2020151430A1 (en) * | 2019-01-23 | 2020-07-30 | 广东康云科技有限公司 | Air imaging system and implementation method therefor |
| CN111402885A (en) * | 2020-04-22 | 2020-07-10 | 北京万向新元科技有限公司 | Interactive method and system based on voice and air imaging technology |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019179409A1 (en) | 2019-09-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108573403A (en) | A kind of multidimensional vision purchase guiding system and method | |
| CN109085966B (en) | Three-dimensional display system and method based on cloud computing | |
| US9727874B2 (en) | Virtual photorealistic digital actor system for remote service of customers | |
| CN104102412B (en) | A kind of hand-held reading device and method thereof based on augmented reality | |
| CN106658038A (en) | Live broadcast interaction method based on video stream and corresponding device thereof | |
| WO2020151431A1 (en) | Data processing method and system for intelligent vehicle viewing | |
| EP3005033A1 (en) | Object display with visual verisimilitude | |
| CN204028887U (en) | A kind of reading of the hand-held based on augmented reality equipment | |
| WO2020151255A1 (en) | Display control system and method based on mobile terminal | |
| CN111178294A (en) | State recognition method, device, equipment and storage medium | |
| CN103455142A (en) | Image identification real-time three-dimensional interactive device and image identification real-time three-dimensional interactive method | |
| US20130202267A1 (en) | Interactive video reflection shopping aid | |
| CN103294803A (en) | Method and system for augmenting product information introduction and realizing man-machine interaction | |
| CN112990043A (en) | Service interaction method and device, electronic equipment and storage medium | |
| WO2020125598A1 (en) | Product display device | |
| WO2020151430A1 (en) | Air imaging system and implementation method therefor | |
| CN109658167A (en) | Try adornment mirror device and its control method, device | |
| CN115439171A (en) | Commodity information display method and device and electronic equipment | |
| CN109683711B (en) | Product display method and device | |
| CN110716641B (en) | Interaction method, device, equipment and storage medium | |
| CN206946194U (en) | A kind of holographic 3D interactive exhibition systems based on artificial intelligence Visual identification technology | |
| CN113180427A (en) | Multifunctional intelligent mirror | |
| CN112509152A (en) | Car watching method, system, equipment and readable medium based on AR technology | |
| WO2020151240A1 (en) | Ar automobile marketing system and method | |
| CN108597368A (en) | A kind of displaying devices and methods therefor based on threedimensional model |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20180925 |
|
| RJ01 | Rejection of invention patent application after publication |