CN110298683A - Information popularization method, apparatus, equipment and medium based on micro- expression - Google Patents

Information popularization method, apparatus, equipment and medium based on micro- expression Download PDF

Info

Publication number
CN110298683A
CN110298683A CN201910430181.4A CN201910430181A CN110298683A CN 110298683 A CN110298683 A CN 110298683A CN 201910430181 A CN201910430181 A CN 201910430181A CN 110298683 A CN110298683 A CN 110298683A
Authority
CN
China
Prior art keywords
user
micro
expression
preset
service product
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910430181.4A
Other languages
Chinese (zh)
Inventor
米扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
OneConnect Smart Technology Co Ltd
Original Assignee
OneConnect Smart Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by OneConnect Smart Technology Co Ltd filed Critical OneConnect Smart Technology Co Ltd
Priority to CN201910430181.4A priority Critical patent/CN110298683A/en
Publication of CN110298683A publication Critical patent/CN110298683A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0281Customer communication at a business location, e.g. providing product or service information, consulting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/174Facial expression recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Theoretical Computer Science (AREA)
  • Finance (AREA)
  • General Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Development Economics (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Game Theory and Decision Science (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The invention discloses a kind of information popularization method, apparatus, equipment and media based on micro- expression, the described method includes: being monitored using preset monitoring system to target area, obtain the facial image of each user and the dynamic location information of user, after the video data for receiving user's browse service product, video data is analyzed using micro- Expression Recognition model, obtains user to the interest-degree of service product;And when interest-degree of the user to service product is more than preset interest threshold, using the facial image of the user as target facial image, using the service product as target service product, simultaneously, obtain the dynamic location information of the corresponding user of target facial image, the dynamic location information of target facial image, target service product and user is sent to client, so that it is determined that the interested user of product and the interested product of user, so that business personnel accurately pushes relevant product information, the recommendation accuracy of product information is improved.

Description

Information popularization method, apparatus, equipment and medium based on micro- expression
Technical field
The present invention relates to micro- Expression Recognition technical field more particularly to a kind of information popularization methods based on micro- expression, dress It sets, equipment and medium.
Background technique
User online under solid shop/brick and mortar store transacting business when, usually can be during waiting in line business handling to solid shop/brick and mortar store The product of release is browsed or is experienced, and the staff in solid shop/brick and mortar store can not timely and accurately obtain because the volume of the flow of passengers is larger Know that who user is interested in product, causes staff that cannot provide service to target user in time.Meanwhile in work people When member is user's products Presentation, since the information to strange user grasps deficiency, also user can not be pointedly introduced for user Interested product is not high so as to cause the accuracy of Products Show.
Summary of the invention
A kind of information popularization method, apparatus, equipment and medium based on micro- expression is provided in the embodiment of the present invention, to solve Can not promptly and accurately identify in physical operating place to the interested user of product and the interested product of user, cause to The not high problem of the accuracy of family progress product information recommendation.
A kind of information popularization method based on micro- expression, comprising:
Target area is monitored using preset monitoring system, obtains the people of each user in the target area The dynamic location information of face image and the user in the target area;
Receive the video data for user's browse service product that preset product photographic device is collected, wherein each The video data accordingly records the video information for browsing a kind of each of the service product user;
Each video data is analyzed using preset micro- Expression Recognition model, obtains the video data packet Micro- expression type of the user contained, and according to micro- expression type of the user, the user is assessed to each institute State the interest-degree of the corresponding service product of video data;
If the user is more than preset interest threshold to the interest-degree of the service product, the described of the user is obtained Facial image is as target facial image, and obtains the service product as target service product;
It is corresponding that the target facial image is obtained in the preset monitoring system according to the target facial image The dynamic location information of the user in the target area;
The dynamic location information of the target facial image, the target service product and the user is sent to Client, so that according to the dynamic location information of the user to navigate to the target facial image corresponding by business personnel User, and the product information of the target service product is pushed to the user.
A kind of information popularization device based on micro- expression, comprising:
Video monitoring module obtains the target area for being monitored using preset monitoring system to target area The dynamic location information of the facial image of each user in domain and the user in the target area;
Data reception module, for receiving the view for user's browse service product that preset product photographic device is collected Frequency evidence, wherein each video data accordingly records the view for browsing a kind of each of the service product user Frequency information;
Data analysis module, for being analyzed using preset micro- Expression Recognition model each video data, The micro- expression type for the user that the video data includes is obtained, and according to micro- expression type of the user, is commented The user is estimated to the interest-degree of the corresponding service product of each video data;
Goal verification module, if being more than preset interest threshold for interest-degree of the user to the service product, The facial image of the user is then obtained as target facial image, and obtains the service product and is produced as target service Product;
Position acquisition module, for obtaining the mesh in the preset monitoring system according to the target facial image The corresponding user of facial image is marked in the dynamic location information of the target area;
Information sending module, for will be described in the target facial image, the target service product and the user Dynamic location information is sent to client so that business personnel navigated to according to the dynamic location information of the user it is described The corresponding user of target facial image, and the product information of the target service product is pushed to the user.
A kind of computer equipment, including memory, processor and storage are in the memory and can be in the processing The computer program run on device, the processor realize that the above-mentioned information based on micro- expression pushes away when executing the computer program Wide method.
A kind of computer readable storage medium, the computer-readable recording medium storage have computer program, the meter Calculation machine program realizes the above-mentioned information popularization method based on micro- expression when being executed by processor.
Above-mentioned information popularization method, apparatus, equipment and medium based on micro- expression, by using preset monitoring system pair Target area is monitored, obtain target area in each user facial image and user target area dynamic position Information;After receiving the video data of user's browse service product of product photographic device collection, micro- Expression Recognition mould is used Type analyzes each video data, and assessment obtains user to the interest-degree of each service product;And in user to business When the interest-degree of product is more than preset interest threshold, target facial image is set by the facial image of the user, and will The service product is set as target service product, meanwhile, the corresponding use of target facial image is obtained in preset monitoring system The dynamic location information of target facial image, target service product and user is sent to client by the dynamic location information at family. It is analyzed, can precisely be efficiently identified by the video data of the user's browse service product acquired to product photographic device Out in the target area to the interested user of service product and the interested service product of the user, and from monitoring system The middle dynamic location information for obtaining user, so that business personnel can mention in time for target user according to the location information of user It for service, and is provided according to target service product for target user and is targetedly serviced, to improve the recommendation of product information Accuracy.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below by institute in the description to the embodiment of the present invention Attached drawing to be used is needed to be briefly described, it should be apparent that, the accompanying drawings in the following description is only some implementations of the invention Example, for those of ordinary skill in the art, without any creative labor, can also be according to these attached drawings Obtain other attached drawings.
Fig. 1 is an application environment schematic diagram of the information popularization method in one embodiment of the invention based on micro- expression;
Fig. 2 is a flow chart of the information popularization method in one embodiment of the invention based on micro- expression;
Fig. 3 is a specific flow chart of step S3 in Fig. 2;
Fig. 4 is a specific flow chart of step S32 in Fig. 3;
Fig. 5 is that the shorter video of video recording duration is deleted in information popularization method in one embodiment of the invention based on micro- expression One specific flow chart of data;
Fig. 6 is a specific flow chart of step S6 in Fig. 2;
Fig. 7 is a functional block diagram of the information popularization device in one embodiment of the invention based on micro- expression;
Fig. 8 is a schematic diagram of computer equipment in one embodiment of the invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts Example, shall fall within the protection scope of the present invention.
Information popularization method provided by the embodiments of the present application based on micro- expression, can be applicable in the application environment such as Fig. 1, The application environment includes server-side, client and monitoring client, wherein it is attached between server-side and client by network, It is attached between server-side and monitoring client by network.Server-side divides the video data of user's browse service product Analysis, obtains target facial image and target service product, and the dynamic location information of user is obtained from monitoring client, by target person Face image, target service product and dynamic location information are sent to client.Client specifically can be, but not limited to be various People's computer, laptop, smart phone, tablet computer and portable wearable device, monitoring client specifically can be with independently The server cluster of server perhaps multiple servers composition realize that server-side can specifically use independent server or more The server cluster of a server composition is realized.Information popularization method provided in an embodiment of the present invention based on micro- expression is applied to Server-side.
In one embodiment, Fig. 2 shows a flow chart of the information popularization method in the present embodiment based on micro- expression, the party Method applies the server-side in Fig. 1, analyzes, is obtained to service product for the video data to user's browse service product Interested user and the interested service product of the user, improve the recommendation accuracy of product information.As shown in Fig. 2, the base Include step S1 to step S6 in the information popularization method of micro- expression, details are as follows:
S1: being monitored target area using preset monitoring system, obtains the people of each user in target area The dynamic location information of face image and user in target area.
In the present embodiment, preset monitoring system refers to by using preparatory mounted photographic device and monitoring software The monitoring system combined is recorded a video for the real time status to the target area in solid shop/brick and mortar store, solid shop/brick and mortar store refer to shopping centre, The commercial undertakings such as bank outlets or place of business, target area refer to the service area in solid shop/brick and mortar store.
Specifically, there is pre-configured monitoring system in solid shop/brick and mortar store, each service area in solid shop/brick and mortar store is carried out Monitoring, for improving the safety of user and commodity.User is after entering target area, preset monitoring system meeting in solid shop/brick and mortar store Crawler behavior to each user in target area is monitored video recording, obtains the face figure of each user in target area The dynamic location information of picture and user in target area, wherein dynamic location information refers to user in the real-time position of target area It sets.
Further, preset monitoring system can be by using preset human face recognition model to entrance target area User carries out recognition of face, which is image or the machine of the face information in video for identification Model, the face being able to detect in simultaneously locating and monitoring video recording, returns to high-precision face frame, so that identification obtains every user's Facial image.
Preferably, preset monitoring system can be every user's after identification obtains the facial image of every user Facial image distributes a corresponding unique identifier, the unique identifier can user in unique identification target area, should Unique identifier specifically can be number, be also possible to letter, is also possible to number and the alphabetical ID etc. combined, does not do herein Limitation.After distributing unique identifier for every user, preset monitoring system can be by the reality of user in the target area When position be mapped to real time position of the corresponding unique identifier of the user in the corresponding two-dimensional map in target area, so as to clear Show to Chu every user in the dynamic location information of target area.
S2: the video data for user's browse service product that preset product photographic device is collected is received, wherein each view Frequency browses the video information of each user of service product a kind of according to accordingly record.
Specifically, taking the photograph on the product frame or electric advertisement screen that preset product photographic device is mounted in solid shop/brick and mortar store As device, the camera in the preset product photographic device is fixed camera, for wide to product frame or electronics The imaging area for accusing the front of screen carries out the acquisition of video data, wherein and each product frame is served only for one service product of display, Each page in electric advertisement screen accordingly shows that a service product, each service product have preset product number.
Specifically, if there is user to browse the service product in product frame or electric advertisement screen, preset product camera shooting Device can acquire the video data of user's browse service product, and by collected video data transmission to server-side, service End receives preset product photographic device by network and sends video data.
For example, working as preset product photographic device in product frame has detected that face information enters imaging area, it is preset Product photographic device will start the video data of recording user's browse service product, if detecting, the face information leaves imaging region Domain then stops recorded video data, and the product number of the service product in product frame and video data is accordingly transferred to Server-side.
S3: each video data is analyzed using preset micro- Expression Recognition model, obtains what video data included Micro- expression type of user, and according to micro- expression type of user, user is assessed to the corresponding service product of each video data Interest-degree.
Wherein, micro- expression of the process of user's browse service product is recorded in video data, micro- expression refers to the face of people Expressive features, the slight expression of the impression for expressing personage's heart, to micro- table of user's browse service product in video data Whether feelings are analyzed, can assess to obtain user interested in the service product.
Specifically, the analysis method of micro- expression can carry out analysis identification user's using preset micro- Expression Recognition model Micro- expression type, preset micro- Expression Recognition model are the machine moulds of micro- expression for analysis trained in advance.Make Each video data is analyzed with preset micro- Expression Recognition model, obtains the micro- expression for the user that video data includes Type can learn user to the industry according to the different relationships for presetting micro- expression type and product fancy grade is pre-defined The fancy grade of business product, and the fancy grade is evaluated as user to the interest of the corresponding service product of each video data Degree.
Preferably, micro- expression type includes but is not limited to 6 seed types such as glad, surprised, detest, angry, tranquil and disappointment Micro- expression, also, preset micro- Expression Recognition model can specifically acquire in advance and respectively represent the big of this 6 kinds micro- expression types Amount samples pictures are labeled, and form samples pictures collection, corresponding neural network model is then selected to be trained, such as: volume Product neural network model or long recurrent neural networks model etc. in short-term, to obtain preset micro- Expression Recognition model.Alternatively, The great amount of samples video that acquisition respectively represents this 6 kinds of moods in advance is labeled, and is formed Sample video collection, is then selected corresponding Neural network model is trained, and finally obtains preset micro- Expression Recognition model.
S4: if user is more than preset interest threshold to the interest-degree of service product, the facial image of the user is obtained As target facial image, and the service product is obtained as target service product.
Specifically, preset interest threshold is number of the pre-set expression user to the interest level of service product Value, whether interested in the service product for distinguishing user, which can be set according to the needs of practical application It sets, herein with no restrictions.
It is understood that indicating user to this when interest-degree of the user to service product is more than preset interest threshold Service product is interested, and when interest-degree of the user to service product is no more than preset interest threshold, user is to the business for expression Product is less interested.
Specifically, it if user is more than preset interest threshold to the interest-degree of service product, can determine that the user is To service product, there are the users of the product information to be recommended of demand, and obtain the facial image of the user as target face figure Picture, and the service product is obtained as target service product, so as to which the hobby and demand for user carry out product letter The recommendation of breath improves the recommendation success rate of service product.
S5: the corresponding user of target facial image is obtained in preset monitoring system according to target facial image in target The dynamic location information in region.
Specifically, server-side can inquire target facial image pair according to target facial image in preset monitoring system The user answered is in the real time position of target area, and real-time update user is in the real time position of target area, it can obtains mesh The corresponding user of facial image is marked in the dynamic location information of target area.
For example, target area mapping is become a two-dimensional plane map in advance by preset monitoring system, and using only One identifier indicates position of the user in map, and server-side is according to the corresponding unique identifier of target facial image, default Monitoring system monitoring video in navigate to the user rapidly, and the real time position by the user in target area is mapped to this Location information of the corresponding unique identifier of user in the corresponding plane map in target area, to obtain user in target area The dynamic location information in domain.
S6: the dynamic location information of target facial image, target service product and user is sent to client, so that industry Business personnel navigate to the corresponding user of target facial image according to the dynamic location information of user, and by the production of target service product Product information is pushed to the user.
Specifically, server-side is by the dynamic location information business information of target facial image, target service product and user, Business information is sent to client, so that business personnel determines the user's according to the dynamic location information of user in client Real time position, and after reaching corresponding position, the user of product information to be recommended is confirmed according to target facial image, meanwhile, The information for needing to recommend the user is determined according to target service product, and the product information of target service product is pushed to the use Family.Wherein, client, which specifically can be, but not limited to, is various computers, smart phone, tablet computer and portable wearable sets It is standby.
For example, business personnel receives the business information of server-side transmission in the tablet computer that bank outlets distribute, it should Business information includes the dynamic location information of target facial image, target service product and user, and business personnel is clicking opening After business information, user can be reached according to the dynamic location information of user at present in the position of bank outlets, and use target Facial image confirms the user of product information to be recommended, to introduce the product information of target service product to user.
In the corresponding embodiment of Fig. 2, target area is monitored by using preset monitoring system, obtains target The dynamic location information of the facial image of each user in region and user in target area;Receiving product photographic device After the video data of user's browse service product of collection, each video data is analyzed using micro- Expression Recognition model, Assessment obtains user to the interest-degree of each service product;It and is more than preset interest in interest-degree of the user to service product When threshold value, target facial image is set by the facial image of the user, and set target service for the service product and produce Product, meanwhile, the dynamic location information of the corresponding user of target facial image is obtained in preset monitoring system, by target face The dynamic location information of image, target service product and user is sent to client.Pass through the use acquired to product photographic device The video data of family browse service product is analyzed, and can precisely be efficiently identified out in the target area to service product sense The user of interest and the interested service product of the user, and from monitoring system obtain user dynamic location information, with Just business personnel can provide service in time according to the location information of user for target user, and according to target service product It provides for target user and targetedly services, to improve the recommendation accuracy of product information.
In one embodiment, the present embodiment provides use preset micro- Expression Recognition model pair to mentioned in step S3 Each video data is analyzed, and obtains the micro- expression type for the user that video data includes, and according to micro- expression class of user The concrete methods of realizing of the interest-degree of the corresponding service product of each video data is described in detail in type, assessment user.
Referring to Fig. 3, Fig. 3 shows a specific flow chart of step S3, details are as follows:
S31: being directed to each video data, extracts frequency according to preset frame and extracts video frame images from video data.
Specifically, server-side is extracted frequency according to preset frame and is handled collected video data, from the video The predeterminated position of data starts to extract frame image, obtains video frame images, reduces the interference of redundant frame and improves in image The recognition speed of micro- expression, wherein the preset frame extracts frequency and usually can be set to extract at random in per continuous 3 frame image 1 frame image, but it is not limited to this, and preset frame extracts frequency and can be configured according to the needs of practical application, the default position The first frame position that can be video data is set, is also possible to other positions, herein with no restrictions.
For example, it is assumed that it is to extract 1 frame image at random in every continuous 5 frame image that preset frame, which extracts frequency, if video data Totalframes be 500 frames, and extracted since the first frame of the video data, then the quantity of video frame images is 100 frames.
S32: micro- Expression Recognition processing is carried out to each video frame images using preset micro- Expression Recognition model, is obtained every Micro- expression type of user in a video frame images.
Specifically, preset micro- Expression Recognition model carries out human facial feature extraction to each video frame images of input, and According to micro- expression type of the expressive features identification user extracted, micro- expression type include but is not limited to it is glad, surprised, detest Micro- expression of the types such as evil, angry, tranquil and disappointment, so that identification obtains micro- expression class of the user in each video frame images Type.
S33: micro- expression type of counting user belongs to the number of preset positive expression, calculates the positive expression of user Number accounts for the ratio of video frame images sum, and produces using the ratio being calculated as user to the corresponding business of video data The interest-degree of product.
Wherein, preset positive expression refers to that micro- expression type indicates that user holds with just the attitude of service product To micro- expression of intention, for example, can be in advance that glad and surprised micro- expression is set as preset forward direction by micro- expression type Expression, but it is not limited to this, can specifically be configured according to the actual situation, herein with no restrictions.
Specifically, for server-side according to micro- expression type of user in video frame images, obtaining indicates user to service product Preset positive expression with positive intention, and micro- expression type of counting user belongs to the number of preset positive expression, The number for calculating the positive expression of user accounts for the ratio of video frame images sum, and using the ratio being calculated as user couple The interest-degree of the corresponding service product of video data, for indicating user to the interest level of service product.
For example, obtaining 500 video frame figures after a video data extracts frequency progress image zooming-out according to preset frame Picture obtains after server-side carries out the discriminance analysis of micro- expression using preset micro- Expression Recognition model to each video frame images Belong to the view of preset positive expression to micro- expression type of micro- expression type of each video frame images user, and user Frequency frame image has 100, then it is 20% to the interest-degree of service product that user, which can be calculated,.
In the corresponding embodiment of Fig. 3, video frame figure is extracted from video data by extracting frequency according to preset frame Picture can reduce the interference of redundant frame and improve the recognition speed to micro- expression in image.Server-side uses preset micro- table Feelings identification model carries out micro- Expression Recognition processing to each video frame images, obtains micro- table of the user in each video frame images Feelings type, and micro- expression type of counting user belongs to the number of preset positive expression, according to of the positive expression of user Several and video frame images sums calculate users to the interest-degree of service product, so as to according to user in browse service product Process micro- expression, learn user to the fancy grade of different product, can intuitively, efficiently determine that business to be recommended produces Product ensure that the accuracy of Products Show.
In one embodiment, the present embodiment provides to mentioned in step S32 using preset micro- Expression Recognition model Micro- Expression Recognition processing is carried out to each video frame images, obtains the tool of micro- expression type of the user in each video frame images Body implementation method is described in detail.
Referring to Fig. 4, Fig. 4 shows a specific flow chart of step S32, details are as follows:
S321: using preset micro- Expression Recognition model from the micro- expression for extracting each user in each video frame images Motor unit type and motor unit sequence.
Specifically, preset micro- Expression Recognition model carries out human facial feature extraction from video frame images, according to fixed in advance The type of the good motor unit (Action Units, AU) of justice identifies that identification obtains user's to the expressive features of user The motor unit for including in micro- expression, and the arrangement of the sequencing occurred in micro- expression according to motor unit determines that movement is single The sequence of member.Wherein, the corresponding specific motor unit of the type of each motor unit, the type of motor unit specifically can be with 19 kinds of motor units including but not limited to as shown in Table 1.
Table one
AU label AU description
AU1 Interior eyebrow raises up
AU2 Outer eyebrow raises up
AU4 Eyebrow pushes
AU5 On the face raises up
AU6 Cheek lifts
AU7 Eyelid tightening
AU9 Nose crease
AU10 Upper lip raises up
AU12 The corners of the mouth raises up
AU14 Tighten the corners of the mouth
AU15 Corners of the mouth drop-down
AU16 Lower lip pushes
AU17 Chin tightens
AU18 Lip fold
AU20 Lip stretching, extension
AU23 Lip is shunk
AU24 Lip compresses
AU25 Upper lower lip separates
AU26 Lower jaw drop-down
S322: according to the sequence of the type of motor unit and motor unit, micro- expression type of each user is determined.
Specifically, the class of motor unit corresponding to micro- expression type is pre-defined in preset micro- Expression Recognition model Type and sequence, preset micro- Expression Recognition model can determine micro- according to the combination of the type and sequence of the motor unit extracted The type of expression, micro- expression type include but is not limited to micro- table of the types such as glad, surprised, detest, angry, tranquil and disappointment The type and sequence of motor unit corresponding to feelings, micro- expression type and micro- expression type can specifically carry out according to the actual situation Setting, herein with no restrictions.
It should be noted that micro- expression can only include one from micro- expression of the user extracted in video frame images The motor unit of seed type also may include a plurality of types of motor units, can specifically be determined according to the actual situation.Example It such as, include motor unit AU1 (interior eyebrow raises up) and motor unit AU12 (corners of the mouth raises up) in the one of user micro- expression, then according to pre- If micro- Expression Recognition model in pre-define the type and sequence of motor unit corresponding to micro- expression type, can determine The type of micro- expression is happiness.
In the corresponding embodiment of Fig. 4, mentioned from each video frame images by using preset micro- Expression Recognition model The type of the motor unit in micro- expression of each user and the sequence of motor unit are taken, according to the type and movement of motor unit The sequence of unit determines micro- expression type of each user, so that micro- expression progress to the user in video frame images is thinner The feature extraction and analysis of cause effectively improve the accuracy of micro- Expression Recognition result.
In one embodiment, the information popularization method provided in this embodiment based on micro- expression can also to video recording duration compared with Short video data carries out delete processing, and details are as follows:
As shown in figure 5, upon step s 2, and before step S3, the decision-making technique of the risk information further include as Lower step:
S71: the video recording duration of video data is detected.
Specifically, server-side detects the video recording duration of video data, obtains each after receiving video data The video recording duration of video data is determined user to browse the video data corresponding will pass through the video recording duration of video data The residence time of the product information of service product.
S72: if the video recording duration of video data is less than preset browsing duration threshold value, which is deleted Processing.
Specifically, if the video recording duration of video data is less than preset browsing duration threshold value, it is determined that user is to video counts Lose interest according to corresponding service product, the video data of collected user's browse service product is screened, by user The uninterested video data of the corresponding service product of video data is deleted.Wherein, preset browsing duration threshold value is service Hold preset user to service product possible interested most short residence time, such as 15 seconds etc., it specifically can be according to reality Border situation is configured, herein without limitation.
It in the corresponding embodiment of Fig. 5, is detected by the video recording duration to video data, and by the record of video data It is deleted as duration is less than the preset video data for browsing duration threshold value, user does not feel the corresponding service product of video data The video data of interest filters out, and improves the efficiency obtained to the interested user of service product.
In one embodiment, the present embodiment provides to producing target facial image, target service mentioned in step S6 The concrete methods of realizing that the dynamic location information of product and user are sent to client is described in detail.
Referring to Fig. 6, Fig. 6 shows a specific flow chart of step S6, details are as follows:
S81: the working condition of the business personnel in query target region, wherein working condition includes busy condition and sky Not busy state.
In the present embodiment, target area refers to the service area in solid shop/brick and mortar store, and one is pre-equipped in solid shop/brick and mortar store The business personnel of fixed number amount carries out the recommended work of product information, and each business personnel possesses corresponding client, the client Specifically it can be, but not limited to be laptop, smart phone, tablet computer and portable wearable device etc..
Specifically, the working condition of business personnel includes busy condition and idle state, and busy condition refers to business people Member is carrying out the state of the recommended work of product information, and idle state refers to that the business personnel is currently in waiting to next bit User carries out the state of the recommended work of product information.Business personnel needs business personnel when entering busy working condition Working condition is identified as busy condition in its corresponding client, server-side can be according to every business people in target area The working condition identified in the corresponding client of member, inquiry obtain the working condition of the business personnel in target area.
S82: if the working condition of business personnel is idle state, by target facial image, target service product and use The dynamic location information at family is sent in the corresponding client of the business personnel, and using preset prompting mode to business personnel It is prompted.
Specifically, if the working condition of business personnel be idle state, that is, indicate the business personnel be currently in waiting to Next bit user carry out product information recommended work state, server-side then by target facial image, target service product and The dynamic location information of user is sent in the corresponding client of the business personnel, and using preset prompting mode to business people Member is prompted, and the mode which can be voice prompts, and the mode for being also possible to vibration prompts.So that Business personnel determines the real time position of the user according to the dynamic location information of user in client, and reaches corresponding position Afterwards, the product information of target service product is pushed to this by the user that product information to be recommended is confirmed according to target facial image User.
In the corresponding embodiment of Fig. 6, by the working condition of the business personnel in query target region, and by target person It is corresponding that the dynamic location information of face image, target service product and user is sent to the business personnel that working condition is idle state Client in so that business personnel recommends the product information of the interested service product of the user to user, and being capable of root The quantity or ability of business personnel are adjusted according to the working condition of business personnel.
It should be understood that the size of the serial number of each step is not meant that the order of the execution order in above-described embodiment, each process Execution sequence should be determined by its function and internal logic, the implementation process without coping with the embodiment of the present invention constitutes any limit It is fixed.
In one embodiment, a kind of information popularization device based on micro- expression is provided, it should the information popularization based on micro- expression Information popularization method in device and above-described embodiment based on micro- expression corresponds.As shown in fig. 7, should the letter based on micro- expression It includes: video monitoring module 71, data reception module 72, data analysis module 73, goal verification module 74, position that breath, which promotes device, It sets and obtains module 75 and information sending module 76.Detailed description are as follows for each functional module:
Video monitoring module 71 obtains target area for being monitored using preset monitoring system to target area In each user facial image and user target area dynamic location information;
Data reception module 72, for receiving the video for user's browse service product that preset product photographic device is collected Data, wherein each video data accordingly records the video information for browsing a kind of each user of service product;
Data analysis module 73 is obtained for being analyzed using preset micro- Expression Recognition model each video data The micro- expression type for the user for including to video data, and according to micro- expression type of user, user is assessed to each video counts According to the interest-degree of corresponding service product;
Goal verification module 74 obtains if being more than preset interest threshold for interest-degree of the user to service product The facial image of the user is as target facial image, and obtains the service product as target service product;
Position acquisition module 75, for obtaining target facial image in preset monitoring system according to target facial image Dynamic location information of the corresponding user in target area;
Information sending module 76, for sending out the dynamic location information of target facial image, target service product and user Client is given, so that business personnel navigates to the corresponding user of target facial image according to the dynamic location information of user, and The product information of target service product is pushed to the user.
Further, data analysis module 73 includes:
Framing unit 731 extracts frequency according to preset frame and extracts from video data for being directed to each video data Video frame images;
Recognition unit 732, for carrying out micro- expression knowledge to each video frame images using preset micro- Expression Recognition model Other places reason, obtains micro- expression type of the user in each video frame images;
Computing unit 733, micro- expression type for counting user belong to the number of preset positive expression, calculate user The number of positive expression account for the ratio of video frame images sum, and using the ratio being calculated as user to video data The interest-degree of corresponding service product.
Further, recognition unit 732 includes:
Feature extraction subelement 7321, for being extracted from each video frame images using preset micro- Expression Recognition model The type of motor unit in micro- expression of each user and the sequence of motor unit;
Expression confirms subelement 7322, for determining each use according to the type of motor unit and the sequence of motor unit Micro- expression type at family.
Further, it is somebody's turn to do the information popularization device based on micro- expression further include:
Data detection module 77 is detected for the video recording duration to video data;
Data removing module 78, if the video recording duration for video data is less than preset browsing duration threshold value, to this Video data carries out delete processing.
Further, information sending module 76 includes:
Status inquiry unit 761, the working condition for the business personnel in query target region, wherein working condition Including busy condition and idle state;
Service informing unit 762, if for business personnel working condition be idle state, by target facial image, The dynamic location information of target service product and user are sent in the corresponding client of business personnel, and are mentioned using preset Show that mode prompts business personnel.
Specific restriction about the information popularization device based on micro- expression may refer to above for based on micro- expression The restriction of information popularization method, details are not described herein.Modules in the above-mentioned information popularization device based on micro- expression can be complete Portion or part are realized by software, hardware and combinations thereof.Above-mentioned each module can be embedded in the form of hardware or independently of calculating In processor in machine equipment, it can also be stored in a software form in the memory in computer equipment, in order to processor It calls and executes the corresponding operation of the above modules.
In one embodiment, a kind of computer equipment is provided, which can be server, internal junction Composition can be as shown in Figure 8.The computer equipment include by system bus connect processor, memory, network interface and Database.Wherein, the processor of the computer equipment is for providing calculating and control ability.The memory packet of the computer equipment Include non-volatile memory medium, built-in storage.The non-volatile memory medium is stored with operating system, computer program and data Library.The built-in storage provides environment for the operation of operating system and computer program in non-volatile memory medium.The calculating The network interface of machine equipment is used to communicate with external terminal by network connection.When the computer program is executed by processor with Realize a kind of information popularization method based on micro- expression.
In one embodiment, a kind of computer equipment is provided, including memory, processor and storage are on a memory And the computer program that can be run on a processor, processor are realized in above-described embodiment when executing computer program based on micro- table Step in the information popularization method of feelings, such as step S1 shown in Fig. 2 to step S6, alternatively, processor executes computer journey The function of each module/unit of the information popularization device in above-described embodiment based on micro- expression, such as mould shown in Fig. 7 are realized when sequence Block 71 to module 76 function.To avoid repeating, which is not described herein again.
In one embodiment, a kind of computer readable storage medium is provided, computer program is stored thereon with, is calculated Machine program realizes the step in the information popularization method in above-described embodiment based on micro- expression, such as Fig. 2 when being executed by processor Shown step S1 to step S6, alternatively, processor is realized in above-described embodiment when executing computer program based on micro- expression The function of each module/unit of information popularization device, such as module 71 shown in Fig. 7 is to the function of module 76.To avoid repeating, this In repeat no more.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with Relevant hardware is instructed to complete by computer program, the computer program can be stored in a non-volatile computer In read/write memory medium, the computer program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, To any reference of memory, storage, database or other media used in each embodiment provided herein, Including non-volatile and/or volatile memory.Nonvolatile memory may include read-only memory (ROM), programming ROM (PROM), electrically programmable ROM (EPROM), electrically erasable ROM (EEPROM) or flash memory.Volatile memory may include Random access memory (RAM) or external cache.By way of illustration and not limitation, RAM is available in many forms, Such as static state RAM (SRAM), dynamic ram (DRAM), synchronous dram (SDRAM), double data rate sdram (DDRSDRAM), enhancing Type SDRAM (ESDRAM), synchronization link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic ram (DRDRAM) and memory bus dynamic ram (RDRAM) etc..
It is apparent to those skilled in the art that for convenience of description and succinctly, only with above-mentioned each function Can unit, module division progress for example, in practical application, can according to need and by above-mentioned function distribution by different Functional unit, module are completed, i.e., the internal structure of described device is divided into different functional unit or module, more than completing The all or part of function of description.
Embodiment described above is merely illustrative of the technical solution of the present invention, rather than its limitations;Although referring to aforementioned reality Applying example, invention is explained in detail, those skilled in the art should understand that: it still can be to aforementioned each Technical solution documented by embodiment is modified or equivalent replacement of some of the technical features;And these are modified Or replacement, the spirit and scope for technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution should all It is included within protection scope of the present invention.

Claims (10)

1. a kind of information popularization method based on micro- expression, which is characterized in that the information popularization method packet based on micro- expression It includes:
Target area is monitored using preset monitoring system, obtains the face figure of each user in the target area The dynamic location information of picture and the user in the target area;
Receive the video data for user's browse service product that preset product photographic device is collected, wherein each described Video data accordingly records the video information for browsing a kind of each of the service product user;
Each video data is analyzed using preset micro- Expression Recognition model, obtaining the video data includes Micro- expression type of the user, and according to micro- expression type of the user, the user is assessed to each view Frequency according to corresponding service product interest-degree;
If the user is more than preset interest threshold to the interest-degree of the service product, the face of the user is obtained Image is as target facial image, and obtains the service product as target service product;
It is corresponding described that the target facial image is obtained in the preset monitoring system according to the target facial image The dynamic location information of the user in the target area;
The dynamic location information of the target facial image, the target service product and the user is sent to client End, so that business personnel navigates to the corresponding use of the target facial image according to the dynamic location information of the user Family, and the product information of the target service product is pushed to the user.
2. as described in claim 1 based on the information popularization method of micro- expression, which is characterized in that described to use preset micro- table Feelings identification model analyzes each video data, obtains micro- expression type of the user, and according to the user Micro- expression type, assess the user includes: to the interest-degree of each service product
For each video data, frequency is extracted according to preset frame and extracts video frame images from the video data;
Micro- Expression Recognition processing is carried out to each video frame images using preset micro- Expression Recognition model, is obtained every Micro- expression type of the user in a video frame images;
The micro- expression type for counting the user belongs to the number of preset positive expression, calculates the positive expression of the user Number accounts for the ratio of the video frame images sum, and using the ratio being calculated as the user to the video data The interest-degree of corresponding service product.
3. as claimed in claim 2 based on the information popularization method of micro- expression, which is characterized in that described using described preset Micro- Expression Recognition model carries out micro- Expression Recognition processing to each video frame images, obtains in each video frame images Micro- expression type of the user includes:
Micro- table of each user is extracted from each video frame images using preset micro- Expression Recognition model The sequence of the type of motor unit in feelings and the motor unit;
According to the sequence of the type of the motor unit and the motor unit, micro- expression type of each user is determined.
4. as described in claim 1 based on the information popularization method of micro- expression, which is characterized in that receive preset production described After the video data for user's browse service product that product photographic device is collected, and preset micro- expression is used described Identification model analyzes each video data, obtains the micro- expression class for the user that the video data includes Type, and according to micro- expression type of the user, before assessing the user to the interest-degree of each service product, The information popularization method based on micro- expression further include:
The video recording duration of the video data is detected;
If the video recording duration of the video data is less than preset browsing duration threshold value, which is carried out at deletion Reason.
5. such as the described in any item information popularization methods based on micro- expression of Claims 1-4, which is characterized in that incited somebody to action described The dynamic location information of the target facial image, the target service product and the user is sent to client packet It includes:
Inquire the working condition of the business personnel in the target area, wherein the working condition includes busy condition and sky Not busy state;
If the working condition of the business personnel is the idle state, by the target facial image, the target The dynamic location information of service product and the user are sent in the corresponding client of the business personnel, and using default Prompting mode the business personnel is prompted.
6. a kind of information popularization device based on micro- expression, which is characterized in that the information popularization device packet based on micro- expression It includes:
Video monitoring module is obtained in the target area for being monitored using preset monitoring system to target area Each user facial image and the user the target area dynamic location information;
Data reception module, for receiving the video counts for user's browse service product that preset product photographic device is collected The video letter for browsing a kind of each of the service product user is accordingly recorded according to, wherein each video data Breath;
Data analysis module is obtained for being analyzed using preset micro- Expression Recognition model each video data The micro- expression type for the user that the video data includes, and according to micro- expression type of the user, assess institute User is stated to the interest-degree of the corresponding service product of each video data;
Goal verification module obtains if being more than preset interest threshold for interest-degree of the user to the service product It takes the facial image of the user as target facial image, and obtains the service product as target service product;
Position acquisition module, for obtaining the target person in the preset monitoring system according to the target facial image The dynamic location information of the corresponding user of face image in the target area;
Information sending module, for by the dynamic of the target facial image, the target service product and the user Location information is sent to client, so that business personnel navigates to the target according to the dynamic location information of the user The corresponding user of facial image, and the product information of the target service product is pushed to the user.
7. as claimed in claim 6 based on the information popularization device of micro- expression, which is characterized in that the data analysis module packet It includes:
Framing unit extracts frequency according to preset frame and mentions from the video data for being directed to each video data Take video frame images;
Recognition unit, for carrying out micro- expression knowledge to each video frame images using preset micro- Expression Recognition model Other places reason, obtains micro- expression type of the user in each video frame images;
Computing unit, micro- expression type for counting the user belong to the number of preset positive expression, calculate the use The number of the positive expression at family accounts for the ratio of the video frame images sum, and using the ratio being calculated as the user To the interest-degree of the corresponding service product of the video data.
8. as claimed in claim 7 based on the information popularization device of micro- expression, which is characterized in that the recognition unit includes:
Feature extraction subelement, for being extracted from each video frame images using preset micro- Expression Recognition model The type of motor unit in micro- expression of each user and the sequence of the motor unit;
Expression confirms subelement, for determining each institute according to the type of the motor unit and the sequence of the motor unit State micro- expression type of user.
9. a kind of computer equipment, including memory, processor and storage are in the memory and can be in the processor The computer program of upper operation, which is characterized in that the processor realized when executing the computer program as claim 1 to Based on the information popularization method of micro- expression described in 5 any one.
10. a kind of computer readable storage medium, the computer-readable recording medium storage has computer program, and feature exists In information of the realization based on micro- expression as described in any one of claim 1 to 5 pushes away when the computer program is executed by processor Wide method.
CN201910430181.4A 2019-05-22 2019-05-22 Information popularization method, apparatus, equipment and medium based on micro- expression Pending CN110298683A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910430181.4A CN110298683A (en) 2019-05-22 2019-05-22 Information popularization method, apparatus, equipment and medium based on micro- expression

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910430181.4A CN110298683A (en) 2019-05-22 2019-05-22 Information popularization method, apparatus, equipment and medium based on micro- expression

Publications (1)

Publication Number Publication Date
CN110298683A true CN110298683A (en) 2019-10-01

Family

ID=68027087

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910430181.4A Pending CN110298683A (en) 2019-05-22 2019-05-22 Information popularization method, apparatus, equipment and medium based on micro- expression

Country Status (1)

Country Link
CN (1) CN110298683A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112183333A (en) * 2020-09-27 2021-01-05 苏州工业职业技术学院 Human screen interaction method, system and device based on micro-expressions
CN113435975A (en) * 2021-06-29 2021-09-24 平安科技(深圳)有限公司 Wheelchair leasing processing method and device and related equipment
CN113487357A (en) * 2021-07-08 2021-10-08 上海叮铃铃信息技术有限公司 Customer file management method and system based on face recognition
CN113515335A (en) * 2021-05-20 2021-10-19 口碑(上海)信息技术有限公司 Method and device for determining service information display form and electronic equipment
CN113635324A (en) * 2021-08-20 2021-11-12 中国工商银行股份有限公司 Intelligent coordination service method and system
CN113746875A (en) * 2020-05-27 2021-12-03 百度在线网络技术(北京)有限公司 Voice packet recommendation method, device, equipment and storage medium
CN113869981A (en) * 2021-09-29 2021-12-31 平安银行股份有限公司 Offline product recommendation method, device and equipment and readable storage medium
WO2023040233A1 (en) * 2021-09-18 2023-03-23 上海商汤智能科技有限公司 Service state analysis method and apparatus, and electronic device, storage medium and computer program product
CN114584836B (en) * 2020-11-30 2024-05-03 京东方科技集团股份有限公司 Method, device, system and medium for detecting using behavior of electronic product

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049734A (en) * 2011-10-12 2013-04-17 杜惠红 Method and system for finding person in public place
CN109447729A (en) * 2018-09-17 2019-03-08 平安科技(深圳)有限公司 A kind of recommended method of product, terminal device and computer readable storage medium
CN109767261A (en) * 2018-12-18 2019-05-17 深圳壹账通智能科技有限公司 Products Show method, apparatus, computer equipment and storage medium
CN109785066A (en) * 2019-01-17 2019-05-21 深圳壹账通智能科技有限公司 Products Show method, apparatus, equipment and storage medium based on micro- expression

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103049734A (en) * 2011-10-12 2013-04-17 杜惠红 Method and system for finding person in public place
CN109447729A (en) * 2018-09-17 2019-03-08 平安科技(深圳)有限公司 A kind of recommended method of product, terminal device and computer readable storage medium
CN109767261A (en) * 2018-12-18 2019-05-17 深圳壹账通智能科技有限公司 Products Show method, apparatus, computer equipment and storage medium
CN109785066A (en) * 2019-01-17 2019-05-21 深圳壹账通智能科技有限公司 Products Show method, apparatus, equipment and storage medium based on micro- expression

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113746875A (en) * 2020-05-27 2021-12-03 百度在线网络技术(北京)有限公司 Voice packet recommendation method, device, equipment and storage medium
CN113746875B (en) * 2020-05-27 2022-08-02 百度在线网络技术(北京)有限公司 Voice packet recommendation method, device, equipment and storage medium
CN112183333A (en) * 2020-09-27 2021-01-05 苏州工业职业技术学院 Human screen interaction method, system and device based on micro-expressions
CN114584836B (en) * 2020-11-30 2024-05-03 京东方科技集团股份有限公司 Method, device, system and medium for detecting using behavior of electronic product
CN113515335A (en) * 2021-05-20 2021-10-19 口碑(上海)信息技术有限公司 Method and device for determining service information display form and electronic equipment
CN113435975A (en) * 2021-06-29 2021-09-24 平安科技(深圳)有限公司 Wheelchair leasing processing method and device and related equipment
CN113435975B (en) * 2021-06-29 2023-09-26 平安科技(深圳)有限公司 Wheelchair leasing processing method and device and related equipment
CN113487357A (en) * 2021-07-08 2021-10-08 上海叮铃铃信息技术有限公司 Customer file management method and system based on face recognition
CN113487357B (en) * 2021-07-08 2022-04-29 上海叮铃铃信息技术有限公司 Customer file management method and system based on face recognition
CN113635324A (en) * 2021-08-20 2021-11-12 中国工商银行股份有限公司 Intelligent coordination service method and system
WO2023040233A1 (en) * 2021-09-18 2023-03-23 上海商汤智能科技有限公司 Service state analysis method and apparatus, and electronic device, storage medium and computer program product
CN113869981A (en) * 2021-09-29 2021-12-31 平安银行股份有限公司 Offline product recommendation method, device and equipment and readable storage medium

Similar Documents

Publication Publication Date Title
CN110298683A (en) Information popularization method, apparatus, equipment and medium based on micro- expression
US10028569B2 (en) Makeup application assistance device, makeup application assistance system, and makeup application assistance method
CN106454481B (en) A kind of method and device of live broadcast of mobile terminal interaction
CN109657609A (en) Face identification method and system
CN107203897A (en) A kind of evaluation method of Products Show degree, apparatus and system
CN104883515B (en) A kind of video labeling processing method and video labeling processing server
CN102947850A (en) Content output device, content output method, content output program, and recording medium with content output program thereupon
CN106910085B (en) Intelligent product recommendation method and system based on e-commerce platform
CN109033985A (en) Processing method, device, equipment, system and the storage medium of commodity identification
CN110796472A (en) Information pushing method and device, computer readable storage medium and computer equipment
CN108235122A (en) The monitoring method and device of video ads
US20140233854A1 (en) Real time object scanning using a mobile phone and cloud-based visual search engine
CN109002776B (en) Face recognition method, system, computer device and computer-readable storage medium
CN110309716A (en) Service tracks method, apparatus, equipment and storage medium based on face and posture
CN113850183A (en) Method for judging behaviors in video based on artificial intelligence technology
CN116452745A (en) Hand modeling, hand model processing method, device and medium
JP6593949B1 (en) Information processing apparatus and marketing activity support apparatus
CN115544475A (en) Business service method and device
US9621505B1 (en) Providing images with notifications
CN102783174B (en) Image processing equipment, content delivery system, image processing method and program
WO2022041182A1 (en) Method and device for making music recommendation
CN109345184A (en) Nodal information processing method, device, computer equipment and storage medium based on micro- expression
CN104049833A (en) Terminal screen image displaying method based on individual biological characteristics and terminal screen image displaying device based on individual biological characteristics
CN116567349A (en) Video display method and device based on multiple cameras and storage medium
CN108234629B (en) Method and device for processing user request

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20191001