CN104598012B - A kind of interactive advertising equipment and its method of work - Google Patents

A kind of interactive advertising equipment and its method of work Download PDF

Info

Publication number
CN104598012B
CN104598012B CN201310526678.9A CN201310526678A CN104598012B CN 104598012 B CN104598012 B CN 104598012B CN 201310526678 A CN201310526678 A CN 201310526678A CN 104598012 B CN104598012 B CN 104598012B
Authority
CN
China
Prior art keywords
user
node
action
master control
vector
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201310526678.9A
Other languages
Chinese (zh)
Other versions
CN104598012A (en
Inventor
张宜春
蒋伟
吴晓雨
郑伟
欧雪雯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
RESEARCH INSTITUTE OF CHINA ART TECHNOLOGY
Original Assignee
RESEARCH INSTITUTE OF CHINA ART TECHNOLOGY
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by RESEARCH INSTITUTE OF CHINA ART TECHNOLOGY filed Critical RESEARCH INSTITUTE OF CHINA ART TECHNOLOGY
Priority to CN201310526678.9A priority Critical patent/CN104598012B/en
Publication of CN104598012A publication Critical patent/CN104598012A/en
Application granted granted Critical
Publication of CN104598012B publication Critical patent/CN104598012B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09FDISPLAYING; ADVERTISING; SIGNS; LABELS OR NAME-PLATES; SEALS
    • G09F27/00Combined visual and audible advertising or displaying, e.g. for public address
    • G09F27/005Signs associated with a sensor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01Indexing scheme relating to G06F3/01
    • G06F2203/011Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Abstract

The present invention relates to a kind of interactive advertising equipment and its method of work, the advertising equipment includes display device, body feeling interaction device, and master control set and shipment performs device, the master control set control display device plays video information, the user action information caught according to body feeling interaction device, identify selection of the user to advertised product, and assess user action and the matching degree of selected advertised product associated video action, and judge whether that output shipment instructs according to matching degree and give shipment performs device, with control advertising equipment export selected by product to user to reward.Product is issued to user by the matching degree that the present invention acts according to user action and selected advertised product associated video, and this interaction mode improves the participation and interest of user, is advantageous to expand the popularization degree of product.

Description

A kind of interactive advertising equipment and its method of work
Technical field
The present invention relates to a kind of advertising equipment and its method of work, more particularly to a kind of interactive advertising equipment and its work Make method.
Background technology
With the continuous development of digital media technology, there occurs earthshaking for the propagandizing form and its transmitting carrier of advertisement Change.The conventional ads form just colourful now life promoted by the folk prescription such as word, picture or video curstomer-oriented It is relatively uninteresting and flat for work, tend not to produce deep impression to client, also just have no way of reaching desired publicity Effect.In fact, for product or service, best publicity mode is no more than inviting user to try out or experience in person.To push away Exemplified by wide beverage products, businessman can produce in the beverage that masses' distribution of the crowd's high aggregation place such as sales field to contact is freely tasted Product.But this mode usually requires tissue of disposing available manpower, and often because the time is short, audient's randomness is big, causes to promote and imitates Fruit is extremely limited.
The content of the invention
The present invention is in view of the above-mentioned problems, provide a kind of with body feeling interaction function, the interactive that intuitive is strong, convenient and practical Advertising equipment and its method of work.
To reach above-mentioned purpose, present invention employs following technical proposal:
A kind of interactive advertising equipment is provided, it is characterised in that including:
Display device;
Body feeling interaction device, it is used to catch user action information;
Master control set, it electrically connects display device and body feeling interaction device, for controlling display device to play video information, The user action information caught according to body feeling interaction device, selection of the identification user to advertised product, and assess user action The matching degree acted with selected advertised product associated video, and judge whether that exporting shipment instructs according to matching degree;
Shipment performs device, it electrically connects master control set, for the shipment instruction control advertisement sent according to master control set Equipment exports advertised product.
Above-mentioned body feeling interaction device includes infrared camera or RGB-D cameras, includes depth data and use with record The user action information of family bone node data.
Further, above-mentioned body feeling interaction device also includes optical camera.
According to one embodiment of the invention, above-mentioned interactive advertising equipment can also include communicator, and it electrically connects master Device is controlled, the control instruction for being transmitted according to master control set connects internet, to realize the remote operation to advertising equipment.
According to one embodiment of the invention, above-mentioned interactive advertising equipment can also include sound-producing device, and it electrically connects master Device is controlled, the control instruction for being transmitted according to master control set plays voice messaging.
In addition, the present invention also provides the method for work of above-mentioned interactive advertising equipment, comprise the following steps:
S10, prompting user select advertised product;
S20, catch user action information, identification user's selection;
Whether advertised product selected by S30, detection user is in short supply:
If in stockit is available, the associated video of advertised product selected by user is played, prompts user to imitate video actions;
S40, user action information is caught, assess the matching degree of user action and video actions;
S50, the advertised product according to selected by matching degree judges whether output user.
According to one embodiment of the invention, in above-mentioned steps S20 and S40, the user action information of seizure includes depth number According to user's bone node data.
Specifically, in above-mentioned steps S40, the matching degree of user action and video actions is assessed based on following steps:
S100, user's bone node and profile node chosen based on depth data;
S200, based on user's bone node structure user limbs vector, it is vectorial with corresponding video screen module to calculate user's limbs Space angle between plate limbs vector, is weighted normalizing, calculate user's limbs it is vectorial with corresponding video template limbs to Space angle accumulated error between amount, as the human action diversity factor analyzed based on bone node;
S300, sky calculating user adjacent two profile vector between vectorial based on user profile node structure user profile Between angle, build energy function using difference value between space angle of its vector corresponding video template profile, ask for The minimum value of energy function is as the human action diversity factor analyzed based on profile node;
S400, to the human action diversity factor analyzed based on bone node and the human action based on profile node analysis is poor Different degree weighted sum, as the assessment parameter for weighing user action and video actions matching degree.
In addition, in above-mentioned steps S30, if in short supply, information in short supply is prompted the user with, and by internet to operator Send information in short supply.
Compared with prior art, the beneficial effects of the invention are as follows:
1)The present invention configures body feeling interaction device to advertising equipment and presets the master control set of image processing algorithm, right The actions such as user gesture, posture are identified, and realize the switching of product selection, therefore can save traditional physical commodity displaying Window, save hardware cost.
2)The present invention configures body feeling interaction device to advertising equipment and presets the master control set of image processing algorithm, User utilizes image processing algorithm assessment user action and of advertised product associated video action after selecting certain advertised product With degree, advertised product is provided to user to reward according to action matching degree, this interaction mode improves the ginseng of user With degree and interesting, be advantageous to expand the popularization degree of product.
3)Preferably infrared camera or RGB-D cameras of the invention, which are caught, includes depth data and user's bone nodes According to user action information, and combine it is a kind of based on bone node analyze and based on profile node analysis human action comment automatically Estimation algorithm, user's body artis and gesture, and human body attitude direction are accurately positioned, the assessment result degree of accuracy is higher.
4)The present invention gives advertising equipment configuration communicator access internet, can further realize the remote of advertising equipment Journey operates and management.
The present invention changes traditional advertisement putting pattern, realizes the body feeling interaction interaction of user and advertisement video, The promotion effect of product is enhanced while self-service to-be-experienced product.
Brief description of the drawings
Fig. 1 is the composition schematic diagram of one embodiment of interactive advertising equipment of the present invention;
Fig. 2 is the workflow diagram of one embodiment of interactive advertising equipment of the present invention;
Fig. 3 is the flow chart of default human action automatic evaluation method in control device of the present invention;
Fig. 4 is the schematic diagram for the human body contour outline node that method shown in Fig. 3 is chosen;
Fig. 5 is the choosing method schematic diagram of human body profile node under hip in method shown in Fig. 3;
Fig. 6 is the method flow diagram for calculating diversity factor in method shown in Fig. 3 based on skeleton node;
Fig. 7 is the schematic diagram based on skeleton node structure limbs vector in method shown in Fig. 3;
Fig. 8 is the method flow diagram for calculating diversity factor in method shown in Fig. 3 based on human body contour outline node.
Embodiment
As shown in figure 1, it is the composition schematic diagram of a specific embodiment of interactive advertising equipment provided by the invention.Should Embodiment is an interactive advertisement beverage dispenser, mainly includes master control set 10, the body feeling interaction dress electrically connected with master control set 10 Put 20, display device 30, sound-producing device 40, shipment performs device 50, refrigerating plant 60 and communicator 70.Certainly, in this base On plinth, the equipment can also be needed according to user or use condition is extended and adjusted, such as can in some cold districts With using heating combined equipment substitution refrigerating plant.As long as this area and various equivalent modifications are not it is to be understood that departing from this hair On the premise of bright disclosed spirit, any modification is made in the formal and details that technical scheme is implemented and is existed with change In the scope of protection of present invention.
Unlike traditional advertising equipment, interactive advertising equipment provided by the invention mainly utilizes body feeling interaction Device 20 and display device 30 realize interaction with user, and the switching of product selection is carried out by the gesture identification in body feeling interaction, The real-time analysis and evaluation user action of image processing algorithm preset in master control set 10 is being utilized after user selects certain advertised product With the matching degree of the action of the advertised product associated video, and according to action matching degree provide product as reward.Below With reference to accompanying drawing, function and the effect of wherein each device are described in detail by taking interactive advertisement beverage dispenser as an example, whereby to the present invention such as What application technology means solves technical problem, and the implementation process for reaching technique effect fully understood and had to implement.
Master control set 10, it is the core control part of interactive advertisement beverage dispenser.Preferred computer conduct in the present embodiment Master control set 10, arithmetic sum logical operation is carried out, coordinated so as to control and dispatch each device of other in interactive advertisement beverage dispenser Work.
Body feeling interaction device 20, it is the critical component that interactive advertisement beverage dispenser realizes human-computer interaction.Adequately catch User action, the preferred infrared camera of the present embodiment gather human body in advertisement interactive process with optical camera combination set and moved Make information.Specifically, the control instruction sent according to master control set 10, infrared camera are launched red according to certain time interval Outer ray, and the infrared ray for being irradiated in human body return is detected, testing result is transmitted to master control set 10, master control set 10 passes through meter Time and the phase difference of reflection infrared ray are calculated, obtains the information such as depth data, skeleton node data, and then to human body Three-dimensional motion is tracked.And optical camera is generally used for the graph images such as static action recognition, recognition of face, scene Recognition Processing application.
Display device 30, according to the control instruction that master control set 10 is sent to user's display reminding information, play default Advertisement video etc..
Sound-producing device 40, voice messaging is played to user according to the control instruction that master control set 10 is sent.
Shipment performs device 50, the shipment instruction action sent according to master control set 10, control interactive advertisement beverage dispenser Shipment, beverage products as selected by exporting user are to user to reward.
Refrigerating plant 60, the beverage products stored in beverage machine are freezed according to the control instruction that master control set 10 is sent and dropped Temperature.
Communicator 70, the control instruction sent according to master control set 10, access operator in internet, with internet and control The communicator at end processed carries out data interaction, so that operator can inquire about the discharge of machine, quantity in stock, operation shape at any time State, failure situation, increase new interactive application, more new system, analysis user behavior etc..
Certainly, also promising each device provides the supply unit of operating voltage.
As shown in Fig. 2 it is a kind of flow chart of work methods of above-mentioned interactive advertisement beverage dispenser.It should be noted that should Method is only the preferred embodiments of the present invention, every equivalent flow conversion done using description of the invention and accompanying drawing content, It is included in technical scheme.
S10, master control set send control instruction, control the prompt message of display device Display Select Panel and correlation, Prompting user selects the beverage products admired by way of body feeling interaction.
Wherein it is possible to the left and right switching for waving to carry out beverage selection of regulation user, upward show of hands confirm selected drink Material, certainly also can not limited to this.
S20, master control set receive the user actions such as the depth data of body-sensing interactive device record, user's bone node data Information, the selection of user is identified by built-in image processing algorithm;
Whether beverage selected by S30, master control set detection user is in short supply:
If in short supply, information in short supply, return to step S10 are prompted;
If in stockit is available, master control set sends control instruction, and control display device plays corresponding advertisement video, prompts user Imitate video actions;
S40, when user imitates video actions, master control set receives the depth data of body-sensing interactive device record, user The user action informations such as bone node data, the matching of user action and video actions is assessed by built-in image processing algorithm Degree;
S50, master control set judge whether matching degree meets the requirements, such as judge whether matching degree is higher than default threshold Value 80%:
If undesirable, return to step S10;
If met the requirements, master control set sends shipment instruction, starts the work of shipment performs device, control beverage machine output Beverage products are to user to reward.
,, can also be by internet to operator when prompting the user with information in short supply if in short supply in above-mentioned steps S30 Send information in short supply.
In above-mentioned steps S40, master control set can be by analyzing and based on profile node analysis below based on bone node The automatic assessment algorithm of human action, assess the matching degrees of user action and video actions.As shown in figure 3, the human action Automatic assessment algorithm comprises the following steps:
S100, user's bone node and profile node chosen based on depth data;
S200, based on user's bone node structure user limbs vector, it is vectorial with corresponding video screen module to calculate user's limbs Space angle between plate limbs vector, is weighted normalizing, calculate user's limbs it is vectorial with corresponding video template limbs to Space angle accumulated error between amount, as the human action diversity factor analyzed based on bone node;
S300, sky calculating user adjacent two profile vector between vectorial based on user profile node structure user profile Between angle, build energy function using difference value between space angle of its vector corresponding video template profile, ask for The minimum value of energy function is as the human action diversity factor analyzed based on profile node;
S400, to the human action diversity factor analyzed based on bone node and the human action based on profile node analysis is poor Different degree weighted sum, as the assessment parameter for weighing user action and video actions matching degree.
In assessment algorithm automatic using above-mentioned human action, the preferred RGB-D cameras of body feeling interaction device 20, which are caught, to be used Family action message.
Certainly, the present invention can also use the image processing algorithm for for example calculating skeleton based on X-Y scheme sequence to know Not or user action is assessed, simply the degree of accuracy of this method is relatively low.
Below by a specific embodiment, the automatic assessment algorithm of above-mentioned human action is further described in detail.
In above-mentioned steps S100, RGB-D equipment can be used to obtain depth data, it is ensured that equipment includes within sweep of the eye Human body is whole, then the depth data collected is converted to the depth image of certain resolution, is established based on the depth image Human body segmentation's image, in embodiments of the invention, human body segmentation's image refers to the figure after background image and human body image separation Picture.
The skeleton node of analysis human action is determined by being fitted in human body segmentation's image.In the present embodiment In, preferably following 20 bone nodes:Head, neck, left shoulder, left elbow, left wrist, left hand, right shoulder, right elbow, right wrist, the right hand, vertebra, Waist, left stern, left knee, left ankle, left foot, right stern, right knee, right ankle, right crus of diaphragm.These bone nodes are according to human motion mode to action Influence degree can be roughly divided into following a few classes:
Trunk node:Vertebra, waist, left shoulder, right shoulder, left stern, right stern, neck totally seven nodes.By observing it is known that body Dry node typically exhibits strong autokinetic movement trend and seldom shows the motion of high independence, therefore can be human body body It is dry to be considered as the larger rigid body of motion inertia, do not consider the motion of trunk node in the similitude of general image registration is weighed.
First nodes:The head being directly connected with trunk, left elbow, right elbow, left knee, right knee.The a small amount of motion of first nodes is inclined Difference is with regard to that can cause visually larger difference.
Two-level node:Left wrist, right wrist, left ankle, the right ankle being connected with first nodes.Two-level node compared to first nodes from Trunk is farther, and movement tendency is only influenceed by first nodes, it is easy to rotated freely in space, therefore motion amplitude It is larger, but it is visually higher to the tolerance of angular deviation.
Endpoint node:Left hand, the right hand, left foot, right crus of diaphragm.Endpoint node is very short apart from two-level node, and flexibility ratio is higher, Easily caused positioning inaccurate by noise jamming when tracking and being imaged, therefore ignore shadow of the endpoint node to human action in the present embodiment Ring.
Human body contour outline node is chosen in human body segmentation's image.Body contour line is extracted in human body segmentation's image first, Then contour line is converted into the representation of sequence of points, therefrom the human body contour outline node of Analysis on Selecting human action.Such as Fig. 4 Characteristic that is shown, being acted according to human body limb, the preferred in the following manner of the present embodiment choose the left oxter of human body, left elbow, left wrist, a left side Under stern, left knee, left ankle, hip, right ankle, right knee, right stern, right wrist, right elbow, right oxter totally ten three profile nodes:
The selection mode of left oxter profile node is that a straight line parallel to X-axis is drawn at excessively left shoulder bone node, is found The nearest sequence of points of the left shoulder bone node of distance on the contour line below straight line, as left oxter profile node.Right oxter wheel Wide node is similarly.
The selection mode of right elbow profile node is that a straight line parallel to Y-axis is drawn at excessively right elbow bone node, is found straight The nearest sequence of points of the right elbow bone node of distance on line right-hand wheel profile, as right elbow profile node.Right wrist, right stern, right knee, the right side Ankle is similarly.
The selection mode of left elbow profile node is that a straight line parallel to Y-axis is drawn at excessively left elbow bone node, is found straight The nearest sequence of points of the left elbow bone node of distance on contour line on the left of line, as left elbow profile node.Left wrist, left stern, left knee, a left side Ankle is similarly.
The selection mode of hip bottom profiled node is as shown in figure 5, by left stern bone node and left kneecap bone node line, line taking It is A points at a quarter in section, at a quarter is B points in line taking section by right stern bone node and right kneecap bone node line, A, B point are crossed respectively and does straight line parallel to vertical axes, are found on the contour line between this two straight lines apart from pelvic bone bone node O Nearest sequence of points P, as hip bottom profiled node.
As shown in fig. 6, it is that being analyzed based on skeleton node for step S200 shown in Fig. 3 calculates human action diversity factor Method flow diagram, it comprises the following steps:
S201, descriptor as human action data vectorial based on skeleton node structure human body limb:
Because the coordinate of skeleton node does not have relativity and directionality, therefore the present invention is vectorial come generation using limbs For descriptor of the skeleton node as skeleton data.On the one hand, limbs vector has directionality, and its locus can borrow The three-dimensional coordinate of bone node is helped to represent, on the other hand, limbs vector is corresponding with human body limb, with the motion energy of limbs vector The motion of human body limb is enough described, greatly reduces the quantity of data and reduces the complexity calculated.In addition, from the motion side of human body Formula understands that the motion of human body head and trunk is smaller for the influence degree of human action, and the motion of human body limb is for people The influence degree of body action is larger, therefore the present invention employs certain simplification when using limbs vector description human motion Measure.As shown in fig. 7, in this example implementation, human body wrist joint, elbow joint, shoulder joint, stern joint, knee joint, ankle-joint are chosen Left and right composition point of totally 12 bone nodes as limbs vector, points to rudimentary bone node using advanced bone node and is used as limbs The direction of vector, namely first nodes are pointed to by trunk node, point to two-level node by first nodes.
S202, the vectorial space angle between corresponding template limbs vector of human body limb is calculated according to the following formula, with weighing apparatus Measure the matching degree between corresponding points in the template skeleton data of the skeleton data gathered in real time and systemic presupposition.
In above formula, θ is the vectorial space angle between corresponding template limbs vector of human body limb(Also referred to as limbs vector Space angle), its value is smaller to be shown that human body limb is vectorial and is more matched with corresponding template limbs vector, therefore based on human body bone It is used for the matching degree for weighing human action and swooping template action in the analysis method of bone node.Human body limb is represented respectively Vector sum template limbs vector.x1, y1, z1With x2, y2, z2RespectivelyThree-dimensional coordinate.The three-dimensional of human body limb vector Coordinate determines by the three-dimensional coordinate of skeleton node, the depth that the three-dimensional coordinate of skeleton node is obtained based on step S100 Data and determine.In the present embodiment, preferably human lumbar bone node is origin, and horizontal direction is X-axis, and vertical direction is Y-axis Establish rectangular coordinate system in space, the three-dimensional coordinate of skeleton node and limbs vector is straight in the rectangular coordinate system in space Angular coordinate, it is the same order of magnitude.
From the foregoing it will be appreciated that during human motion, the subjective sensation that the action difference at different types of bone node gives people is not Together, therefore the present invention is by substantial amounts of data comparison and practical experience, respectively the limbs related to first nodes vector, two level section The limbs vector of vectorial, human upper the limbs vector sum human body bottom of the related limbs of point assigns difference in differential expression Weight.Specific set can be as follows:
In the present embodiment, two-level node compared to first nodes apart from trunk farther out, motion amplitude only by first nodes Influence, be relatively easy to control in motion, therefore the limbs vector that two-level node is related(Limbs vector shown in Fig. 74,5,6,7) It is less that the difficulty of action matching considers middle proportion, and first nodes are nearer apart from trunk, influenceed by trunk motional inertia, Also influenceed simultaneously by two-level node motion amplitude, therefore the limbs vector that first nodes are related(Limbs vector shown in Fig. 70,1, 2、3)Proportion is more in the difficulty of action matching is considered.It is also desirable to consider to be likely to occur local space angle mistake Big situation, in order that the same each vectorial space angle between corresponding template limbs vector of human body limb of action is as far as possible It is average, in the present embodiment, also the same vectorial space between corresponding template limbs vector of each human body limb of action is pressed from both sides The standard deviation at angle also serves as measurement action matching degree and considers the factor.In addition, the limbs that the present embodiment preferred pair upper limbs is related Vector(Limbs vector shown in Fig. 70,1,4,5)Variance data assign less weight, it is related to lower limb(Limbs shown in Fig. 7 Vector 2,3,6,7)Variance data assign larger weight, to balance visual experience.
S203, space angle is weighted to normalizing, it is vectorial vectorial with corresponding template limbs to calculate human body limb according to the following formula Between space angle accumulated error, as the human action diversity factor analyzed based on skeleton node:
Metric=SD+AngDiff1×f1+AngDiff2×f2+AngDiffU×fU+AngDiffL×fL
In above formula, Metric is that the vectorial space angle accumulation between corresponding template limbs vector of human body limb misses Difference, SD are the standard deviations of limbs vector space angle.AngDiffU、AngDiffL、AngDiff1、AngDiff2Represent respectively same Upper limbs is related in one one experiment sample of action, lower limb are related, first nodes are related, limbs that two-level node is related to The accumulation of quantity space angle and.In the present embodiment, eight limbs vectors 0~7 shown in Fig. 5 are only accounted for, therefore are had:
Wherein,I ∈ { 0,1 ..., 7 } are the vectorial spaces between corresponding template limbs vector of eight human body limbs Angle.
fU、fL、f1、f2Represent that upper limbs is related, lower limb correlation, that first nodes are related, two-level node correlation respectively Limbs vector weight shared in differential expression, for embodying upper and lower limb respectively, first nodes are related to two-level node Limbs vector to the influence degree of human action.
In above formula, AngDiff'U、AngDiff'L、AngDiff1'、AngDiff2' represent that multigroup experiment sample is concentrated respectively All upper limbs are related, the accumulation of lower limb correlation, first nodes correlation, two-level node correlation limbs vector space angle With.Here one group of experiment sample is made up of multiple experiment samples, and an experiment sample specifically refers to assume default swooping template action For A(Such as the action of upright flattened both arms), certain moment human action similar with swooping template action A of collection is a, then template is moved Make A and human action a and just form a swooping template action A experiment sample.One group of experiment sample is specifically referred to for same template A is acted, the similar action of similar action and different people at different moments of same person at different moments is together with swooping template action Form one group of experiment sample.Each swooping template action just has one group of experiment sample, multiple different swooping template actions(As swooping template action A, Swooping template action B and swooping template action C etc.)Just construct multigroup experiment sample collection.
As shown in figure 8, it is that being analyzed based on human body contour outline node for step S300 shown in Fig. 3 calculates human action diversity factor Method flow diagram, it comprises the following steps:
S301, human body contour outline vector is built based on human body contour outline node:
Human body contour outline node is joined end to end successively, connected two-by-two to build human body contour outline vector, in the present embodiment, can With according under left oxter, left elbow, left wrist, left stern, left knee, left ankle, hip, right ankle, right knee, right stern, right wrist, right elbow, right oxter Order joins end to end, and forms 13 human body contour outline vectors.
S302, the according to the following formula space angle between the adjacent two profiles vector of calculating human body, as human action data Descriptor:
In above formula, θ is the space angle between the adjacent two profiles vector of human body(Also referred to as profile vector space angle),The adjacent two profiles vector of human body, x are represented respectively1, y1, z1With x2, y2, z2It is respectively hereinThree-dimensional seat Mark(It is different from the formula definition above based on step S202 in skeleton node analysis method).The three-dimensional of human body contour outline vector Coordinate determines by the three-dimensional coordinate of human body contour outline node, the depth that the three-dimensional coordinate of human body contour outline node is obtained based on step 100 Data and determine.Similar with the analysis method of skeleton node, in the present embodiment, preferably human lumbar bone node is original Point, horizontal direction are X-axis, and vertical direction is the three-dimensional that Y-axis establishes rectangular coordinate system in space, human body contour outline node and profile vector Coordinate is the rectangular co-ordinate in the rectangular coordinate system in space, is the same order of magnitude.
S303, the difference value for calculating each profile vector space angle of human body and all profile vector space angles of template:
In the present embodiment, 13 human body contour outline vectors of step S302 obtain 13 human body contour outline vector space folders Angle, first man body profile vector space angle is individually subtracted 13 profile vector space angles of template, then by second 13 profile vector space angles of template are individually subtracted in individual human body contour outline vector space angle, the like, obtain altogether 13 × 13 difference values.
S304, energy function constructed based on difference value, ask for the minimum value of energy function as being based on human body contour outline node The human action diversity factor of analysis:
Above-mentioned steps S303 obtain 13 × 13 difference values be used as matrix element, composition 13 × 13 difference matrix, by It can just be born in the value of matrix element, in order to construct energy function, by the processing of each matrix element square, build energy according to the following formula Function E (d):
In above formula, s is the sequence number of profile vector space angle, k1(s) it is profile vector corresponding to sequence number s in template data Space angle, d (s) are represented for the offset in sequence number s somatic data to be matched.In actual applications, in template data Profile vector space angle may be inconsistent with the order of profile vector space angle in somatic data to be matched, such as may go out Existing situations below:First space angle is left oxter space angle in template data, and 3rd in somatic data to be matched Space angle is left oxter space angle, so needing to define d (s), is represented for s-th of space angle in template data, Needed in somatic data to be matched to after s offset ds (s), both profile vector space angles can just correspond to each other, therefore k2 (s-d (s)) is the profile vector space angle in somatic data to be matched after skew converts.α is smoothing factor.J is wheel The number of wide vector space angle, in the present embodiment, its value are 13.
Then, the minimum value that algorithm asks for energy function is cut using figure, as the human body analyzed based on human body contour outline node Act diversity factor.
S400, by the above-mentioned human action diversity factor analyzed based on skeleton node and human body contour outline node according to the following formula Weighted sum, for its result as human action and the assessment parameter of swooping template action matching degree is weighed, its value is bigger, shows human body Action is lower with swooping template action similarity, and its value is smaller, shows that human action and swooping template action similarity are higher, so as to realize people The comprehensive and accurate automatic technique effect assessed, reach the present invention of body action.
D=a×Dskeleton+(1-a)×Dshape
In above formula, D is to weigh human action and the assessment parameter of swooping template action matching degree, DskeletonIt is to be based on human body bone The human action diversity factor of bone node analysis, a is its weight coefficient, DshapeIt is the human action based on the analysis of human body contour outline node Diversity factor, it is normalized, it is its weight coefficient to make (1-a).
, it is necessary to carry out substantial amounts of data test and combine human body subjective sensation to determine during the setting of above-mentioned weight Weight coefficient a value.And weight coefficient can also be adjusted according further to specific requirement.For example, can be according to step The depth data and skeleton node data obtained in rapid s100 judges that human action blocks with the presence or absence of itself.When human body moves When work blocks in the presence of itself, part of limb profile is lost, and cannot now use again with mutually being tied based on the analysis of human body contour outline node The method of conjunction carries out computing, it is necessary to forcibly by the weight coefficient for the human action diversity factor analyzed based on skeleton node 1 is set to, computing, assessment action matching degree are carried out only with the analysis method based on skeleton node.
Above-mentioned judgement human action whether there is the method itself blocked and comprise the following steps:
S401, edge is searched to human body segmentation's image, find out depth mutation pixel:
Edge is searched to human body segmentation's image, finds out the pixel that wherein depth data is more than given threshold value, it is believed that its depth There is mutation, be depth mutation pixel;
S402, judge whether depth mutation pixel is human body image pixel:
Depth mutation pixel coordinate is checked, is human body image pixel if depth mutation pixel is located at the scope of human body image, Then show that human body has depth mutation, and then infer that human action blocks in the presence of itself.
The assessment result of the above-mentioned analysis of fusion skeleton node and the analysis of human body contour outline node, automatically assesses human body and moves Make the matching degree between swooping template action, compensate for being based only upon the analysis of skeleton node in the prior art to a certain extent Or the analysis of human body contour outline node act the deficiency of comparison, the accurate evaluation of human action can be better achieved.
Interactive advertising equipment provided by the invention passes through body feeling interaction equipment and the master control for presetting image processing algorithm Device coordinates, and can be tracked positioning to user's body artis, gesture, and human body attitude direction, user is to wide for identification The selection of product is accused, user action and the matching degree of advertised product associated video action are assessed, if matching degree reaches It is expected that requirement then provides product to user to reward.This interaction mode enhances the participation and feeling of immersion of user, favorably In the popularization degree for expanding advertised product.
The preferred embodiments of the present invention are the foregoing is only, are not intended to limit the scope of the invention, every utilization The equivalent structure or equivalent flow conversion that description of the invention and accompanying drawing content are done, or directly or indirectly it is used in other correlations Technical field, be included within the scope of the present invention.

Claims (9)

  1. A kind of 1. interactive advertising equipment, it is characterised in that including:
    Display device;
    Body feeling interaction device, it is used to catch the user action information for including depth data and user's bone node data;
    Master control set, it electrically connects the display device and body feeling interaction device, for controlling the display device to play video Information, the user action information caught according to the body feeling interaction device, selection of the identification user to advertised product, and pass through It is a kind of to be analyzed based on bone node and user action and institute are assessed based on the automatic assessment algorithm of human action that profile node is analyzed The matching degree for selecting advertised product associated video to act, and judge whether that exporting shipment instructs according to matching degree;
    Shipment performs device, it electrically connects the master control set, and the shipment for being sent according to the master control set instructs control The advertising equipment exports advertised product.
  2. 2. interactive advertising equipment as claimed in claim 1, it is characterised in that:
    The body feeling interaction device includes infrared camera or RGB-D cameras, includes depth data and user's bone with record The user action information of bone node data.
  3. 3. interactive advertising equipment as claimed in claim 2, it is characterised in that:
    The body feeling interaction device also includes optical camera.
  4. 4. the interactive advertising equipment as described in claim 1 or 2 or 3, it is characterised in that further comprise communicator, It electrically connects the master control set, and the control instruction for being transmitted according to the master control set connects internet, to realize to institute State the remote operation of advertising equipment.
  5. 5. the interactive advertising equipment as described in claim 1 or 2 or 3, it is characterised in that further comprise sound-producing device, It electrically connects the master control set, and the control instruction for being transmitted according to the master control set plays voice messaging.
  6. 6. a kind of method of work of interactive advertising equipment as claimed in any one of claims 1 to 5, wherein, comprises the following steps:
    S10, prompting user select advertised product;
    S20, catch user action information, identification user's selection;
    Whether advertised product selected by S30, detection user is in short supply:
    If in stockit is available, the associated video of advertised product selected by user is played, prompts user to imitate video actions;
    S40, user action information is caught, assess the matching degree of user action and video actions;
    S50, the advertised product according to selected by matching degree judges whether output user.
  7. 7. method of work as claimed in claim 6, it is characterised in that:
    In the step S20 and S40, the user action information of seizure includes depth data and user's bone node data.
  8. 8. method of work as claimed in claim 7, it is characterised in that:In the step S40, user is assessed based on following steps Action and the matching degree of video actions:
    S100, user's bone node and profile node chosen based on depth data;
    S200, based on user's bone node structure user limbs vector, it is vectorial with corresponding video template limb to calculate user's limbs Space angle between body vector, is weighted normalizing, and it is vectorial with corresponding video template limbs vector to calculate user's limbs Between space angle accumulated error, as the human action diversity factor analyzed based on bone node;
    S300, space folder calculating user adjacent two profile vector between vectorial based on user profile node structure user profile Angle, energy function is built using its difference value between the space angle of corresponding video template profile vector, asks for energy Functional minimum value is as the human action diversity factor analyzed based on profile node;
    S400, to the human action diversity factor analyzed based on bone node and the human action diversity factor analyzed based on profile node Weighted sum, as the assessment parameter for weighing user action and video actions matching degree.
  9. 9. method of work as claimed in claim 7 or 8, it is characterised in that:
    In the step S30, if in short supply, information in short supply is prompted the user with, and short supply is sent to operator by internet Information.
CN201310526678.9A 2013-10-30 2013-10-30 A kind of interactive advertising equipment and its method of work Active CN104598012B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310526678.9A CN104598012B (en) 2013-10-30 2013-10-30 A kind of interactive advertising equipment and its method of work

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310526678.9A CN104598012B (en) 2013-10-30 2013-10-30 A kind of interactive advertising equipment and its method of work

Publications (2)

Publication Number Publication Date
CN104598012A CN104598012A (en) 2015-05-06
CN104598012B true CN104598012B (en) 2017-12-05

Family

ID=53123858

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310526678.9A Active CN104598012B (en) 2013-10-30 2013-10-30 A kind of interactive advertising equipment and its method of work

Country Status (1)

Country Link
CN (1) CN104598012B (en)

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104915011A (en) * 2015-06-28 2015-09-16 合肥金诺数码科技股份有限公司 Open environment gesture interaction game system
CN105138111A (en) * 2015-07-09 2015-12-09 中山大学 Single camera based somatosensory interaction method and system
CN109308624A (en) * 2017-07-27 2019-02-05 英业达科技有限公司 Interactive type advertisement method and its system
CN108062533A (en) * 2017-12-28 2018-05-22 北京达佳互联信息技术有限公司 Analytic method, system and the mobile terminal of user's limb action
CN109800645A (en) * 2018-12-18 2019-05-24 武汉西山艺创文化有限公司 A kind of motion capture system and its method
CN110555737A (en) * 2019-09-06 2019-12-10 北京海益同展信息科技有限公司 Content presentation method, device and system
CN110717428A (en) * 2019-09-27 2020-01-21 上海依图网络科技有限公司 Identity recognition method, device, system, medium and equipment fusing multiple features

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102103408A (en) * 2009-12-18 2011-06-22 微软公司 Gesture style recognition and reward
CN102609871A (en) * 2012-02-18 2012-07-25 扬州市前景电子技术研究所有限公司 Network self-service store and shopping method thereof
CN103049873A (en) * 2013-01-23 2013-04-17 贵州宝森科技有限公司 3D shopping guide machine system and method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102103408A (en) * 2009-12-18 2011-06-22 微软公司 Gesture style recognition and reward
CN102609871A (en) * 2012-02-18 2012-07-25 扬州市前景电子技术研究所有限公司 Network self-service store and shopping method thereof
CN103049873A (en) * 2013-01-23 2013-04-17 贵州宝森科技有限公司 3D shopping guide machine system and method

Also Published As

Publication number Publication date
CN104598012A (en) 2015-05-06

Similar Documents

Publication Publication Date Title
CN104598012B (en) A kind of interactive advertising equipment and its method of work
US20210177124A1 (en) Information processing apparatus, information processing method, and computer-readable storage medium
JP7078275B2 (en) Product detection system and product detection method based on video monitoring
US11403866B2 (en) Method, medium, and system for fast 3D model fitting and anthropometrics using synthetic data
CA2734143C (en) Method and apparatus for estimating body shape
Liu et al. Tracking-based 3D human skeleton extraction from stereo video camera toward an on-site safety and ergonomic analysis
Bonnechere et al. Determination of the precision and accuracy of morphological measurements using the Kinect™ sensor: comparison with standard stereophotogrammetry
CN105117924A (en) Personalized commodity recommendation system
US20140340479A1 (en) System and method to capture and process body measurements
US20180350148A1 (en) Augmented reality display system for overlaying apparel and fitness information
CN106127552B (en) Virtual scene display method, device and system
WO2020203656A1 (en) Information processing device, information processing method, and program
Pascali et al. Face morphology: Can it tell us something about body weight and fat?
CN110298279A (en) A kind of limb rehabilitation training householder method and system, medium, equipment
CN108363964A (en) A kind of pretreated wrinkle of skin appraisal procedure and system
KR102506352B1 (en) Digital twin avatar provision system based on 3D anthropometric data for e-commerce
CN109839827A (en) A kind of gesture identification intelligent home control system based on total space location information
US20130069939A1 (en) Character image processing apparatus and method for footskate cleanup in real time animation
Liu et al. Simple method integrating OpenPose and RGB-D camera for identifying 3D body landmark locations in various postures
CN114638929A (en) Online virtual fitting method and device, electronic equipment and storage medium
WO2020156627A1 (en) The virtual caliper: rapid creation of metrically accurate avatars from 3d measurements
CN104268773A (en) Background household product decision-making assisting method and system based on consumption feature information
Boulay et al. Posture recognition with a 3d human model
Pini et al. Baracca: a multimodal dataset for anthropometric measurements in automotive
CN110111415A (en) A kind of 3D intelligent virtual of shoes product tries method and system on

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant