CN109214312B - Information display method and device, computer equipment and storage medium - Google Patents
Information display method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN109214312B CN109214312B CN201810940544.4A CN201810940544A CN109214312B CN 109214312 B CN109214312 B CN 109214312B CN 201810940544 A CN201810940544 A CN 201810940544A CN 109214312 B CN109214312 B CN 109214312B
- Authority
- CN
- China
- Prior art keywords
- information
- target
- display
- area
- sub
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 57
- 230000001815 facial effect Effects 0.000 claims abstract description 22
- 238000001514 detection method Methods 0.000 claims description 49
- 238000004590 computer program Methods 0.000 claims description 25
- 238000013507 mapping Methods 0.000 claims description 22
- 238000005516 engineering process Methods 0.000 claims description 19
- 238000013459 approach Methods 0.000 claims description 9
- 230000003542 behavioural effect Effects 0.000 claims description 7
- 230000002123 temporal effect Effects 0.000 claims 1
- 230000008569 process Effects 0.000 abstract description 11
- 230000003993 interaction Effects 0.000 abstract description 8
- 230000006399 behavior Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 4
- 241001465754 Metazoa Species 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 210000000554 iris Anatomy 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000002699 waste material Substances 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000008014 freezing Effects 0.000 description 1
- 238000007710 freezing Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0269—Targeted advertisements based on user profile or attribute
- G06Q30/0271—Personalized advertisement
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Health & Medical Sciences (AREA)
- Finance (AREA)
- General Health & Medical Sciences (AREA)
- Accounting & Taxation (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Social Psychology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Entrepreneurship & Innovation (AREA)
- Psychiatry (AREA)
- Game Theory and Decision Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Economics (AREA)
- Marketing (AREA)
- General Business, Economics & Management (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to an information display method, an information display device, computer equipment and a storage medium, and belongs to the technical field of display. The method comprises the following steps: acquiring facial feature information of a subject; when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information, the distance between the object and the target area is obtained; when the distance meets a preset condition, judging that the corresponding object is a target object; determining first display information according to the position of a target object, and displaying the first display information to the target object. According to the technical scheme, the problem that information display is not accurate enough due to inaccurate identification of the target object is solved, the target object can be accurately determined according to the interaction process of the object and the target area, and then information display is accurately carried out on the target object.
Description
Technical Field
The present invention relates to the field of display technologies, and in particular, to an information display method and apparatus, a computer device, and a storage medium.
Background
With the development and progress of society, information display has become important content such as advertisement placement, and becomes a key development direction in the future. But the information display is not targeted at present. Taking a supermarket as an example, currently, information such as sales promotion and advertisement displayed by the supermarket is generally displayed for all consumers, but there are more consumers who are not interested in corresponding commodities, which easily causes waste of resources and cannot realize accurate delivery. Therefore, it is necessary to identify a target object (e.g., a consumer interested in the corresponding product) among a plurality of objects and display information on the target object.
In the process of implementing the invention, the inventor finds that at least the following problems exist in the prior art: at present, a target object identification method is mainly realized through an induction technology and the like, but a shopping cart, a pet and the like may be identified as a target object, so that information is displayed inaccurately.
Disclosure of Invention
Based on the above, the invention provides an information display method, an information display device, a computer device and a storage medium, which can accurately display information of a target object.
The content of the embodiment of the invention is as follows:
an information display method comprising the steps of: acquiring facial feature information of a subject; when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information, the distance between the object and the target area is obtained; when the distance meets a preset condition, judging that the corresponding object is a target object; determining first display information according to the position of a target object, and displaying the first display information to the target object.
In one embodiment, the step of obtaining facial feature information of the subject includes: acquiring body characteristic information of a subject; and when the type of the object is judged to be matched with a preset type according to the body characteristic information, acquiring the face characteristic information of the object.
In one embodiment, before the step of obtaining the distance between the object and the target area, the method further includes: acquiring second display information, and displaying the second display information to the target object; so that the object approaches the target area according to the second display information.
In one embodiment, the step of determining that the corresponding object is the target object when the distance satisfies a preset condition includes: and when the distance is smaller than a preset threshold value, judging that the corresponding object is the target object.
In one embodiment, the target region comprises a plurality of target sub-regions; the step of determining the first display information according to the position of the target object includes: when the target object is determined to be in a first target sub-region, determining first display information corresponding to the first target sub-region according to a preset mapping table.
In one embodiment, after the step of determining the first display information corresponding to the first target sub-region according to the preset mapping table, the method further includes: determining video detection information of the target object; wherein the video detection information comprises: biometric information, physical characteristic information, behavioral characteristic information; and establishing a first temporary association relation among the video detection information, the first target sub-area and the first display information.
In one embodiment, after the step of establishing the temporary association relationship among the video detection information, the first target sub-region and the first display information, the method further includes: when the target object moves to a second target subregion, disconnecting the first temporary association relation; determining third display information corresponding to the second target sub-area according to a preset mapping table, and displaying the third display information to the target object; and establishing a second temporary association relation among the video detection information, the second target sub-area and the third display information.
Accordingly, an embodiment of the present invention provides an information display device, including: the information acquisition module is used for acquiring the facial feature information of the object; the distance acquisition module is used for acquiring the distance between the object and the target area when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information; the object judgment module is used for judging that the corresponding object is the target object when the distance meets the preset condition; and the display module is used for determining first display information according to the position of the target object and displaying the first display information to the target object.
According to the information display method and device, when the face of the object is determined to face the target area according to the face feature information of the object, whether the object is the target object or not is determined according to the distance between the object and the target area, and then the corresponding first display information is determined. The target object can be accurately determined according to the interaction process of the object and the target area, and information display is further accurately carried out on the target object.
A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program: acquiring facial feature information of a subject; when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information, the distance between the object and the target area is obtained; when the distance meets a preset condition, judging that the corresponding object is a target object; determining first display information according to the position of a target object, and displaying the first display information to the target object.
The computer equipment can accurately determine the target object according to the interaction process of the object and the target area, and further accurately display the information of the target object.
A computer-readable storage medium, on which a computer program is stored which, when executed by a processor, carries out the steps of: acquiring facial feature information of a subject; when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information, the distance between the object and the target area is obtained; when the distance meets a preset condition, judging that the corresponding object is a target object; determining first display information according to the position of a target object, and displaying the first display information to the target object.
The computer readable storage medium can accurately determine the target object according to the interaction process of the object and the target area, and further accurately display the information of the target object.
Drawings
FIG. 1 is a diagram of an application environment of an information display method according to an embodiment;
FIG. 2 is a flow chart illustrating a method of displaying information according to one embodiment;
FIG. 3 is a block diagram of an information display system in one embodiment;
FIG. 4 is a block diagram of a target area in one embodiment;
fig. 5 is a block diagram showing the structure of an information display device according to an embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
The information display method provided by the application can be applied to computer equipment shown in figure 1. The computer device may be a server, and its internal structure diagram may be as shown in fig. 1. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The database of the computer device is used for storing data such as facial feature information, distance, first display information, second display information and the like. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program, when executed by a processor, implements an information display method.
Those skilled in the art will appreciate that the architecture shown in fig. 1 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
The information display method provided by the present application can be applied to an information display system as shown in fig. 2, which includes a processor, a detector, a display and a target area. The detector is used for carrying out video detection on the object within the coverage range, and a series of information acquisition technologies are utilized to transmit the acquired object information to the processor for analysis and processing. The processor consists of a processing unit and a storage unit, and the information display method is realized when the processor runs; the processor is used for analyzing the identified video detection information and the article information and sending the display information to the display; the processing unit is mainly used for processing, forwarding and transferring data; the storage unit is mainly used for storing article information and video detection information; the display feeds back a series of information such as images, videos, and sounds of the article to the object through various means such as wire and wireless. The target area is used for placing an article.
The embodiment of the invention provides an information display method, an information display device, computer equipment and a storage medium. The following are detailed below.
In one embodiment, as shown in fig. 3, there is provided an information display method including the steps of:
s301, acquiring facial feature information of the object.
The object may be a natural person, a robot, an animal, or the like, and may be one, two, or more (when there are a plurality of objects, it may be determined whether or not the objects are target objects, respectively). Meanwhile, the object may refer to a consumer who enters a specific area (the specific area may refer to an area such as an unmanned vending machine, an unmanned supermarket, an unmanned refrigerator, etc., and all objects in the specific area can be detected through a video detection technology).
The facial feature information refers to information related to the face of the subject, and may refer to information such as the expression of the face, biometric information, face orientation, and the like. The facial feature information of the subject can be obtained through video recognition technology.
The video identification technology is a mature and stable identification technology so far, and can realize the identification of human bodies, organisms and the like. The video identification technology is to obtain the environment image, the video information and the like through a certain optical module, extract the information required in the environment image and the video information through the technologies of image analysis and the like and make corresponding judgment so as to make up the incompleteness of the conventional identification technology. The current video recognition technology comprises a plurality of recognition technologies such as face recognition, video recognition, image recognition, character recognition, behavior recognition, iris recognition, eyeball focus positioning and the like. The video detection technique can be implemented by a detector, which can be a camera installed in a specific area, or a mobile terminal of an object. In addition, the video recognition technology can be applied to various embodiments of the present invention, that is, facial feature information, body feature information, behavior feature information, and the like of the subject can be obtained through the video recognition technology.
The step of acquiring facial feature information of a subject includes: acquiring body characteristic information of a subject; and when the type of the object is judged to be matched with a preset type according to the body characteristic information, acquiring the face characteristic information of the object. The physical characteristic information may refer to information such as height, weight, and body type of the subject. The preset type may refer to a type of human, animal, article, etc. Whether the object is a person, an animal or an article can be determined according to body characteristic information such as height, weight, body type and the like, and misjudgment caused by obstacles such as shopping carts can be effectively avoided. The determination of whether the type of the object matches the preset type may be performed by other means than the body characteristic information, for example, by means of a sensor, an infrared detector, a thermal imager, or the like.
S302, when the face direction of the object is determined to be consistent with the direction of the target area according to the face feature information, the distance between the object and the target area is obtained.
The target area can be the area where unmanned vending equipment, unmanned supermarkets, unmanned freezers and the like are located. The unmanned refrigerator can be a refrigerating refrigerator, a freezing refrigerator and other storage devices capable of storing relevant essential products, the display part of the unmanned refrigerator can be divided into different commodity arrangement areas and compartments, and the refrigerator can be of a glass door structure or a door-free structure.
If the face of the object is determined to be consistent with the direction of the target area, it can be said that the object is watching the target area in the direction. The object may be interested in the merchandise displayed, the information displayed in the target area. The distance of the object from the target area may then be determined, and a determination may be made as to whether the object has moved toward the target area after viewing merchandise, information, etc. in the target area.
The distance between the object and the target region may be the outermost distance between the object and the target region, or may be the distance between the object and the center position of the target region.
And S303, when the distance meets a preset condition, judging that the corresponding object is the target object.
The preset condition that the distance needs to meet may be that the distance is greater than or less than a certain threshold. If the preset condition is less than a certain threshold, it indicates that the target object needs to move towards the target area and approach the target area.
S304, determining first display information according to the position of the target object, and displaying the first display information to the target object.
The position of the target object may be within the target area, a certain position close to the target area, or a certain position related to the target area. The first display information may be information related to the target area, article information on articles displayed in the target area, sales promotion information, or the like.
In addition, a step of establishing a binding relationship between the position of the target object and the first display information may be further included before S304. After the binding relationship is determined, when the position of the target object is determined, the corresponding first display information can be determined according to the binding relationship. The first display information determined according to the position where the target object is located may be considered as information of interest to the object.
The first display information may be displayed by the display of fig. 2.
According to the embodiment, the target object can be accurately determined according to the interaction process of the object and the target area, and information display is further accurately performed on the target object.
In one embodiment, before the step of obtaining the distance between the object and the target area, the method further includes: acquiring second display information, and displaying the second display information to the target object; so that the object approaches the target area according to the second display information.
Wherein the second display information refers to information related to the target area. The item information may be item information of items stored in the target area, or sales promotion information may be used. Further, the second display information may be information that can cause the object to move in the direction in which the target area is located. Taking the target area as the freezer as an example, the second display information may be welcome information, or a product list, sales promotion information, popular product information, etc. of the articles stored in the freezer, and if the subject is interested in seeing the information, the subject will move in the direction of the freezer.
If the second display information refers to the article information, the article information can be information pre-stored in a memory or article information acquired in real time through a video detection technology; and different kinds of articles in the target area can be stored in fixed positions or can be stored in changed positions.
The first display information and the second display information may be the same information or different information. The first display information and the second display information can be displayed by the display in fig. 2.
After the second display information is obtained, the method further comprises the steps of obtaining video detection information such as biological characteristic information, body characteristic information and behavior characteristic information of the object, binding the video detection information with the second display information and storing the bound video detection information. When the object matched with the video detection information is located in the specific area again, the second display information can be determined and displayed directly according to the stored binding information without the process of facial feature information analysis.
In the embodiment, the second display information is displayed to promote the object to be close to the target area, the target object can be determined from a plurality of objects in an object interaction mode instead of displaying information on all the objects, the waste of advertisement resources can be effectively reduced, and meanwhile, the purpose of accurate marketing is achieved.
In one embodiment, the step of determining that the corresponding object is the target object when the distance satisfies a preset condition includes: and when the distance is smaller than a preset threshold value, judging that the corresponding object is the target object.
The preset threshold may be 1 meter, 5 meters, 10 meters, or other values.
Whether the object is the target object may be determined according to a size change of the distance. For example, if the distance is gradually reduced, it may be determined that the corresponding object moves toward the target area and is the target object.
It is also possible to determine whether or not an object is a target object in conjunction with time. For example, if the distance between a certain object and the target area (although the distance may be greater than a preset threshold) is maintained at a fixed value for more than 1 minute, and the face is always directed to the target area, the certain object may also be determined as the target object. In this case, the first display information may be remote display information stored in advance in the memory.
In this embodiment, whether the object moves towards the target area is determined according to the distance, and if the distance is smaller than a preset threshold value, the object is determined to be the target object. It can be determined whether the object is a target object through interaction with the object, i.e., whether the object is a potential customer. In addition, if the object faces the target area but the distance does not satisfy the preset condition, it may be determined that the object does not move toward the target area in the actual action although the face of the object faces the target area, and the object may be filtered because the object is determined to be temporarily uninteresting in the target area only by observing left and right during walking or by considering a general behavior around.
In one embodiment, the target region comprises a plurality of target sub-regions; the step of determining the first display information according to the position of the target object includes: when the target object is determined to be in a first target sub-region, determining first display information corresponding to the first target sub-region according to a preset mapping table.
The target sub-area may be inside the target area, or near the target area, or have a certain association with the target area. The preset mapping table may include a mapping of the target sub-area to the items displayed in the target area. Under the condition that the first target sub-area is determined, the corresponding article can be determined by inquiring the mapping table, and the article information of the article can be used as the first display information.
Meanwhile, the target object is determined to be in the first target sub-area by the sensor arranged in the first target sub-area, and when the sensor senses that the object approaches and the distance between the object and the target area is smaller than a preset threshold value, the object is considered to be in the first target sub-area. Based on this, the target sub-region may be referred to as a sensing region.
In addition, the display for displaying the first display information can be arranged in the target sub-area, for example, the display screens of each compartment of the ice bin can be arranged, and each display screen correspondingly displays the article information of one ice bin sub-area. Of course, the information of different target sub-areas can also be displayed centrally by one display. The embodiment of the invention does not limit the number and the installation position of the displays.
Taking the target area as an ice bin, as shown in FIG. 4, there are 1/2/3 three target sub-areas near the ice bin, which have corresponding A/B/C ice bin sub-areas. 1/2/3, there is a corresponding relationship between the three target sub-areas and the A/B/C ice chest sub-area, for example, when the target object stands in the target sub-area 1, the ice chest sub-area corresponding to the target sub-area 1 is determined to be A according to the mapping table, and then the first display information is determined according to the articles stored in the ice chest area A.
According to the embodiment, the first display information corresponding to the target sub-area is determined according to the mapping table, and the first display information required to be displayed can be accurately determined according to the position of the target object. Taking the target area as the refrigerator as an example, when the distance between the potential consumer and the refrigerator meets the condition, the article information (first display information) is displayed in the corresponding area of the refrigerator. In a real scenario, not all people facing and moving towards the freezer are potential consumers, who may just be right to pass. Therefore, a threshold is added, when the distance between a person and the freezer is already in the sensing area in the defined area outside the freezer, then the probability of his passing by is small, and it is likely that the freezer items are really of interest, and it is desirable to display product information in the corresponding area of the freezer. Through dividing the induction area outside the refrigerator, the potential consumers who really are interested in the product can be screened out, then accurate advertisement putting is carried out, and the advertisement cost is saved.
In one embodiment, after the step of determining the first display information corresponding to the first target sub-region according to the preset mapping table, the method further includes: determining video detection information of the target object; wherein the video detection information comprises: biometric information, physical characteristic information, behavioral characteristic information; and establishing a first temporary association relation among the video detection information, the first target sub-area and the first display information.
The biometric information refers to information representing physiological characteristics of a subject, such as fingerprints, face images, irises, and body types. The behavior feature information refers to information such as motion attitude and motion amplitude.
In this embodiment, when the target object is in the first target sub-region, the biological characteristic information, the body characteristic information, and the behavior characteristic information of the target object are associated with the first target sub-region and the first display information temporarily. According to the incidence relation, the first display information can be directly determined according to the characteristic information of the target object, and the information display efficiency can be effectively improved.
In one embodiment, after the step of establishing the temporary association relationship among the video detection information, the first target sub-region and the first display information, the method further includes: when the target object moves to a second target subregion, disconnecting the first temporary association relation; determining third display information corresponding to the second target sub-area according to a preset mapping table, and displaying the third display information to the target object; and establishing a second temporary association relation among the video detection information, the second target sub-area and the third display information.
In this embodiment, when the target object moves to another target sub-area, the corresponding third display information is determined according to the target sub-area where the target object is located, and the previously displayed first display information is replaced, so that the information that the target object is interested in can be displayed according to the behavior of the target object, and the display of invalid information is prevented, thereby avoiding wasting resources.
In order to better understand the above method, taking the target area as the refrigerator (the refrigerator comprises three refrigerator sub-areas of A/B/C, and there are 1/2/3 target sub-areas), and taking the target as the consumer, an application example of the information display method of the present invention is described in detail below.
1. Consumer A, B enters an area detectable by video detection technology and obtains physical characteristics information of consumer A, B by video detection technology.
2. When the processor judges that the consumer A is a human according to the body characteristic information, the face characteristic information of the consumer A is obtained.
3. When the consumer A is determined to face the refrigerator according to the facial feature information, acquiring sales promotion information of commodities displayed in the refrigerator, and displaying the sales promotion information through the display; so that consumer a sees the promotional information next to the freezer.
4. The distance between the consumer A and the refrigerator is obtained in real time.
5. When the consumer A moves towards the refrigerator and the distance between the consumer A and the refrigerator is less than 5 meters, the consumer A is judged as the target consumer.
6. When it is determined that the consumer a is in the target sub-area according to the sensor set in the target sub-area 1, product information of the product in the ice chest sub-area a is acquired and displayed through the display set in the ice chest sub-area a.
7. When consumer a moves from target sub-area 1 to target sub-area 2, product information for the product in refrigerator sub-area B is obtained and displayed by a display disposed in refrigerator sub-area B.
In the embodiment, after the consumer is determined to be a human, whether the consumer faces the refrigerator is judged according to the facial feature information of the consumer; if yes, displaying promotion information to attract the consumer to move towards the refrigerator; and displaying the corresponding product information when the consumer reaches the target sub-area. Whether the object is a potential consumer can be determined according to the behavior of the object, interested product information is displayed, and accurate marketing is achieved.
It should be noted that, for the sake of simplicity, the foregoing method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present invention is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present invention.
The present invention also provides an information display apparatus, which can be used to execute the above-described information display method, based on the same idea as the information display method in the above-described embodiment. For convenience of explanation, the structure of the embodiment of the information display device is only shown in the schematic diagram, and those skilled in the art will understand that the structure shown in the figure does not constitute a limitation to the device, and may include more or less components than those shown in the figure, or combine some components, or arrange different components.
As shown in fig. 5, the information display apparatus includes an information acquisition module 501, a distance acquisition module 502, an object judgment module 503, and a display module 504, which are described in detail as follows:
an information obtaining module 501, configured to obtain facial feature information of a subject.
A distance obtaining module 502, configured to obtain a distance between the object and the target region when it is determined that the face orientation of the object is consistent with the direction of the target region according to the facial feature information.
And an object determining module 503, configured to determine that the corresponding object is the target object when the distance satisfies a preset condition.
And a display module 504, configured to determine first display information according to a position of a target object, and display the first display information to the target object.
According to the embodiment, the target object can be accurately determined according to the interaction process of the object and the target area, and information display is further accurately performed on the target object.
In one embodiment, the information obtaining module 501 includes: the characteristic information acquisition submodule is used for acquiring body characteristic information of the object; and the matching judgment sub-module is used for acquiring the facial feature information of the object when the matching of the type of the object and a preset type is judged according to the body feature information.
In one embodiment, further comprising: the information display module is used for acquiring second display information and displaying the second display information to the target object; so that the object approaches the target area according to the second display information.
In an embodiment, the object determining module 503 is further configured to determine that the corresponding object is the target object when the distance is smaller than a preset threshold.
In an embodiment, the display module 504 is further configured to, when it is determined that the target object is located in a first target sub-region, determine first display information corresponding to the first target sub-region according to a preset mapping table.
In one embodiment, the display module 504 includes: a detection information determining sub-module for determining video detection information of the target object; wherein the video detection information comprises: biometric information, physical characteristic information, behavioral characteristic information; and the first incidence relation determining sub-module is used for establishing a first temporary incidence relation among the video detection information, the first target sub-area and the first display information.
In one embodiment, the display module 504 further comprises: the incidence relation disconnection submodule is used for disconnecting the first temporary incidence relation when the target object moves to a second target subregion; the display information acquisition submodule is used for determining third display information corresponding to the second target sub-area according to a preset mapping table and displaying the third display information to the target object; and the second incidence relation determining sub-module is used for establishing a second temporary incidence relation among the video detection information, the second target sub-area and the third display information.
It should be noted that, the information display apparatus of the present invention corresponds to the information display method of the present invention one to one, and the technical features and the advantageous effects described in the embodiments of the information display method are all applicable to the embodiments of the information display apparatus, and specific contents may refer to the description in the embodiments of the method of the present invention, which is not described herein again, and thus it is stated that.
In addition, in the above-described exemplary embodiment of the information display device, the logical division of each program module is only an example, and in practical applications, the above-described function distribution may be performed by different program modules according to needs, for example, due to the configuration requirements of corresponding hardware or the convenience of implementation of software, that is, the internal structure of the information display device is divided into different program modules to perform all or part of the above-described functions.
In one embodiment, a computer device is provided, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the following steps when executing the computer program: acquiring facial feature information of a subject; when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information, the distance between the object and the target area is obtained; when the distance meets a preset condition, judging that the corresponding object is a target object; determining first display information according to the position of a target object, and displaying the first display information to the target object.
In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring body characteristic information of a subject; and when the type of the object is judged to be matched with a preset type according to the body characteristic information, acquiring the face characteristic information of the object.
In one embodiment, the processor, when executing the computer program, further performs the steps of: acquiring second display information, and displaying the second display information to the target object; so that the object approaches the target area according to the second display information.
In one embodiment, the processor, when executing the computer program, further performs the steps of: and when the distance is smaller than a preset threshold value, judging that the corresponding object is the target object.
In one embodiment, the processor, when executing the computer program, further performs the steps of: when the target object is determined to be in a first target sub-region, determining first display information corresponding to the first target sub-region according to a preset mapping table.
In one embodiment, the processor, when executing the computer program, further performs the steps of: determining video detection information of the target object; wherein the video detection information comprises: biometric information, physical characteristic information, behavioral characteristic information; and establishing a first temporary association relation among the video detection information, the first target sub-area and the first display information.
In one embodiment, the processor, when executing the computer program, further performs the steps of: when the target object moves to a second target subregion, disconnecting the first temporary association relation; determining third display information corresponding to the second target sub-area according to a preset mapping table, and displaying the third display information to the target object; and establishing a second temporary association relation among the video detection information, the second target sub-area and the third display information.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of: acquiring facial feature information of a subject; when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information, the distance between the object and the target area is obtained; when the distance meets a preset condition, judging that the corresponding object is a target object; determining first display information according to the position of a target object, and displaying the first display information to the target object.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring body characteristic information of a subject; and when the type of the object is judged to be matched with a preset type according to the body characteristic information, acquiring the face characteristic information of the object.
In one embodiment, the computer program when executed by the processor further performs the steps of: acquiring second display information, and displaying the second display information to the target object; so that the object approaches the target area according to the second display information.
In one embodiment, the computer program when executed by the processor further performs the steps of: and when the distance is smaller than a preset threshold value, judging that the corresponding object is the target object.
In one embodiment, the computer program when executed by the processor further performs the steps of: when the target object is determined to be in a first target sub-region, determining first display information corresponding to the first target sub-region according to a preset mapping table.
In one embodiment, the computer program when executed by the processor further performs the steps of: determining video detection information of the target object; wherein the video detection information comprises: biometric information, physical characteristic information, behavioral characteristic information; and establishing a first temporary association relation among the video detection information, the first target sub-area and the first display information.
In one embodiment, the computer program when executed by the processor further performs the steps of: when the target object moves to a second target subregion, disconnecting the first temporary association relation; determining third display information corresponding to the second target sub-area according to a preset mapping table, and displaying the third display information to the target object; and establishing a second temporary association relation among the video detection information, the second target sub-area and the third display information.
It will be understood by those skilled in the art that all or part of the processes of the methods of the above embodiments may be implemented by a computer program, which is stored in a computer readable storage medium and sold or used as a stand-alone product. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (electronic device) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
The terms "comprises" and "comprising," and any variations thereof, of embodiments of the present invention are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or (module) elements is not limited to only those steps or elements but may alternatively include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-described examples merely represent several embodiments of the present invention and should not be construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. An information display method, comprising the steps of:
acquiring body characteristic information of a subject; when the object is determined to be a person according to the body feature information, acquiring face feature information of the object;
when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information, acquiring article information of articles stored in the target area in real time through a video detection technology to obtain second display information, and displaying the second display information to the object; enabling the object to approach the target area according to the second display information, and acquiring the distance between the object and the target area; the target area is an area where the unmanned freezer is located;
if the distance is gradually reduced, determining that the object moves to the target area, and judging that the object is a target object;
when the sensor arranged in the first target sub-area determines that the target object is in the first target sub-area according to the position of the target object, wherein the first target sub-area is a sensing area in the area defined outside the freezer; determining a freezer sub-region which is in a corresponding relation with the first target sub-region according to a preset mapping table, determining corresponding first display information according to articles stored in the freezer sub-region, and displaying the first display information to the target object through a display arranged in the first target sub-region;
after the second display information is obtained, the method further comprises the following steps:
and when the object matched with the video detection information is positioned in the specific area again, the second display information is determined and displayed according to the stored binding information under the condition of not analyzing the facial feature information.
2. The information display method according to claim 1, characterized in that the method further comprises:
and when the distance is smaller than a preset threshold value, judging that the corresponding object is the target object.
3. The information display method according to claim 1, wherein after the step of determining a freezer sub-region corresponding to the first target sub-region according to a preset mapping table and determining corresponding first display information according to the articles stored in the freezer sub-region, the method further comprises:
determining video detection information of the target object; wherein the video detection information comprises: biometric information, physical characteristic information, behavioral characteristic information;
and establishing a first temporary association relation among the video detection information, the first target sub-area and the first display information.
4. The information displaying method of claim 3, wherein after the step of establishing the temporal relationship between the video detection information, the first target sub-region and the first display information, further comprising:
when the target object moves to a second target subregion, disconnecting the first temporary association relation;
determining third display information corresponding to the second target sub-area according to a preset mapping table, and displaying the third display information to the target object;
and establishing a second temporary association relation among the video detection information, the second target sub-area and the third display information.
5. An information display device characterized by comprising:
the information acquisition module is used for acquiring the body characteristic information of the object; when the object is determined to be a person according to the body feature information, acquiring face feature information of the object;
the distance acquisition module is used for acquiring article information of articles stored in the target area in real time through a video detection technology to obtain second display information when the face orientation of the object is determined to be consistent with the direction of the target area according to the face characteristic information, and displaying the second display information to the object; enabling the object to approach the target area according to the second display information, and acquiring the distance between the object and the target area; the target area is an area where the unmanned freezer is located;
the object judging module is used for determining that the object moves to the target area and judging that the object is the target object if the distance is gradually reduced;
the display module is used for determining that the target object is in the first target sub-area when the sensor arranged in the first target sub-area determines that the target object is in the first target sub-area according to the position of the target object, wherein the first target sub-area is a sensing area in a defined area outside the refrigerator; determining a freezer sub-region which is in a corresponding relation with the first target sub-region according to a preset mapping table, determining corresponding first display information according to articles stored in the freezer sub-region, and displaying the first display information to the target object through a display arranged in the first target sub-region;
the apparatus also includes means for performing the steps of:
and when the object matched with the video detection information is positioned in the specific area again, the second display information is determined and displayed according to the stored binding information under the condition of not analyzing the facial feature information.
6. The information display device according to claim 5, wherein the object determination module is further configured to determine that the corresponding object is the target object when the distance is smaller than a preset threshold.
7. The information display device according to claim 5, wherein the display module comprises:
a detection information determining sub-module for determining video detection information of the target object; wherein the video detection information comprises: biometric information, physical characteristic information, behavioral characteristic information;
and the first incidence relation determining sub-module is used for establishing a first temporary incidence relation among the video detection information, the first target sub-area and the first display information.
8. The information display device of claim 7, wherein the display module further comprises: the incidence relation disconnection submodule is used for disconnecting the first temporary incidence relation when the target object moves to a second target subregion; the display information acquisition submodule is used for determining third display information corresponding to the second target sub-area according to a preset mapping table and displaying the third display information to the target object; and the second incidence relation determining sub-module is used for establishing a second temporary incidence relation among the video detection information, the second target sub-area and the third display information.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 4 are implemented by the processor when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810940544.4A CN109214312B (en) | 2018-08-17 | 2018-08-17 | Information display method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810940544.4A CN109214312B (en) | 2018-08-17 | 2018-08-17 | Information display method and device, computer equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109214312A CN109214312A (en) | 2019-01-15 |
| CN109214312B true CN109214312B (en) | 2021-08-31 |
Family
ID=64989022
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810940544.4A Active CN109214312B (en) | 2018-08-17 | 2018-08-17 | Information display method and device, computer equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109214312B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106384237A (en) * | 2016-08-31 | 2017-02-08 | 北京志光伯元科技有限公司 | Member authentication-management method, device and system based on face identification |
| CN108062673A (en) * | 2017-11-15 | 2018-05-22 | 平安科技（深圳）有限公司 | Method of payment, terminal device and computer readable storage medium |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5015926B2 (en) * | 2005-08-04 | 2012-09-05 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | Apparatus and method for monitoring individuals interested in property |
| JP6217123B2 (en) * | 2013-04-26 | 2017-10-25 | 株式会社寺岡精工 | Packaging equipment |
| US20150058129A1 (en) * | 2013-08-23 | 2015-02-26 | Marshall Feature Recognition Llc | System and method for electronic interaction with merchandising venues |
| US20160203499A1 (en) * | 2013-09-06 | 2016-07-14 | Nec Corporation | Customer behavior analysis system, customer behavior analysis method, non-transitory computer readable medium, and shelf system |
| CN105580040A (en) * | 2013-09-06 | 2016-05-11 | 日本电气株式会社 | Substituted n-biphenyl-3-acetylamino-benzamides and n-[3-(acetylamino)phenyl]-biphenyl-carboxamides and their use as inhibitors of the wnt signalling pathway |
| CN104462530A (en) * | 2014-12-23 | 2015-03-25 | 小米科技有限责任公司 | Method and device for analyzing user preferences and electronic equipment |
| US20170053314A1 (en) * | 2015-08-20 | 2017-02-23 | Quixey, Inc. | Displaying Advertisements In Application Launcher |
| CN105939199B (en) * | 2016-04-12 | 2018-10-19 | 成都嘉泽兴业科技有限责任公司 | Distributed broadcast notification information update method |
| CN106779940B (en) * | 2016-12-13 | 2020-10-27 | 中国联合网络通信集团有限公司 | Method and device for confirming display commodity |
| CN107179827A (en) * | 2017-04-01 | 2017-09-19 | 深圳怡化电脑股份有限公司 | The intelligent interactive method and system of a kind of finance device |
| CN107247759A (en) * | 2017-05-31 | 2017-10-13 | 深圳正品创想科技有限公司 | A kind of Method of Commodity Recommendation and device |
| CN107493319A (en) * | 2017-07-18 | 2017-12-19 | 上海千帆科技股份有限公司 | A kind of intelligent interaction Multimedia System and its implementation |
| CN107909443B (en) * | 2017-11-27 | 2020-04-03 | 北京旷视科技有限公司 | Information pushing method, device and system |
| CN108197971A (en) * | 2017-12-08 | 2018-06-22 | 北京天正聚合科技有限公司 | Information collecting method, information processing method, apparatus and system |
-
2018
- 2018-08-17 CN CN201810940544.4A patent/CN109214312B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106384237A (en) * | 2016-08-31 | 2017-02-08 | 北京志光伯元科技有限公司 | Member authentication-management method, device and system based on face identification |
| CN108062673A (en) * | 2017-11-15 | 2018-05-22 | 平安科技（深圳）有限公司 | Method of payment, terminal device and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109214312A (en) | 2019-01-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11638490B2 (en) | Method and device for identifying product purchased by user and intelligent shelf system | |
| US12008631B2 (en) | In-store item alert architecture | |
| US11481805B2 (en) | Marketing and couponing in a retail environment using computer vision | |
| US20220198550A1 (en) | System and methods for customer action verification in a shopping cart and point of sales | |
| KR102217024B1 (en) | Refrigerator, controlling method thereof and system | |
| US20170068945A1 (en) | Pos terminal apparatus, pos system, commodity recognition method, and non-transitory computer readable medium storing program | |
| EP3852038B1 (en) | Food management system, server apparatus, and refrigerator | |
| US11599928B2 (en) | Refrigerator and method for managing products in refrigerator | |
| US11488315B2 (en) | Visual and geolocation analytic system and method | |
| US20200387865A1 (en) | Environment tracking | |
| CN108922028A (en) | Automatic vending equipment, the control method and system of automatic vending equipment | |
| CN110689389A (en) | Computer vision-based shopping list automatic maintenance method and device, storage medium and terminal | |
| CN109191188A (en) | Determination method, apparatus, computer equipment and the storage medium of target information | |
| CN113781058A (en) | Payment method and device for unmanned vehicle, electronic equipment and storage medium | |
| CN109214312B (en) | Information display method and device, computer equipment and storage medium | |
| CN104980695A (en) | Coordination of object location data with video data | |
| CN110303503A (en) | Control method, device, robot and storage medium based on vending machine people | |
| CN110610358A (en) | Commodity processing method and device and unmanned goods shelf system | |
| WO2021097831A1 (en) | Information display method, apparatus, computer device, and storage medium | |
| CN212481823U (en) | Intelligent cooling and heating cabinet | |
| CN113495975A (en) | Video processing, display and completion method, device, system and storage medium | |
| CN113129112A (en) | Article recommendation method and device and electronic equipment | |
| CN106557940B (en) | Information release terminal and method | |
| US20240177189A1 (en) | Image data association method, system, apparatus and related computer program product | |
| US20220269890A1 (en) | Method and system for visual analysis and assessment of customer interaction at a scene |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231110 Address after: Room 607, Building B, Lanjiangshan Phase I, No. 7, Lin Tong Mei Second Road, Meijing Community, Meilin Street, Futian District, Shenzhen, Guangdong 518000 Patentee after: SHENZHEN SONIQ DIGITAL SMART SOLUTION Ltd. Address before: 222000 No.6, East Huanghai Avenue, Lingang Industrial Zone, Lianyungang Economic and Technological Development Zone, Lianyungang City, Jiangsu Province Patentee before: LIANYUNGANG QUATIUS DIGITAL TECHNOLOGY Co.,Ltd. |
|
| TR01 | Transfer of patent right |