CN108898102B - Method and device for determining concerned commodity, storage medium and terminal - Google Patents

Method and device for determining concerned commodity, storage medium and terminal Download PDF

Info

Publication number
CN108898102B
CN108898102B CN201810697527.2A CN201810697527A CN108898102B CN 108898102 B CN108898102 B CN 108898102B CN 201810697527 A CN201810697527 A CN 201810697527A CN 108898102 B CN108898102 B CN 108898102B
Authority
CN
China
Prior art keywords
customer
determining
iris
angle
video data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201810697527.2A
Other languages
Chinese (zh)
Other versions
CN108898102A (en
Inventor
李晗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Xiaoyi Technology Co Ltd
Original Assignee
Shanghai Xiaoyi Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Xiaoyi Technology Co Ltd filed Critical Shanghai Xiaoyi Technology Co Ltd
Priority to CN201810697527.2A priority Critical patent/CN108898102B/en
Publication of CN108898102A publication Critical patent/CN108898102A/en
Application granted granted Critical
Publication of CN108898102B publication Critical patent/CN108898102B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201Market modelling; Market analysis; Collecting market data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/193Preprocessing; Feature extraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/197Matching; Classification

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Finance (AREA)
  • Health & Medical Sciences (AREA)
  • Strategic Management (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • Development Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Accounting & Taxation (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Marketing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Game Theory and Decision Science (AREA)
  • Data Mining & Analysis (AREA)
  • Image Analysis (AREA)

Abstract

A method and a device for determining an attention commodity, a storage medium and a terminal are provided, the method comprises the following steps: acquiring front video data of customers in a store; extracting iris video data of the customer from the front video data of the customer; when the sight of the customer stays for more than a preset time length, determining the watching direction and the watching angle of the customer according to the iris video data; and determining the commodity concerned by the customer according to the watching direction and the watching angle. The scheme of the invention can timely and accurately count the attention condition of the customer to the commodity and provide evidence for the specific operation of commercial behaviors.

Description

Method and device for determining concerned commodity, storage medium and terminal
Technical Field
The invention relates to the technical field of new retail, in particular to a method and a device for determining concerned commodities, a storage medium and a terminal.
Background
In physical sales, it is crucial how to determine the attention of customers to goods. Specifically, in the business activities such as investment in brick-and-mortar stores and entrepreneurship, the customers can be more interested in the commodities during stock, thereby contributing to reduction of the overstock of the commodities and cost reduction.
However, in the prior art, only a small number of parameters can be generally estimated, for example, whether a certain commodity is sold hot can be determined only through a sales record or an actual sales amount, so that the information feedback is too slow, and the sales record does not show commodities which are not purchased but are concerned by customers, so that the commodities are difficult to be properly promoted and promoted.
There is a need for a method for determining a concerned commodity, which can more timely and accurately count the concerned condition of a customer on the commodity and provide evidence for the specific operation of a commercial behavior.
Disclosure of Invention
The invention aims to provide a method and a device for determining concerned commodities, a storage medium and a terminal, which can accurately count the concerned conditions of customers on the commodities in time and provide evidence for specific operation of commercial behaviors.
In order to solve the above technical problem, an embodiment of the present invention provides a method for determining a focused commodity, including the following steps: acquiring front video data of customers in a store; extracting iris video data of the customer from the front video data of the customer; when the sight of the customer stays for more than a preset time length, determining the watching direction and the watching angle of the customer according to the iris video data; and determining the commodity concerned by the customer according to the watching direction and the watching angle.
Optionally, determining the gazing direction and the gazing angle of the customer according to the iris video data includes: determining the diameter of the iris when the customer is looking forward according to the iris video data; determining a current contour shape of the iris in the iris video data; and determining the gazing direction and the gazing angle of the customer according to the contour shape and the diameter of the iris.
Optionally, determining the gazing direction and the gazing angle of the customer according to the contour shape and the diameter of the iris includes: determining the ratio of the size of the outline shape in the horizontal direction to the diameter of the iris, and recording the ratio as a first ratio, and determining the ratio of the size of the outline shape in the vertical direction to the diameter of the iris, and recording the ratio as a second ratio; determining the gazing direction of the customer according to the first proportion and the deviation direction of the iris from the in-eye position; and determining the gazing angle of the customer according to the second proportion and the deviation direction of the iris from the position in the eye.
Optionally, the method for determining a commodity of interest further includes: and forming an attention commodity track curve of the customer according to the commodities which are sequentially concerned by the customer.
Optionally, the method for determining a commodity of interest further includes: confirming a plurality of commodities concerned by the customer and recording characteristic information of the commodities; wherein the characteristic information is selected from one or more of: category, color, model, size.
To solve the above technical problem, an embodiment of the present invention provides an apparatus for determining a product of interest, including: the acquisition module is suitable for acquiring front video data of customers in the store; the extraction module is suitable for extracting iris video data of the customer from the front video data of the customer; the direction and angle determining module is suitable for determining the gazing direction and the gazing angle of the customer according to the iris video data when the sight of the customer stays for more than a preset time length; and the commodity determining module is suitable for determining the commodity concerned by the customer according to the gazing direction and the gazing angle.
Optionally, the direction angle determining module includes: a diameter determination sub-module adapted to determine a diameter of the iris at which the customer is looking forward based on the iris video data; a contour shape determination sub-module adapted to determine a current contour shape of the iris in the iris video data; and the direction angle determination submodule is suitable for determining the gazing direction and the gazing angle of the customer according to the contour shape and the diameter of the iris.
Optionally, the direction angle determination sub-module includes: a proportion determining unit, which is suitable for determining the proportion of the size of the outline shape in the horizontal direction to the diameter of the iris, and recording the proportion as a first proportion, and determining the proportion of the size of the outline shape in the vertical direction to the diameter of the iris, and recording the proportion as a second proportion; a direction determination unit adapted to determine a gazing direction of the customer based on the first ratio and a direction of deviation of the iris from an in-eye position; an angle determination unit adapted to determine the gaze angle of the customer based on the second ratio and a direction of deviation of the iris from an in-eye position.
Optionally, the apparatus for determining an item of interest further includes: and the curve determining module is suitable for forming an attention commodity track curve of the customer according to the commodities which are sequentially attended by the customer.
Optionally, the apparatus for determining an item of interest further includes: the recording module is suitable for confirming a plurality of commodities concerned by the customer and recording the characteristic information of the commodities; wherein the characteristic information is selected from one or more of: category, color, model, size.
To solve the above technical problem, an embodiment of the present invention provides a storage medium having stored thereon computer instructions, which when executed, perform the steps of the above method for determining a product of interest.
In order to solve the above technical problem, an embodiment of the present invention provides a terminal, including a memory and a processor, where the memory stores computer instructions capable of being executed on the processor, and the processor executes the steps of the method for determining a product of interest when executing the computer instructions.
Compared with the prior art, the technical scheme of the embodiment of the invention has the following beneficial effects:
in the embodiment of the invention, by determining the iris video data of the customer, when the sight line of the customer stays for more than the preset time length, the watching direction and the watching angle of the customer are determined, so that the commodity concerned by the customer is determined.
Furthermore, according to the multiple commodities which are sequentially concerned by the customer, the concerned commodity track curve of the customer is formed, the shopping preference of the customer can be judged, and therefore the promotion and propaganda success rate of the customer is improved.
Further, by confirming a plurality of commodities concerned by the customer and recording characteristic information of the commodities, the attention of commodities with different characteristics can be determined before sale by analyzing shopping preferences of the customer, and further evidence is provided for specific operation of commercial behaviors.
Drawings
FIG. 1 is a flow chart of a method for determining a commodity of interest in an embodiment of the present invention;
FIG. 2 is a flowchart of one embodiment of step S13 of FIG. 1;
FIG. 3 is a schematic view of an iris outline shape of a customer looking straight at an embodiment of the present invention;
FIG. 4 is a flowchart of one embodiment of step S23 of FIG. 2;
FIG. 5 is a schematic view of a profile of an iris when viewed obliquely in a horizontal direction for a customer in accordance with an embodiment of the present invention;
FIG. 6 is a schematic representation of the profile of an iris when viewed obliquely in the vertical direction by a customer in an embodiment of the present invention;
FIG. 7 is a schematic structural diagram of an apparatus for determining an item of interest according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an embodiment of the direction angle determining module 73 in fig. 7.
Detailed Description
In the prior art, when the condition that a customer pays attention to a commodity needs to be analyzed, only a small number of parameters can be generally estimated, so that the timeliness and the accuracy of statistics are poor.
The inventor of the present invention has found through research that in the prior art, only a small number of parameters can be generally evaluated, for example, whether a certain commodity is sold hot or not is determined through a sales record or an actual sales amount, so that information feedback is too slow, and the sales record does not show commodities which are not purchased but are concerned by customers, so that the commodities are difficult to be properly promoted and promoted.
In the embodiment of the invention, by determining the iris video data of the customer, when the sight line of the customer stays for more than the preset time length, the watching direction and the watching angle of the customer are determined, so that the commodity concerned by the customer is determined.
In order to make the aforementioned objects, features and advantages of the present invention comprehensible, embodiments accompanied with figures are described in detail below.
Referring to fig. 1, fig. 1 is a flowchart of a method for determining a product of interest according to an embodiment of the present invention. The determination method of the commodity of interest may include steps S11 to S14:
step S11: acquiring front video data of customers in a store;
step S12: extracting iris video data of the customer from the front video data of the customer;
step S13: when the sight of the customer stays for more than a preset time length, determining the watching direction and the watching angle of the customer according to the iris video data;
step S14: and determining the commodity concerned by the customer according to the watching direction and the watching angle.
In an implementation of step S11, the video data may be recorded by a camera disposed in the store.
In particular, the camera may be disposed within a predetermined range of the periphery of the product, for example, on a showcase or a shelf. The specific size of the preset range may be determined according to the size of the specific commodity, which is not limited in the embodiment of the present invention. The commodity may be a plurality of commodities or may be a single commodity.
In the embodiment of the invention, the cameras are arranged in the preset range around the commodity, so that compared with the arrangement of the cameras at the positions back to the commodity, the shooting of the face in a more middle direction or a more positive angle is facilitated, and the accuracy of statistics is improved.
Further, the camera may be selected from: a Charge-coupled Device (CCD) camera, an infrared camera, and the like.
In the embodiment of the invention, the camera is a CCD (charge coupled device) camera or an infrared camera, so that the shooting quality is improved, and the shooting quality at night and in poor light is improved.
In a specific implementation of step S12, the iris video data of the customer may be extracted from the front video data of the customer, so as to analyze the product focused by the customer.
Wherein the iris is an annular membrane with pigment in the front of the eyeball, and the iris video data can be used for indicating the fixation condition of the black eyeball (also called eye black) of a customer.
In a specific implementation manner of the embodiment of the invention, the cameras are arranged in the preset range around the commodity, so that the iris of the customer can be shot at the visual angle of the position of the commodity, and the statistical accuracy can be improved.
In a specific implementation of step S13, the preset time period may be a time period for which the user needs to pay attention to the commodity, for example, 0.5S to 5S.
Referring to fig. 2, fig. 2 is a flowchart of an embodiment of step S13 in fig. 1. The step of determining the gazing direction and the gazing angle of the customer based on the iris video data may include steps S21 to S23, each of which is described below.
In step S21, the diameter of the iris when the customer is looking at is determined from the iris video data.
Referring to fig. 3, fig. 3 is a schematic diagram of an iris outline shape of a customer in a front view according to an embodiment of the present invention.
Specifically, when a customer looks at the camera head, the outline shape of the iris 10 is close to a circle, and the diameter d of the iris 10 can be determined according to the outline of the iris 10.
In the embodiment of the invention, the diameter d of the iris 10 when the customer is looking at the eye is determined, so that the change of the outline shape of the iris 10 of the customer can be more accurately determined, and the accuracy of analysis is improved.
With continued reference to fig. 2, in step S22, the current contour shape of the iris in the iris video data is determined.
Specifically, when a customer in the video gazes at a commodity, the contour shape of the iris changes with changes in the gazing direction and gazing angle of the customer. For example, when a customer looks at the commodities on the left and right sides in the horizontal direction, the iris may be rotated left and right to cause the size in the horizontal direction to be smaller than the size in the vertical direction; when a customer views the goods above and below in the vertical direction, the iris may be rotated up and down to have a smaller vertical dimension than a horizontal dimension.
In step S23, the gaze direction and gaze angle of the customer are determined based on the contour shape and the diameter of the iris.
Referring to fig. 4, fig. 4 is a flowchart of an embodiment of step S23 in fig. 2. The step of determining the gazing direction and the gazing angle of the customer based on the contour shape and the diameter of the iris may include steps S41 to S43, and the respective steps will be described below.
In step S41, the ratio of the size of the outline shape in the horizontal direction to the diameter of the iris is determined and recorded as a first ratio, and the ratio of the size of the outline shape in the vertical direction to the diameter of the iris is determined and recorded as a second ratio.
In step S42, the gaze direction of the customer is determined based on the first ratio and the direction of deviation of the iris from the in-eye position.
In step S43, the gaze angle of the customer is determined based on the second ratio and the direction of deviation of the iris from the in-eye position.
The procedure of determining the gaze direction and gaze angle of the customer based on the contour shape and the diameter of the iris will be described below with reference to fig. 5 to 6.
Referring to fig. 5, fig. 5 is a schematic diagram of an iris outline shape of a customer when the customer looks obliquely in a horizontal direction in the embodiment of the present invention.
When the customer looks obliquely in the horizontal direction, the contour shape of the iris 11 changes from a nearly circular shape to a nearly elliptical shape, resulting in a dimension a1 in the horizontal direction being smaller than a dimension b1 in the vertical direction.
The ratio of the dimension a1 of the outline shape in the horizontal direction to the diameter d (see fig. 3) of the iris 11 is determined and is referred to as a first ratio.
The gaze direction of the customer is determined based on the first ratio and the direction of deviation of the iris 11 from the in-eye position.
Wherein the gaze direction may be used to indicate a degree of deviation of the iris 11 photographed in the video data in a horizontal direction.
Specifically, the line L1-L2 may be used as the eye position, and when the iris 11 is shifted to the right from the eye position, it may be determined that the customer gazing direction is the right commodity.
Referring to fig. 6, fig. 6 is a schematic diagram of an iris outline shape of a customer when looking obliquely in a vertical direction according to an embodiment of the present invention.
When the customer looks obliquely in the vertical direction, the contour shape of the iris 12 changes from nearly circular to nearly elliptical, resulting in a dimension a2 in the vertical direction being smaller than a dimension b2 in the vertical direction.
The ratio of the dimension a2 of the contour shape in the vertical direction to the diameter d (see fig. 3) of the iris 12 is determined and noted as a second ratio.
And determining the gazing angle of the customer according to the second proportion and the deviation direction of the iris 12 from the in-eye position.
Wherein the gaze angle may be used to indicate a degree of deviation in a vertical direction of the iris 12 captured in the video data.
Specifically, the M1-M2 line may be used as the eye position, and when the iris 12 is shifted downward from the eye position, it may be determined that the customer gazes at a product whose direction is the lower side.
With continued reference to fig. 1, in an implementation of step S14, the item of interest to the customer is determined based on the gaze direction and gaze angle.
Specifically, the commodity concerned by the customer is determined through calculation according to the position of a camera, the watching direction and the watching angle.
More specifically, a conventional calculation method may be employed, and in the embodiment of the present invention, the calculation method for determining the product of interest to the customer is not limited.
In the embodiment of the invention, by determining the iris video data of the customer, when the sight line of the customer stays for more than the preset time length, the watching direction and the watching angle of the customer are determined, so that the commodity concerned by the customer is determined.
Further, an attention commodity trajectory curve of the customer is formed according to the commodities which the customer sequentially pays attention to.
In the embodiment of the invention, the concerned commodity track curve of the customer is formed according to the commodities which are concerned by the customer in sequence, and the shopping preference of the customer can be judged, thereby being beneficial to improving the sales promotion and propaganda success rate of the customer.
Further, a plurality of products focused by the customer are confirmed, and feature information of the plurality of products is recorded.
Wherein, as a non-limiting example, the characteristic information may be selected from one or more of the following: category, color, model, size.
In the embodiment of the invention, the characteristics of the commodities which are interested by the customers can be classified and sorted by determining the commodity category, color, model and size, so that the customers can be recommended in a targeted manner in the subsequent shopping behaviors of the customers.
Further, by confirming a plurality of commodities concerned by the customer and recording characteristic information of the commodities, the attention of commodities with different characteristics can be determined before sale by analyzing shopping preferences of the customer, and further evidence is provided for specific operation of commercial behaviors.
Referring to fig. 7, fig. 7 is a schematic structural diagram of a device for determining a product of interest according to an embodiment of the present invention. The apparatus for determining an item of interest may include:
an acquisition module 71 adapted to acquire front video data of a customer in a store;
an extraction module 72 adapted to extract iris video data of the customer from the front video data of the customer;
a direction angle determination module 73, adapted to determine a gazing direction and a gazing angle of the customer according to the iris video data when the sight line of the customer stays for more than a preset duration;
an item determination module 74 adapted to determine an item of interest to the customer based on the gaze direction and gaze angle;
a curve determining module 75 adapted to form a track curve of the concerned commodities of the customer according to a plurality of commodities concerned by the customer in sequence;
a recording module 76 adapted to identify a plurality of items of interest to the customer and record characteristic information of the plurality of items, wherein the characteristic information is selected from one or more of the following: category, color, model, size.
Referring to fig. 8, fig. 8 is a schematic structural diagram of an embodiment of the direction angle determining module 73 in fig. 7. The direction angle determination module 73 may include:
a diameter determination sub-module 81 adapted to determine a diameter of the iris at which the customer is looking based on the iris video data;
a contour shape determination sub-module 82 adapted to determine a current contour shape of the iris in the iris video data;
a direction angle determination sub-module 83 adapted to determine a gaze direction and a gaze angle of the customer based on the contour shape and the diameter of the iris.
Further, the direction angle determination submodule 83 may include:
a ratio determining unit (not shown) adapted to determine a ratio of a size of the outline shape in a horizontal direction to a diameter of the iris, denoted as a first ratio, and determine a ratio of the size of the outline shape in a vertical direction to the diameter of the iris, denoted as a second ratio;
a direction determining unit (not shown) adapted to determine a gazing direction of the customer based on the first ratio and a direction of deviation of the iris from an in-eye position;
an angle determination unit (not shown) adapted to determine the gaze angle of the customer based on the second ratio and a direction of deviation of the iris from an in-eye position.
For the principle, specific implementation and beneficial effects of the apparatus for determining a product of interest, please refer to the foregoing and the related descriptions of the method for determining a product of interest shown in fig. 1 to 6, which are not repeated herein.
Embodiments of the present invention also provide a storage medium having stored thereon computer instructions, which when executed perform the above steps of the method for determining a commodity of interest. The storage medium may be a computer-readable storage medium, and may include, for example, a non-volatile (non-volatile) or non-transitory (non-transitory) memory, and may further include an optical disc, a mechanical hard disk, a solid state hard disk, and the like.
The embodiment of the present invention further provides a terminal, which includes a memory and a processor, where the memory stores computer instructions capable of being executed on the processor, and the processor executes the steps of the above determination method for a commodity of interest when executing the computer instructions. The terminal includes, but is not limited to, a mobile phone, a computer, a tablet computer and other terminal devices.
Although the present invention is disclosed above, the present invention is not limited thereto. Various changes and modifications may be effected therein by one skilled in the art without departing from the spirit and scope of the invention as defined in the appended claims.

Claims (10)

1. A method for determining an item of interest, comprising the steps of:
acquiring front video data of customers in a store;
extracting iris video data of the customer from the front video data of the customer;
when the sight of the customer stays for more than a preset time length, determining the watching direction and the watching angle of the customer according to the iris video data;
determining the commodity concerned by the customer according to the watching direction and the watching angle;
wherein determining the gaze direction and gaze angle of the customer based on the iris video data comprises: determining the diameter of the iris when the customer is looking forward according to the iris video data;
determining a current contour shape of the iris in the iris video data;
determining the gazing direction and the gazing angle of the customer according to the contour shape and the diameter of the iris;
wherein determining the gaze direction and gaze angle of the customer according to the contour shape and the diameter of the iris comprises:
according to the size of the outline shape in the horizontal direction and the diameter of the iris, the gazing direction of the customer is determined, and according to the size of the outline shape in the vertical direction and the diameter of the iris, the gazing angle of the customer is determined.
2. The method for determining a commodity of interest according to claim 1, wherein determining the gaze direction of the customer based on a ratio of a size of the outline shape in a horizontal direction to a diameter of the iris, and determining the gaze angle of the customer based on a ratio of a size of the outline shape in a vertical direction to the diameter of the iris comprises:
determining the ratio of the size of the outline shape in the horizontal direction to the diameter of the iris, and recording the ratio as a first ratio, and determining the ratio of the size of the outline shape in the vertical direction to the diameter of the iris, and recording the ratio as a second ratio;
determining the gazing direction of the customer according to the first proportion and the deviation direction of the iris from the in-eye position;
and determining the gazing angle of the customer according to the second proportion and the deviation direction of the iris from the position in the eye.
3. The method for determining a commodity of interest according to claim 1, further comprising:
and forming an attention commodity track curve of the customer according to the commodities which are sequentially concerned by the customer.
4. The method for determining a commodity of interest according to claim 1, further comprising:
confirming a plurality of commodities concerned by the customer and recording characteristic information of the commodities;
wherein the characteristic information is selected from one or more of: category, color, model, size.
5. An apparatus for determining an item of interest, comprising:
the acquisition module is suitable for acquiring front video data of customers in the store;
the extraction module is suitable for extracting iris video data of the customer from the front video data of the customer;
the direction and angle determining module is suitable for determining the gazing direction and the gazing angle of the customer according to the iris video data when the sight of the customer stays for more than a preset time length;
the commodity determining module is suitable for determining commodities concerned by the customer according to the watching direction and the watching angle;
wherein the direction angle determination module comprises:
a diameter determination sub-module adapted to determine a diameter of the iris at which the customer is looking forward based on the iris video data;
a contour shape determination sub-module adapted to determine a current contour shape of the iris in the iris video data;
a direction angle determination submodule adapted to determine a gazing direction and a gazing angle of the customer based on the contour shape and the diameter of the iris;
wherein the direction angle determination submodule includes:
the horizontal-vertical determination sub-module is suitable for determining the gazing direction of the customer according to the proportion of the size of the outline shape in the horizontal direction to the diameter of the iris, and determining the gazing angle of the customer according to the proportion of the size of the outline shape in the vertical direction to the diameter of the iris.
6. The apparatus for determining items of interest according to claim 5, wherein the horizontal-vertical determination submodule comprises:
a proportion determining unit, which is suitable for determining the proportion of the size of the outline shape in the horizontal direction to the diameter of the iris, and recording the proportion as a first proportion, and determining the proportion of the size of the outline shape in the vertical direction to the diameter of the iris, and recording the proportion as a second proportion;
a direction determination unit adapted to determine a gazing direction of the customer based on the first ratio and a direction of deviation of the iris from an in-eye position;
an angle determination unit adapted to determine the gaze angle of the customer based on the second ratio and a direction of deviation of the iris from an in-eye position.
7. The apparatus for determining an item of interest according to claim 5, further comprising:
and the curve determining module is suitable for forming an attention commodity track curve of the customer according to the commodities which are sequentially attended by the customer.
8. The apparatus for determining an item of interest according to claim 5, further comprising:
the recording module is suitable for confirming a plurality of commodities concerned by the customer and recording the characteristic information of the commodities;
wherein the characteristic information is selected from one or more of: category, color, model, size.
9. A storage medium having stored thereon computer instructions, wherein the computer instructions are operable to perform the steps of the method of determining items of interest according to any of claims 1 to 4.
10. A terminal comprising a memory and a processor, the memory having stored thereon computer instructions executable on the processor, wherein the processor, when executing the computer instructions, performs the steps of the method of determining items of interest according to any one of claims 1 to 4.
CN201810697527.2A 2018-06-29 2018-06-29 Method and device for determining concerned commodity, storage medium and terminal Expired - Fee Related CN108898102B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810697527.2A CN108898102B (en) 2018-06-29 2018-06-29 Method and device for determining concerned commodity, storage medium and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810697527.2A CN108898102B (en) 2018-06-29 2018-06-29 Method and device for determining concerned commodity, storage medium and terminal

Publications (2)

Publication Number Publication Date
CN108898102A CN108898102A (en) 2018-11-27
CN108898102B true CN108898102B (en) 2021-02-02

Family

ID=64347212

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810697527.2A Expired - Fee Related CN108898102B (en) 2018-06-29 2018-06-29 Method and device for determining concerned commodity, storage medium and terminal

Country Status (1)

Country Link
CN (1) CN108898102B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110335095A (en) * 2019-07-21 2019-10-15 韶关市启之信息技术有限公司 A kind of doll machine intelligent recommendation method and system
CN110378740A (en) * 2019-07-24 2019-10-25 秒针信息技术有限公司 A kind of monitoring method, monitoring device and readable storage medium storing program for executing for launching resource

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101639939A (en) * 2008-07-29 2010-02-03 株式会社日立制作所 Image information processing method and apparatus
CN104391574A (en) * 2014-11-14 2015-03-04 京东方科技集团股份有限公司 Sight processing method, sight processing system, terminal equipment and wearable equipment
CN106598221A (en) * 2016-11-17 2017-04-26 电子科技大学 Eye key point detection-based 3D sight line direction estimation method

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8503737B2 (en) * 2010-09-27 2013-08-06 Panasonic Corporation Visual line estimating apparatus
CN103300815B (en) * 2012-03-15 2015-05-13 凹凸电子(武汉)有限公司 Eyeball focus determination method, device and system
CN106056092B (en) * 2016-06-08 2019-08-20 华南理工大学 The gaze estimation method for headset equipment based on iris and pupil
CN106897426A (en) * 2017-02-27 2017-06-27 上海禹放信息科技有限公司 Specific data genaration system and method based on eyeball tracking technology
CN107249126A (en) * 2017-07-28 2017-10-13 华中科技大学 A kind of gazing direction of human eyes tracking suitable for free view-point 3 D video
CN107886410A (en) * 2017-11-29 2018-04-06 北京小米移动软件有限公司 The method, apparatus and storage medium of Products Show

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101639939A (en) * 2008-07-29 2010-02-03 株式会社日立制作所 Image information processing method and apparatus
CN104391574A (en) * 2014-11-14 2015-03-04 京东方科技集团股份有限公司 Sight processing method, sight processing system, terminal equipment and wearable equipment
CN106598221A (en) * 2016-11-17 2017-04-26 电子科技大学 Eye key point detection-based 3D sight line direction estimation method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于两次多项式拟合的人眼注视方向估计;张太宁 等;《光电子·激光》;20120731;第23卷(第7期);1389-1394 *

Also Published As

Publication number Publication date
CN108898102A (en) 2018-11-27

Similar Documents

Publication Publication Date Title
US9595098B2 (en) Image overlaying and comparison for inventory display auditing
US7643658B2 (en) Display arrangement including face detection
US10185869B2 (en) Filter and shutter based on image emotion content
US20160191995A1 (en) Image analysis for attendance query evaluation
US20140093164A1 (en) Video scene detection
US20190108551A1 (en) Method and apparatus for customer identification and tracking system
US20120140069A1 (en) Systems and methods for gathering viewership statistics and providing viewer-driven mass media content
CN111263224B (en) Video processing method and device and electronic equipment
CN108898102B (en) Method and device for determining concerned commodity, storage medium and terminal
US20130243332A1 (en) Method and System for Estimating an Object of Interest
JP6498900B2 (en) Advertisement evaluation system, advertisement evaluation method
TWI745653B (en) Customer behavior analyzing method and customer behavior analyzing system
CN113468914B (en) Method, device and equipment for determining purity of commodity
CN111666792A (en) Image recognition method, image acquisition and recognition method and commodity recognition method
CN108960999A (en) Consume recommended method and device, storage medium, terminal
CN111260685B (en) Video processing method and device and electronic equipment
US11615430B1 (en) Method and system for measuring in-store location effectiveness based on shopper response and behavior analysis
Wedel et al. Eye tracking methodology for research in consumer psychology
US20240086946A1 (en) Familiarity degree estimation apparatus, familiarity degree estimation method, and recording medium
JP6418270B2 (en) Information processing apparatus and information processing program
JP6480676B2 (en) Intake amount estimation device, intake amount estimation method and program
JP6428062B2 (en) Information processing apparatus and information processing program
CN111681018A (en) Customer behavior analysis method and customer behavior analysis system
CN110610358A (en) Commodity processing method and device and unmanned goods shelf system
Chen et al. Blinking: Toward wearable computing that understands your current task

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210202

Termination date: 20210629

CF01 Termination of patent right due to non-payment of annual fee