TWI748857B - System of product promotion using image tracking and method of the same - Google Patents

Abstract

A system of product promotion using image tracking and method of the same. The system and method are used on the product promotion system which includes a tracking device, a matching device and a terminal server, wherein the tracking device detects a position coordinates and a gaze duration of a user gazing at a content displayed on a screen. The matching device connects to the tracking device to receive the gaze duration and the position coordinates. When the matching device determines the gaze duration reaches a predetermined duration, the matching device outputs a matching result which includes a product promoting information based on the position coordinates and the content displayed on the screen. And the terminal server connects to the matching device to receive the matching result and then displays the product promoting information.

Description

Commodity promotion system and method based on image tracking

The present invention relates to a product promotion system and method based on image tracking, and more particularly to a product promotion system and method for user image tracking.

With the development of various communication media, the methods of product promotion are also changing with each passing day. In addition to traditional newspapers and magazines and TV advertisements, the common advertising methods nowadays also include algorithms on the Internet or social media based on user habits. Promote users individually, or set up advertising billboards or TV walls in commercial spaces such as banks and other financial institutions, and display advertising content on them, so that everyone in the space can become a potential purchaser Commodity customers promote products to customers who need to handle financial affairs in financial institutions in a more efficient manner.

The above-mentioned method of playing advertisements on billboards or TV walls is already a common publicity method. Although this method can simultaneously promote sales to multiple customers in the financial institution, for customers, if the advertising content meets the needs of customers , But because the clerk did not explain the customer, the customer’s understanding of the product was insufficient, so that the customer’s needs were not met; similarly, the advertisements shown on the TV wall are not necessarily the content that customers are interested in. The product is not interested, and the clerk promotes the advertised product to the customer one by one, which will cause trouble to the customer.

In view of the above, the present invention provides a product promotion system and method based on image tracking to meet the above needs.

A product promotion system based on image tracking according to an embodiment of the present invention is used to track a user and promote products to the user, including: a tracking device for detecting that the user in a tracking area has a single display A gaze period of continuous gaze of the display content and a position coordinate of the user, wherein the tracking device further includes: a light emitter for emitting a first infrared beam to an eyeball of the user, so as to be in the eyeball of the user A first spot is formed on the pupil, and a second spot is formed on the cornea of the eyeball; a camera for receiving a first reflected light reflected from the first spot, and a first reflected light from the second spot Two reflected light; an image processor, electrically connected to the camera to detect and record the first reflected light and the second reflected light, and according to the first reflected light and the second reflected light recorded by the image processor Obtaining an eyeball movement track, and obtaining the gaze period according to the eyeball movement track; and a position detector for emitting a second infrared beam to the user and detecting a third reflected light from the user, And calculate the position coordinate associated with the user according to a time difference between emitting the second infrared beam and detecting the third reflected light; a matching device communicatively connected to the tracking device to receive the gaze period and the position coordinate, When the matching device determines that the gaze period reaches a preset time, the matching device outputs a matching result including a product promotion information according to the position coordinates and the display content of the display; and an end server, which is communicatively connected to the matching device to Receive the matching result and display the product promotion information, where the end server is different from the display, and the product promotion information is associated with the display content of the display, wherein if the user is located in a predetermined area adjacent to the end server, then The end server displays the product promotion information. If the user is outside the predetermined area adjacent to the end server, the end server displays the product promotion information and the location coordinates.

A product promotion method based on image tracking according to an embodiment of the present invention is used to promote a product to a user, including: emitting a first infrared beam to an eyeball of the user to form a first eyeball on the pupil of the eyeball. A light spot, and a second light spot is formed on the cornea of the eyeball; a camera is used to detect a first reflected light reflected from the first light spot, and a second reflected light reflected from the second light spot; with an image The processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and obtains an eyeball movement track according to the eyeball movement track Gaze period; when it is determined that the eyeball movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period ; When the gaze period reaches the preset time, a position detector emits a second infrared beam to the user, and detects a third reflected light from the user, and emits the second infrared beam according to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the The product promotion information is on the end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and the product promotion information and an identity data of the user recorded on the end server Matches and records in a bank server.

A product promotion method based on image tracking according to an embodiment of the present invention is used to promote a product to a user, including: emitting a first infrared beam to an eyeball of the user to form a first eyeball on the pupil of the eyeball. A light spot, and a second light spot is formed on the cornea of the eyeball; a camera is used to detect a first reflected light reflected from the first light spot, and a second reflected light reflected from the second light spot; with an image The processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and obtains an eyeball movement track according to the eyeball movement track Gaze period; when it is determined that the eyeball movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period ; When the gaze period reaches the preset time, a position detector emits a second infrared beam to the user, and detects a third reflected light from the user, and emits the second infrared beam according to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the The product promotion information is on the end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and biometric identification is performed on the user to obtain a biometric identification result, based on the biological feature The feature identification result obtains an identity data of the user, matches the product promotion information and the identity data, and records the result on a bank server.

A product promotion method based on image tracking according to an embodiment of the present invention is used to promote a product to a user, including: emitting a first infrared beam to an eyeball of the user to form a first eyeball on the pupil of the eyeball. A light spot, and a second light spot is formed on the cornea of the eyeball; a camera is used to detect a first reflected light reflected from the first light spot, and a second reflected light reflected from the second light spot; with an image The processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and obtains an eyeball movement track according to the eyeball movement track Gaze period; when it is determined that the eyeball movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period ; When the gaze period reaches the preset time, a position detector emits a second infrared beam to the user, and detects a third reflected light from the user, and emits the second infrared beam according to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the The product promotion information is on the end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and the product promotion information and an identity data of the user recorded on the end server Match and record in a bank server, where if the user is located in a predetermined area adjacent to the end server, the product promotion information is output to the end server adjacent to the user, if the user is located adjacent to the end server Outside the predetermined area, the end server displays the product promotion information and the position coordinates.

A product promotion method based on image tracking according to an embodiment of the present invention is used to promote a product to a user, including: emitting a first infrared beam to an eyeball of the user to form a first eyeball on the pupil of the eyeball. A light spot, and a second light spot is formed on the cornea of the eyeball; a camera is used to detect a first reflected light reflected from the first light spot, and a second reflected light reflected from the second light spot; with an image The processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and obtains an eyeball movement track according to the eyeball movement track Gaze period; when it is determined that the eyeball movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period ; When the gaze period reaches the preset time, a position detector emits a second infrared beam to the user, and detects a third reflected light from the user, and emits the second infrared beam according to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the The product promotion information is on the end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and biometric identification is performed on the user to obtain a biometric identification result, based on the biological feature The feature identification result obtains an identity data of the user, matches the product promotion information and the identity data, and records it on a bank server. If the user is located in a predetermined area adjacent to the end server, the product promotion information is Output to the end server adjacent to the user. If the user is outside the predetermined area adjacent to the end server, the end server displays the product promotion information and the location coordinates.

The effect of the present invention is that the clerk in the bank can actively know the user’s interest in the advertisement or product and the location of the user, so that the clerk can explain the product to the user in a more personal way, which not only satisfies The possible consumer needs of customers can also prevent customers who are not interested in products from being promoted by clerks. According to one or more embodiments of the present invention, when the user is in a predetermined area in front of the counter, the related product information can only be transmitted to the end server adjacent to the predetermined area to avoid occupying the matching device and other end servers. The bandwidth between the

The above description of the disclosure and the following description of the implementation manners are used to demonstrate and explain the spirit and principle of the present invention, and to provide a further explanation of the patent application scope of the present invention.

The detailed features and advantages of the present invention will be described in detail in the following embodiments. The content is sufficient to enable anyone familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and in accordance with the content disclosed in this specification, the scope of patent application and the drawings Anyone who is familiar with relevant skills can easily understand the purpose and advantages of the present invention. The following examples further illustrate the viewpoints of the present invention in detail, but do not limit the scope of the present invention by any viewpoint.

Please refer to FIG. 1, which is a schematic diagram of a product promotion system based on image tracking according to an embodiment of the present invention. The embodiment of the present invention applied to a product promotion system based on image tracking includes a tracking device 1, a matching device 2, and an end server 3, which is suitable for tracking a user 4 and promoting products to the user 4, wherein the tracking device 1 is connected in communication The matching device 2 and the matching device 2 are connected to the end server 3 in communication.

Please continue to refer to FIG. 1, the tracking device 1 is used to detect a gaze period during which a user 4 in a tracking area A continuously gazes at a single display content of a display 10 and a position coordinate of the user 4. In more detail, in the tracking area A, in addition to detecting the position coordinates of the user 4, the tracking device 1 also detects the gaze of the user 4. During the time period, the display 10 is playing the same advertisement content, and the tracking device 1 outputs the gaze time period and position coordinates to the matching device 2.

Please refer to FIG. 1 and FIG. 2A together. FIG. 2A is a block diagram of a tracking device of a product promotion system based on image tracking according to an embodiment of the present invention. The tracking device 1 includes a light emitter 11, a camera 12, an image processor 13 and a position detector 14.

Please continue to refer to FIG. 1, FIG. 2A and FIG. 2B. FIG. 2B is a schematic diagram of detecting a gaze period in a product promotion system based on image tracking according to an embodiment of the present invention. The light transmitter 11 emits the first infrared light beam L1 to the eyeball E of the user 4, and forms a first spot on the pupil P and a second spot on the cornea C. The camera 12 is used to detect the first spot reflected from the first spot. A reflected light R1 and a second reflected light R2 reflected from the second spot. In other words, the light transmitter 11 is used to emit the first infrared light beam L1 to the eyeball E, and the camera 12 is used to receive the first reflected light R1 of the first infrared light beam L1 reflected by the pupil P and the first infrared light beam L1 reflected by the cornea C. The second reflected light R2 of the first light spot is the position where the pupil P reflects the first reflected light R1, and the second light spot is the position where the cornea C reflects the second reflected light R2.

Please continue to refer to FIGS. 2A and 2B. After the camera 12 detects the first reflected light R1 and the second reflected light R2, the image processor 13 electrically connected to the camera 12 receives and records the first reflected light R1 and the second reflected light. The light R2 obtains the eyeball movement track according to the recorded first reflected light R1 and the second reflected light R2, and obtains the gaze period according to the eyeball movement track. In more detail, the image processor 13 records the phase/angle offsets of the first reflected light R1 and the second reflected light R2 at intervals of one hour to obtain the eyeball movement trajectory, and obtains the single eyeball E to the display according to the eyeball movement trajectory Shows the gaze period during which the content continues to be gaze at. The integration of the light emitter 11, the camera 12 and the image processor 13 included in the tracking device 1 is, for example, an eye tracking device, or other devices with Pupil-Center Corneal Reflection (PCCR) technology. However, the present invention is not limited to this.

Please refer to FIG. 1 and FIG. 2C together. FIG. 2C is a schematic diagram of detecting a user's location coordinates in a product promotion system based on image tracking according to an embodiment of the present invention. In addition to the tracking device 1 used to detect the gaze period during which the user 4 in the tracking area A continues to look at the single display content of the display 10, the tracking device 1 is also used to detect the position coordinates of the user 4 in the tracking area A . In more detail, the tracking device 1 includes a position detector 14. The position detector 14 emits a second infrared beam L2 to the user 4 and detects the third reflected light R3 reflected by the user 4, wherein the position detector 14 There is a time difference between the emission of the second infrared beam L2 and the detection of the third reflected light R3. The position detector 14 calculates the distance between the position detector 14 and the user 4 according to the time difference to obtain the user 4 and A depth distance d between the tracking devices 1. Wherein, the position detector 14 may be a depth camera or other cameras with Time of Flight (ToF) technology, but the present invention is not limited to this.

Please continue to refer to FIG. 2C. After the position detector 14 of the tracking device 1 obtains the depth distance d between the user 4 and the tracking device 1, the depth distance d is respectively projected onto a boundary (X axis) and phase of the tracking area A. Adjacent to the other boundary (Y-axis) to get the position coordinates associated with the user 4.

Please continue to refer to FIG. 1. After the matching device 2 receives the gaze period output by the tracking device 1, the matching device 2 determines whether the gaze period has reached a preset time. If the matching device 2 determines that the gaze period has not reached the preset time, the tracking device 1 restarts Detect another gaze period of user 4 and update the position coordinates of user 4; if the matching device 2 determines that the gaze period reaches the preset time, the output of the matching device 2 according to the position coordinates of the user 4 and the display content of the display 10 includes a product promotion A matching result of the information. In other words, if the gaze period has not reached the preset time, the matching device 2 determines that the user 4 is not interested in the advertisement content displayed on the display 10, and the tracking device 1 re-detects another gaze period of the user 4 and updates its position coordinates; if The gaze period reaches the preset time, and the matching device 2 determines that the user 4 is interested in the advertisement content displayed on the display 10, then the matching device 2 outputs the matching result to the end server 3, where the matching result includes a product promotion information, and the matching result can also be selected The sex includes the position coordinates of the user 4, which means that the matching device 2 matches the position coordinates of the user 4 and the advertisement content of interest and outputs the matching result. Wherein, the matching device 2 may be a server inside the bank, etc., but the present invention is not limited to this.

The aforementioned matching result may optionally include the location coordinates of the user 4, which is determined based on the location of the user 4 in the tracking area A. In more detail, if the user 4 is in a predetermined area A'adjacent to the end server 3, the end server 3 only displays product promotion information, which means that if the user 4 is in the predetermined area A'close to the end server 3, it means The user 4 has already handled the business in front of the service counter, and the matching device 2 only needs to output the product promotion information to the end server 3 for the clerk who serves the user 4 at the counter to promote the product to the user 4. However, if the user 4 is outside the predetermined area A'of all the end servers 3, it means that the user 4 is not located at the service counter to handle the affairs, then the matching device 2 outputs the product promotion information and the location coordinates of the user 4 to at least one end server 3. The clerk can know the location of the user 4 and the products that he is interested in, so that the clerk can actively go to the location of the user 4 and promote the products to him, or promote the products to the user 4 when he goes to the counter to handle affairs. Wherein, the aforementioned end server 3 may be a device with a display such as a fixed computer or a portable computer, but the present invention is not limited to this.

Please refer to FIG. 3, which is a flowchart of a product promotion method based on image tracking according to an embodiment of the present invention. In the product promotion method, in step S01, the light emitter 11 of the tracking device 1 emits the first infrared light beam L1 to the eyeball E of the user 4 to form a first spot on the pupil P of the eyeball E, and on the cornea C of the eyeball E A second spot is formed on it. After the light emitter 11 emits the first infrared light beam L1 to the eyeball E, the camera 12 of the tracking device 1 detects the first reflected light R1 reflected from the first spot and the second reflected light reflected from the second spot in step S02 R2.

Please continue to refer to FIG. 3, after the camera 12 detects the first reflected light R1 and the second reflected light R2, the image processor 13 electrically connected to the camera 12 receives and records the first reflected light R1 and the first reflected light R1 and the second reflected light R2 in step S03. The second reflected light R2 is followed in step S04 to obtain the eyeball movement track according to the first reflected light R1 and the second reflected light R2 recorded by the image processor 13. In more detail, the image processor 13 obtains the eyeball movement trajectory according to the phase/angle offset of the first reflected light R1 and the second reflected light R2, and obtains the eyeball E paired with the display according to the eyeball movement trajectory in step S05. The gaze period during which the content of the display continues to be gaze at.

Please continue to refer to FIG. 3, after the matching device 2 receives the gaze period detected by the tracking device 1 in step S05, the matching device 2 compares the gaze period with a preset time in step S06, and if the gaze period reaches the preset time, the tracking The position detector 14 of the device 1 emits the second infrared light beam L2 to the user 4 in step S07, and detects the third reflected light R3 reflected from the user 4. The position detector 14 further emits the second infrared light beam L2 according to the step S08 The time difference between the infrared light beam L2 and the detection of the third reflected light R3 calculates the position coordinates associated with the user; if the gaze period does not reach the preset time, the tracking device 1 re-executes step S01 to re-emit the first infrared light L1 Go to the eyeball E of the user 4 to detect another first reflected light and another second reflected light. In other words, when the gaze period reaches the preset time and it is determined that the user 4 is interested in the advertisement content displayed on the display 10, the tracking device 1 further detects the position coordinates of the user 4 in step S07 and step S08; when the gaze period has not reached the preset time Assuming time, it is determined that the user 4 is not interested in the advertisement content displayed on the display 10, and the tracking device 1 executes step S01 again.

Please continue to refer to FIG. 3, after step S08 is performed and the tracking device 2 detects the location coordinates of the user 4, the matching device 2 matches the location coordinates of the user 4 and the display content of the display 10 in step S09, and outputs in step S10 Match results. In more detail, after detecting the location of the user 4 in the tracking area A, the matching device 2 matches the location coordinates of the user 4 with the advertisement content that the user 4 is interested in, and based on the location coordinates and the display content of the display 10. Output matching results containing product promotion information. The above matching result may include location coordinates in addition to product promotion information.

Please continue to refer to Figure 3. After outputting the matching result in step S10, the end server 3 receives the matching result and displays the product promotion information in step S11. If the user 4 is in a predetermined area A'adjacent to the end server 3, the product promotion information is output To the end server 3 adjacent to the user 4. In other words, in this case, the user 4 has already done business at the service counter, and the matching device 2 only needs to output product promotion information to the end server 3 for the clerk who serves the user 4 at the counter to promote the product to the user 4. However, if the user 4 is outside the predetermined area A'adjacent to the end server 3, the end server 3 displays product promotion information and location coordinates, indicating that the user 4 is not at the service counter to handle affairs, and the matching device 2 outputs the product promotion information and The location coordinates of the user 4 are sent to the end server 3, so that the clerk can know the location of the user 4 and the products of interest, so that the clerk can take the initiative to go to the location of the user 4 and promote the products to him. In the above operation, when there are multiple end servers 3, if the user 4 is in the predetermined area A'adjacent to one of the end servers 3, the product promotion information will be output to the end server 3; and if the user 4 Located outside the predetermined area A'of all end servers 3, the product promotion information and position coordinates will be transmitted to all end servers 3, or to the end server 3 closest to this coordinate position.

Please refer to FIG. 4, which is a flowchart of a product promotion method based on image tracking according to another embodiment of the present invention. Steps S01-S11 of FIG. 4 are the same as those of FIG. 3, so they will not be repeated here. However, the difference between FIG. 4 and FIG. 3 is that after step S11 displays the product promotion information, the flowchart of the embodiment of FIG. 4 is more matched with step S12 Commodity promotion information and identity information. In more detail, after the end server 3 receives the product promotion information, the end server 3 matches the product promotion information with the user 4’s identity data and records it on the bank’s server for the bank staff to use mobile phone text messages, paper letters or Promote the product to user 4 in other ways such as email.

Furthermore, the aforementioned identity data of the user 4 can be obtained from the record of the end server 3, which means that the identity data of the user 4 input into the end server 3 when the transaction is processed. In addition, the product promotion method of the present invention can also perform biometric identification of user 4 to obtain a biometric identification result, and refer to user 4 data stored in a bank server or other memory device according to the biometric identification result of user 4 to obtain Identity information. Wherein, the above-mentioned biometric identification result can be obtained by biometric identification methods such as facial recognition, voiceprint, fingerprint, etc.

In summary, the product promotion system and method based on image tracking disclosed in the present invention detect the continuous gaze period of a single display content of the display by the user and the user's position coordinates, and compare the gaze period and the preset time To determine whether the customer is interested in the display content of the display, when the gaze period reaches the preset time, which means that the user may be interested in the display content, the matching device will match the user's position coordinates with the display content of the display and output the matching As a result, the system then sends the matching result containing the product promotion information to the end server to notify the clerk, so that the clerk can further explain the products that he is interested in to the customer. According to the product promotion system and method based on image tracking disclosed in the present invention, in addition to judging whether the user is interested in the product promoted by the advertisement, it can also let the traveller know the location of the user in real time to explain to the user about the product. , And if the customer is not interested in the product, it will not be promoted by the clerk. In addition, the product promotion system and method based on image tracking disclosed in the present invention can also match and record the customer's identity data and the display content of the display on the bank server, and then use other methods such as mobile phone text messages, paper letters or emails to check The customer promotes the advertised product.

The effect of the present invention is that the clerk in the bank can actively know the user’s interest in the advertisement or product and the location of the user, so that the clerk can explain the product to the user in a more personal way, which not only satisfies The possible consumer needs of customers can also prevent customers who are not interested in products from being promoted by clerks.

According to one or more embodiments of the present invention, when the user is in a predetermined area in front of the counter, the related product information can only be transmitted to the end server adjacent to the predetermined area to avoid occupying the matching device and other end servers. The bandwidth between the

The present invention takes the operating mode in the bank as an example. However, the product promotion system and method based on image tracking disclosed in the present invention can also be used in other spaces, such as supermarkets, shopping malls, or department stores that have displays or advertisements that display advertisements. In the commercial space of the wall, the present invention is not limited to financial institutions.

Although the present invention is disclosed as above in the foregoing embodiments, it is not intended to limit the present invention. All changes and modifications made without departing from the spirit and scope of the present invention fall within the scope of the patent protection of the present invention. For the scope of protection defined by the present invention, please refer to the attached patent scope.

1: tracking device 2: matching device 3: End server 4: user 10: display 11: Light transmitter 12: Camera 13: image processor 14: position detector A: Tracking area A’: Reservation area d: depth distance C: cornea E: Eyeball P: pupil L1: First infrared beam L2: Second infrared beam R1: first reflected light R2: second reflected light R3: third reflected light X: X axis Y: Y axis

FIG. 1 is a schematic diagram of a product promotion system based on image tracking according to an embodiment of the present invention. 2A is a block diagram of a tracking device of a commodity promotion system based on image tracking according to an embodiment of the present invention. FIG. 2B is a schematic diagram of detecting a gaze period in a commodity promotion system based on image tracking according to an embodiment of the present invention. 2C is a schematic diagram of detecting the location coordinates of a user in a product promotion system based on image tracking according to an embodiment of the present invention. FIG. 3 is a flowchart of a method for product promotion based on image tracking according to an embodiment of the present invention. FIG. 4 is a flow chart of a method for product promotion based on image tracking according to another embodiment of the present invention.

1: tracking device

2: matching device

3: End server

4: user

10: display

A: Tracking area

A’: Reservation area

Claims (6)

A product promotion system based on image tracking, used to track a user and promote products to the user, includes: a tracking device for detecting that the user in a tracking area continuously looks at a single display content of a display A gaze period and a position coordinate of the user, wherein the tracking device further includes: a light emitter for emitting a first infrared beam to an eyeball of the user to form a first spot on the pupil of the eyeball , And forming a second spot on the cornea of the eyeball; a camera for receiving a first reflected light reflected from the first spot, and a second reflected light reflected from the second spot; an image processing A device electrically connected to the camera to detect and record the first reflected light and the second reflected light, and obtain an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and Obtain the gaze period according to the eyeball movement track; and a position detector for emitting a second infrared beam to the user, and detecting a third reflected light from the user, and emitting the second infrared ray according to A time difference between the light beam and the detection of the third reflected light to calculate the position coordinate related to the user; A matching device is communicatively connected to the tracking device to receive the gaze period and the position coordinate. When the matching device determines that the gaze period reaches a preset time, the matching device outputs according to the position coordinate and the display content of the display including a A matching result of product promotion information; and an end server communicatively connected to the matching device to receive the matching result and display the product promotion information, wherein the end server is different from the display, and the product promotion information is associated with the display Display content, where if the user is located in a predetermined area adjacent to the end server, the end server displays the product promotion information; if the user is located outside the predetermined area adjacent to the end server, the end server displays the Product promotion information and the coordinates of the location. A product promotion method based on image tracking, used to promote a product to a user, includes: emitting a first infrared light beam to an eyeball of the user to form a first spot on the pupil of the eyeball, and A second light spot is formed on the cornea; a camera is used to detect a first reflected light reflected from the first light spot and a second reflected light reflected from the second light spot; An image processor receives and records the first reflected light and the second reflected light, and obtains an eyeball movement track according to the first reflected light and the second reflected light recorded by the image processor, and according to the eyeball movement The trajectory obtains a gaze period; when it is determined that the eyeball movement trajectory is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another A gaze period; when the gaze period reaches the preset time, a second infrared beam is emitted to the user with a position detector, and a third reflected light reflected from the user is detected, and the first reflected light is emitted according to A time difference between the two infrared light beams and the detection of the third reflected light calculates a position coordinate related to the user; matches the position coordinate with the display content of the display and outputs a matching result containing a product promotion information ; Display the product promotion information on an end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and the product promotion information and the user’s information recorded on the end server An identity data is matched and recorded on a bank server. The product promotion method based on image tracking according to claim 2, wherein the method further includes performing biometric identification on the user to obtain a biometric identification result, and obtaining the identity information of the user according to the biometric identification result. A product promotion method based on image tracking, used to promote a product to a user, includes: emitting a first infrared light beam to an eyeball of the user to form a first spot on the pupil of the eyeball, and A second light spot is formed on the cornea; a camera is used to detect a first reflected light reflected from the first light spot and a second reflected light reflected from the second light spot; an image processor is used to receive and record the first reflected light A reflected light and the second reflected light, and obtain an eyeball movement trajectory according to the first reflected light and the second reflected light recorded by the image processor, and obtain a gaze period according to the eyeball movement trajectory; when judging the eyeball When the movement track is concentrated on a single display of a display, compare the gaze period with a preset time; when the gaze period does not reach the preset time, re-detect another gaze period; When the gaze period reaches the preset time, a second infrared beam is emitted to the user with a position detector, and a third reflected light reflected from the user is detected, and the second infrared beam is emitted to A time difference between detecting the third reflected light and calculating a position coordinate related to the user; matching the position coordinate and the display content of the display and outputting a matching result containing a product promotion information; displaying the product The promotion information is in an end server, where the end server is different from the display, and the product promotion information is associated with the display content of the display; and biometric identification is performed on the user to obtain a biometric identification result, based on the biometric feature The identification result obtains an identity data of the user, matches the product promotion information and the identity data, and records them on a bank server. A product promotion method based on image tracking, used to promote a product to a user, includes: emitting a first infrared light beam to an eyeball of the user to form a first spot on the pupil of the eyeball, and A second spot is formed on the cornea; A camera is used to detect a first reflected light reflected from the first spot and a second reflected light reflected from the second spot; an image processor is used to receive and record the first reflected light and the second reflection Light, and obtain an eyeball movement track based on the first reflected light and the second reflected light recorded by the image processor, and obtain a fixation period based on the eyeball movement track; when it is determined that the eyeball movement track is concentrated on a single display When the content of the gaze is displayed, compare the gaze period with a preset time; when the gaze period has not reached the preset time, re-detect another gaze period; when the gaze period reaches the preset time, take a position The detector emits a second infrared beam to the user, detects a third reflected light from the user, and calculates based on a time difference between when the second infrared beam is emitted and the third reflected light is detected Output a position coordinate associated with the user; match the position coordinate and the display content of the display and output a matching result containing a product promotion information; display the product promotion information on an end server, wherein the end server is different from the end server A display, and the product promotion information is associated with the display content of the display; and Match the product promotion information with the user’s identity data recorded on the end server and record it on a bank server, wherein if the user is located in a predetermined area adjacent to the end server, the product promotion information is output to If the end server adjacent to the user is outside the predetermined area adjacent to the end server, the end server displays the product promotion information and the location coordinates. A product promotion method based on image tracking, used to promote a product to a user, includes: emitting a first infrared light beam to an eyeball of the user to form a first spot on the pupil of the eyeball, and A second light spot is formed on the cornea; a camera is used to detect a first reflected light reflected from the first light spot and a second reflected light reflected from the second light spot; an image processor is used to receive and record the first reflected light A reflected light and the second reflected light, and obtain an eyeball movement trajectory according to the first reflected light and the second reflected light recorded by the image processor, and obtain a gaze period according to the eyeball movement trajectory; when judging the eyeball When the movement track is concentrated on a single display of a display, compare the gaze period and a preset time; When the gaze period has not reached the preset time, another gaze period is detected again; when the gaze period reaches the preset time, a second infrared beam is emitted to the user with a position detector and detected A third reflected light is reflected from the user, and a position coordinate related to the user is calculated according to a time difference between the second infrared beam is emitted and the third reflected light is detected; the position coordinate and the Display the display content of the display and output a matching result containing a product promotion information; display the product promotion information on an end server, wherein the end server is different from the display, and the product promotion information is associated with the display content of the display; And perform biometric identification on the user to obtain a biometric identification result, obtain an identity data of the user according to the biometric identification result, match the product promotion information and the identity data and record them on a bank server, wherein If the user is located in a predetermined area adjacent to the end server, the product promotion information is output to the end server adjacent to the user, and if the user is located outside the predetermined area adjacent to the end server, the end server displays The product promotion information and the location coordinates.

Images