TWI659366B - Method and electronic device for playing advertisements based on facial features - Google Patents

Abstract

The present invention provides a method for playing advertisements based on facial features, which is used in an electronic device, including: capturing an image of a viewer's face by an image capturing device; analyzing the facial features of the facial image to Identify the ethnic group to which the viewer belongs, select a specific advertisement corresponding to the ethnic group from the advertisements, and play the specific advertisement through a display; when the facial features of the viewer watching the specific advertisement change, determine the above Whether the facial feature belongs to a positive emotion; and when determining that the facial feature belongs to a positive emotion, an exclusive link corresponding to the specific advertisement is generated and transmitted to the display to display the exclusive link. The invention further includes an electronic device for playing advertisements based on facial features.

Description

Method and electronic device for playing advertisement based on facial features

The invention relates to a method and an electronic device for playing advertisements based on facial features.

Some malls have electronic signboards to provide advertisements to their consumers. For example, electronic interactive signage can automatically play advertisements when a consumer enters a location. As a more specific example, when a consumer approaches a mall door, the electronic signage may play an advertisement to the consumer. However, uncategorized ads are widely broadcast and most of them may be of little or no value to consumers.

Therefore, a method for playing advertisements based on facial features and an electronic device are used to dynamically grasp consumers' likes and dislikes of advertisements displayed on an electronic signboard, thereby inserting marketing activities and enabling advertisers to send coupons or promotions to these consumers.

The content of the following invention is exemplary and is not intended to be limiting in any way. In addition to the described aspects, embodiments, and features, other aspects, embodiments, and features will also be apparent by reference to the drawings and the following specific embodiments. That is, the contents of the following inventions are provided to introduce concepts, important points, benefits, and novel and non-obvious technical advantages described herein. Selected, not owned, implemented Examples will be described in further detail below. Therefore, the content of the following invention is not intended to be an essential feature of the claimed subject matter, nor is it intended to determine the scope of the claimed subject matter for use.

The invention provides a method and an electronic device for playing advertisements based on facial features.

The invention provides an electronic device for playing advertisements based on facial features, including: a display for playing a plurality of advertisements; an image capturing device for capturing an image of a viewer's face; and a processor coupled to the foregoing The image capturing device and the display receive the facial image and analyze the facial characteristics of the facial image to identify the group to which the viewer belongs, select a specific advertisement corresponding to the group from the advertisement, and transmit the specific advertisement Advertising to the display to play the specific advertisement; when the facial feature of the viewer watching the specific advertisement changes, the processor determines whether the facial feature belongs to a positive emotion; and when the processor determines the face When some of the features are positive emotions, the processor generates an exclusive link corresponding to the specific advertisement and sends it to the display to display the exclusive link.

In some embodiments, the exclusive link is a Quick Response Code (QR code) for providing the viewer to view or use the related webpage or coupon for the specific advertisement.

In some embodiments, the ethnic group is distinguished according to the gender and age of the viewer.

In some embodiments, when the processor determines that the facial feature is the positive emotion, the processor records the ethnic group and the positive emotion of the viewer.

In some embodiments, when the processor determines that the facial features belong to a negative emotion, the processor records the ethnic group and the negative emotion of the viewer, and switches to another advertisement different from the specific advertisement.

In some embodiments, the above-mentioned positive emotion is an emotion determined by the processor as any one of the following combinations: excitement, happiness, joy, relaxation, tranquility, and calmness.

In some embodiments, the negative emotion is an emotion determined by the processor as any one of the following combinations: distressed, angry, nervous, sad, bored, and sleepy.

In some embodiments, the processor further records a viewing information of the viewer, and the viewing information includes a time, a place, a browsing history, and a staying time of the viewer watching the advertisement.

In some embodiments, when the image capturing device does not capture any facial images, the processor sends an instruction signal to the display to instruct the display to randomly play the advertisement.

The present invention provides a method for playing advertisements based on facial features, which is used in an electronic device, including: capturing an image of a viewer's face by an image capturing device; analyzing the facial features of the facial image to Identify the ethnic group to which the viewer belongs, select a specific advertisement corresponding to the ethnic group from the advertisements, and play the specific advertisement through a display; when the facial features of the viewer watching the specific advertisement change, determine the above Whether the facial feature belongs to a positive emotion; and when determining that the facial feature belongs to a positive emotion, an exclusive link corresponding to the specific advertisement is generated and transmitted to the display to display the exclusive link.

100‧‧‧ system

110‧‧‧Electronic device

112‧‧‧Image capture device

114‧‧‧ Display

120‧‧‧ Management Server

130‧‧‧ viewers

150‧‧‧Internet

200‧‧‧ Method

S205, S210, S215, S220, S225, S230‧‧‧ steps

300‧‧‧ Computing Device

310‧‧‧Bus

312‧‧‧Memory

314‧‧‧Processor

316‧‧‧Display element

318‧‧‧I / O port

320‧‧‧I / O components

322‧‧‧ Power Supply

The drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this invention. The drawings illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. It can be understood that the accompanying drawings are not necessarily drawn to scale, and some elements may be shown beyond the size of an actual embodiment to clearly illustrate the concept of the present invention.

FIG. 1 is an exemplary diagram showing a system for playing advertisements according to an embodiment of the present invention.

FIG. 2 is a flowchart illustrating a method for playing an advertisement according to an embodiment of the present invention.

FIG. 3 shows an exemplary operating environment for implementing an embodiment of the present invention.

Hereinafter, aspects of the present invention will be described more fully with reference to the accompanying drawings. The invention may, however, be embodied in many different forms and should not be construed as limited to any particular structure or function presented throughout the invention. Rather, these aspects are provided so that this invention will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Based on the teachings herein, one skilled in the art will appreciate that the scope of the invention is intended to cover any aspect disclosed herein, whether alone or in combination with any other aspect of the invention. For example, it can be implemented using any number of devices or execution methods proposed herein. In addition, in addition to the various aspects of the invention presented herein, the scope of the invention is more intended to encompass devices or methods implemented using other structures, functions, or structures and functions. It should be understood that any aspect disclosed herein may be embodied by one or more elements within the scope of the patent application.

The word "exemplary" is used herein to mean "serving as an example, instance, or illustration." Any aspect of the invention or a design described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other aspects of the invention or design. In addition, the same number indicates the same element in all several illustrations, and the articles "a" and "the above" include plural references unless otherwise specified in the description.

It will be understood that when an element is referred to as being "connected" or "coupled" to another element, the foregoing element may be directly connected or coupled to the other element or intervening elements may be present. In contrast, when an element is referred to as being "directly connected" or "directly coupled" to another element, there are no intervening elements present. Other words used to describe the relationship between elements should be interpreted in a similar manner (for example, "between" and "directly between", "adjacent" and "directly adjacent", etc.).

FIG. 1 is an exemplary diagram showing a system 100 for playing advertisements according to an embodiment of the present invention. In this embodiment, the system 100 may include an electronic device 110, a management server 120, and a network 150. The management server 120 may be connected to the electronic device 110 through a network 150. The network 150 may be any type of network familiar to those skilled in the art, and may use any of various protocols available on the communication to support data communication. , Including but not limited to TCP / IP and so on. For example, the network 150 may be a local area network (LAN), such as Ethernet, etc., a virtual network, including but not limited to a virtual private network (Virtual Private Network, VPN), the Internet, wireless networks, and / or any combination of these and / or other networks.

The management server 120 may be or include any database capable of storing and / or providing access to information, such as an electronic database, a computer and / or a computerized server, a database server or generally capable of storing data and connecting to Any type of data network Web host. The management server 120 may store a plurality of related information such as advertisements provided by an advertiser in a database. In addition, the management server 120 can also train a facial feature recognition model.

To explain in more detail, the advertiser may input a plurality of facial images for training to the management server 120 in advance. The management server 120 trains a facial feature recognition model based on a neural network model to identify facial features in a plurality of facial images, wherein the facial features include gender, age, and emotion. Emotions can include positive emotions and negative emotions. Among them, positive emotions are one of excitement, happiness, joy, relaxation, tranquility, and calmness. Negative emotions are one of distress, anger, tension, sadness, boredom, and sleepiness. One. Neural networks can be implemented in C ++, Visual Basic, or other object-oriented programming languages suitable for this purpose. As used herein, the term "training" is used to identify objects used to train a recognition model. Therefore, the training image refers to an image used to train a recognition model. Moreover, the training image may include a classification corresponding to a target image. After the management server 120 has trained the facial feature recognition model, the management server 120 can send the facial feature recognition model to the electronic device 110, and the power supply device 110 recognizes the facial image.

The electronic device 110 may be an electronic signboard and is disposed in a public place, and may receive advertisements and facial feature recognition models transmitted by the management server 120. The electronic device 110 may include a processor (not shown), an image capturing device 112 and a display 114. The image capturing device 112 is configured to capture a facial image of a viewer 130. The image capturing device 112 can be any commercially available image capturing device or device, such as a video camera / camera. In addition, the image capturing device 112 can aim at a fixed position, or can move and shoot a certain range of positions. In addition, the image capturing device 112 can also enlarge and reduce the image.

The display 114 may be implemented as a flat panel display, such as a liquid crystal display (LCD), a field emission display (FED), a plasma display panel (PDP), and an organic light emitting diode (Organic Light Emitting Diode (OLED) display. Although the embodiment of the present invention is described using a liquid crystal display as an example, other displays may be used. In this embodiment, the display 114 is used to display information such as animations, images, advertisements, etc., to attract viewers and generate interaction.

The processor of the electronic device 110 is coupled to the image capturing device 112 and the display 114. The processor may receive the facial image captured by the image capturing device 112 and manage the facial feature recognition model sent by the server 120 to analyze the facial features of the facial image to identify the ethnic group to which the viewer belongs.

The ethnic group to which the viewer belongs may be assigned in advance by the advertiser, wherein the above ethnic group is distinguished according to the gender and age of the viewer. Table 1 shows the ethnic groups classified according to the sex and age of the viewers.

As shown in Table 1, viewers can be classified into one of the above-mentioned groups A ~ J. The advertisements can also be classified by the management server 120 or the electronic device 110 according to the groups. The processor of the electronic device 110 may select a specific advertisement corresponding to the group from all the advertisements according to the group, and send the specific advertisement to the display to play the specific advertisement. For example, shampoo ads and mobile ads are classified into ethnic groups A and B. When the processor of the electronic device 110 recognizes that the viewer belongs to the group A, the processor selects an advertisement, such as a shampoo advertisement, from the advertisement (shampoo advertisement and mobile phone advertisement) corresponding to the group A, and transmits the shampoo Advertisements are displayed on the display.

In one embodiment, when the facial features of a viewer watching the specific advertisement changes, the processor of the electronic device 110 determines whether the facial features belong to a positive emotion. When the processor determines that the facial features are positive emotions, it generates an exclusive link corresponding to the specific advertisement and sends it to the display to display the exclusive link. The exclusive link is a Quick Response Code (QR code). , Light code, or web address to provide the above viewers with the ability to view or use relevant webpages or coupons for specific advertisements. In addition, the processor can further record the aforementioned ethnic groups and the aforementioned positive emotions of the viewer. When the processor judges that the facial feature belongs to a negative emotion, it records the ethnic group and negative emotion of the viewer, and switches to another advertisement corresponding to the ethnic group but different from the specific advertisement. In an embodiment, the processor may record the above-mentioned ethnic group and emotion of the viewer after recording the above-mentioned ethnic group and emotion of the viewer. The information such as the thread and the exclusive link are fed back to the management server 120.

In one embodiment, when the image capturing device 112 does not capture any facial images, the processor of the electronic device 110 sends an instruction signal to the display 114 to instruct the display 114 to randomly play advertisements. In another embodiment, the processor of the electronic device 110 further records a viewing information of the viewer and returns the viewing information to the management server 120. The viewing information may include a time, a place, and a browsing history of the viewer watching the advertisement And stay time. The management server 120 may adjust the facial feature recognition model or reclassify advertisements to the corresponding ethnic groups according to the viewing information, the above-mentioned ethnic groups and emotions of the viewers, so as to enhance the effectiveness of playing advertisements. In another embodiment, the management server 120 may further generate a statistical report according to the viewing information, the above-mentioned ethnic groups and emotions of the viewer, and the exclusive link, and check whether the viewer uses the exclusive link. In the report.

In addition, the advertiser can also download and install its own application developed by the management server 120 through a terminal device (not shown) (for convenience of understanding, hereafter referred to as -APP). The management server 120 can send viewing information or statistical reports to the terminal device, so that the advertiser can know the relevant information such as the viewer watching the advertisement in real time. The terminal device may be a computer or a mobile device, such as a notebook computer, a smart phone, or a tablet computer, which may be capable of running application programs.

It should be understood that each element shown in FIG. 1 may be implemented via any type of computing device, such as the computing device 300 described with reference to FIG. 3, as shown in FIG. 3.

FIG. 2 is a flowchart illustrating a method 200 for playing advertisements according to an embodiment of the present invention. This method can be used in a device, for example, implemented in the electronic device 110 as shown in FIG.

In step S205, the electronic device captures a face image of a viewer through an image capturing device. Next, in step S210, the electronic device analyzes the facial features of the facial image to identify the ethnic group to which the viewer belongs, and selects a specific advertisement corresponding to the ethnic group from the advertisements. In step S215, the electronic device plays the specific advertisement through a display, and detects whether a facial feature of a viewer who watches the specific advertisement changes.

When the facial features of a viewer who watches the specific advertisement changes, in step S220, the electronic device determines whether the facial features of the viewer belong to a positive emotion. When the electronic device judges that the facial feature belongs to a positive emotion (YES in step S220), in step S225, the electronic device generates an exclusive link corresponding to the specific advertisement and sends it to the display to display the exclusive link. When the electronic device judges that the facial features belong to negative emotions (NO in step S220), in step S230, the ethnic group and the negative emotions of the viewer are recorded, and switched to the corresponding ethnic group but the same as the aforementioned A specific ad is not the same as another ad.

The method and the electronic device for playing advertisements of the present invention are based on age, gender, and emotion information obtained based on facial recognition technology as a basis for selecting advertisements, and can record viewers' emotions of watching advertisements and feed them back to the management server. The management server can adaptively adjust the facial feature recognition model or reclassify the advertisement to the corresponding ethnic group through the above feedback to give the viewer or the customer a better experience.

For the embodiments of the invention that have been described, an exemplary operating environment in which the embodiments of the invention can be implemented is described below. Referring specifically to FIG. 3, FIG. 3 shows an exemplary operating environment for implementing the embodiments of the present invention, and can generally be regarded as a computing device 300. The computing device 300 is an example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. The computing device 300 should also not be solved It is construed as having any dependency or requirement relating to any or combination of the elements shown.

The present invention can be executed in computer code or machine using instructions. The instructions can be computer-executable instructions of a program module which is executed by a computer or other machine, such as a personal digital assistant or other portable device. . Generally speaking, program modules include routines, programs, objects, components, data structures, etc. Program modules refer to code that performs specific tasks or implements specific abstract data types. The invention can be implemented in various system configurations, including portable devices, consumer electronics, general-purpose computers, more professional computing devices, and the like. The invention can also be implemented in a decentralized computing environment to process devices connected by a communication network.

Refer to Figure 3. The computing device 300 includes a bus 310, a memory 312, one or more processors 314, one or more display elements 316, an input / output (I / O) port 318, an input / Output (I / O) element 320 and an illustrative power supply 322. The bus 310 represents a component that can be one or more buses (eg, an address bus, a data bus, or a combination thereof). Although the blocks in FIG. 3 are shown by lines for the sake of brevity, in fact, the boundaries of the various elements are not specific. For example, the presentation element of a display device can be regarded as an I / O element; the processor can have memory. .

The computing device 300 generally includes various computer-readable media. The computer-readable media can be any available media that can be accessed by the computing device 300, and the media includes both volatile and non-volatile media, removable and non-removable media. By way of example and not limitation, computer-readable media may include computer storage media and communication media. Computer-readable media includes both volatile and non-volatile media implemented in any method or technology used to store information such as computer-readable instructions, data structures, program modules or other data, Removable and non-removable media. Electricity Brain storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage device, magnetic disk, magnetic disk, magnetic disk storage Device or other magnetic storage device, or any other medium that can be used to store required information and can be accessed by computing device 400. Computer storage media itself does not include signals.

Communication media generally include computer-readable instructions, data structures, program modules, or other data in the form of modular data signals such as carrier waves or other transmission mechanisms, and include any information delivery media. The term "modular data signal" refers to a signal that has one or more sets of characteristics or that is altered by one of the ways of encoding information in the signal. By way of example and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as audio, radio frequency, infrared, and other wireless media. The combination of the above media is included in the scope of computer-readable media.

The memory 312 includes computer storage media in the form of volatile and non-volatile memory. The memory may be removable, non-movable, or a combination of the two. Exemplary hardware devices include solid state memory, hard disk drives, optical disk drives, and the like. The computing device 300 includes one or more processors that read data from entities such as the memory 312 or the I / O element 420. The display element 316 displays a data indication to a user or other device. Exemplary display elements include display devices, speakers, printing elements, vibration elements, and the like.

I / O port 318 allows computing device 300 to be logically connected to other devices including I / O element 420, some of which are built-in devices. Exemplary components include microphones, joysticks, gaming tables, satellite dish receivers, scanners, printers, wireless devices, and the like. I / O device 320 can provide a natural user interface for processing User-generated gestures, sounds, or other physiological inputs. In some examples, these inputs can be passed to a suitable network element for further processing. NUI enables language recognition, touch and stylus recognition, facial recognition, biometrics, gesture recognition on and near the screen, gestures in the air, head and eye tracking, and touch recognition associated with display on the computing device 300 random combination. The computing device 300 may be equipped with a depth camera, such as a stereo camera system, an infrared camera system, an RGB camera system, and a combination of these systems to detect and recognize gestures. In addition, the computing device 300 may be equipped with an accelerometer or a gyroscope that detects motion. The output of the accelerometer or gyroscope may be provided to the computing device 300 for display to present an immersive augmented reality or virtual reality.

In addition, the processor 314 in the computing device 300 can also execute the programs and instructions in the memory 312 to present the actions and steps described in the above embodiments, or other descriptions in the description.

Any specific order or hierarchical steps of the procedures disclosed herein are purely by way of example. Based on design preferences, it is important to understand that any specific sequence or layer of steps in the process can be rearranged within the scope of this document. The accompanying method claims present elements of various steps in an exemplary order, and therefore should not be limited by the specific order or hierarchy shown here.

Although the present invention has been disclosed as above with the implementation examples, it is not intended to limit the case. Anyone familiar with the art can make some changes and retouching without departing from the spirit and scope of the present invention. Therefore, the scope of protection of this case should be Subject to the scope of the attached patent application.

Claims (18)

An electronic device for playing advertisements based on facial features includes: a display for playing a plurality of advertisements; an image capturing device for capturing an image of a viewer's face; and a processor coupled to the image capturing The device and the display, receiving the facial image and analyzing the facial characteristics of the facial image to identify the group to which the viewer belongs, selecting a specific advertisement corresponding to the group from the advertisement, and transmitting the specific advertisement to the A display to play the specific advertisement; when the facial feature of the viewer watching the specific advertisement changes, the processor determines whether the facial feature belongs to a positive emotion; and when the processor determines that the facial feature belongs to When the emotion is positive, the processor generates an exclusive link corresponding to the specific advertisement, and sends the exclusive link to the display to display the exclusive link. According to the electronic device for playing advertisements based on facial features according to item 1 of the scope of patent application, the above-mentioned exclusive link is a Quick Response Code (QR code) for providing the above viewers to view or use the above Relevant pages or coupons for specific ads. The electronic device for playing advertisements based on facial features according to item 1 of the scope of patent application, wherein the above-mentioned ethnic group is distinguished according to the gender and age of the viewer. The electronic device for playing advertisements based on facial features according to item 1 of the scope of patent application, wherein when the processor determines that the facial features are the positive emotions, the processor records the ethnic group and the positives of the viewers. To emotions. The electronic device for playing advertisements based on facial features according to item 1 of the scope of patent application, wherein when the processor judges that the facial features are negative emotions, records the ethnic group and the negative emotions of the viewers, and Switch to another ad that is different from the specific ad above. The electronic device for playing advertisements based on facial features according to item 1 of the scope of patent application, wherein the positive emotion is an emotion determined by the processor as any one of the following combinations: excitement, happiness, joy, relaxation, tranquility, and calm. The electronic device for playing advertisements based on facial features according to item 5 of the scope of patent application, wherein the negative emotions are emotions judged by the processor as any of the following combinations: distressed, angry, nervous, sad, bored, and sleepy. According to the electronic device for playing advertisements based on facial features according to item 1 of the scope of patent application, the processor further records a viewing information of the viewer, and the viewing information includes the time, place, and browsing of the viewer watching the advertisement. History and length of stay. According to the electronic device for playing advertisements based on facial features according to item 1 of the scope of patent application, when the image capturing device does not capture any facial images, the processor sends an instruction signal to the display to indicate The display randomly plays the advertisement. A method for playing advertisements based on facial features used in an electronic device includes: capturing an image of a viewer's face by an image capturing device; analyzing facial features of the facial image to identify the viewing The group to which the person belongs, and select a specific advertisement corresponding to the group from the advertisement; and play the specific advertisement through a display; determine the face when the facial characteristics of the viewer who watches the specific advertisement changes Whether the feature belongs to a positive emotion; and when determining that the facial feature belongs to a positive emotion, an exclusive link corresponding to the specific advertisement is generated and sent to the display to display the exclusive link. The method for playing advertisements based on facial features as described in item 10 of the scope of patent application, wherein the exclusive link is a Quick Response Code (QR code) for providing the viewer to view or use the specific Ads related pages or coupons. The method for playing advertisements based on facial features as described in item 10 of the scope of the patent application, wherein the ethnic group is distinguished according to the gender and age of the viewer. The method for playing advertisements based on facial features as described in item 10 of the scope of patent application, wherein when determining that the facial features are the positive emotions, record the ethnic group and the positive emotions of the viewers. The method for playing advertisements based on facial features as described in item 10 of the scope of patent application, wherein when determining that the facial features belong to negative emotions, record the ethnic group and negative emotions of the viewer, and switch to the same A specific ad is not the same as another ad. The method for playing advertisements based on facial features as described in item 10 of the scope of patent application, wherein the above-mentioned positive emotions are emotions of any one of the following combinations: excitement, happiness, joy, relaxation, tranquility, and calmness. The method for playing advertisements based on facial features according to item 14 of the scope of patent application, wherein the negative emotions are emotions judged by the processor as any of the following combinations: distress, anger, tension, sadness, boredom, and sleepiness . The method for playing advertisements based on facial features as described in item 10 of the scope of patent application, further comprises: recording a viewing information of the viewer, the viewing information including the time, place, browsing history and stay of the viewer watching the advertisement time. The method for playing advertisements based on facial features as described in item 10 of the scope of patent application, wherein when the image capturing device does not capture any facial images, the method further includes: sending an instruction signal to the display, and Instruct the display to randomly play the advertisement.