TW202009784A - Method and electronic device for playing advertisements based on facial features - Google Patents

Abstract

A method for playing advertisements based on facial features is provided in the invention. The method is used in an electronic device and includes: capturing, by an image capturing device, a facial image of a viewer; analyzing a facial feature of the facial image to identify a group which the viewer belongs to, and selecting a specific advertisement corresponding to the group from the advertisements; playing the specific advertisement by a display; determining whether the facial feature belongs to a positive emotion when the facial feature of the viewer looking at the specific advertisement is changed; and generating a dedicated link corresponding to the specific advertisement and transmitting the dedicated link to the display to display the dedicated link when determining that the facial feature belongs to a positive emotion. An electronic device for playing advertisements based on facial features is further provided in the invention.

Description

Method and electronic device for playing advertisements based on facial features

The invention relates to a method and electronic device for playing advertisements based on facial features.

Some shopping malls set up electronic signage to provide advertisements to their consumers. For example, electronic interactive signage can automatically play advertisements when consumers enter a location. As a more specific example, when a consumer approaches the entrance of a shopping mall, an electronic signage can play an advertisement to the consumer. However, uncategorized ads are widely broadcast and most of them may have little or no value to consumers.

Therefore, a method and electronic device for playing advertisements based on facial features are used to dynamically grasp consumers' likes and dislikes of advertisements played on electronic signage, thereby inserting marketing activities, so that advertisers can send coupons or promotions to these consumers.

The content of the following invention is exemplary and is not meant to be limiting in any way. In addition to the illustrative aspects, embodiments, and features, other aspects, embodiments, and features will be apparent by reference to the drawings and specific embodiments described below. That is, the content of the following invention is provided to introduce concepts, highlights, benefits, and novel and non-obvious technical advantages described herein. Selected, not all, embodiments will be described in further detail below. Therefore, the content of the following invention is not intended to be a necessary feature of the claimed subject matter, nor is it intended to be used in determining the scope of the claimed subject matter.

The invention provides a method and an electronic device for playing advertisements based on facial features.

The invention provides an electronic device for playing advertisements based on facial features, including: a display for playing a plurality of advertisements; an image capturing device for capturing a viewer's face image; and a processor coupled to the above The image capturing device and the display receive the facial image and analyze the facial features of the facial image to identify the ethnic group to which the viewer belongs, select a specific advertisement corresponding to the ethnic group from the advertisement, and send the specific Advertising to the display to play the specific advertisement; when the facial features of the viewer watching the specific advertisement change, the processor determines whether the facial features belong to positive emotions; and when the processor determines the face When some features belong to positive emotions, the processor generates an exclusive link corresponding to the specific advertisement, and sends it to the display to display the exclusive link.

In some embodiments, the exclusive link is a Quick Response Code (QR code), which is used to provide related webpages or coupons for the viewer to view or use the specific advertisement.

In some embodiments, the ethnic group is distinguished according to the gender and age of the viewer.

In some embodiments, when the processor determines that the facial feature is the positive emotion, the processor records the viewer's ethnic group and the positive emotion.

In some embodiments, when the processor determines that the facial features belong to negative emotions, it records the viewer's ethnic group and the negative emotions, and switches to another advertisement different from the specific advertisement.

In some embodiments, the positive emotion is determined by the processor as any one of the following combinations: excitement, joy, pleasure, relaxation, tranquility, and calmness.

In some embodiments, the negative emotion is determined by the processor as any one of the following combinations: distress, anger, tension, sadness, boredom, and drowsiness.

In some embodiments, the processor also records viewing information of the viewer, where the viewing information includes the time, location, browsing history, and stay time of the viewer watching the advertisement.

In some embodiments, when the image capturing device does not capture any facial images, the processor sends an indication signal to the display to instruct the display to randomly play the advertisement.

The present invention provides a method for playing advertisements based on facial features, which is used in an electronic device and includes: capturing a viewer's facial image by an image capturing device; analyzing the facial features of the facial image to Identify the group to which the viewer belongs, and select a specific advertisement corresponding to the group from the advertisement; and play the specific advertisement through a display; when the facial features of the viewer watching the specific advertisement change, determine the above Whether the facial features belong to positive emotions; and when it is determined that the facial features belong to positive emotions, an exclusive link corresponding to the specific advertisement is generated and sent to the display to display the exclusive link.

100‧‧‧System

110‧‧‧Electronic device

112‧‧‧Image capture device

114‧‧‧Monitor

120‧‧‧ Management Server

130‧‧‧Viewer

150‧‧‧ Internet

200‧‧‧Method

S205, S210, S215, S220, S225, S230

300‧‧‧Computer

310‧‧‧Bus

312‧‧‧Memory

314‧‧‧ processor

316‧‧‧Display element

318‧‧‧I/O port

320‧‧‧I/O components

322‧‧‧Power supply

The drawings are included to provide a further understanding of the invention and are incorporated and form a part of the invention. The drawings illustrate embodiments of the invention and together with the description serve to explain the principles of the invention. It is understandable that the drawings are not necessarily drawn to scale, and some elements may be displayed beyond the size of the actual implementation to clearly illustrate the concept of the present invention.

FIG. 1 is an exemplary schematic diagram showing a system for playing advertisements according to an embodiment of the present invention.

FIG. 2 is a flowchart showing a method for playing advertisements according to an embodiment of the invention.

Figure 3 shows an exemplary operating environment for implementing embodiments of the present invention.

In the following, various aspects of the present invention will be described more fully with reference to the accompanying drawings. However, the present invention can be embodied in many different forms and should not be interpreted as being limited to any specific structure or function presented throughout the present invention. On the contrary, providing these aspects will make the invention comprehensive and complete, and the invention will fully convey the scope of the invention to those skilled in the art. Based on what is taught herein, those skilled in the art should realize that, whether alone or in combination with any other aspect of the present invention, implement any aspect disclosed herein, the scope of the present invention is intended to cover any aspect disclosed herein. For example, it can be implemented using any number of devices or execution methods proposed herein. In addition, in addition to the various aspects of the invention presented herein, the scope of the invention is intended to cover devices or methods implemented using other structures, functions, or structures and functions. It should be understood that it may embody any aspect disclosed herein through one or more elements of the patent scope.

The word "exemplary" is used herein to mean "used as an example, instance, or illustration." Any aspect of the invention or design described herein as "exemplary" is not necessarily to be construed as preferred or superior to other aspects of the invention or design. In addition, the same number indicates the same element in all several drawings, and unless otherwise specified in the description, the articles "a" and "above" include plural references.

It will be understood that when an element is referred to as being "connected" or "coupled" to another element, the above element can be directly connected or coupled to the other element or intervening elements may be present. Conversely, when an element is referred to as being "directly connected" or "directly coupled" to another element, there are no intervening elements. Other words used to describe the relationship between components should be interpreted in a similar manner (for example, "between" and "directly between", "adjacent" and "directly adjacent", etc.).

FIG. 1 shows an exemplary schematic diagram of a system 100 for playing advertisements according to an embodiment of the present invention. In this embodiment, the system 100 may include an electronic device 110, a management server 120, and a network 150. The management server 120 can be connected to the electronic device 110 through a network 150, wherein the network 150 can be any type of network familiar to those skilled in the art, and can use any of various protocols available on the communication to support data communication , Including but not limited to TCP/IP, etc. For example, the network 150 may be a local area network (Local Area Network, LAN), such as Ethernet, etc., and a virtual network, including but not limited to a virtual private network (Virtual Private Network, VPN), Internet, wireless network and/or any combination of these and/or other networks.

The management server 120 may be or include any database capable of storing and/or providing access to information, such as an electronic database, computer and/or computerized server. The database server may generally store data and connect to Web host for any type of data network. The management server 120 may store plural advertisements and other related information provided by an advertiser in a database. In addition, the management server 120 can also train a facial feature recognition model.

In more detail, the advertiser may input a plurality of facial images for training to the management server 120 in advance. The management server 120 trains a facial feature recognition model based on a Neural Network model to recognize facial features in plural facial images, where the facial features include gender, age, and emotion. Emotions can include positive emotions and negative emotions, where positive emotions are one of excitement, happiness, pleasure, relaxation, tranquility and calmness, and negative emotions are one of distress, anger, tension, sadness, boredom and drowsiness One. Neural networks can be implemented in C++, Visual Basic, or other object-oriented programming languages suitable for this purpose. As used herein, the term "training" is used to identify objects used to train a recognition model. Therefore, the training image refers to the image used to train the recognition model. Moreover, the training image may include a classification corresponding to a target image. After the management server 120 trains the facial feature recognition model, the management server 120 can transmit the facial feature recognition model to the electronic device 110, and the power supply device 110 recognizes the facial image.

The electronic device 110 may be an electronic billboard and installed in a public place, and it may receive advertisements and facial feature recognition models transmitted by the management server 120. The electronic device 110 may include a processor (not shown), an image capturing device 112 and a display 114. The image capturing device 112 is used to capture a face image of a viewer 130. The image capturing device 112 may be any commercially available device or device capable of capturing images, such as a camera/camera. In addition, the image capturing device 112 can aim at a fixed position, or can move to shoot a range of positions. In addition, the image capturing device 112 can also zoom in and zoom out the image.

The display 114 may be implemented as a flat panel display, such as a liquid crystal display (LCD), a field emission display (FED), a plasma display panel (PDP), an organic light emitting diode (Organic light emitting diode) Light Emitting Diode (OLED) display. Although the embodiments of the present invention have been described using a liquid crystal display as an example, other displays may be used. In this embodiment, the display 114 is used to display animations, images, advertisements, and other information to attract viewers and thereby generate interaction.

The processor of the electronic device 110 is coupled to the image capturing device 112 and the display 114. The processor can receive the facial image captured by the image capturing device 112 and manage the facial feature recognition model sent by the server 120 to analyze the facial features of the facial image to identify the ethnic group to which the viewer belongs.

The ethnic group to which the viewer belongs can be allocated by the advertiser in advance, and the above ethnic group is distinguished according to the gender and age of the viewer. Table 1 shows the ethnic groups classified according to the viewer's gender and age.

如表格1所示，觀看者可被分類為上述族群A~J其中之一。而上述廣告亦可由管理伺服器120或是電子裝置110根據上述族群作分類。電子裝置110之處理器可根據上述族群從所有廣告中選擇對應上述族群的一特定廣告，並傳送上述特定廣告至上述顯示器，以播放上述特定廣告。舉例說明，洗髮乳廣告及手機廣告係被分類至族群A及B。當電子裝置110之處理器辨識觀看者屬於族群A時，處理器從對應族群A的廣告(洗髮乳廣告及手機廣告)中選擇一廣告，例如，洗髮乳廣告，並傳送上述洗髮乳廣告至顯示器進行播放。

As shown in Table 1, viewers can be classified as one of the above groups A~J. The advertisements may also be classified by the management server 120 or the electronic device 110 according to the ethnic group. The processor of the electronic device 110 may select a specific advertisement corresponding to the above-mentioned group from all the advertisements according to the above-mentioned group, and send the specific advertisement to the display to play the specific advertisement. For example, shampoo ads and mobile phone ads are classified into ethnic groups A and B. When the processor of the electronic device 110 recognizes that the viewer belongs to the group A, the processor selects an advertisement from the advertisement (shampoo advertisement and mobile phone advertisement) corresponding to the group A, for example, a shampoo advertisement, and transmits the shampoo Advertise to the monitor to play.

In one embodiment, when the facial features of the viewer watching the specific advertisement change, the processor of the electronic device 110 determines whether the facial features belong to positive emotions. When the processor determines that the facial features are positive emotions, it generates an exclusive link corresponding to the specific advertisement and sends it to the display to display the exclusive link, where the exclusive link is a Quick Response Code (QR code) , Optical code or URL, etc., to provide related webpages or coupons for the above viewers to view or use the above specific advertisements. In addition, the processor can also record the viewer's aforementioned ethnic group and the aforementioned positive emotion. When the processor determines that the facial features belong to negative emotions, it records the viewer's ethnic group and negative emotions, and switches to another advertisement that corresponds to the ethnic group but is different from the specific advertisement. In one embodiment, after recording the viewer's above-mentioned ethnic group and emotion, the processor can feed back the viewer's above-mentioned ethnic group and emotion, exclusive link and other information to the management server 120.

In one embodiment, when the image capture device 112 does not capture any facial images, the processor of the electronic device 110 sends an indication signal to the display 114 to instruct the display 114 to randomly play advertisements. In another embodiment, the processor of the electronic device 110 further records the viewing information of the viewer, and feeds back the viewing information to the management server 120, wherein the viewing information may include the time, location, and browsing history of the viewer watching the advertisement And information such as the length of stay. The management server 120 can adjust the facial feature recognition model or reclassify the advertisement to the corresponding ethnic group according to the viewing information, the above-mentioned ethnic groups and emotions of the viewer to enhance the effectiveness of playing the advertisement. In another embodiment, the management server 120 can further generate a statistical report based on the viewing information, the above-mentioned ethnic groups and emotions of the viewer, the exclusive link, and the like, and check whether the viewer uses the exclusive link, and record the verification result in the statistics Report.

In addition, the advertiser can also download and install its own application developed by the management server 120 through a terminal device (not shown) (hereinafter referred to as -APP for convenience of understanding). The management server 120 can send viewing information or statistical reports to the terminal device, so that the advertiser can instantly understand related information such as the viewer watching the advertisement. The terminal device may be a computer or a mobile device, such as a notebook computer, a smart phone, or a tablet computer, etc., which may be capable of running application programs.

It should be understood that each element shown in FIG. 1 may be implemented via any type of computing device, such as the computing device 300 described with reference to FIG. 3, as shown in FIG.

FIG. 2 is a flowchart showing a method 200 for playing advertisements according to an embodiment of the invention. This method can be used in a device, for example, implemented in the electronic device 110 shown in FIG. 1.

In step S205, the electronic device captures a viewer's face image by an image capturing device. Next, in step S210, the electronic device analyzes the facial features of the facial image to identify the ethnic group to which the viewer belongs, and selects a specific advertisement corresponding to the ethnic group from the advertisement. In step S215, the electronic device plays the specific advertisement through a display, and detects whether the facial features of the viewer watching the specific advertisement have changed.

When the facial features of the viewer watching the specific advertisement change, in step S220, the electronic device determines whether the facial features of the viewer belong to positive emotions. When the electronic device determines that the facial features belong to positive emotions ("Yes" in step S220), in step S225, the electronic device generates an exclusive link corresponding to the specific advertisement and sends it to the display to display the exclusive link. When the electronic device determines that the facial features belong to negative emotions ("No" in step S220), in step S230, record the viewer's ethnic group and the negative emotion, and switch to correspond to the ethnic group but with the above Another ad with a different specific ad.

The method and electronic device for playing advertisements of the present invention are based on the age, gender and emotion information obtained based on face recognition technology as the basis for selecting advertisements, and can record the emotions of viewers watching advertisements and feed them back to the management server. The management server can adaptively adjust the facial feature recognition model or reclassify the advertisement to the corresponding ethnic group through the above feedback to give the viewer or customer a better experience.

For the described embodiments of the present invention, the following describes an exemplary operating environment in which embodiments of the present invention can be implemented. Referring specifically to FIG. 3, FIG. 3 shows an exemplary operating environment for implementing embodiments of the present invention, which can generally be regarded as the computing device 300. The computing device 300 is an example of a suitable computing environment and is not intended to imply any limitation on the use or functional scope of the present invention. The computing device 300 should also not be interpreted as having any dependency or requirement related to any one or combination of the illustrated elements.

The present invention can be executed in a computer program code or a machine by using instructions. The instructions can be computer executable instructions of a program module. The program module is executed by a computer or other machine, such as a personal digital assistant or other portable device. . Generally speaking, program modules include routines, programs, objects, components, data structures, etc. Program modules refer to program codes that perform specific tasks or implement specific abstract data types. The present invention can be implemented in various system configurations, including portable devices, consumer electronic products, general-purpose computers, and more professional computing devices. The invention can also be implemented in a distributed computing environment, processing devices connected by a communication network.

Refer to Figure 3. The computing device 300 includes a bus 310, a memory 312, one or more processors 314, one or more display elements 316, an input/output (I/O) port 318, and an input/output directly or indirectly coupled to the following devices An output (I/O) element 320 and an illustrative power supply 322. The bus 310 represents an element that can be one or more buses (eg, address bus, data bus, or a combination thereof). Although each block in FIG. 3 is shown as a line for the sake of brevity, in fact, the boundary of each element is not specific, for example, the presentation element of the display device can be regarded as an I/O element; the processor can have a memory .

The computing device 300 generally includes various computer-readable media. The computer-readable media may be any available media that can be accessed by the computing device 300, and the above-mentioned media include both volatile and non-volatile media, removable and non-removable media. For example, but not limited to, computer-readable media may include computer storage media and communication media. Computer-readable media includes both volatile and non-volatile media implemented in any method or technology used to store information such as computer-readable instructions, data structures, program modules, or other data. Removable and non-removable media. Computer storage media include but are not limited to RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage devices, diskettes, diskettes, diskette storage A device or other magnetic storage device, or any other medium that can be used to store required information and can be accessed by the computing device 400. Computer storage media itself does not include signals.

Communication media generally include computer readable commands, data structures, program modules, or other data in the form of modular data signals such as carrier waves or other transmission mechanisms, and include any information delivery media. The term "modulated data signal" refers to a signal that has one or more feature sets or is modified in such a way as to encode information in the signal. For example, but not limited to, communication media includes wired media such as a wired network or a direct wired connection, and wireless media such as audio, radio frequency, infrared, and other wireless media. The combination of the above-mentioned media is included in the range of computer-readable media.

The memory 312 includes computer storage media in the form of volatile and non-volatile memory. The memory can be removable, non-removable, or a combination of the two. Exemplary hardware devices include solid-state memory, hard disk drives, optical disk drives, and the like. The computing device 300 includes one or more processors that read data from entities such as the memory 312 or the I/O device 420. The display element 316 displays data instructions to the user or other devices. Exemplary display elements include display devices, speakers, printing elements, vibration elements, and the like.

The I/O port 318 allows the computing device 300 to be logically connected to other devices including I/O devices 420, some of which are built-in devices. Exemplary components include microphones, joysticks, game consoles, satellite dish receivers, scanners, printers, wireless devices, and the like. I/O device 320 may provide a natural user interface for processing user-generated gestures, sounds, or other physiological inputs. In some examples, these inputs may be sent to a suitable network element for further processing. NUI enables language recognition, touch and stylus recognition, facial recognition, biometrics, gesture recognition on and near the screen, aerial gestures, head and eye tracking, and touch recognition associated with the display on the computing device 300 random combination. The computing device 300 may be equipped with a depth camera, such as a stereo camera system, an infrared camera system, an RGB camera system, and a combination of these systems to detect and recognize gestures. In addition, the computing device 300 may be equipped with an accelerometer or gyroscope that detects motion. The output of the accelerometer or gyroscope may be provided to the computing device 300 for display to present immersive augmented reality or virtual reality.

In addition, the processor 314 in the computing device 300 can also execute the programs and instructions in the memory 312 to present the actions and steps described in the above embodiments, or other descriptions in the description.

Any specific order or hierarchical steps of the procedures disclosed herein are purely an example. Based on design preferences, it must be understood that any specific sequence or hierarchical steps in the procedure can be rearranged within the scope disclosed in this document. The accompanying method claims present elements of the various steps in a sample order, and therefore should not be limited by the specific order or hierarchy shown.

Although the present invention has been disclosed as above with the implementation examples, it is not intended to limit the case. Anyone who is familiar with this skill can make some changes and modifications without departing from the spirit and scope of the present invention, so the scope of protection of the case is Subject to the definition of the scope of the attached patent application shall prevail.

200‧‧‧Method

S205, S210, S215, S220, S225, S230

Claims (18)

An electronic device for playing advertisements based on facial features includes: a display for playing a plurality of advertisements; an image capture device for capturing a viewer's face image; and a processor coupled to the image capture The device and the display receive the facial image and analyze the facial features of the facial image to identify the ethnic group to which the viewer belongs, select a specific advertisement corresponding to the ethnic group from the advertisement, and send the specific advertisement to the aforementioned A display to play the specific advertisement; when the facial features of the viewer watching the specific advertisement change, the processor determines whether the facial features belong to positive emotions; and when the processor determines that the facial features belong When the emotion is positive, the processor generates an exclusive link corresponding to the specific advertisement and sends it to the display to display the exclusive link. The electronic device for playing advertisements based on facial features as described in item 1 of the patent scope, wherein the dedicated link is a Quick Response Code (QR code) to provide the viewer to view or use the above Related pages or coupons for specific advertisements. The electronic device for playing advertisements based on facial features as described in item 1 of the patent application scope, wherein the ethnic group is distinguished according to the gender and age of the viewer. The electronic device for broadcasting advertisements based on facial features as described in item 1 of the patent scope, wherein when the processor determines that the facial features are the positive emotions, the processor records the ethnic group of the viewer and the positive To emotions. The electronic device for playing advertisements based on facial features as described in item 1 of the patent scope, wherein when the processor determines that the facial features belong to negative emotions, it records the viewer’s ethnic group and the negative emotions, and Switch to another ad that is different from the specific ad above. The electronic device for playing advertisements based on facial features as described in item 1 of the patent application scope, wherein the positive emotion is determined by the processor as any one of the following combinations of emotions: excitement, happiness, pleasure, relaxation, tranquility and calm. The electronic device for playing advertisements based on facial features as described in item 5 of the patent application scope, wherein the negative emotion is determined by the processor as any one of the following combinations of emotions: distress, anger, tension, sadness, boredom and sleepy. The electronic device for playing advertisements based on facial features as described in item 1 of the patent application scope, wherein the processor also records a viewing information of the viewer, the viewing information includes the time, location, and browsing of the viewer watching the advertisement History and length of stay. The electronic device for playing advertisements based on facial features as described in item 1 of the patent scope, wherein when the image capture device does not capture any facial images, the processor sends an indication signal to the display to indicate The above display randomly plays the above advertisement. A method for playing advertisements based on facial features used in an electronic device, including: capturing a viewer's facial image by an image capturing device; analyzing facial features of the facial image to identify the viewing The group to which the person belongs and select a specific advertisement corresponding to the group from the advertisement; and play the specific advertisement through a display; when the facial characteristics of the viewer watching the specific advertisement change, determine the face Whether the feature belongs to a positive emotion; and when it is determined that the facial feature belongs to a positive emotion, an exclusive link corresponding to the specific advertisement is generated and sent to the display to display the exclusive link. The method for playing advertisements based on facial features as described in item 10 of the patent application, wherein the exclusive link is a Quick Response Code (QR code) to provide the viewer to view or use the specific Advertisement related webpages or coupons. The method for playing advertisements based on facial features as described in item 10 of the patent application scope, wherein the ethnic group is distinguished according to the gender and age of the viewer. The method for broadcasting advertisements based on facial features as described in item 10 of the patent application scope, wherein when it is determined that the facial features are the positive emotions, the ethnic group of the viewer and the positive emotions are recorded. The method for playing advertisements based on facial features as described in item 10 of the patent application scope, wherein when it is judged that the facial features belong to negative emotions, the ethnic groups of the viewer and the negative emotions are recorded and switched to the above Another ad with a different specific ad. The method for playing advertisements based on facial features as described in item 10 of the patent application scope, wherein the positive emotions are emotions in any one of the following combinations: excitement, happiness, pleasure, relaxation, tranquility and calmness. The method for playing advertisements based on facial features as described in item 14 of the patent application scope, wherein the negative emotion is determined by the processor as any one of the following combinations of emotions: distress, anger, tension, sadness, boredom and drowsiness . The method for playing advertisements based on facial features as described in item 10 of the patent application scope further includes: recording a viewing information of the viewer, the viewing information includes the time, location, browsing history and stay of the viewer watching the advertisement time. The method for playing advertisements based on facial features as described in item 10 of the patent application scope, wherein when the image capture device does not capture any facial image, the method further includes: sending an indication signal to the display, Instruct the display to play the advertisement randomly.

Images