JP2011197276A - Apparatus and method for displaying of advertisement image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an advertisement image display technology, capable of effectively providing an advertisement image, while preventing an individual taste of a user from being leaked to a third person.SOLUTION: In an advertisement image display device, positional relationship of a viewer of an advertisement image and a third person is calculated using an image captured by an imaging unit, on the basis of the positional relationship, and the advertisement image for the viewer is displayed at a position where the third person cannot view the advertisement image.

Description

  The present invention relates to a technique for displaying an advertisement image.

  Conventionally, in the advertisement of merchandise at a store, a method of installing a signboard and pasting paper has been common. However, in recent years, cases in which various information display systems (digital signage systems) that display images on a display using electronic data are used for advertisements are increasing.

  In addition, an IC card reader capable of proximity communication is provided in the digital signage system, communicates with the ID card owned by the user, and transmits the user ID stored in the ID card to the IC card reader to obtain user-specific information. There is also technology that reflects in the content. If this technique is used, information according to the user's hobbies and preferences can be output to the display device.

  FIG. 6 is a diagram illustrating a configuration example of a conventional digital signage system. The digital signage system 400 includes an IC card reader 410, an image display unit 420, a control unit 430, and a storage unit 440.

  The user 450 holds the IC card 460 over the IC card reader 410. The IC card 460 stores the membership code of the user 450, the product purchase history so far, and the like. The IC card reader 410 reads these pieces of information and notifies the control unit 430 of them. Based on these pieces of information, the control unit 430 can display an advertisement image customized for the user 450 on the image display unit 420.

  Japanese Patent Application Laid-Open No. 2004-228561 describes a technique for presenting an advertisement to a customer in real time when the customer's attribute matches a predetermined condition.

  Patent Document 2 listed below describes a technique for stopping ATM screen display when a plurality of face images are detected. Thereby, it is aimed to prevent a third party from looking into the ATM display.

Japanese Patent Laid-Open No. 2002-15204 JP 2006-259930 A

  In the above-described conventional digital signage system 400, when an advertisement image customized for the user 450 is displayed in a place where many people gather, the personal preference of the user 450 may be known to a third party. In general, the user's psychological resistance to being informed of personal information is great. This is considered to be an impediment to disseminating targeted advertisements customized for each individual in the digital signage system.

  On the other hand, in the digital signage system, it is conceivable to introduce a technique for preventing a third party from looking into an image, such as the technique described in Patent Document 2. However, with the technique described in Patent Document 2, when the presence of a third party is detected, the screen display itself is blocked, and the user himself / herself cannot view the image. This can be an effective technique when handling highly confidential information such as ATM, but in situations where an advertisement image is provided, it may lead to the possibility of losing business opportunities if the advertisement image is suddenly blocked. Is not preferable.

  The present invention has been made to solve the above-described problems, and can effectively provide an advertisement image while preventing the personal preference of the user from leaking to a third party. An object is to provide advertisement image display technology.

  The advertisement image display device according to the present invention calculates the positional relationship between the viewer and the third party of the advertisement image using the image captured by the imaging unit, and the third party views the advertisement image based on the positional relationship. Display advertisement images for viewers at locations where they cannot.

  According to the advertisement image display device of the present invention, it is possible to prevent a third party from looking into the advertisement image while presenting the advertisement image customized for the viewer.

1 is a configuration diagram of an advertisement image display device 100 according to Embodiment 1. FIG. 1 is a front view of an advertisement image display device 100. FIG. It is a figure explaining the edge part of the captured image of the user. 3 is a top view of the advertisement image display device 100. FIG. 4 is a diagram illustrating an operation flow of the advertisement image display device 100. FIG. It is a figure which shows the structural example of the conventional digital signage system.

<Embodiment 1>
FIG. 1 is a configuration diagram of an advertisement image display device 100 according to Embodiment 1 of the present invention. The advertisement image display device 100 includes a control unit 10, a member information database 20, a usage history database 30, a product information database 40, a display unit 50, an imaging unit 60, and an IC card reading device 70. Hereinafter, functions of each unit will be described.

  The member information database 20 stores personal information such as a user ID, name, sex, date of birth, address, telephone number, and occupation of a user who browses the advertisement image displayed by the advertisement image display device 100. Each user is specified by the user ID recorded in the member card possessed by the user.

  The merchandise information database 40 stores merchandise information such as merchandise ID, release date, merchandise genre, inventory quantity, merchandise image, and advertisement image.

  The usage history database 30 stores the history of products purchased by each user in the past for each user ID.

  The display unit 50 is a display device that presents an advertisement image to the user. The display unit 50 may be configured using a personal computer or a television display, or may be configured using a large display, a kiosk terminal, or the like. Furthermore, in addition to a function for displaying an image, a button for inputting information by a user, a touch panel, and the like may be provided.

  The imaging unit 60 is a device that captures a peripheral image of the advertisement image display device 100. The imaging unit 60 can be configured using, for example, a video camera, a CCD imaging device, or the like.

  The IC card reading device 70 is a device that reads information stored in a member card possessed by a user. An IC chip is embedded in the membership card, and a user ID is recorded on this IC chip. Instead of a membership card, a device in which a user ID is embedded in an IC chip incorporated in a terminal such as a mobile phone can be used.

  The control unit 10 is a functional unit that controls the operation of the advertisement image display device 100, and includes an IC card recognition unit 11, a person detection unit 12, a DB search unit 13, an image area calculation unit 14, and a display control unit 15. The control unit 10 can be configured by using hardware such as a circuit device that realizes the function, or by using an arithmetic device such as a microcomputer or a CPU (Central Processing Unit) and software that defines the operation thereof. It can also be configured. Further, the function of the control unit 10 can be realized by a computer such as a personal computer connected to the outside of the advertisement image display device 100.

  The IC card recognition unit 11 has a function of converting a signal read by the IC card reader 70 into digital data and extracting a user ID and the like.

  The person detection unit 12 receives the image data captured by the image capturing unit 60 and detects the position of the user viewing the advertisement image and the position of the third party. Details of the detection method will be described again with reference to FIGS.

  The DB search unit 13 executes a search process for the member information database 20, the usage history database 30, and the product information database 40.

  The image area calculation unit 14 calculates an image area in which the advertisement image is to be displayed on the display unit 50. The calculation method will be described later. The display control unit 15 controls the operation of the display unit 50 to display an advertisement image in the image region calculated by the image region calculation unit 14.

  FIG. 2 is a front view of the advertisement image display device 100. The imaging unit 60 is disposed adjacent to and above the display unit 50. Thereby, the image of the user 200 who browses the advertisement image on the display unit 50 can be taken. Assume that the positions of the display unit 50 and the imaging unit 60 are fixed.

  The person detection unit 12 detects the position of the user 200 by detecting the face of the user 200. Any known technique can be used as a method for detecting a face. For example, the following methods can be mentioned.

(Face detection method 1) Among templates prepared in advance, a template that matches the pattern of feature points of the face image is searched (template matching).
(Face Detection Method No. 2) An edge portion is detected based on a change in luminance of the face outline and background.
(Face Detection Method 3) A face portion is detected by detecting skin color and hair color.

  Hereinafter, as an example, template matching based on face feature points will be used.

  The person detection unit 12 determines that the person closest to the imaging unit 60 is the user 200 who browses the advertisement image. The person detection unit 12 holds several types of templates having different face sizes in advance, and estimates the distance between the person and the imaging unit 60 based on the detected difference in face size. The human detection unit 12 estimates the approximate height of the user based on the detected height of the face position, and detects the contour of the body by template matching as well as the face.

  The person detection unit 12 detects the user's face and body contour by the above method, and specifies the coordinates. The origin of the coordinate axes is the lower left end of the display area 51 provided in the display unit 50 as viewed in FIG. Also, the horizontal direction is the x axis, the vertical direction is the y axis, and the front direction in FIG. 2 is the z axis.

  FIG. 3 is a diagram for explaining an end portion of a captured image of the user 200. The person detection unit 12 divides the body contour of the user 200 detected by the above-described method into a plurality of blocks. Here, an example in which it is divided into 10 in the vertical direction is shown. The vertical width 210 of each block is a length obtained by dividing the height of the user 200 into ten equal parts.

  The human detection unit 12 specifies end coordinates of the body contour of the user 200 in each block. In FIG. 3, the coordinates of the upper right end where the boundary line of each block and the body outline of the user 200 intersect are used as end coordinates, which are indicated by black circles. Similarly, the person detection unit 12 specifies the coordinates of the upper left end where the boundary line of each block and the body outline of the user 200 intersect.

  The human detection unit 12 specifies the ten left end coordinates and the ten right end coordinates by the above procedure as follows.

Left end 1 (L_x1, L_y1, L_z1) / Right end 1 (R_x1, R_y1, R_z1)
Left end 2 (L_x2, L_y2, L_z2) / Right end 2 (R_x2, R_y2, R_z2)
・
・
Left end 10 (L_x10, L_y10, L_z10) / Right end 10 (R_x10, R_y10, R_z10)

  The person detection unit 12 also detects the faces of third parties excluding the user 200 in the same manner as described above. However, for the third party, it is not necessary to detect the body contour for the reason described later. Instead, the person detection unit 12 detects the coordinates of the eyes of the third person. As a method for detecting the binocular coordinates, any known technique (for example, template matching) can be used in the same manner as the body contour and the face. The binocular coordinates of the third party are expressed as follows.

  Left eye coordinates (Leye_x, Leye_y, Leye_z) / right eye coordinates (Reye_x, Reye_y, Reye_z)

  FIG. 4 is a top view of the advertisement image display device 100. Here, it is assumed that the user 200 is located substantially in front of the display unit 50 and the third person 300 is located obliquely behind the user. Since the area 52 on the display unit 50 is hidden behind the user 200, the area 52 is not visible to the third person 300.

  The image area calculation unit 14 calculates the above-described area 52 when the person detection unit 12 detects that the third person 300 excluding the user 200 who is the viewer of the advertisement image exists. Hereinafter, the calculation method will be described.

  The image area calculation unit 14 receives the position information of the user 200 and the third person 300 calculated by the person detection unit 12. Specifically, the binocular coordinates of the third person 300 and the end coordinates of the body contour of the user 200 are shown.

  In FIG. 4, the image area calculation unit 14 calculates the coordinates of the point where the extension line connecting the coordinates of the left end 1 of the body contour and the third person's left eye coordinates intersects the display surface of the display unit 50. Specifically, the equation of the straight line passing through the left eye coordinates and the left end 1 is expressed by the following (Equation 1).

  Since the display surface of the display unit 50 is a plane with z = 0, the intersection of the straight line represented by the above (Equation 1) and the display surface of the display unit 50 is expressed as follows.

  Similarly, the image area calculation unit 14 obtains coordinates of a point where a straight line connecting the left and right end portions of the body contour of the user 200 and the left and right eye coordinates of the third person 300 intersects the display surface of the display unit 50. . As a result, 20 intersection coordinates can be obtained. The inner area surrounded by connecting the 20 intersections is hidden by the user 200 and cannot be seen by the third person 300. The image area calculation unit 14 can calculate this area as the area 52 in FIG. Although the number of divisions of the body contour is 10 here, the region 52 can be obtained more accurately by increasing the number of divisions.

  When there are a plurality of third parties 300, the above-described area 52 is obtained for each third party 300, and the logical product of the areas 52 that are not visible to each third party 300 is taken so that only the user 200 can see. The area can be determined.

  As described with reference to FIG. 4, the image area calculation unit 14 uses the body contour of the user 200 and the extension line of the binocular coordinates of the third person 300, and therefore it is not necessary to detect the body contour of the third person 300.

  The display control unit 15 searches the product information database 40 using the user ID acquired by the IC card reader 70 and the IC card recognition unit 11 as a key, and extracts an advertisement image of a product that matches the preference of the user 200. The display control unit 15 displays the advertisement image extracted from the product information database 40 in the region 52 calculated by the image region calculation unit 14. Whether or not it matches the user's 200 preference can be determined using an arbitrary criterion such as a category that matches the product recently purchased by the user or a close price range.

  FIG. 5 is a diagram illustrating an operation flow of the advertisement image display device 100. Hereinafter, each step of FIG. 5 will be described.

(FIG. 5: Step S501)
The IC card recognition unit 11 acquires the reading result of the IC card reader 70. When the IC card reader 70 recognizes that the member card has been read, the process proceeds to step S502, and this step is continued until then.

(FIG. 5: Step S502)
The person detection unit 12 calculates the position information of the user 200 by the method described above.

(FIG. 5: Step S503)
The person detection unit 12 determines whether the third person 300 exists around the user 200 based on a criterion such as whether there are two or more face images. If a third party exists, the process proceeds to step S507, and if not, the process proceeds to step S504.

(FIG. 5: Step S504)
The display control unit 15 uses the function of the DB search unit 13 to search the usage history database 30 using the user ID as a key, and acquires the product purchase history of the user 200.

(FIG. 5: Step S505)
The display control unit 15 determines an advertisement image based on the product purchase history of the user 200. For example, only one product closest to the recent purchase history of the user 200 is selected from the product information database 40, and it is determined to use the advertisement image. In addition, methods such as selecting a plurality of similar category products or selecting an advertisement image at random may be used in an appropriate combination. By this step, an advertisement image customized for the user 200 can be selected.

(FIG. 5: Step S506)
The display control unit 15 causes the display unit 50 to display the advertisement image for the user 200 determined in step S505.

(FIG. 5: Step S507)
The person detection unit 12 calculates the position information of the third person 300, that is, the binocular coordinates by the above-described method.

(FIG. 5: Step S508)
The image area detection unit 14 calculates the area 52 invisible to the third person 300 by the above-described method.

(FIG. 5: Steps S509 to S510)
These steps are the same as steps S504 to S505.

(FIG. 5: Step S511)
The display control unit 15 processes the advertisement image to be displayed on the display unit 50 as necessary. For example, processing such as enlarging / reducing the advertisement image in accordance with the size of the region 52 is performed.

(FIG. 5: Step S512)
This is the same as step S506.

(FIG. 5: Step S513)
The control unit 10 determines whether to end the operation of the advertisement image display device 100. When continuing the operation, the process returns to step S501 and the same processing is repeated. When the operation is finished, this flow is finished.

  The operation of the advertisement image display device 100 according to Embodiment 1 has been described above. In the above description, it is assumed that there is only one imaging unit 60. However, the position in the depth direction (z-axis direction) of the user 200 may be calculated more accurately using a plurality of cameras.

  As described above, the advertising image display device 100 according to the first embodiment acquires the positions of the user 200 and the third party 300 based on the image captured by the imaging unit 60, and the region 52 that is not visible to the third party 300. Is calculated. By displaying the advertisement image in this area 52, only the user 200 can view the advertisement image, so that the possibility that the third person 300 knows the personal preference of the user 200 can be reduced.

  Further, according to the first embodiment, the image area calculation unit 14 calculates a straight line connecting the binocular coordinates of the third person 300 and the body contour of the user 200, and the intersection of the straight line and the display surface of the display unit 50. Ask for. The area 52 surrounded by the intersection is hidden behind the user 200 and cannot be seen by the third person 300. That is, by calculating the region 52 using the above method, the region 52 can be reliably hidden from the third party 300.

  Further, according to the first embodiment, since the advertisement image is selected based on the product purchase history of the user 200, the advertisement image customized for each user 200 can be presented.

<Embodiment 2>
In the first embodiment, the display control unit 15 displays the advertisement image for the user 200 when the IC card recognition unit 11 stops recognizing the member card, that is, when the user 200 leaves the front of the advertisement image display device 100. May be erased from the screen and a public advertisement image may be displayed.

  Further, in the first embodiment, even when a person who simply passes in front of the imaging unit 60 or a person who does not direct his / her line of sight to the imaging unit 60 is displayed, the screen display is switched by calculating the region 52 one by one. If so, the effectiveness of the advertisement will be reduced. Therefore, a threshold is set for the size of the face detected by template matching, and when the detected face is small, that is, when the distance between the imaging unit 60 and the third person 300 is far, a normal screen display is performed without using the region 52. May be performed.

  In addition, in order to determine a person who only passes, a threshold value may be provided so that a third person 300 is not determined unless it appears in the imaging unit 60 for a certain period of time.

  In addition, when the direction of the face of the person and the direction of the line of sight reflected on the imaging unit 60 are detected and the line of sight of the third person 300 is not directed to the display unit 50, the normal screen is displayed without using the area 52. Display may be performed.

<Embodiment 3>
In the first and second embodiments, it has been described that the user ID is stored in the IC chip and the user 200 is specified using the user ID. However, the user 200 can be specified using other methods. For example, the advertisement display device 100 may be caused to input an authentication code that is uniquely assigned to the user 200 in advance.

<Embodiment 4>
As an application target of the present invention, for example, a digital signage terminal installed in a music media rental shop can be considered. The present invention can be applied not only to a rental shop but also to an information display terminal installed in a retail store or a street.

  10: Control unit, 11: IC card recognition unit, 12: Human detection unit, 13: DB search unit, 14: Image area calculation unit, 15: Display control unit, 20: Member information database, 30: Usage history database, 40 : Product information database, 50: display unit, 51: display area, 60: imaging unit, 70: IC card reader, 100: advertisement image display device, 200: user, 300: third party, 400: digital signage system, 410: IC card reader, 420: image display unit, 430: control unit, 440: storage unit.

Claims (5)

A device for displaying an advertisement image,
A display for displaying the advertisement image;
An imaging unit that captures an image of a viewer who browses the advertisement image displayed by the display unit;
A human detection unit for detecting a person present in the image captured by the imaging unit;
An image region calculation unit for calculating an image region for displaying an advertisement image on the display unit;
A display control unit for displaying the advertisement image for the viewer specified by the human detection unit in an area on the display unit calculated by the image region calculation unit;
With
The human detection unit is
It is determined whether or not a third party who is not the viewer is included in the image captured by the imaging unit,
The image area calculation unit
When the human detection unit determines that the third person is included in the image captured by the imaging unit,
Based on the image captured by the imaging unit, the positional relationship between the viewer and the third party is calculated, and based on the positional relationship, an image area where the third party cannot see the advertisement image on the display unit. Calculate and notify the display control unit,
The display control unit
The advertisement image display device, wherein the advertisement image for the viewer is displayed in an image area where the third party cannot see the advertisement image on the display unit. The previous image recording area calculation unit
When the human detection unit determines that the third person is included in the image captured by the imaging unit,
Calculating a straight line connecting the end of the viewer's body contour and the eyes of the third person;
The advertisement image display device according to claim 1, wherein the image region is set at a position closer to an inner side of the body contour of the viewer than a position where the straight line and the display unit intersect. A personal information database holding personal identification information of the viewer;
A usage history database that holds the product purchase history of the viewer;
A product information database that holds product advertising images,
A personal information acquisition unit for acquiring personal identification information of the viewer;
With
The display control unit
The viewer is identified by searching the personal information database using the personal identification information acquired by the personal information acquisition unit as a key,
Search the product purchase history of the viewer from the usage history database,
The advertisement image display device according to claim 1 or 2, wherein an advertisement image suitable for the viewer is selected from advertisement images held in the product information database using the product purchase history. . The display control unit
4. The advertisement image is processed according to the size and position of the region calculated by the image region calculation unit, and the advertisement image is displayed on the display unit. 5. The advertisement image display device described in 1. A method of displaying an advertisement image on a device having a display unit for displaying an advertisement image,
An imaging step of capturing an image of a viewer who browses the advertisement image displayed by the display unit;
A human detection step of detecting a person present in the image captured in the imaging step;
An image area calculating step for calculating an image area for displaying an advertisement image on the display unit;
A display control step for displaying the advertisement image for the viewer specified in the person detection step in the region on the display unit calculated in the image region calculation step;
With
In the human detection step,
It is determined whether or not a third person who is not the viewer is included in the image captured in the imaging step,
In the image area calculation step,
When the person detection step determines that the third person is included in the image captured in the imaging step,
A positional relationship between the viewer and the third party is calculated based on the image captured in the imaging step, and an image area where the third party cannot see the advertisement image on the display unit based on the positional relationship. Calculate
In the display control step,
The advertisement image display method, wherein the advertisement image for the viewer is displayed in an image area where the third party cannot see the advertisement image on the display unit.

Images