JP6048475B2 - Content output apparatus and program - Google Patents

Description

The present invention relates to a content output device and a program for outputting content .

  In general, an advertisement output device such as a digital signage device called an electronic signboard or an electronic advertising board can provide the latest data by changing the advertisement content at any time via a communication network or a storage medium, and also displays moving image data. Therefore, it is popular as an advertising medium that can increase the attention of the viewer. As such a digital signage device, conventionally, for example, a technique has been disclosed in which advertisement data is distributed to a mobile terminal device possessed by a customer who is viewing an advertisement on an advertisement screen (Patent Literature). 1).

JP 2013-140542 A

  However, in the technique of the above-mentioned patent document, advertisement data is distributed to the mobile terminal device via a communication means or a two-dimensional code. It is not necessarily the content of the advertisement that interests you, and when you find the data that the customer is interested in while playing the data, if the play request operation is performed, jump to the linked data Therefore, the previous reproduction is interrupted, and the storytelling is interrupted by switching to other data suddenly. In addition, there is a risk that important data may be missed or the data may be mistaken, and the advertisement content before and after the switching may be confused with the linked advertisement content.

It is an object of the present invention to enable the output related to the output content that the viewer is interested in during the output of the advertisement content to be controlled at an appropriate timing.

The invention of claim 1, a content output apparatus that outputs the advertising contents, and output means for outputting the output content is sequentially changed in the advertising content and the output content of the advertisement content into their individual output timing In response to content storage means for storing in association with the output contents of the advertisement content in the course of being output in sequence, it is determined whether or not there is a reaction at an arbitrary timing in the viewer, and there is a reaction when the detection means and storage control means for storing the reaction storage means by the reaction timing point detected by said detecting means in association with the advertising content to detect the time point of the reaction time, the output content of the advertisement content At a predetermined time after a series of outputs, it is determined whether or not the reaction storage means stores a reaction timing point. When stored is judged that there is a reaction time when it is stored in the reaction storage means reads, specifying means for specifying the output content of the advertising content that has been outputted to the reaction timing point, at the specifying unit And a process execution means for executing an output control process corresponding to the specified output content.

The invention of claim 6 is the content output apparatus that outputs the advertisement content, a content storage means for storing advertising content that includes information for each of a plurality of output position of the output content, there during the output of the advertisement content And determining means for determining whether the line-of-sight position is an output position of the information included in the advertisement content when a line-of-sight is detected by a viewer at an arbitrary position in the advertisement content; in case it is determined that the output position of the information, and storage control means for storing an identifier for identifying the information at the output position the viewing storage means in association with the advertising content, the output of the advertisement content At a later point in time, it is determined whether or not the identifier is stored in the line-of-sight storage means. Reading the stored identifier憶means, specifying means for specifying the information corresponding to the identifier of the advertisement content, and process execution means for executing output control process corresponding to the information specified by said specifying means It is characterized by comprising.

ADVANTAGE OF THE INVENTION According to this invention, the output regarding the output content which the viewer was interested during the advertisement content output can be controlled at an appropriate timing.

The block diagram which showed the communication system containing the digital signage apparatus applied as an advertisement output device. The block diagram which showed the basic component of the digital signage apparatus 1. FIG. (1) is a figure for demonstrating the output information memory 13c, (2) is a figure for demonstrating the reaction information memory 13d. The flowchart for demonstrating operation | movement (characteristic operation | movement of 1st Embodiment) of the digital signage apparatus 1 started execution according to power activation. The flowchart following the operation | movement of FIG. 6 is a flowchart for explaining in detail a reaction timing detection process (step A7 in FIG. 4). In the second embodiment, (1) is a diagram showing a display example of advertisement data, (2) is a diagram for explaining the output information memory 13c, and (3) is for explaining the reaction information memory 13d. Illustration. The flowchart for demonstrating operation | movement (characteristic operation | movement of 2nd Embodiment) of the digital signage apparatus 1 started execution according to power activation. 8 is a flowchart for explaining in detail the gaze detection process (step B4 in FIG. 7).

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described with reference to FIGS.
This embodiment exemplifies a case where the present invention is applied to a digital signage device as an advertisement output device, and FIG. 1 is a block diagram showing a communication system including the digital signage device.
The advertisement output device (digital signage device) 1 is installed at a place where customers gather such as near the entrance, near a resting place, near the exit in a large store, for example, and various kinds of advertisement data (for example, web page data, TV broadcast data, video data, still image group data, audio data, etc.) can be output, and its basic functions include advertisement data output function, timekeeping function, touch input function, communication function, and imaging function. It has image analysis function, sound analysis function, etc.

  The advertisement data output function uses advertisement data received from the content distribution device (server device) 2 via a communication network 3, such as the Internet or a LAN (Local Area Network), or a removable portable memory (recording medium). This is a function of displaying and outputting advertisement data supplied externally to the viewer or outputting sound. In the present embodiment, the viewer is a customer who visits the store, and is not necessarily a customer who is watching the advertisement display and the advertisement sound, but is a customer who is watching only the advertisement display, only the advertisement sound. It may be a customer. The timekeeping function is a function for measuring the current time (year / month / day / hour / minute / second / millisecond) or measuring the timer time. Other functions will be described later in detail.

  The advertisement data is a series of data composed of a plurality of pages (screens), and the advertisement data X in the example shown in the figure includes 1 page data X1, 2 page data X2,..., 6 page data X6. The digital signage apparatus 1 sequentially outputs the individual data X1, X2,..., X6 constituting the advertisement X in units of one page (one screen), and after outputting the final page X6, the first page It returns to the output of X1. In this way, data for each page (screen) is sequentially output, and each page is cyclically switched and output even after it has been completed. Similarly, the advertisement data Y has a configuration including one page of data Y1, two pages of data Y2,..., Five pages of data Y5, and the digital signage apparatus 1 includes individual data Y1, Y2, ..., Y5 is sequentially output in units of one page, and is sequentially switched and output cyclically.

FIG. 2 is a block diagram showing basic components of the digital signage apparatus 1.
The CPU 11 as the core of the digital signage device 1 is a central processing unit that operates by supplying power from the power supply unit 12 and controls the overall operation of the digital signage device 1 according to various programs in the storage unit 13. . The storage unit 13 includes, for example, a ROM, a flash memory, and the like, and includes a program memory 13a that stores a program for realizing the present embodiment in accordance with the operation procedure illustrated in FIGS. 4 to 6, and the digital signage. It has a work memory 13b that temporarily stores various data required by the apparatus 1 (time measurement time, timer measurement time, flag, etc.), an output information memory 13c and a reaction information memory 13d, which will be described later. The storage unit 13 may include a removable portable memory (recording medium) such as an SD card or an IC card, and is connected to the communication network 3 via a communication function (not shown). In such a state, a storage area on a predetermined server device side may be included.

  The CPU 11 is connected with a touch display unit 14, a key operation unit 15, a human sensor unit 16, a voice input / output unit 17, a communication unit 18, an imaging unit 19, a face recognition unit 20, and the like as input / output devices. The CPU 11 controls each input / output device according to the input / output program. The touch display unit 14 displays advertisement data or displays a function name as a software key. A touch screen (touch input function) for detecting a touch-operated position and inputting the coordinate data is displayed. Configure. The key operation unit 15 includes a push button type key such as a power key for turning on / off the power.

  The human sensor unit 16 is an infrared sensor for human body detection that is arranged on the screen (advertisement screen) side of the touch display unit 14 and senses whether or not there is a viewer (customer) in the vicinity of the advertisement screen. When it is detected that the user is present, the CPU 11 drives the voice input / output unit 17 and the imaging unit 19, and when it is detected that there is no customer, the CPU 11 stops driving the voice input / output unit 17 and the imaging unit 19. The voice input / output unit 17 has a microphone and a speaker, and while the human sensor unit 16 detects a customer, the voice input / output unit 17 outputs a voice of the advertisement data or inputs a voice from the customer. It is arranged toward the side. The CPU 11 analyzes whether or not a predetermined voice described later is included by analyzing the voice from the customer input from the voice input / output unit 17.

  The communication unit 18 is a communication module (communication function) capable of high-speed and large-capacity communication that receives advertisement data from the content distribution device 2 via the communication network 3. The imaging unit 19 is a digital camera (imaging function) that is arranged on the advertisement screen side and captures an image centered on a customer's face looking at the advertisement screen while the human sensor unit 16 detects the customer. The face recognizing unit 20 constitutes an image analysis function for analyzing the facial image of the customer imaged by the imaging unit 19 and detecting the facial expression of the customer. It is intended to recognize whether or not there is.

FIG. 3 is a diagram for explaining the output information memory 13c and the reaction information memory 13d. (1) shows the output information memory 13c, and (2) shows the reaction information memory 13d.
The output information memory 13c is a memory that temporarily stores the output timing and the like as the status (output information) related to the output each time the individual data constituting the advertisement is sequentially output on the advertisement screen. As shown in FIG. 4, the data item includes “data number”, “data name”, “time stamp when reading data”, and “link destination”.

  “Data number” indicates a serial number (information for identifying data in the memory) generated each time individual data is output, and the value of “data number” is updated each time data is sequentially output. Is done. “Data name” is data identification information such as “image X1” and “image X”. The “time stamp at the time of reading data” is the time obtained by the timekeeping function when the data to be output is read. In the example shown in the figure, “time stamp at the time of data reading” indicates that it is “2013.3.2.26.09: 47: 50,000 (year / month / day / hour / minute / second / millisecond)” in the case of the image X1. In the case of the image X2, “2013.3.26.09:47:55:500 (year / month / day / hour / minute / second / millisecond)” is indicated. “Link destination” indicates detailed data (for example, product description information) and URL (Uniform Resource Locator) of the link destination for the data.

  The reaction information memory 13d is a memory that temporarily stores the timing as a reaction timing when it is detected that the customer has responded to the advertisement during the output of the advertisement data. As shown in FIG. Each item includes “data number”, “data name”, and “reaction timing”. The “data number” is a serial number that identifies data in the memory. “Reaction timing” is the time when it is detected that the customer has issued a specific word in the middle of the output of the advertisement data, or when the facial expression of the customer is an expression that is interested in the advertisement. As the reaction of the customer to the advertisement, the time obtained by the timekeeping function when the reaction is detected is set as the reaction timing. In the example shown in the figure, “reaction timing” indicates “2013.3.26.609:47:52,000 (year / month / day / hour / minute / second / millisecond)” in the case of the image X1.

  Here, specific words by customers are positive words such as “I want to buy”, “Good”, “Cool”, “Looks good”, etc. Assume that a customer responds to an advertisement when a voice containing words is emitted. In addition, it is good also as a customer's reaction not only a positive word but a negative word to an advertisement. The expression of the customer's facial expression that is interested in the advertisement is, for example, a case where the customer watching the advertisement screen stares at one point for a certain time or longer without changing the line-of-sight direction. It is assumed that the customer responds to the advertisement when changing to such an expression during viewing. The facial expression is not limited to staring at a single point, but whether the pupil is wide open for a certain period of time (surprise) or whether the mouth is open (smile). Also good.

  As described above, the CPU 11 detects the timing of the customer's reaction as the first timing, temporarily stores it in the reaction information memory 13d, and then a timing later than the “response timing”, for example, a series of advertisements composed of a plurality of pages. The timing at which sequential output of data is completed (timing to return from the last page to the first page) is detected as the second timing (output timing), and at this second timing (output timing), the reaction timing (first timing) Data that has been output from time to time is identified, and output control relating to that data is performed. In this case, the specified data is output again as it is, or detailed data linked to the data is newly output.

  Next, the operation concept of the digital signage apparatus 1 in the first embodiment will be described with reference to the flowcharts shown in FIGS. Here, each function described in these flowcharts is stored in the form of a readable program code, and operations according to the program code are sequentially executed. Further, it is possible to sequentially execute the operation according to the above-described program code transmitted via a transmission medium such as a network. The same applies to other embodiments described later. In addition to the recording medium, an operation unique to the present embodiment can be executed using a program / data supplied externally via a transmission medium.

4 and 5 are flowcharts for explaining the operation of the digital signage apparatus 1 (characteristic operation of the first embodiment) that is started in response to power-on.
First, the CPU 11 is in a state in which advertisement data can be received from the content distribution device (server device) 2 via the communication network 3 (step A1 in FIG. 4). Then, it is checked whether or not the customer is detected by the human sensor unit 16, that is, whether or not there is a customer in the vicinity of the advertisement screen (step A2). If there is no customer (NO in step A2), the output of the data currently being output is temporarily stopped (step A9), and then the process returns to step A1, but when it is detected that there is a customer in the vicinity of the advertisement screen ( YES in step A2), in order to cyclically sequentially switch and output advertisement data for a plurality of pages (screens) for each page (one screen), the data for one page (one screen) is read (step A3). . Then, it is checked whether the sequential output has been completed, that is, whether it is the timing to move from the last page (screen) to reading the first page (step A4).

  If the sequential output is not completed (NO in step A4), the read data is arranged and displayed on the advertisement screen of the touch display unit 14, and if audio is added to the data, the audio data is converted to audio. Output from the input / output unit 17 (step A5). Then, “data name”, “link destination”, and “time stamp at the time of data reading” are generated as information of the output data and temporarily stored in the output information memory 13c (step A6), and then the customer's reaction is performed. The process proceeds to detection timing detection processing to be detected (step A7).

FIG. 6 is a flowchart for explaining the reaction timing detection process (step A7 in FIG. 4) in detail.
First, the CPU 11 checks whether there is a voice input from the voice input / output unit 17 (step A71). If there is a voice input (YES in step A71), the CPU 11 analyzes the voice and, for example, "I want to buy" It is checked whether or not the predetermined voice includes a positive word such as “delicious” (step A73). If the predetermined voice does not come (NO in step A73), the process proceeds to the next step A74. If it is a predetermined voice (YES in step A73), it is determined that the customer has responded to the advertisement and the process proceeds to the next step A77, and the time obtained by the time counting function at the time of the reaction is set as the reaction timing (first time). As a timing, a process of temporarily storing in the reaction information memory 13d is performed.

  If there is no voice input (NO in step A71), the process proceeds to the next step A74, and the customer's face image captured by the imaging unit 19 is acquired. Then, the face recognition unit 20 analyzes the captured image (step A75). As a result, it is checked whether the facial expression of the customer is an expression that is interested in the advertisement (for example, whether it is staring, surprised, or smiling) (step A76), and the customer is interested. If it is not a facial expression (NO in step A76), the flow of FIG. 6 is exited, but if it is a facial expression showing interest (YES in step A76), it is determined that the customer has responded to the advertisement. Then, the process proceeds to the next step A77, where the time obtained by the time measuring function at the time of the reaction is used as the reaction timing (first timing) to temporarily store it in the reaction information memory 13d.

  When such a reaction timing detection process (step A7 in FIG. 4) is completed, it is checked whether it is a switching timing to the next page (next screen) (step A8), and a reaction timing detection process (until the switching timing is reached) (step A8). Returning to step A7), when the switching timing is reached (YES in step A8), the process returns to the first step A1. In this way, in the state where the advertisement data is switched and output sequentially for each page, when it is detected that the advertisement output has completed (YES in step A4), the reaction timing is temporarily stored with reference to the reaction information memory 13d. If the reaction timing is not stored (NO in step A10), the process returns to the first step A1.

  If the reaction timing is temporarily stored (YES in step A10), the process proceeds to the flow of FIG. 5, and the contents of the reaction information memory 13d and the contents of the output information memory 13c are collated (step A11). The data output at the timing is specified (step A12). In the example of FIGS. 3A and 3B, the “time stamp at the time of data reading” is “... 50,000” in the image X1, and “… 55: 500” in the image X2. Since the “reaction timing” is “... 52,000”, the data of the image X1 is specified as the data output at the reaction timing.

  When data is identified by this, the output information memory 13c is referred to, and it is checked whether or not “link destination” is associated with the specific data (step A13). If “link destination” is not associated (NO in step A13) ), The process of re-outputting the specific data as it is (step A15). If “link destination” is associated (YES in step A13), after jumping to the link destination (step A14), detailed data (such as product description) is read from the link destination. A new output process is performed (step A15).

  In this state, the presence / absence of an instruction operation (touch operation on the touch screen) by the customer is checked (step A16). If the instruction operation is not performed (NO in step A16), the process proceeds to the next step A18. If it has been carried out (YES in step A16), a process corresponding to the instruction (step A17) is performed, and then the process proceeds to step A18. This step A18 is to check whether or not a certain output time has elapsed. The process returns to step A15 until the output time has elapsed. When the elapse of the output time is detected (YES in step A18), the power is turned off. (Step A19), the process returns to the first step A1 in FIG.

  As described above, the digital signage apparatus 1 according to the first embodiment detects the response time of the viewer (customer) during the output of the advertisement as the first timing (response timing), and more than this response timing. Since the late predetermined timing is detected as the second timing (output timing) and when this output timing is reached, the data output at the reaction timing is identified and the output control related to the data is performed. It is possible to control the output related to the data that the customer is interested in at an appropriate timing while the individual data constituting the advertisement is being output sequentially. As a result, it is possible to prevent sudden switching of data during advertisement output, and to maintain a series of data flow. For customers, it is possible to prevent data from being missed or mistaken, On the main side (store side), the advertising effect can be enhanced.

  The CPU 11 collates the contents of the output information memory 13c that stores the output information in association with the individual data constituting the advertisement and the contents of the reaction information memory 13d that stores the timing (reaction timing) of the customer's reaction. By doing so, the data output at the time of the reaction is specified, so that it is possible to easily specify the data that the customer has responded from the output data.

  Since the customer's reaction is recognized from the change in the customer's image captured by the imaging unit 19 and the reaction timing is detected, it is not necessary to request a special operation for the customer, and the customer's reaction is detected from the captured image. Can be accurately detected.

  Since the captured customer image is analyzed and the viewer's reaction is recognized from the change in the facial expression of the customer, the customer's reaction can be detected more accurately.

  Since the customer's reaction is recognized from the voice input from the voice input / output unit 17 and the reaction timing is detected, it is not necessary to request a special operation from the customer. It is possible to accurately detect customer reaction.

  Since the timing at which the sequential output of individual data composing the advertisement is completed (timing from the last page to the first page) is detected as the second timing (output timing), the data is suddenly output during the advertisement output. There is no switching, and the customer can view the data that interests them after viewing a series of data.

  At the output timing, the data that was output at the reaction timing is output again, so that the customer can reconfirm the data that interests them.

  When link data is associated with the data that was output at the time of the reaction, the link data is newly acquired and output, so for example, when a product reacts to the product details It is possible to switch to the output of link data.

  When an instruction operation by a customer is performed in a state where output control is performed on data output at the time of reaction, for example, a process corresponding to the instruction operation is executed. It is also possible to apply for purchase on the spot.

  In the first embodiment described above, the viewer's reaction is recognized from the change in the customer's image captured by the imaging unit 19 to detect the reaction timing, or the viewer's reaction is recognized from the input voice. Although the reaction timing is detected, the reaction timing may be detected by a predetermined input operation by the customer. For example, customers who are interested in advertising can touch the advertising screen (touch screen) casually without having a special will, or operate the specified touch keys and push buttons with a special will to input instruction commands. In such a case, the time at that time may be detected as the reaction timing, and the reaction timing can also be detected by such an input operation.

  In the first embodiment described above, the timing at which the sequential output of the individual data constituting the advertisement is completed is detected as the second timing (output timing), but the customer in the vicinity of the advertisement screen is detected. You may make it detect the timing which the sequential output of the data completed from the beginning as 2nd timing (output timing). For example, it is also possible to detect, as the output timing, the timing at which the sequential output of data from the starting point is the data at which the customer has started to see the advertisement. In this case, the image picked up by the image pickup unit 19 is analyzed, and the time when the customer's face faces the advertisement screen may be recognized as the time when the advertisement is started. In addition, after the data that the customer has started to see the advertisement is output again, the data that was output at the reaction timing may be output.

In this way, when the timing at which the sequential output of data is completed after the customer starts to see the advertisement is used as the output timing, the flowchart in FIG. 4 may be partially changed. For example, when it is determined at step A2 in FIG. 4 that human presence is present, the customer's face is imaged, and the captured image is analyzed to determine whether the face has started to face the advertisement screen. The identification information of the output data is temporarily stored, and in step A2 in FIG. 4, it is only necessary to determine whether or not the sequential output of the data has been completed with this data as a starting point.
As described above, the output timing is the timing when the data starting from the advertisement is started, and the customer can view the data with interest after viewing all the data.

In the first embodiment described above, the timing at which the sequential output of data is completed is detected as the output timing. However, the timing at which the customer has changed the advertisement output from a viewable state to an impossible state is set as the output timing. You may make it detect. For example, the timing at which the customer is about to leave the digital signage apparatus 1 may be detected as the output timing. Or you may make it detect as the output timing the timing which looked away so that the line of sight turned to the outer side of an advertising screen. In this case, for example, by analyzing the image captured by the imaging unit 19 and detecting the timing when the customer is about to leave or the direction of the gaze is largely deviated based on the direction of the customer's face or the direction of the line of sight. Good.
Thus, it is possible to attract the customer to the advertisement again by setting the timing when the customer tries to leave or the timing when the customer looks away as the output timing.

  Furthermore, the output timing at which the customer's reaction data is output may be a timing at which the customer is about to leave the store. For example, data related to a product that a customer who has watched a digital signage device installed near the entrance of a store has shown interest is transmitted to the digital signage device installed near the exit of the store and output. Also good. In this case, for example, in the communication system in the store, the customer's location is tracked and managed together with the customer identification information by communicating with the mobile terminal device owned by the customer in the store, and the customer passes near the exit of the store. When recognizing that it is immediately before, data relating to a product that the customer has shown interest in may be transmitted to the digital signage device near the exit to instruct the output.

  Although not particularly mentioned in the first embodiment described above, the present invention can be similarly applied even when there are a plurality of viewers in the vicinity of the digital signage device. In this case, if it is detected that there are a plurality of viewers, the reaction timing is detected for each viewer, and output control related to the data output at each reaction timing is repeatedly performed for each viewer. Good. That is, when the presence sensor unit 16 detects that there are a plurality of viewers in the vicinity of the digital signage device, the CPU 11 may detect the timing at the time of reaction for each viewer as the first timing. . In this case, a plurality of first timings are detected. At that time, the number of viewers may be counted, and the first timing may be detected for the number of viewers. Next, the CPU 11 specifies the data output at the first timing for each viewer (for example, specifies data for the number of viewers), and repeatedly performs output control on the data for each viewer. You can do it. At that time, for example, data that each viewer responds may be sequentially switched and displayed at the output timing, or may be sequentially switched and displayed by a page turning operation (touch operation) on an advertisement screen (touch screen). . For example, even when three viewers are detected as the number of viewers, if two people respond to the advertisement, the first timing may be detected for two people. Furthermore, the present invention is not limited to counting the number of viewers, but the viewer (who) is identified by detecting the viewer's position (right corner, middle, etc.) with respect to the digital signage device, and the timing when the viewer reacts You may make it identify the data currently output.

(Second Embodiment)
A second embodiment of the present invention will be described below with reference to FIGS.
In the first embodiment described above, the timing at which the customer responds to the advertisement is detected. However, in this second embodiment, the display position (advertisement position) at which the customer is staring at the advertisement screen is displayed. The detection is performed, and output control relating to the data of the gaze position is performed at a predetermined timing (output timing) after the data output to the gaze position is specified. In the first embodiment, the individual data constituting the advertisement is sequentially output. However, in the second embodiment, the advertisement data for one screen is always output, and the output timing is shown. Shows the timing when the customer tries to leave the advertisement screen. Here, in both the embodiments, the same or the same names are denoted by the same reference numerals, the description thereof will be omitted, and the following description will focus on the features of the second embodiment. .

FIG. 7A shows a state in which images A, B, C, and D are arranged and displayed as data for one screen on the advertisement screen, that is, a plurality of data are arranged and displayed in one screen. FIG. 7B is a diagram showing the contents of the output information memory 13c in this case.
The output information memory 13c of the second embodiment has items of “data number”, “data name”, “data size”, “data pasting position”, and “link destination”.

  The “data number”, “data name”, and “link destination” are the same as those in FIG. “Data size” indicates the size (horizontal width and vertical width) of the data on the advertisement screen. As shown in FIG. 7A, the image A has a size of 200 × 200 dots, and the image B has a size of 200 × 100 dots. Indicates that the size. The “data pasting position” is the position of the upper left corner of the data as the pasting position (display position) in the plane coordinate system with the upper left corner of the advertisement screen as the origin, and is shown in FIG. Thus, the pasting position of image A indicates that the X coordinate value is 50 dots and the Y coordinate value is 500 dots, and the pasting position of image B is 1000 dots for the X coordinate value and 900 dots for the Y coordinate value. It is shown that.

FIG. 7 (3) is a diagram for explaining the reaction information memory 13d.
The reaction information memory 13d of the second embodiment has items of “data number” and “gaze data identification information”. “Gaze data identification information” indicates identification information (data name) of data displayed at a position on the advertisement screen where the customer is staring. Here, the CPU 11 analyzes the image picked up by the image pickup unit 19, and when the customer's line-of-sight direction is staring at a certain point without changing for a certain time or more, the display position staring according to the line-of-sight direction (Advertisement position) is detected as a gaze position. Note that the gaze position is not limited to the case where the position is detected in units of 1 dot, and an approximate position (area) may be detected in units of 10 dots or in units of areas obtained by dividing the advertisement screen into a plurality of areas. In the illustrated example, the case where the image A on the advertisement screen is stared is shown.

FIG. 8 is a flowchart for explaining the operation (characteristic operation of the second embodiment) of the digital signage apparatus 1 that is started in response to power-on.
First, when reading the advertisement data (step B1), the CPU 11 generates “data name”, “data size”, “data pasting position”, and “link destination” as output information of the advertisement data, and outputs the output information. The advertisement data is temporarily stored in the memory 13c (step B2), and the advertisement data is arranged and displayed on the advertisement screen and output by voice (step B3). And it moves to a gaze position detection process (step B4).

FIG. 9 is a flowchart for explaining the gaze position detection process (step B4 in FIG. 8) in detail.
First, the CPU 11 acquires an image captured by the imaging unit 19 (step B41). Then, the face recognition unit 20 analyzes the captured image (step B42). As a result, it is checked whether the customer's line-of-sight direction is staring at one point without being changed for a certain time (for example, 2 seconds) (step B43).

  If the advertisement screen is not stared (NO in step B43), the flow of FIG. 9 is exited, but if the stare is stared (YES in step B43), processing for detecting the staring position (advertisement position) on the advertisement screen is performed. Move (step B44). In this case, an approximate position (area) is detected in units of 10 dots or in units of areas obtained by dividing the advertisement screen into a plurality of parts. Then, referring to “data size” and “data pasting position” in the output information memory 13c, the data displayed at the gaze position is specified (step B45), and the specified data is predetermined data (for example, a product) Name data, product price, etc.) (step B46). Here, if the data is other than the predetermined data, for example, data such as a background image not related to the product to be advertised (NO in step B46), the flow of FIG. YES in step B46), and processing for temporarily storing the identification information (data name) of the data in the reaction information memory 13d as “fixed data identification information” (step B47). Thereafter, the flow of FIG. 9 is exited.

  When such a gaze position detection process (step B4 in FIG. 8) is completed, an image captured by the imaging unit 19 is acquired (step B5), the captured image is analyzed (step B6), and the customer's state is Then, it is checked whether the advertisement output has changed from a viewable state to an impossible state, that is, whether the customer is about to leave by detecting the direction of the customer's face and the direction of the line of sight (step B7). If the customer does not want to leave, that is, if the customer continues to watch the advertisement screen (NO in step B6), the process returns to the gaze position detection process (step B4), but when the customer tries to leave (step B6). YES), it is checked whether or not the “gaze data identification information” is temporarily stored in the reaction information memory 13d, that is, whether or not the customer who responded to the advertisement tried to leave (step B8).

  When the customer who did not respond to the advertisement is about to leave, since the “gaze data identification information” is not stored (NO in step B8), the process returns to the gaze position detection process (step B4), but has responded to the advertisement. When the customer is about to leave, “gaze data identification information” is temporarily stored in the reaction information memory 13d (YES in step B8), so that a sound effect (large sound, customer (Sound to be stopped) is generated and output (step B9). Then, the output information memory 13c is referred to based on the “gaze data identification information”, the data is specified (step B10), and it is checked whether the “link destination” is associated with the specified data (step B11). .

  As a result, if “link destination” is not associated (NO in step B11), this specific data is output again (step B13). If “link destination” is associated (in step B11). YES), after performing the process of jumping to the link destination (step B12), the process of newly outputting the detailed data of the link destination is performed (step B13). In this state, it is checked whether or not a certain output time has passed (step B14), and the process returns to step B13 until the output time has passed. When the elapse of the output time is detected (YES in step B14), the above-described steps Return to B3.

  As described above, the digital signage apparatus 1 according to the second embodiment detects the gaze position on the advertisement screen by the viewer (customer) during the advertisement display, and if the gaze position is predetermined data, the predetermined Since the identification information for designating the data is temporarily stored, the predetermined data displayed at the gaze position is specified from the identification information of the temporary storage at a predetermined timing thereafter, and output control regarding the data is performed. , The output related to the data that the customer is interested in can be controlled at the right time, no special operation is required from the customer, and the data that the customer is interested in can be accurately identified. On the advertiser side (store side), the advertising effect can be enhanced.

  In the second embodiment described above, the case where the advertisement data for one screen is always output has been exemplified. However, as in the first embodiment, individual data constituting the advertisement may be sequentially output. Good. In the second embodiment, the gaze position on the advertisement screen by the viewer (customer) is detected while the advertisement is displayed. However, the gaze position is not limited to detection, and for example, any gaze position on the touch screen is displayed. A position arbitrarily designated by an input operation may be detected, for example, when the customer touches the position. Also, the customer sees when the facial expression changes, such as the customer's eyes are wide open (surprised), mouth open (smile), etc. for a certain period of time The display position may be a position arbitrarily designated by the customer.

  In the second embodiment, the output timing is the timing when the customer tries to leave the advertisement screen. However, as in the first embodiment, the sequential output of the individual data constituting the advertisement is completed. (Timing when moving from the last page to the first page) may be the output timing. Alternatively, the data at which the customer has started to see the advertisement may be used as the starting point, and the timing at which the sequential output of the data from the starting point may be detected as the output timing. Moreover, you may make it detect the timing which a customer tries to go out of a store as an output timing. By sequentially outputting the individual data constituting the advertisement in this way, the same effects as in the first embodiment are obtained.

  Furthermore, the data of the product is displayed on the digital signage device installed at the sales corner at the timing when the customer passes the corner selling the data (product) that the customer has reacted near the entrance of the store. It may be. Even in this case, it is feasible if the customer's position is tracked and managed together with the customer identification information by communicating with the portable terminal device possessed by the customer in the store.

  In each of the embodiments described above, the viewer's (customer) face image is analyzed and the direction of the line of sight is detected as the viewer's response. However, the customer's gesture is detected as the viewer's response. May be. Further, the customer's voice is not limited to the voice naturally uttered in response to the advertisement content, but may be a voice that inputs an instruction command.

In each embodiment mentioned above, although the digital signage apparatus installed in a shop was illustrated, it is not restricted to this, The digital signage apparatus installed in a station premises or a town may be sufficient.
Further, although the advertisement screen is a touch screen, a projected image may be displayed on the screen as long as it is a digital signage device equipped with a projector.

  Further, the “apparatus” and “unit” shown in each of the above-described embodiments may be separated into a plurality of cases by function, and are not limited to a single case. In addition, each step described in the above-described flowchart is not limited to time-series processing, and a plurality of steps may be processed in parallel or separately.

The embodiment of the present invention has been described above. However, the present invention is not limited to this, and includes the invention described in the claims and the equivalent scope thereof.
Hereinafter, the invention described in the claims of the present application will be appended.
(Appendix)
(Claim 1)
The invention described in claim 1
An advertisement output device that sequentially outputs individual data constituting an advertisement,
First timing detection means for detecting, as a first timing, a response time of a viewer during the output of the advertisement;
Second timing detection means for detecting a predetermined timing later than the first timing detected by the first timing detection means as the second timing;
Determining means for determining whether or not the second timing has been reached;
An output control means for specifying the data output at the first timing and performing output control relating to the data when the determination means determines that the second timing has been reached;
It is provided with.
(Claim 2)
The invention according to claim 2 is the advertisement output device according to claim 1,
Further comprising output information storage means for storing the output information in association with individual data constituting the advertisement,
The output control means was output at the first timing by comparing the output information stored in the output information storage means with the first timing detected by the first timing detection means. Identify the data,
It is characterized by that.
(Claim 3)
The invention according to claim 3 is the advertisement output device according to claim 1 or 2,
It further comprises any of imaging means for imaging the viewer, voice input means for inputting the viewer's voice, and operation means for inputting a predetermined input operation by the viewer,
The first timing detection unit detects a first timing by recognizing a viewer's reaction from a change in an image captured by the imaging unit, or a viewer from a voice input from the voice input unit. The first timing is detected by recognizing the reaction, or the timing when a predetermined input operation by the viewer is performed by the operation means is detected as the first timing.
It is characterized by that.
(Claim 4)
The invention according to claim 4 is the advertisement output device according to any one of claims 1 to 3,
The second timing detection means detects, as a second timing, a timing at which the sequential output of individual data constituting the advertisement has made a round.
It is characterized by that.
(Claim 5)
The invention according to claim 5 is the advertisement output device according to any one of claims 1 to 3,
Further comprising viewer detection means for detecting whether or not there is a viewer in the vicinity of the advertisement output device;
The second timing detection means detects, as a second timing, a timing at which the sequential output of individual data constituting the advertisement has been completed since the viewer detection means has started to detect nearby viewers.
It is characterized by that.
(Claim 6)
The invention according to claim 6 is the advertisement output device according to any one of claims 1 to 3,
Further comprising viewer state detecting means for detecting whether or not the viewer can view the advertisement output;
The second timing detection unit detects, as a second timing, a timing at which the viewer state detection unit has changed from a viewable state to an impossible state.
It is characterized by that.
(Claim 7)
The invention according to claim 7 is the advertisement output device according to any one of claims 1 to 6,
The output control means performs output control to output again the data output at the first timing, or newly acquires link data associated with the data output at the first timing Output control
It is characterized by that.
(Claim 8)
The invention according to claim 8 is the advertisement output device according to any one of claims 1 to 7,
A plurality of viewer detection means for detecting whether or not there are a plurality of viewers in the vicinity of the advertisement output device;
The first timing detection means detects the reaction timing as a first timing for each viewer when the plurality of viewer detection means detects that there are a plurality of viewers,
The output control means specifies the data output at the first timing for each viewer and repeatedly performs output control on the data for each viewer.
It is characterized by that.
(Claim 9)
The invention according to claim 9 is the advertisement output device according to any one of claims 1 to 8,
Instruction processing means for executing processing according to an instruction operation when an instruction operation is performed by a viewer in a state where the output control means performs output control on the data output at the first timing. Further comprising
It is characterized by that.
(Claim 10)
The invention according to claim 10 is:
An advertisement output device that displays advertisement data,
Detecting means for detecting a designated position on a screen by a viewer during display of the advertisement;
If the specified position detected by the detecting means is predetermined data, storage means for storing identification information for specifying the predetermined data;
Output control for specifying the predetermined data displayed at the designated position from the identification information stored in the storage means at a predetermined timing after the designated position is detected by the detecting means and performing output control on the data Means,
It is characterized by providing.
(Claim 11)
The invention described in claim 11 is the advertisement output device according to claim 10,
The detection means detects a gaze position on a screen by a viewer during display of the advertisement as a designated position.
It is characterized by that.
(Claim 12)
The invention according to claim 12
A program for controlling a computer of an advertisement output device that sequentially displays individual data constituting an advertisement,
The computer,
First timing detection means for detecting, as a first timing, a response time of a viewer during the output of the advertisement;
Second timing detection means for detecting a predetermined timing later than the first timing detected by the first timing detection means as the second timing;
Determining means for determining whether or not the second timing has been reached;
An output control means for specifying the data output at the first timing and performing output control relating to the data when the determination means determines that the second timing has been reached;
Program to function as.
(Claim 13)
The invention according to claim 13
A program for controlling a computer of an advertisement output device that displays advertisement data,
The computer,
Detecting means for detecting a designated position on a screen by a viewer during display of the advertisement;
If the specified position detected by the detecting means is predetermined data, storage means for storing identification information for specifying the predetermined data;
Output control for specifying the predetermined data displayed at the designated position from the identification information stored in the storage means at a predetermined timing after the designated position is detected by the detecting means and performing output control on the data Means,
Program to function as.

1 Digital Signage Device 2 Content Distribution Device (Server Device)
3 Communication network 11 CPU
DESCRIPTION OF SYMBOLS 13 Memory | storage part 13a Program memory 13c Output information memory 13d Reaction information memory 14 Touch display part 15 Key operation part 16 Human sensor part 17 Voice input / output part 18 Communication part 19 Imaging part 20 Face recognition part

Claims (11)

A content output device that outputs advertisement content,
Output means for sequentially changing and outputting the output content in the advertising content;
Content storage means for storing each output content of the advertising content in association with each output timing;
In the middle of the output contents of the advertisement content being sequentially changed and output, it is determined whether or not the viewer has reacted at an arbitrary timing, and when there is a reaction, the time of the reaction timing is detected. Detection means;
Storage control means for storing the reaction timing point detected by the detection means in the reaction storage means in association with the advertisement content;
At a predetermined time after a series of output contents of the advertising content, it is determined whether or not the reaction storage means has a memory of the reaction timing point, and when it is determined that there is a memory, the reaction storage means stores the memory. A means for reading out the response timing point, and specifying the output content of the advertising content that was output at the reaction timing point;
Processing execution means for executing output control processing corresponding to the output content specified by the specifying means;
A content output apparatus comprising: Said detecting means, when the viewer is determined that in a position near the output of the output content, determination of the particular sound based on the voice analysis of the viewer, or based on the captured image analysis with respect to the viewer an image By detecting the change, the determination time point is detected as the reaction timing time point.
The content output apparatus according to claim 1. The specifying unit determines whether or not the reaction storage unit stores the reaction timing at the end of a series of outputs of the advertising content, and when it is determined that the detection has been performed, the output content of the advertising content Identify
The content output device according to claim 1, wherein the content output device is a content output device. Each output content of the advertising content includes link information corresponding to the output content,
The process execution means executes a process of outputting information of the link destination based on the link information corresponding to the output content specified by the specifying means.
The content output device according to any one of claims 1 to 3. Determining means for determining whether or not link information is included corresponding to the output content specified by the specifying means;
Further comprising
When it is determined that the link information is included, the process execution unit outputs the information of the link destination based on the link information, and when it is determined that the link information is not included, Executing a process of outputting the output content specified by the specifying means;
The content output device according to claim 1, wherein the content output device is a content output device. A content output device that outputs advertisement content,
Content storage means for storing advertisement content including information for each of a plurality of output positions of output content;
In the middle output of the advertisement content, the time of detecting the sight line by the viewer for any position in the advertising content, whether the output position of the information which the visual line position is included in the advertisement content Discriminating means for discriminating;
A storage control unit for storing an identifier for identifying information at the output position in the line-of-sight storage unit in association with the advertisement content when the determination unit determines that the output position is the information;
At a predetermined time after the output of the advertising content, it is determined whether or not the identifier is stored in the line-of-sight storage unit. When it is determined that there is a memory, the identifier stored in the line-of-sight storage unit is read. Identifying means for identifying information corresponding to the identifier in the advertising content;
Processing execution means for executing output control processing corresponding to the information specified by the specifying means;
A content output apparatus comprising: The predetermined time point in the specifying means is a time point before the viewer who was in front of the output position output to the advertising content leaves the output position.
The content output apparatus according to claim 6. Each information included in the advertising content includes link information,
The process execution means executes a process of outputting the information of the link destination based on the link information specified by the specifying means.
The content output device according to claim 6 or 7, wherein Determining means for determining whether or not link information is included in the information specified by the specifying means;
Further comprising
When it is determined that the link information is included, the process execution unit outputs the information of the link destination based on the link information, and when it is determined that the link information is not included, Executing the process of outputting the information specified by the specifying means;
The content output device according to claim 6, wherein the content output device is a content output device. A program for controlling a computer of a content output device that outputs advertisement content,
The computer,
Output means for sequentially changing and outputting the output content in the advertising content;
Content storage means for storing each output content of the advertising content in association with each output timing;
In the middle of the output contents of the advertisement content being sequentially changed and output, it is determined whether or not the viewer has reacted at an arbitrary timing, and when there is a reaction, the time of the reaction timing is detected. Detection means,
Storage control means for storing the reaction timing point detected by the detection means in the reaction storage means in association with the advertisement content;
At a predetermined time after a series of output contents of the advertising content, it is determined whether or not the reaction storage means has a memory of the reaction timing point, and when it is determined that there is a memory, the reaction storage means stores the memory. A specifying means for reading the response timing point that has been output and specifying the output content of the advertising content that was output at the reaction timing point;
Processing execution means for executing output control processing corresponding to the output content specified by the specifying means;
A program designed to function as A program for controlling a computer of a content output device that outputs advertisement content,
The computer,
Content storage means for storing advertisement content including information for each of a plurality of output positions of output content;
In the middle output of the advertisement content, the time of detecting the sight line by the viewer for any position in the advertising content, whether the output position of the information which the visual line position is included in the advertisement content Discriminating means for discriminating,
A storage control unit that stores an identifier for identifying information at the output position in the line-of-sight storage unit in association with the advertisement content when the determination unit determines that the output position is the information;
At a predetermined time after the output of the advertising content, it is determined whether or not the identifier is stored in the line-of-sight storage unit. When it is determined that there is a memory, the identifier stored in the line-of-sight storage unit is read. , A specifying means for specifying information corresponding to the identifier in the advertising content,
Processing execution means for executing output control processing corresponding to the information specified by the specifying means;
A program designed to function as

Images