JP6405826B2 - Information processing apparatus, information processing method, and program - Google Patents

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program.

  2. Description of the Related Art Conventionally, an image output device connected to an image supply device, a reflection member, and a screen, output light that projects content from the image output device is reflected by the reflection member, and output light reflected by the reflection member There is known a video output device-equipped device that can enhance the impression to the viewer by projecting the image on a screen formed in the shape of the outline of the content (see, for example, Patent Document 1).

JP 2011-150221 A

  However, the technique described in Patent Document 1 only outputs a video unilaterally. For this reason, for example, when content that requires user operation is output, it is impossible to grasp the type of operation suitable for the user and perform operation guidance suitable for the user.

  An object of the present invention is to make it possible to grasp the type of operation suitable for a user.

In order to solve the above problem, an information processing apparatus according to claim 1 is provided.
Extraction means for detecting a user and extracting the characteristics of the user;
Detecting means for detecting the type of operation performed on the input means by the user while the predetermined content is output by the output means;
And characteristics of the user who operated extracted by the extraction means, the type of operation by the user detected by the detection unit, the operation is stored in association with a content that has been outputted when detected Storage means;
Is provided.

  According to the present invention, it is possible to grasp the types of operations suitable for the user.

It is a figure which shows the example of whole structure of the content output system in this embodiment. It is a block diagram which shows the functional structure of the digital signage apparatus of FIG. It is a figure which shows schematic structure of the screen part of FIG. It is a block diagram which shows the functional structure of the server apparatus of FIG. It is a figure which shows the example of data storage of the operation information storage part of FIG. It is a flowchart which shows the operation information recording process performed by the control part of FIG. It is a flowchart which shows the content output control process performed by the control part of FIG.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following embodiments, a case where the information processing apparatus according to the present invention is applied to the digital signage apparatus 1 will be described as an example. The present invention is not limited to the illustrated example.

[Configuration of Content Output System 100]
FIG. 1 is a diagram showing an overall configuration of a content output system 100 according to an embodiment of the present invention. As shown in FIG. 1, the content output system 100 includes a digital signage device 1 provided in a store and a server device 2. The digital signage device 1 and the server device 2 are configured to be communicable via a communication network N such as a LAN (Local Area Network) or a WAN (Wide Area Network). The number of digital signage devices 1 is not particularly limited.

[Configuration of Digital Signage Device 1]
FIG. 2 is a block diagram showing a main control configuration of the digital signage apparatus 1.
The digital signage device 1 is, for example, a device that outputs content related to a product handled in a store. As illustrated in FIG. 2, a projection unit 21 that emits image light of the content, and a projection unit 21 that emits the light. And a screen unit 22 that receives the image light on the back surface and projects the image light on the front surface.

First, the projection unit 21 will be described.
The projection unit 21 includes a control unit 23, a projector 24, a storage unit 25, a communication unit 26, and a timer unit 30. The projector 24, the storage unit 25, the communication unit 26, and the time measuring unit 30 are connected to the control unit 23 as shown in FIG.

  The control unit 23 includes a CPU that executes various programs stored in the program storage unit 251 of the storage unit 25 to perform predetermined calculations and control of each unit, and a memory that is a work area when the program is executed. (Both not shown). The control unit 23 performs various processes including an operation information recording process and a content output control process described later in cooperation with the program, and functions as an extraction unit, an output control unit, and an estimation unit.

  The projector 24 is a projection device that converts the image data output from the control unit 23 into image light and irradiates the image data toward the screen unit 22. For example, the projector 24 performs a display operation by individually turning on / off each tilt angle of a plurality of micromirrors arranged in an array (in the case of XGA, horizontal 1024 pixels × vertical 768 pixels) at high speed. A DLP (Digital Light Processing) (registered trademark) projector using a DMD (digital micromirror device), which is a display element that forms a light image with the reflected light, is applicable.

  The storage unit 25 is configured by an HDD (Hard Disk Drive), a nonvolatile semiconductor memory, or the like. The storage unit 25 is provided with a program storage unit 251 as shown in FIG. The program storage unit 251 includes a system program executed by the control unit 23, a processing program for executing various processes including an operation information recording process and a content output control process, which will be described later, and is necessary for executing these programs. Various data are stored.

The storage unit 25 is provided with a content storage unit 252. The content storage unit 252 stores content data to be reproduced by the digital signage apparatus 1 in association with content identification information. The content data is composed of, for example, moving image data composed of a plurality of frame images and audio data corresponding to each frame image.
Further, the storage unit 25 stores the device No. of its own device. Is remembered.

  The communication unit 26 includes a modem, a router, a network card, and the like, and performs communication with an external device connected to the communication network N.

  The time measuring unit 30 is configured by an RTC (Real Time Clock) or the like, acquires the current date and time, and outputs it to the control unit 23.

Next, the screen unit 22 will be described.
FIG. 3 is a front view illustrating a schematic configuration of the screen unit 22. As shown in FIG. 3, the screen unit 22 includes an image forming unit 27 and a pedestal 28 that supports the image forming unit 27.

  The image forming unit 27 is formed by laminating a film-like Fresnel lens on a single translucent plate 29 formed in a human shape such as an acrylic plate, which is disposed so as to be substantially orthogonal to the image light irradiation direction. The rear screen projection film screen 291 and a film 292 on which a person is printed in advance are attached. The projector 24 projects an image on the area where the film screen 291 of the image forming unit 27 is pasted. In addition, it is good also as a structure which stuck the film screen 291 to the translucent board 29 whole, and also projects a person. The image forming unit 27 and the projector 24 described above constitute an output unit.

  The pedestal 28 is provided with a button-type operation unit 32, an audio output unit 33 such as a speaker that outputs audio, a non-contact communication unit 34, a printer 35, and an imaging unit 36.

  The operation unit 32 includes a plurality of operation buttons, detects a press signal of the operation button, and outputs it to the control unit 23. Each operation button is associated with a display area 32a for displaying a process executed by pressing the operation button, a content switching destination by pressing the operation button, and the like.

  The non-contact communication unit 34 has a wireless communication function such as NFC (Near Field Communication), and performs wireless communication with the IC card 3 and the mobile terminal 4 to read / write data from / to the IC card 3 and the mobile terminal 4. Or send / receive data to / from the portable terminal 4. The non-contact communication unit 34 functions as a detection unit.

  Here, the IC card 3 is a membership card or the like of a store where the digital signage device 1 is installed, and can perform non-contact communication, and stores a user ID and the like for identifying a user. The portable terminal 4 is a portable terminal that is possessed by the user and capable of non-contact communication.

  The printer 35 performs printing on a sheet in accordance with an instruction from the control unit 23 and outputs it from the discharge port 351.

The imaging unit 36 captures an image of a space facing the image forming unit 27 and generates a captured image. Although not shown, the imaging unit 36 includes a camera including an optical system and an imaging element, and an imaging control unit that controls the camera.
The optical system of the camera is directed in a direction in which a person (user) in front of the image forming unit 27 can be photographed. The imaging element is, for example, an image sensor such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS). The imaging element converts the optical image that has passed through the optical system into a two-dimensional image signal.

  The operation unit 32, the audio output unit 33, the non-contact communication unit 34, the printer 35, and the imaging unit 36 are connected to the control unit 23 as shown in FIG.

[Configuration of Server Device 2]
FIG. 4 is a block diagram illustrating a main control configuration of the server device 2. The server device 2 is a device that selects content suitable for the user, and includes a control unit 201, a storage unit 202, a communication unit 203, and the like, as shown in FIG.

  The control unit 201 executes a variety of programs stored in the program storage unit 221 of the storage unit 202 to perform a predetermined calculation and control of each unit, and a memory serving as a work area when executing the program (Both not shown). The control unit 201 executes various processes including an operation information analysis process in cooperation with a program stored in the program storage unit 221 of the storage unit 202.

  The storage unit 202 includes an HDD (Hard Disk Drive), a nonvolatile semiconductor memory, or the like. As shown in FIG. 4, the storage unit 202 is provided with a program storage unit 221. The program storage unit 221 stores a system program executed by the control unit 201, various processing programs including an operation information analysis process, data necessary for executing these programs, and the like.

  The storage unit 202 is provided with an operation information storage unit 222 and a compatible content information storage unit 223.

FIG. 5 shows an example of data storage in the operation information storage unit 222. As shown in FIG. 5, the operation information storage unit 222 includes items such as “date and time”, “apparatus No.”, “user characteristics”, “reproduction content”, and “operation type”. Operation information such as the characteristics of the operated user when the operation is performed in the digital signage apparatus 1, the information specifying the content reproduced during the operation, and the operation type are stored in association with each other.
Here, “date and time” is the date and time when the operation was performed. “Apparatus No.” is an identification number for identifying the digital signage apparatus 1 that has been operated. “User characteristics” is information indicating the characteristics of the user who performed the operation, and here, gender and estimated age. “Reproduced content” is information (for example, content identification information when the operation is performed or time from the start of reproduction) that identifies which content is being operated. The “type of operation” is, for example, a button operation (operated button number), an operation of holding the IC card 3, an operation of holding the mobile terminal 4, or the like.

  The compatible content information storage unit 223 stores user characteristics (here, gender and age) and content identification information suitable for the user having the characteristics in association with each other.

  The communication unit 203 includes a modem, a router, a network card, and the like, and performs communication with an external device connected to the communication network N.

[Operation of Content Output System 100]
Next, the operation of the content output system 100 will be described.

  In the content output system 100, first, operation information recording processing (see FIG. 6) is executed in the digital signage device 1 until a predetermined period or a predetermined number of operation information is accumulated in the operation information storage unit 222. Accumulate operation information. When operation information for a predetermined period or a predetermined number of pieces of operation information is stored in the operation information storage unit 222, an operation information analysis process is executed in the server device 2, and the user characteristics are based on the operation information accumulated in the operation information storage unit 222. The tendency of each preference and operation type is analyzed, and content that matches each user feature is selected or created based on the analysis result. And the identification information of the content adapted for every user characteristic is stored in the adapted content information storage unit 223. Thereafter, the digital signage apparatus 1 performs content output control processing (see FIG. 7), and accumulates further operation information while outputting content suitable for the user. The server device 2 executes an operation information analysis process every time operation information for a predetermined period or a predetermined number is stored in the operation information storage unit 222, and analyzes based on the operation information accumulated in the operation information storage unit 222. To update the information on the relevant content. Hereinafter, processing executed in each apparatus will be described.

(Operation information recording process)
FIG. 6 shows a flowchart of the operation information recording process executed in the digital signage apparatus 1. The operation information recording process includes a program stored in the control unit 23 and the program storage unit 251 while the power of the digital signage device 1 is ON within a predetermined period or a period until a predetermined number of operation information is accumulated. It is executed by the cooperation.

  First, the control unit 23 causes the image forming unit 27 and the audio output unit 33 to output content (step S1). For example, the control unit 23 sequentially reads content data of content from the content storage unit 252, sequentially outputs the frame images to the projector 24, and causes the projector 24 to project the image forming unit 27. Also, the audio data of the read content data is output to the audio output unit 33, and the audio of the content is output. Note that the output of the content is continued after step S2.

  The content output here is, for example, content such as an advertisement related to a product handled at a store. In the content, for example, a lottery where a discount coupon for a product described in the content is won, display of a product sales floor guide, download of a URL of a product catalog homepage, and the like can be performed according to a user operation. Moreover, it can switch to the content of another goods according to user operation (here button operation of the operation part 32).

  That is, if the user operation on the content and the information specifying the content output when the operation is performed are accumulated for each user feature, a desired product tendency (preference trend) is obtained for each user feature. Is possible. For example, an operation that instructs a lottery, display of a sales floor guide, download, or the like can be considered that the user is interested in the product described in the content that was output when the operation was performed. In addition, an operation for switching to another content can be considered that the user is interested in the switching destination content.

  In addition, a plurality of types of operation means are prepared for the content output here. For example, operations for obtaining a discount coupon by lottery include (1) pressing an operation button to issue a paper coupon, and (2) holding the IC card 3 over the non-contact communication unit 34 and coupon information on the IC card 3 Three operation means are prepared: (3) launching the application of the mobile terminal 4 and holding the application over the non-contact communication unit 34 to write the coupon information to the mobile terminal 4. Therefore, if the types of user operations for content are accumulated for each user feature, information on what types of operations are frequently used for each user feature can be acquired.

  Next, the control unit 23 obtains a photographed image by photographing with the imaging unit 36 (step S2), and performs face recognition processing on the obtained photographed image (step S3). Then, it is determined whether or not a face is detected from the captured image (step S4). The face recognition process can be performed using a known image processing technique based on features such as eyes, nose, and mouth.

  If it is determined that no face has been detected from the captured image (step S4; NO), the control unit 23 returns to step S1 and causes the imaging unit 36 to capture images at predetermined time intervals during the output of the content.

  When it is determined that a face has been detected from the captured image (step S4; YES), the control unit 23 determines that the user has been detected and has come to the front of the digital signage device 1 from the face image detected from the captured image. User characteristics (specifically, age and sex) are extracted, and the extracted user characteristics are stored (overwritten) in a predetermined area of the memory in association with the face area (position and size) (step S5). Note that the extraction of the user's age and gender may be performed using any known image processing technique such as a method of estimating the age and gender based on the facial contour extracted from the face image and the characteristics of the parts. Good. When a plurality of faces are detected from the photographed image, features are extracted from each face image.

  Next, the control unit 23 determines whether a user operation has been detected (step S6). Here, it is determined whether any one of the operation buttons 32 of the operation unit 32, the operation of holding the IC card 3 or the operation of holding the portable terminal 4 is detected. Whether or not an operation of holding the IC card 3 or the portable terminal 4 is detected is determined based on whether or not the IC card 3 or the portable terminal 4 is detected in the communication area of the non-contact communication unit 34.

  If it is determined that no user operation has been detected (step S6; NO), the control unit 23 returns to step S1.

  If it is determined that a user operation has been detected (step S6; YES), the control unit 23 acquires the current date and time (operation date and time) by the time measuring unit 30, and estimates the operated user (step S7). Specifically, when the number of faces detected in step S4 is one, it is estimated that the user operated by the user of that face. When there are a plurality of faces detected in step S4, it is estimated that the user operated by the user with the largest face area is operated.

  Then, the control unit 23 operates the operation date and time, the device number of the own device, the characteristics of the operated user stored in the memory, the information specifying the content reproduced at the time of operation, and the type of operation (button operation (operation Button number), an operation of holding an IC card, and an operation of holding a portable terminal) are associated with each other and transmitted as operation information to the server device 2 by the communication unit 26 and stored in the operation information storage unit 222 (step S8). Return to S1.

  The control unit 23 repeatedly executes Steps S1 to S8 while the digital signage device 1 is powered on.

  When the control unit 201 of the server device 2 receives the operation information from the digital signage device 1 through the communication unit 203, the control unit 201 stores the received operation information in the operation information storage unit 222.

(Operation information analysis processing)
When operation information for a predetermined period or a predetermined number of operations is stored in the operation information storage unit 222, the control unit 201 of the server device 2 executes an operation information analysis process and is stored in the operation information storage unit 222 as an analysis unit. Based on the operation information, the tendency of the preference and operation type for each feature of the user is analyzed, and the tendency of the content suitable for each feature of the user is acquired. As the tendency of the type of operation, for example, the type of operation determined to be used most frequently is analyzed for each feature of the user. Based on the analysis result, content that matches each user's characteristics is selected from the already prepared contents, or content that matches each user's characteristics is newly generated. Are stored in the matching content information storage unit 223 in association with each other. When a new content is generated, the content identification information and the content data are associated with each other and transmitted to the digital signage apparatus 1 and stored in the content storage unit 252.

Here, as described above, in the server device 2, for example, for a feature of the user, for example, a desired product tendency (preference tendency) and an operation are performed based on the operation information accumulated in the operation information storage unit 222. Analyzes and obtains trends of types. Therefore, in the present embodiment, the control unit 201 of the server device 2 uses the operation information stored in the operation information storage unit 222 to determine, for each user feature, a product that matches the user preference having the feature. Content for which the operation guide of the type of operation most frequently used by the user having the feature is displayed as the matching content, and the identification information is associated with the user's feature and the matching content information storage unit Store in 223.
When the operation information analysis process is completed, the control unit 201 of the server device 2 notifies the digital signage device 1 to that effect by the communication unit 203.

(Content output control processing)
In the server device 2, when content identification information that matches each user feature is stored in the compatible content information storage unit 223 by the above-described operation information recording process, the control unit 23 of the digital signage device 1 performs content output control. Processing (refer to FIG. 7) is performed, and further operation information is accumulated while outputting contents suitable for the user.

  FIG. 7 shows a flowchart of content output control processing executed in the digital signage apparatus 1. The content output control process is executed by cooperation of the control unit 23 and the program stored in the program storage unit 251 while the digital signage device 1 is powered on.

  First, the control unit 23 causes the image forming unit 27 and the audio output unit 33 to output content (step S11). For example, the control unit 23 sequentially reads content data of content from the content storage unit 252 and causes the image forming unit 27 and the audio output unit 33 to output the content data. Note that the output of the content is continued after step S12.

  Next, the control unit 23 obtains a photographed image by photographing with the imaging unit 36 (step S12), and performs face recognition processing on the obtained photographed image (step S13). Then, it is determined whether or not a face has been detected from the captured image (step S14).

  If it is determined that no face has been detected from the captured image (step S14; NO), the control unit 23 returns to step S11 and causes the image capturing unit 36 to capture images at predetermined time intervals during the output of the content.

  When it is determined that a face has been detected from the captured image (step S14; YES), the control unit 23 determines that a new user has been detected, and before the digital signage device 1 from the face image detected from the captured image. The features (specifically, age and gender) of the user who has come are extracted, and the extracted user features are associated with the face area and stored (overwritten) in a predetermined area of the memory (step S15). When a plurality of faces are detected from the captured image, the user's features are extracted from the largest face area, that is, the face image of the user closest to the digital signage device 1.

  And the control part 23 requests | requires selection of a content by transmitting the information of a user's characteristic to the server apparatus 2 by the communication part 26 (step S16).

  In the server device 2, when the control unit 201 receives the operation information from the communication unit 203, the control unit 201 refers to the compatible content information storage unit 223, and sends the content of the identification information stored in association with the received user characteristics to the user. Select as suitable content. Here, the content suitable for the user is content based on the operation information stored in the operation information storage unit 222 and associated with the received user characteristics. For example, when the female 30's is performing the most operation on the mobile terminal, the content that is mainly operated by the mobile terminal is selected. Then, the identification information of the selected content is transmitted to the digital signage device 1 by the communication unit 203.

In the digital signage apparatus 1, the communication unit 26 waits for reception of identification information of the selected content from the server apparatus 2 (step S17).
When the identification information of the selected content from the server device 2 is received by the communication unit 26 (step S17; YES), the control unit 23 determines whether or not a user having the same feature as the feature extracted in step S15 has been detected. (Step S18). Specifically, when the same process as described in steps S11 to S15 is performed again and the extracted feature matches the feature stored in the memory, the feature extracted in step S15 It is determined that a user having the same characteristics has been detected.

  When it is determined that a user having the same feature as the feature extracted in step S15 is detected (step S18; YES), the control unit 23 outputs the content selected in the server device 2 by the image forming unit 27 and the audio output unit 33. (Step S19).

  Next, the control unit 23 determines whether a user operation is detected (step S20). Here, it is determined whether any one of the operation buttons 32 of the operation unit 32, the operation of holding the IC card 3 or the operation of holding the portable terminal 4 is detected.

If it is determined that no user operation has been detected (step S20; NO), the control unit 23 returns to step S18.
If it is determined that a user operation has been detected (step S20; YES), the control unit 23 acquires the current date and time (operation date and time) by the time measuring unit 30, and the user whose characteristics are stored in the memory (in the captured image). It is estimated that the user who operated the user with the largest face area is the operated user (step S21). Then, the control unit 23 operates the operation date and time, the device number of the own device, the characteristics of the operated user stored in the memory, the information specifying the content reproduced at the time of operation, and the type of operation (button operation (operation Button number), an operation of holding an IC card, and an operation of holding a portable terminal are associated with each other and transmitted as operation information to the server device 2 by the communication unit 26 (step S22), and the process returns to step S18.

  When the control unit 201 of the server device 2 receives the operation information from the digital signage device 1 through the communication unit 203, the control unit 201 stores the received operation information in the operation information storage unit 222.

  On the other hand, when it is determined in step S18 that a user having the same feature as that extracted in step S15 has not been detected (step S18; NO), the control unit 23 returns to step S11.

  The control unit 23 repeatedly executes the processes of steps S11 to S22 while the power of the digital signage device 1 is ON.

  As described above, in the content output system 100, the content is about the product that matches the user's preference according to the characteristics of the user in front of the digital signage device 1, and the operation guidance of the type of operation suitable for the user. Select the content to be output. Therefore, it is possible to provide highly convenient content according to the user's preference.

  When operation information for a predetermined period or a predetermined number of pieces of operation information is stored in the operation information storage unit 222, the control unit 201 of the server device 2 executes the above-described operation information analysis process and is stored in the compatible content information storage unit 223. Content data stored in the content storage unit 252 is updated.

  As described above, according to the digital signage apparatus 1 in the present embodiment, the control unit 23 detects the type of operation performed by the user, and associates the operated user's characteristics with the type of operation to the server. The information is stored in the operation information storage unit 222 of the device 2.

  Therefore, since it is possible to acquire the tendency of the type of operation for each feature of the user, it is possible to grasp the type of operation suitable for the user.

  The types of operations by the user include button operations, card-holding operations, and operations that hold the mobile terminal, so whether the type of operation suitable for the user is a button operation, an operation that holds the card, or the mobile terminal It becomes possible to grasp whether it is an operation or the like.

In addition, the control unit 201 of the server device 2 is most frequently assigned to the user having the feature for each user feature based on the user feature and the type of operation stored in the operation information storage unit 222 in association with each other. Analyzing the tendency of the type of operation used, and using the identification information of the matching content (specifically, the content that provides operation guidance for the most frequently used operation type) according to this trend as the user's characteristics The associated content information storage unit 223 is stored in association with each other. When the control unit 23 of the digital signage apparatus 1 newly detects a user and extracts its features, the output content is switched to content corresponding to the extracted features.
Therefore, since the content for performing the operation guidance of the type of operation suitable for the user is output, the convenience for the user can be improved.

  In addition, the operation information storage unit 222 stores the characteristics of the operated user, the type of operation, and information specifying the content that was output when the operation was detected in association with each other. Every time, it becomes possible to grasp the content of interest, that is, the tendency of preference.

  The user's characteristics can be extracted based on the recognized face image by acquiring the user's captured image by the imaging unit 36, performing face recognition processing on the acquired captured image.

  In addition, when a plurality of face images are recognized by the face recognition process, the largest face image among the recognized face images is estimated as the face image of the user who operated, so that the operated user can be easily estimated. it can.

  Also, by extracting the user's gender and age as the user's characteristics, it becomes possible to acquire the tendency of the operation type by gender and age, so it is possible to grasp the type of operation suitable for the user's gender and age. It is possible to output content that outputs operation guidance of the type of operation suitable for the user's gender and age.

  In addition, the description content in the said embodiment is a suitable example of the content output system and digital signage apparatus which concern on this invention, and is not limited to this.

  For example, in the above-described embodiment, the user detection and the user feature extraction from the captured image are performed in the digital signage device 1, but may be performed in the server device 2. And operation is performed in the digital signage apparatus 1, operation date and time, apparatus NO. When the information on the type of operation and the content reproduced at the time of operation is transmitted to the server device 2, the control unit 23 of the server device 2 associates the feature of the operated user extracted immediately before with the received information. It is also possible to select content that is stored in the operation information storage unit 222 and that matches the operated user.

  In the above-described embodiment, the operation information storage unit 222 and the compatible content information storage unit 223 are provided in the server device 2 so that the server device 2 stores the operation information or performs an analysis based on the accumulated operation information. However, the operation information storage unit 222 and the compatible content information storage unit 223 are provided in the storage unit 25 of the digital signage device 1 and processing performed by the server device 2 is described. This may be performed by the control unit 23 of the digital signage apparatus 1.

  In the above embodiment, in the content output control process, when a user is detected, the feature of the user is extracted, and content that matches the feature is selected and output. However, a user operation is detected. In this case, it is also possible to select and output content suitable for the characteristics of the operated user.

  In the above embodiment, the content is stored in the digital signage device 1 in advance, and the content that matches the detected user's characteristics is selected from the stored contents. Content that conforms to the above may be distributed on the spot from the server device 2.

  Moreover, in the said embodiment, although the kind of operation was made into 3 types, the operation of holding up a button operation, holding up an IC card, and holding up a portable terminal, the kind of operation is not limited to these. For example, an interactive operation for inputting a response to a question from the digital signage device 1 by voice, an action operation for performing an operation input by an operation in front of the digital signage device 1 (for example, a hand movement), and the like are included. It is good as well. In this case, the content of the dialogue (answer) and the content of the action are also stored in the operation information.

  Moreover, in the said embodiment, although the case where sex and age were acquired as a user's characteristic from a face image was demonstrated as an example, as a user's characteristic, it is not limited to this. For example, race, operator's facial expression (whether laughing, etc.), presence / absence of glasses, clothes, etc. may be acquired as user characteristics. As a result, it is possible to classify the user's characteristics more finely and select content that is more suitable for the user. Further, the value of the operation information stored in the operation information storage unit 222 as marketing data can be improved.

  In the above embodiment, only the features of the user estimated to be the operator are included in the operation information and stored. However, when there are a plurality of face images in the captured image, the number of other face images (together) The number of users who are viewing the content) and the characteristics of each user may be stored in association with the operation information. Thereby, the value as marketing data of the operation information memorize | stored in the operation information memory | storage part 222 can further be improved.

  Further, for example, when the face image of the user registered together with the personal information at the time of registering the store member is stored in the database of the digital signage device 1 or the server device 2, the user's face image obtained from the photographed image The user's individual may be specified by collating with the customer's face image in the database. If operation information is stored in association with the user ID and the like of the identified user, the user's personal preference and operation type tendency can be acquired based on the operation information, and content suitable for the user's individual Can be selected. Also, if you take a picture every predetermined time and remember the content and position of the content when the user smiles, you can clarify where the user reacted in the content, Can be useful.

  In the above embodiment, the operator's face image extracted from the photographed image is discarded without being used in particular, but may be stored in association with the operation information according to the purpose. If the face image data is stored every time, there is a problem that the amount of data to be stored becomes large. For example, if it is used for the purpose of also serving as a crime prevention surveillance camera, the face image is also used. It may be stored together.

  In the above-described embodiment, the case where the image forming unit 27 is a human type has been described as an example. However, other shapes may be used, and the present invention is not limited to this.

  In the above embodiment, the case where the present invention is applied to a digital signage apparatus that displays an image by projecting an image from a projector onto a screen has been described as an example. Even if it is applied to a content output device having the display device, the same effect can be obtained, and the present invention is not limited to this example.

  In addition, the detailed configuration and detailed operation of the content output system and the digital signage apparatus can be changed as appropriate without departing from the spirit of the invention.

Although several embodiments of the present invention have been described, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof.
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Extraction means for detecting a user and extracting the characteristics of the user;
Detecting means for detecting the type of operation performed by the user;
Storage means for storing the characteristics of the operated user extracted by the extracting means and the type of operation by the user detected by the detecting means in association with each other;
An information processing apparatus comprising:
<Claim 2>
The information processing apparatus according to claim 1, wherein the type of operation by the user includes a button operation, an operation of holding a card, and an operation of holding a mobile terminal.
<Claim 3>
Output means for outputting content;
When the extraction unit newly detects the user and extracts the feature, the content output by the output unit is stored in the storage unit in association with the extracted feature. Output control means for switching to content based on;
The information processing apparatus according to claim 1, comprising:
<Claim 4>
Analyzing means for analyzing, for each user feature, the type of operation most frequently used by the user having the feature based on the user feature and the kind of operation stored in association with each other in the storage means. Prepared,
When the extraction means newly detects a user and extracts its features, the output control means assigns the content output by the output means to the user having the characteristics extracted by the analysis means. The information processing apparatus according to claim 3, wherein the information processing apparatus switches to content that provides operation guidance of an operation type that is determined to be frequently used.
<Claim 5>
The storage means stores the characteristics of the operated user extracted by the extracting means, the type of operation by the user detected by the detecting means, and the content output when the operation by the user is detected. The information processing apparatus according to claim 3 or 4, wherein the information to be identified is stored in association with each other.
<Claim 6>
The extraction unit includes an imaging unit that acquires a captured image of a user, performs face recognition processing on the captured image acquired by the imaging unit, and extracts features of the user based on the recognized face image. Item 6. The information processing device according to any one of Items 1 to 5.
<Claim 7>
The information processing apparatus according to claim 6, further comprising: an estimation unit configured to estimate a face image of a user who has operated a largest face image among recognized face images when a plurality of face images are recognized by the face recognition process. .
<Claim 8>
The information processing apparatus according to claim 1, wherein the user characteristics are a user's gender and age.
<Claim 9>
Detecting a user and extracting features of the user;
Detecting the type of operation performed by the user;
Storing the extracted characteristics of the operated user in association with the detected type of operation by the user in a storage unit;
An information processing method including:
<Claim 10>
Computer
Extraction means for detecting a user and extracting the characteristics of the user;
Detecting means for detecting the type of operation performed by the user;
Storage means for storing the characteristics of the operated user extracted by the extracting means and the type of operation by the user detected by the detecting means in association with each other;
Program to function as.

DESCRIPTION OF SYMBOLS 100 Content output system 1 Digital signage apparatus 21 Projection part 22 Screen part 23 Control part 24 Projector 25 Storage part 251 Program storage part 252 Content storage part 26 Communication part 27 Image formation part 28 Base 29 Translucent board 32 Operation part 33 Audio | voice output part 34 Non-contact communication unit 2 Server device 201 Control unit 202 Storage unit 221 Program storage unit 222 Operation information storage unit 223 Conforming content information storage unit 203 Communication unit

Claims (9)

Extraction means for detecting a user and extracting the characteristics of the user;
Detecting means for detecting the type of operation performed on the input means by the user while the predetermined content is output by the output means;
The characteristics of the operated user extracted by the extracting unit, the type of operation by the user detected by the detecting unit , and the content output when the operation is detected are stored in association with each other. Storage means;
An information processing apparatus comprising:   The information processing apparatus according to claim 1, wherein the type of operation by the user includes a button operation, an operation of holding a card, and an operation of holding a mobile terminal. Output means for outputting content;
When the extraction unit newly detects the user and extracts the feature, the content output by the output unit is stored in the storage unit in association with the extracted feature. Output control means for switching to content based on;
The information processing apparatus according to claim 1, comprising: Analyzing means for analyzing, for each user feature, the type of operation most frequently used by the user having the feature based on the user feature and the kind of operation stored in association with each other in the storage means. Prepared,
When the extraction means newly detects a user and extracts its features, the output control means assigns the content output by the output means to the user having the characteristics extracted by the analysis means. The information processing apparatus according to claim 3, wherein the information processing apparatus switches to content that provides operation guidance of an operation type that is determined to be frequently used. The extraction unit includes an imaging unit that acquires a captured image of a user, performs face recognition processing on the captured image acquired by the imaging unit, and extracts features of the user based on the recognized face image. Item 5. The information processing device according to any one of Items 1 to 4 . The information processing apparatus according to claim 5 , further comprising: an estimation unit configured to estimate a face image of a user who has operated the largest face image among the recognized face images when a plurality of face images are recognized by the face recognition process. . Features of the user, the information processing apparatus according to any one of claim 1 to 6, which is a sex and age of the user. Detecting a user and extracting features of the user;
Detecting the type of operation performed on the input means by the user while the predetermined content is being output by the output means ;
Storing the extracted characteristics of the operated user , the detected type of operation by the user, and the content output when the operation is detected in a storage unit in association with each other;
An information processing method including: Computer
Extraction means for detecting a user and extracting the characteristics of the user;
Detecting means for detecting the type of operation performed on the input means by the user while predetermined content is output by the output means;
A storage for storing the characteristics of the operated user extracted by the extraction unit, the type of operation by the user detected by the detection unit , and the content output when the operation is detected in association with each other means,
Program to function as.

Images