JP2020119425A - Information processing device, information processing system, information processing method, and program - Google Patents

Abstract

To more accurately estimate a use state of each user with respect to an apparatus shared by a group of users.SOLUTION: A log storage unit stores a first log including operation information indicating an operation state of a first apparatus shared by a group of users and a second log including event information indicating an event related to each user appearing in a second apparatus corresponding to the first apparatus, and a log analysis unit estimates a usable period in which the first apparatus is usable by each user on the basis of the event information, and adds user identification information indicating the user related to the usable period to the operation information indicating the operation state in the usable period to generate a coupling log.SELECTED DRAWING: Figure 5

Description

The present invention relates to an information processing device, an information processing system, an information processing method and a program, for example, an information processing system for analyzing a viewing tendency of a television broadcast program.

As the viewing information of the television broadcast program, information for identifying a program or a commercial (commercial advertisement) advertised by connecting the television receiver to the Internet without using a special device is sent to a predetermined server device, It may be used for surveying other viewing trends, and distributing advertisements based on survey results. The viewing information includes information indicating the reception time and the broadcast program received by the television receiver. Since the television receiver is usually shared by each household, the viewing information indicates the viewing status for each household, but does not necessarily indicate the viewing status for each individual.

In the computer system described in Patent Document 1, a set used by a TV subscriber in order for a server to receive an IP address associated with an account of a TV subscriber who uses the TV service and to display TV content provided by the TV service. An IP address is associated with the top box. The server receives information about TV viewing, including the IP address, and maintains a TV log of TV viewing. The IP address is also associated with an internet device, such as a home computer corresponding to a TV subscriber, and the computer uses a web browser to view internet net content. The server receives information about in-home web browsing activity associated with the IP address, maintains an Internet log for it, and stores entries in the TV log in association with entries in the Internet log.

Japanese Patent Publication No. 2013-543710

Therefore, it is conceivable that the mobile phone personally owned by the user provides the server device with position information indicating its position and connection information indicating the connected base station device. The server device estimates whether or not the user is at home based on the information received from the mobile phone. However, while there are limited opportunities to receive the merits of providing information, the user may feel reluctant to periodically send various types of information to the server device from the mobile phone.

It may be possible to provide the user with a service that brings more merits to the collection of position information and the like, but the user may not want the service in the first place. In addition, when the user goes out with the mobile phone left at home, the activity status of the user may not be accurately determined, such as whether or not the user is out.

The present invention has been made in view of the above points, and an information processing apparatus, an information processing system, and an information processing that can more accurately estimate the usage status of each user with respect to a device shared by a group of users. Methods and programs are provided.

The present invention has been made to solve the above problems, and one aspect of the present invention is to provide a first log including operation information indicating an operation status of a first device shared by a group of users, and the first log. A log accumulation unit that accumulates a second log including event information indicating an event related to an individual user that appears in a second device corresponding to one device, and the individual user uses the first log based on the event information. A log analysis unit that estimates a usable period during which the device can be used and adds the user identification information indicating the user relating to the usable period to the operation information indicating the operating condition in the usable period to generate a combined log. An information processing apparatus including:

According to this embodiment, it is possible to more accurately estimate the usage status of each user with respect to the device shared by the group of users.

It is explanatory drawing which shows the outline of an example of the information processing system which concerns on this embodiment. It is a figure which shows the example of the content presentation apparatus which concerns on this embodiment, a living condition of each user, and an estimated viewing-and-listening condition of each user. It is a schematic block diagram which shows the structural example of the information processing system which concerns on this embodiment. It is a schematic block diagram which shows the hardware structural example of the information processing apparatus which concerns on this embodiment. It is a schematic block diagram which shows the functional structural example of the information processing apparatus which concerns on this embodiment. It is a figure which shows the operation example of the voice input device which concerns on this embodiment. It is a figure which shows the 1st example of the apparatus log of the voice input device which concerns on this embodiment. It is a figure which shows the 2nd example of the apparatus log of the voice input device which concerns on this embodiment. It is a figure which shows the operation example of the information terminal device which concerns on this embodiment. It is a figure which shows the example of the equipment log of the information terminal device which concerns on this embodiment. It is a figure which shows the example of operation|movement of the communication robot which concerns on this embodiment. It is a figure which shows the example of the equipment log of the communication robot which concerns on this embodiment. It is a figure which shows the 2nd example of the apparatus log of the information terminal device which concerns on this embodiment. It is a figure which shows the 1st example of the combination log which concerns on this embodiment. It is a figure which shows the 2nd example of the combination log which concerns on this embodiment. It is a figure which shows the 3rd example of the combination log which concerns on this embodiment. It is a figure which shows the 4th example of the combination log which concerns on this embodiment. It is a figure which shows the 5th example of the combination log which concerns on this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(System overview)
First, the outline of the information processing system according to the present embodiment will be described. The information processing system according to the present embodiment estimates the operating period of a device that can be shared by a group of one or more users and the usable period during which the device can be used by each user Information indicating the period is added to the operation information of the device. By specifying the operating period of the user from the operating period and the usable period of each user, it is possible to investigate and analyze the usage status of the device for each user.
In the following description, a device shared by a group may be referred to as a first device, and a device that acquires an event related to an activity state of each user may be referred to as a second device. In the present application, “shared” means that it is not dedicated to a specific individual and may be used by other persons, and does not necessarily mean that it is used by a plurality of users at the same time.

In the example illustrated in FIG. 1, it is assumed that the household HM having the users A1 and A2 as members has the first device, the first device is the content presentation device 40, and the second device is the information terminal device 30. .. The content presentation device 40 is, for example, a television receiver, and the information terminal device 30 is, for example, a mobile phone having a voice interaction function. The content presentation device 40 starts presenting content in response to an operation received from any user, and thereafter ends presenting content in response to another operation received. The content presentation apparatus 40 of the 1st line of FIG. 2 shows an example of the period which presents content in a certain day. The two periods with the letters "ON" indicate the content presentation period.

The information terminal device 30 acquires the utterance content of one of the users in the voice interaction function, and acquires the living situation of each user and the event related to the change from the utterance content. The living situation is divided into a situation in which the content presentation device 40 can be used and a situation in which the content presentation device 40 cannot be used. In the example of the second and fourth lines of FIG. 2, the daily living situations of the users A1 and A2 are classified into sleeping, awake, and going out. Among them, the time zone in which the living situation is a sleeping time zone and the awakening time zone is equivalent to the home time zone. In this example, the information terminal device 30 has an event corresponding to a change (wake-up) from sleeping to awake, an event corresponding to a change from awake to going out (going out), a change from being awake to being awake. It is only necessary to be able to acquire the event corresponding to (going home) and the event corresponding to the change from awake to sleeping (sleep). In this example, the time period during which each user is awake is the available period of the content presentation device 40. Therefore, in the content presentation period, a period that overlaps with the awake period of each user is estimated as a period during which the user can view the content presented by the content presentation device 40 (hereinafter, an estimated viewing period). It The other periods are estimated as periods during which the content is unviewable (hereinafter referred to as unviewable period). Therefore, according to the present embodiment, with respect to the content presentation device 40 shared by the users A1 and A2, it is possible to analyze the operation status in the estimated viewing period as the operation period for each user. As the usage status of each user, for example, it is possible to investigate and analyze the usage frequency, the presence/absence of viewing of a specific content, the taste of the content, and the like.

Therefore, the information processing system according to the present embodiment acquires a first log including operation information indicating the operation status of the first device and a second log including event information indicating an event that appears in the second device of each user. Then, the acquired first log and second log are stored in association with each other. In addition, the information processing system 1 estimates the usable period during which the user of the second device can use the first device based on the event information, and the operation information related to the usable period in the first log indicates the second device. User identification information indicating the user is added. The above estimated viewing period corresponds to the usable period.

(System configuration)
Next, a configuration example of the information processing system 1 according to the present embodiment will be described. FIG. 3 is a schematic block diagram showing a configuration example of the information processing system 1 according to the present embodiment.
FIG. 3 is a schematic block diagram showing a configuration example of the information processing system 1 according to the present embodiment.
The information processing system 1 is configured to include an information processing device 10, an IoT (Internet of Things) device 20, an information terminal device 30, and a content presentation device 40. In the example shown in FIG. 3, the number of IoT devices 20 and the number of information terminal devices 30 are two and one, respectively, but at least one or more is optional. In the following description, the two IoT devices 20 may be referred to as IoT devices 20-1 and 20-2 to distinguish them from each other.

The two IoT devices 20, the information terminal device 30, and the content presentation device 40 are examples of cooperation devices used by one group of users. In the present application, a group refers to a set including one or more users who share the content presentation device 40, and more generally two or more users. One group is mainly a group of people who share a common residence. One group is not limited to a household made up of a family or relatives, and may be a group made up of a part or all of persons belonging to a corporation, a school, a company, other organizations or groups. Among the linked devices, the linked devices other than the first device (for example, the content presentation device 40) may include devices dedicated to a specific user and not used by users other than the specific user. For example, the information terminal device 30 may be dedicated to a certain user (for example, the user A1).
These linked devices may or may not be registered in the information processing system 1 in advance. In the following description, the case where a linked device is registered is mainly taken as an example. The registered linked device may be referred to as a registered device. The linked device may be registered in association with at least one registered user in one group.

The information processing device 10 is connected to the IoT device 20-2, the information terminal device 30, and the content presentation device 40 via a network so that various data can be wirelessly or wired transmitted and received. The network includes a wide area network such as the Internet and a public wireless network, for example. The network may be configured to further include a LAN (Local Area Network) and a dedicated line.
The information processing device 10 includes a first log including operation information indicating an operation status of the content presentation device 40, and a second device (for example, any one of the IoT devices 20-1 and 20-2, the information terminal device 30, or those). And a second log including event information indicating an event appearing in the group (1) is stored in association with each other. The information processing apparatus 10 estimates the usable period during which the user of the second device can use the content presentation device 40 based on the event information, and indicates the user of the second device during the usable period in the first log. User identification information is added to generate a combined log. The combined log indicates an estimated viewing period that is a viewing period for each user in the content presentation period that is the operation period of the content presentation device 40. The combined log can be used to analyze the operation status of the content presentation device 40 during the estimated viewing period of each user. The utilization system US investigates and analyzes the usage status of each user by using the combined log, for example, the usage frequency, the presence/absence of viewing of a specific content, the taste of the content, and the like. The utilization system US may be configured as a part of the information processing device 10 or may be configured separately from the information processing device 10.

Each of the IoT devices 20-1 and 20-2 and the information terminal device 30 is a device from which event information indicating an event is acquired. Event means an event that appears in the device. The event corresponds to a change in the operation or state of the device, a user operation or action that causes the change, an environment that affects the operation or state of the device, or the like. In the present application, an event corresponding to whether or not the content presentation device 40 can be used or a change in the content presentation device 40 mainly corresponds to the activity status of each user. A specific example of the event will be described later.
The IoT devices 20-1 and 20-2 and the information terminal device 30 transmit to the information processing device 10 as soon as the event information indicating the event appearing in the device itself is acquired or every predetermined period (for example, 10 minutes to 1 day). ..
The IoT device 20-1 may transmit event information to the information processing device 10 via the information terminal device 30. In that case, the IoT device 20-1 may not be able to connect to the information processing device 10 as long as it can connect to the information terminal device 30. Each of the IoT device 20-2 and the information terminal device 30 directly transmits event information to the information processing device 10.

At least one of the IoT devices 20-1 and 20-2 (for example, the IoT device 20-1) is, for example, a voice input device. The voice input device realizes an interactive input operation by using a voice recognition result for voice data indicating a voice uttered by a user. The voice input device performs the process instructed by the utterance content for the collected voice signal, and generates event information indicating the operation and the utterance content. The voice input device is also called a smart speaker, an AI (Artificial Intelligence) speaker, or the like. The IoT devices 20-1 and 20-2 are not limited to dedicated voice input devices, and execute predetermined application software (hereinafter, referred to as an application) having a function of realizing an interactive input operation using a voice recognition result. It may be a device that can be realized by. In the following description, performing a process indicated by an instruction (command) described in a program such as an application is referred to as “executing a program”. The IoT devices 20-1 and 20-2 do not necessarily have to include a voice recognition unit that performs voice recognition processing. The IoT devices 20-1 and 20-2 transmit the collected voice data to a voice recognition server device (not shown) connected to the network. The voice recognition server device includes a voice recognition unit that performs voice recognition processing on voice data received from the IoT devices 20-1 and 20-2, and outputs recognition result information indicating the utterance content, which is a voice recognition result, to the voice recognition unit. It is transmitted to the IoT devices 20-1 and 20-2 as a response to the data. The IoT devices 20-1 and 20-2 receive the recognition result information from the voice recognition server device.

The voice recognition unit included in the IoT devices 20-1 and 20-2 or the voice recognition server device performs known speaker recognition processing on input voice data, and user identification information indicating a user who is a recognition result. May be defined. The voice recognition unit outputs the determined user identification information in association with the recognition result information. However, in the voice recognition unit, the user identification information of each user and the acoustic feature amount are associated and stored in advance. The voice recognition unit calculates the acoustic feature amount from the input voice data, identifies the acoustic feature amount that is the closest to the calculated acoustic feature amount among the stored acoustic feature amounts, and corresponds to the identified acoustic feature amount. User identification information to be defined. For example, a spectrogram (so-called voiceprint), a cepstrum, or the like can be used as the acoustic feature amount indicating the utterance characteristic of each user.

The IoT devices 20-1 and 20-2 execute processing instructed by using the utterance content indicated by the received voice recognition result information as a command. In the following description, executing the process instructed by the command may be referred to as “executing the command”. The IoT devices 20-1 and 20-2 may be configured as communication robots that output a spoken voice in response to the voice spoken by the user. Since the interactive input operation using the voice recognition result has relatively little discomfort to the user, there is a high possibility that the user can obtain an understanding of the use for marketing. Further, since the data samples obtained from many users are accumulated, the introduction cost is relatively low and various functions and services according to the user's utterance can be provided immediately.

The IoT devices 20-1 and 20-2 do not necessarily have to be voice input devices. Some of the IoTs 20-1 and 20-2 may be, for example, household electrical appliances, so-called household appliances. Home appliances are also called white goods. The household appliances are, for example, a cooking machine, an air conditioner (air conditioner), a refrigerator and the like. Home appliances may be operated or controlled by a voice input device.

Note that the IoT devices 20-1 and 20-2 may be, for example, a sensor that detects a situation of a user around the IoT device, or a camera that captures an image of the user. The installation of such sensors and cameras is usually intended for security monitoring, but the user feels discomfort and resistance to the secondary use of the provided data, and is used for various marketing. Obtaining consent can be difficult. In security monitoring, opportunities for providing feedback to the obtained data are limited except during an emergency. In addition, since the diffusion rate is low, the collection of data samples is limited, and the introduction cost tends to be relatively high.

The information terminal device 30 may be, for example, any of a mobile phone (including a so-called smartphone), a tablet terminal device, a personal computer (PC: Personal Computer), a wearable device such as a wristwatch type terminal device, and the like. The information terminal device 30 is also a kind of IoT device. The information terminal device 30 may be installed with a predetermined application and execute the application to realize an interactive input operation using voice data uttered by the user.
Each of the IoT devices 20-1 and 20-2 and the information terminal device 30 directly or indirectly transmits event information indicating an event appearing in the device itself to the information processing device 10. In the example shown in FIG. 3, the IoT device 20-1 transmits event information via the information terminal device 30. The IoT device 20-2 transmits event information via the network connected to itself.

The content presentation device 40 is a device that presents content including one or both of video and audio. "Presentation" means one or both of audio reproduction and video display. “Viewing” means one or both of the user listening to the reproduced sound and observing the displayed video. In the present application, “viewing” may mean “presenting” as a function or operation of the content presentation device 40. The content presentation device 40 is, for example, a television receiver, a radio receiver, or the like. The content presentation device 40 does not necessarily have to have a broadcast program presentation as a main function. The content presentation device 40 has, for example, a voice input device having a radio broadcast reception function and a television broadcast reception function. It may be a mobile phone, a tablet terminal device, a PC, or the like. The content that can be presented by the content presentation device 40 is not necessarily limited to the broadcast program. The presentable content may be network content provided from the request-destination server apparatus or network content provided from the providing-source server apparatus in response to a request from the content presentation device 40 via the Internet. Good. In the following description, the case where the content presentation device 40 is mainly a television receiver is taken as an example.

(Hardware configuration)
Next, a hardware configuration example of the information processing device 10 according to the present embodiment will be described. FIG. 4 is a schematic block diagram showing a hardware configuration example of the information processing device 10 according to the present embodiment.
The information processing device 10 includes a CPU (Central Processing Unit) 102, a storage medium 104, a drive unit 106, an input unit 108, an output unit 110, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 114, and an auxiliary storage unit 116. , And an interface unit 118.
The CPU 102, the drive unit 106, the input unit 108, the output unit 110, the ROM 112, the RAM 114, the auxiliary storage unit 116, and the interface unit 118 are mutually connected using a bus BS (bus line).

The CPU 102, for example, reads a program and various data stored in the ROM 112, executes the program, and controls the operation of the information processing device 10.
The storage medium 104 stores various data. The storage medium 104 is, for example, a portable storage medium such as a magneto-optical disk, a flexible disk, or a flash memory.
The drive unit 106 performs one or both of reading various data from the storage medium 104 and writing various data to the storage medium 104, for example.

The input unit 108 is an input device that receives a user's operation, generates an operation signal according to the received operation, and outputs the generated operation signal to the CPU 102. The input unit 108 corresponds to, for example, a mouse or a keyboard. In the present application, operation according to the information indicated by the input operation signal may be simply referred to as “operation according to operation”.
The output unit 110 is, for example, a display unit such as a display and a reproducing unit such as a speaker.
The ROM 112 stores, for example, a program to be executed by the CPU 102.
The RAM 114 temporarily stores various data and programs used by the CPU 102, for example.

The auxiliary storage unit 116 is a storage medium such as an HDD (Hard Disk Drive) and a flash memory. In the following description, a storage medium capable of storing various data and programs will be generically referred to as a “storage unit”.
The interface unit 118 enables various data to be input and output by connecting to other devices by wire or wirelessly. The interface unit 118 includes a communication module that connects to the network NW in a wired or wireless manner, and enables various data to be transmitted and received to and from other devices connected to the network NW.
The IoT devices 20-1 and 20-2, the information terminal device 30, and the content presentation device 40 each have the same or a part of the same hardware configuration as the information processing device 10 illustrated in FIG. Good.

(Function configuration)
Next, a functional configuration example of the information processing device 10 according to the present embodiment will be described.
FIG. 5 is a schematic block diagram showing a functional configuration example of the information processing device 10 according to the present embodiment.
The information processing device 10 includes the following functional units. More specifically, the information processing device 10 includes a content providing unit 122, an access log storage unit 124, a device log storage unit 126, a registered user information management unit 128, an external data acquisition unit 130, a log analysis unit 140, and a combined log storage. It is configured to include a unit 142 and a request receiving unit 144. The CPU 102 may read a program stored in advance in the storage unit and execute the read program to realize the function of each functional unit. The information processing apparatus 10 may not have all the functions of these functional units, as described later. That is, the information processing apparatus 10 has some of these functional units, does not have some of the other functions, and has some of the other functions of the other one or more server devices. Good. Further, the access log storage unit 124 and the device log storage unit 126 are collectively referred to as "log storage unit LC".

The content providing unit 122 provides content data indicating various contents to the cooperation device. The transmission of the content data provides an on-demand network service. The contents that can be provided are, for example, web contents such as web pages, audio data, video data, various programs used by the cooperating device, and setting values. The program may be an API (Application Programming Interface), a software library corresponding to the API, or the like. The content data provided at once may not necessarily be stored in a single data file, may be divided into a plurality of data files, or may be stored as an image file.

The content providing unit 122, for example, specifies the content instructed by the access information received from the cooperating device, and transmits the content data indicating the specified content to the cooperating device as a response to the access information.
The cooperating device transmits the access information to the content providing unit 122, triggered by a user operation, sensor conditions of various sensors included in the cooperating device, and the like. For example, the cooperation device receives an operation of the user, and when the received operation instructs the acquisition of the content, it transmits the access information indicating the instructed content to the content providing unit 122. The operation is not limited to a manual operation, and may include an interactive input operation using a voice recognition result.

When the sensor information detected by the sensor satisfies a predetermined detection condition (sensor condition), the cooperation device may transmit access information indicating content preset in association with the detection condition to the content providing unit 122. The sensor information may differ depending on the type of sensor. The sensor information may be, for example, any of temperature, humidity, pressure, and power consumption of the cooperating equipment to be installed.
Each time the content providing unit 122 receives the access information from the cooperation device, the access information is sequentially output to the access log storage unit 124 and stored therein.

The access log storage unit 124 sequentially stores the access information input from the content providing unit 122. The access log storage unit 124 stores an access log formed by accumulating received access information. An example of the access log will be described later. The transmission of the content request information indicated by the access information and the occurrence of the trigger correspond to a kind of event. Therefore, the access information can be said to be a kind of event information.

The device log storage unit 126 stores the received event information every time the event information is received from the cooperation device. The event indicated by the event information includes, for example, the function of the cooperation device instructed by the user operation, the operation state of the device, and the like. In the device log storage unit 126, a device log formed by accumulating one or more accumulated event information is formed.
The device log may include sensor information. The sensor information is a kind of event information indicating the operating state or operating environment of the cooperating device itself. The device log storage unit 126 stores the received sensor information every time the sensor information is received from the cooperation device. The sensor information is information detected by various sensors included in the cooperation device as described above. The sensor information corresponds to the temperature, the humidity, the pressure, the power consumption of the associated device, and the like, which are illustrated above. The linked device may transmit the sensor information measured at a fixed time interval to the device log storage unit 126, or the sensor log storage unit 126 may send the sensor information to the device log storage unit 126 when the measured sensor information satisfies a predetermined sensor condition. Information may be sent.
The event to be analyzed may be associated with two or more pieces of event information. For example, the viewing period of the television broadcast in the content presentation device 40 is specified using at least the event information indicating power-on and the event information indicating power-off. In the present application, the appearance of an event may be referred to as “an event occurs”, “an event occurs”, and the like. The event information indicating the operation status of the device may be referred to as “operation information”.

In the present embodiment, in the log storage unit LC, the first log including the operation information indicating the operation status of the content presentation device 40 and the second log including the event information indicating the event related to the activity status of each user are associated with each other. Accumulated. One or both of the device log of the content presentation device 40 and the access log may be included as the first log. The second log may include a device log including event information that appears in another linked device that shares the registered user with the content presentation device 40. The event information may include sensor information.

The registered user information management unit 128 stores registered user information for each registered user. The registered user information includes a user ID, user name, authentication information and attribute information for each registered user. Information for authenticating the registered user, for example, a password is set as the authentication information. The attribute information includes, for example, the date of birth, sex, area, etc. as the user's attributes. The registered user information management unit 128 may store the possessed device information including the device ID of the cooperation device for each individual user ID, and the device characteristic information indicating the characteristic of the device for each device ID. The owned device information indicates, for example, the correspondence relationship between the content presentation device 40 related to the first log and the other linked device related to the second log. The user ID may be any type of information as long as it can uniquely identify each user, for example, a uniquely generated number, a personal number, an electronic mail address, or the like. The device ID may be any type of information, such as a MAC (Media Access Control) address and a serial number, as long as the information can uniquely identify each linked device. In addition, an advertisement identifier that can be reset according to a predetermined operation of the user, or a substantially unique identifier obtained by hashing the serial number and current time information by software using a one-way function, for example. Good. When resetting this identifier, the re-registered device ID and user ID are required. The registered user information may further include an advertisement ID, and each advertisement ID may be associated with the user ID. The advertisement ID is identification information for identifying the user or device that is the distribution destination of the advertisement. The registered user information is used to identify each user and log in from the cooperation device.

The external data acquisition unit 130 acquires external data used for log analysis processing. The external data is data provided from the outside of the information processing device 10 without being acquired by the information processing device 10. The external data is, for example, program information. The program information is mainly used when analyzing the viewing status of a television broadcast program from the device log. The external data acquisition unit 130 receives, for example, program information related to individual programs from devices such as broadcasting companies and research companies.

The log analysis unit 140 refers to the possessed device information, identifies the first log and the second log corresponding to the first log for each registered user, and accumulates the identified first log and second log. Read from section LC. Registered users correspond to groups of users as described above. The log analysis unit 140 estimates the usable period during which each user can use the content presentation device 40 from the event information that constitutes the second log. After that, the log analysis unit 140 adds the user identification information indicating the user of the cooperation device related to the estimated usable period to the first log to generate the combined log. The log analysis unit 140 normalizes the user identification information related to the usable period in the same format as the event information forming the first log to generate a combined log. The log analysis unit 140 stores the generated combined log in the combined log storage unit 142. Examples of various logs and processing examples in the log analysis unit 140 will be described later.
The combined log storage unit 142 stores the combined log generated by the log analysis unit 140.

The request receiving unit 144 receives the combined log request information (request) from the utilization system US, and reads the combined log instructed by the combined log request information from the combined log storage unit 142. The request receiving unit 144 transmits the read combined log to the utilization system US as a response to the combined log request information.
The utilization system US estimates the operation period for each user for each user based on, for example, the operation period of the content presentation device 40 indicated by the combined log received from the request reception unit 144 and the usable period for each user. The utilization system US may be, for example, an analysis device for analyzing presence/absence of viewing of a specific content in a user-specific operation period, a viewing time zone of the content, a tendency of a genre of the viewing content, and the like. In addition, the utilization system US may be an advertisement distribution system that selects advertisement data to be distributed from a previously acquired advertisement data group based on the analysis result of a specific user. The advertisement distribution system refers to, for example, the device information to identify the associated device dedicated to the user, and transmits the selected advertisement data to the identified associated device.
In the example shown in FIG. 5, the utilization system US is separate from the information processing device 10, but part or all of the utilization system US may be integrated as a part of the information processing device 10.

(Examples of various logs)
Next, an example of various logs from the cooperation device used as the second device will be described.
FIG. 6 is a diagram showing an operation example of the voice input device as the first example of the cooperation device according to the present embodiment. FIG. 6 illustrates a preset correspondence relationship between detected voices and actions for each case of typical user activity situations. An example of the utterance content used for the determination of the case is shown in the detected voice column, and an operation example corresponding to the determined case is shown in the action column. Also, the portion enclosed by the brackets indicates that the voice data indicating the utterance content is synthesized and the voice indicated by the synthesized voice data is reproduced.

The second row shows the first operation example when going out. In this example, the voice input device transmits a weather forecast information request at the time and the installation area to a predetermined weather information server device when acquiring the utterance content "I'm going." from the user's utterance voice. , Receives weather forecast information as a response. Here, the voice input device specifies information indicating "rain" as weather forecast information from the evening of the day to the night. Then, by substituting the specified information in a preset fixed sentence, a synthesized voice saying "Welcome. Today's weather is from night to rain."

The third row shows a second operation example when going out. In this example, the voice input device transmits lighting control information indicating that the lighting device in the house is turned off, when acquiring the utterance content of "I'm going. Nice to meet you." from the uttered voice of the user. When the lighting device receives the lighting control information indicating turning off from the voice input device, the lighting device turns off the lighting which is being turned on.
The fourth line shows an operation example when returning home. In this example, the voice input device transmits lighting control information indicating lighting to the lighting device installed in the living room, when acquiring the utterance content “I'm home” from the user's uttered voice. When the lighting device in the living room receives the lighting control information indicating the lighting from the voice input device, the lighting device turns on the lighting which is turned off. The voice input device confirms whether or not there is an incoming call from the in-house communication device (so-called intercom) installed on the premises from the time of going out to that point, and as an example of the utterance content showing the confirmation result, "Anyone is out It didn't come.", and the voice indicated by the synthesized voice data is played back.

The fifth line shows an operation example at bedtime. In this example, when acquiring the utterance content of "Good night." from the voice uttered by the user, the voice input device synthesizes the voice data indicating the utterance content of "Good night." and the voice indicated by the synthesized voice data. To play. Further, the voice input device transmits lighting control information indicating that the lighting device in the home is turned off to the lighting device in the home. When the lighting device receives the lighting control information indicating turning off from the voice input device, the lighting device turns off the lighting which is being turned on.

The sixth line shows an operation example when waking up. In this example, the voice input device synthesizes voice data indicating the utterance content of "Good morning. This morning news." when acquiring the utterance content of "Good morning." from the user's utterance voice. The voice represented by the synthesized voice data is reproduced. The voice input device further transmits the news request information at that time to the information providing server device, and acquires the news information as a response. The voice input device synthesizes the voice data indicating the acquired news information and reproduces the voice indicated by the synthesized voice data.
The voice input device generates event information indicating an event that occurred in each case, and transmits the event information to the information processing device 10.

FIG. 7 is a diagram showing a first example of the device log of the cooperation device according to the present embodiment. The device log L04 illustrated in FIG. 7 indicates an operation history formed by sequentially accumulating event information indicating events that appear in the voice input device. The individual event information includes a log ID (logID), a device ID (device), time information (time), running operation information (Current), input information (Input), output information (Output), and user identification information (UserInfo). It is configured to include. The log ID is identification information for identifying individual event information. In the example shown in FIG. 7, the log IDs are set in ascending order of time. The device ID is identification information indicating the linked device in which the event appears. However, in FIG. 7, “speaker 01” is described in the device ID field as the name of the voice input device. The time indicates the time when the device log storage unit 126 received the event information. This time corresponds to the time when the event appears on the voice input device indicated by the device ID, and is represented by year/month/day/hour/minute. As the in-execution operation information, a command indicating an in-execution operation which is another operation being executed at that time is described. When there is no other operation being executed, the in-execution operation information field is blank. The input information indicates the utterance content of the input voice data as an event that occurs in the voice input device. The utterance content is described in a portion enclosed by utterance content tags <voice>...</voice>. The output information indicates, as an event occurring in the voice input device, at least one of a command indicating the operation of the voice input device and the utterance content of the output voice data. The command is described in a portion enclosed by command tags <command>...</command>. The user identification information indicates the user who is the speaker recognized from the input voice data.

More specifically, as an event related to the log ID “1”, the operation at “at wake-up” is described at 5:44 on September 24, 2018. Here, acquisition of the utterance content of the voice of the user A1 who is the recognized speaker who indicates "Good morning" as the utterance content, and the output of the voice having the utterance content of "Good morning. This morning's news." The execution of the process instructed by the command "News" is shown. The command “News” transmits news request information at that point in time to a predetermined information providing server device, obtains news information as a response, and synthesizes voice data indicating the obtained news information as utterance content, It indicates that the synthesized voice data is output to the reproduction unit of the own device. The reproduction unit includes a speaker for reproducing sound based on the input sound data. Based on this event, the log analysis unit 140 can determine that the usable period during which the user A1 can use the content presentation device 40 has started.

As the event related to the log ID “2”, the operation at “at wake-up” at 5:45 on September 24, 2018 is described. Here, the operation being executed is a process instructed by the command "News", and the acquisition of the utterance content of the voice of the user A2 who is the recognized speaker who indicates "Good morning" as the utterance content, "Good morning. Next, the news of this morning will be played." is output to the reproduction unit of voice data indicating the utterance content, and execution of the process instructed by the command "News" is shown. From another point of view, the voice input device is executing the process instructed by the command “News”, and therefore the utterance content different from that when this process is not executed “Continue to send news this morning.” Select the audio data that indicates. The voice input device reproduces the voice based on the selected voice data to repeatedly provide the news information to the user A2 with the voice instructed by the command. Based on this event, the log analysis unit 140 can determine that the usable period during which the content presentation device 40 of the user A2 can be used starts.

The command “PowerOff-MyLight” in the log ID “4” indicates transmission of lighting control information indicating turning off to the lighting device associated with the recognized speaker. Therefore, in the voice input device, lighting control data indicating the relationship between the speaker and the lighting device is stored in advance, and the lighting device corresponding to the recognized speaker is set as a control target by referring to the lighting control data. It is specified as a lighting device to be operated. The log analysis unit 140 can determine that the usable period in which the content presentation device 40 of the user A2 can be used has ended based on the event associated with the log ID “4” indicating going out.

The command “PowerOn-MyLight” related to the log IDs “5” and “6” indicates transmission of lighting control information indicating lighting of the lighting device associated with the speaker. Although the description is omitted in the output information column related to the log ID “6”, the voice input device is the information processing device 10 prior to the output of the utterance content “The recommended program will be broadcast now.” Receive recommended program information from. The voice input device broadcasts a recommended program that is currently being broadcast among the recommended programs indicated by the received recommended program information, or broadcasts within a predetermined time (for example, 5 to 20 minutes) from that time. It is determined whether or not there is a recommended broadcast program to be started. Then, when at least one of the recommended program during broadcasting and the recommended program to be broadcast exists, the audio input device reproduces the audio indicating the utterance content of "The recommended program will be broadcasted from now on." When there is no recommended program being broadcast and a recommended program to be broadcast, the audio input device does not reproduce the audio indicating the utterance content "The recommended program will be broadcast from now on."
The log analysis unit 140 may determine the start of the usable period in which the content presentation devices 40 of the users A1 and A2 can be used, respectively, based on the events associated with the log IDs “5” and “6” indicating that they have returned home. it can.

The command “WaitAnswer” related to the log ID “7” is a command indicating standby of the voice data, which is the answer to the utterance content acquired as the input information, from the speaker related to the input information. That is, the voice input device waits for a predetermined period of time for input of voice data as a response from the user A1 with respect to voice data indicating the utterance content of the user A1 “Good night”. The standby time is, for example, 5 to 20 seconds after the content of the utterance of the user A1 "Good night" is acquired. As an event related to the log ID “8”, during the waiting period for the input of voice data from the user A1, acquisition of voice data indicating “No” (No) as the utterance content and “OK. Good night.” The output of the voice indicating the utterance content of is displayed.
The log analysis unit 140 indicates that the user A1 determines that the available period in which the content presentation device 40 can be used has ended based on the events associated with the log IDs “7” and “8” indicating that the user is sleeping.

Therefore, with reference to the device log L04 shown in FIG. 7 as the second log, the log analysis unit 140 indicates that the user A1 has woken up at 5:44 on September 24, 2018, and has been added at 7:46 on September 24, 2018. Go out at 18:05 on September 24, 2018, and go home at 22:03, 2018. From this determination result, the log analysis unit 140 determines the time zone from 5:44 to 7:46 on September 24, 2018 and the time zone from 18:05 to 22:3 on September 24, 2018. , And can be determined as the usable time of the content presentation device 40 by the user A1.
Further, the log analysis unit 140 is such that the user A2 gets up at 5:45 on September 24, 2018, goes out at 10:03 on September 24, 2018, and returns home at 13:04 on September 24, 2018, It can be judged that he is going to sleep at 23:05 in 2018. From this determination result, the log analysis unit 140 determines the time zone from 5:45 to 10:03 on September 24, 2018 and the time zone from 13:4 to 23:5 on September 24, 2018. , And can be determined as the usable time of the content presentation device 40 by the user A2.

Note that, in the example shown in FIG. 7, the voice input device makes a decision to stay at home or make a sleep decision based on the voice data uttered by the user. However, the voice input device outputs voices, daily sounds, and other sounds. It may be possible to make a home decision or a sleep decision based on the detection status of the audio data shown.
For example, the voice input device has a predetermined detection period (for example, 5 to 20 minutes) in the daytime (for example, from 6:00 to 18:00) as indicated by the log ID “4b” of the device log L06 illustrated in FIG. 8. ) When the voice input is no longer detected continuously, the input information indicating that is transmitted to the information processing device 10 as a part of the event information. For example, when the level value indicated by the input voice data is smaller than a predetermined detection threshold, the voice input device determines not to detect the voice input, and when the level value is equal to or higher than the detection threshold, the voice input device determines that the voice input is detected. To do. In addition, “no longer detecting” means changing from a detected state to a non-detected state. The voice input device estimates a user who has been determined to be at home (or awake) or who has not been able to determine going out as an outing, and includes user identification information indicating the estimated user in event information. May be.

The log analysis unit 140 may estimate that the user indicated by the user identification information is out, that is, the end of the usable period, at a point before the time of the event information by a predetermined period. In the example shown in the log ID “4b”, when the predetermined period is 10 minutes, the end time of the usable period is 9:53 on September 24, 2018.
After that, the log analysis unit 140 determines the start of a new usable period and acquires the end of the estimated usable period when acquiring event information related to returning home for the user, as indicated by the log ID “5”. May be confirmed as the end of the usable period.

The voice input device continuously detects a voice input for a predetermined period (for example, 5 to 20 minutes) at night (for example, from 20:00 to 4:00 the next day) as indicated by the log ID “9b”. When it disappears, the input information indicating that is transmitted to the information processing device 10 as a part of the event information. The voice input device estimates a user who is determined to be at home (or awake) or a user who has not been able to determine sleep by that time as sleeping, and includes user identification information indicating the estimated user in event information. ..
The log analysis unit 140 may estimate that the user indicated by the user identification information is going to sleep, that is, the end of the usable period, at a point before the time of the event information by a predetermined period. In the example shown in the log ID “9b”, when the predetermined period is 10 minutes, the end time of the usable period is 22:55 on September 24, 2018.
Then, the log analysis unit 140 determines the start of a new usable period and acquires the estimated usable state when acquiring event information related to wake-up for the user, as indicated by the log ID “5” in FIG. 7. You may confirm the end of the period.

FIG. 9: is a figure which shows the operation example A08 of the information terminal device 30 as a 2nd example of the cooperation apparatus which concerns on this embodiment. The operation illustrated in FIG. 9 is realized by executing a predetermined application. FIG. 9 exemplifies the correspondence relationship between the detection method and the operation for each case of typical user activity situations. For example, the detection method corresponding to “at the time of going out 1” in the second row is a wireless local area network (WLAN) provided by the base station device (access point) where the information terminal device 30 is installed at home. This is a method in which the user determines that he/she is out when he/she is out of the communication range that can be accessed by. The information terminal device 30 includes a communication interface that performs wireless communication according to a predetermined WLAN standard, and determines whether or not the communication terminal is outside the communication range as an operating condition. The information terminal device 30, for example, determines that the reference signal received using the communication interface is out of the range when the received power intensity is equal to or lower than the predetermined detection intensity, and is within the range when the reference signal intensity exceeds the predetermined detection intensity. To do. The predetermined WLAN standard is, for example, a wireless communication standard defined in IEEE 802.11. Further, not limited to WLAN, a personal area network (PAN: Personal Area Network) may be used. As the WPAN standard, for example, a communication method defined by a wireless communication standard defined by IEEE802.15.1 can be used.

The detection method corresponding to “when going out 2” in the third line is that the information terminal device 30 refers to the schedule information stored in advance in the storage unit of its own device, and the current time is described in the schedule information. When it is determined that the time has reached a predetermined time (for example, 3 to 10 minutes) before the time, a voice having the utterance content for prompting the user to go out is output, and when the utterance content that is the response is acquired, it is determined to be the going out It is a technique. The utterance content "It's about time to leave..." is an example of the utterance content for prompting the user to go out. The utterance content which is the response is obtained by executing the voice recognition process on the voice data of the user's utterance input after the voice output.

In the detection method corresponding to “when going out 3” in the fourth row, the acceleration detected by the acceleration sensor of the information terminal device 30 is a predetermined acceleration detection threshold value (for example, 0.3 to 1.0 m/ This is a method of determining that the user is out when the time that is s ² ) or more continues for a predetermined time (for example, 1 to 3 minutes) or more.
When the information terminal device 30 determines to go out, the information terminal device 30 changes the operation mode of the device itself from the in-home mode to the outing mode. The information terminal device 30 executes the voice interaction process in the in-home mode, but stops the voice interaction process in the outing mode. The voice interaction process mainly refers to an operation instructed as a command by utterance contents recognized from voice data uttered by a user or reproduction of voice having utterance contents as a response to the utterance contents. In addition, the period after the time point when it is determined that the user is out is outside the usable period of the user.

The detection method corresponding to “when returning home” in the fifth line is a method in which the user determines that he/she has returned home because the information terminal device 30 is within the communication range of the WLAN at home. The information terminal device 30 includes, as an operating condition, the reception power strength of the reference signal defined by the predetermined WLAN standard exceeds the predetermined first detection strength, and is included in the notification information carried by the reception signal at predetermined time intervals. When the base station ID to be stored matches the base station ID (for example, SSID: Service Set ID) of the base station device which is set in advance and installed in the home, it is determined to be within the communication range of the WLAN of the home. When the information terminal device 30 determines to return home, the information terminal device 30 changes the operation mode of the device itself from the out-of-home mode to the in-home mode. After that, the information terminal device 30 restarts the voice interaction process. The usable period for the user may start from the time when it is determined that the user returns home.
The detection method corresponding to “at bedtime” in the sixth line is that the information terminal device 30 detects that the acceleration detected by the acceleration sensor of the information terminal device 30 at night (for example, from 20:00 to 4:00 on the next day) is the second predetermined acceleration. This is a method of determining sleeping when the time when the detection threshold value (for example, 0.01 m/s ² ) or less continues for a predetermined time (for example, 1 to 3 minutes). In the example shown in the sixth line, the operation when it is determined that the person is going to sleep is not specified, but the operation is not limited to this. The information terminal device 30 may change the operation mode from the standard mode to the power saving mode that consumes less power. The period after the time when it is determined to go to sleep is outside the usable period of the user.

The detection method corresponding to “at wake-up” in line 7 is (1) the information terminal device 30 detects that the acceleration detected by the acceleration sensor of the device itself in the morning (for example, from 5 am to 8 am) is a predetermined acceleration. When the time exceeding the second detection threshold (for example, 0.01 m/s ² ) continues for a predetermined time (for example, 1 to 3 minutes) or more, or (2) the information terminal device 30 determines that charging is stopped in the morning. This is a method of determining to wake up when doing. In the information terminal device 30, the voltage applied to the battery stored in the information terminal device 30 from the charger of the information terminal device 30 becomes equal to or higher than a predetermined voltage (for example, full charge voltage, 3.6 V in the case of lithium ion battery). When it can be determined that charging is stopped. The information terminal device 30 measures the time from bedtime to wake-up as sleep time, and when detecting the wake-up, "today's sleep time is..." for guiding the sleep time measured as the utterance content. The voice having the utterance content may be reproduced. The usable period for the user may start from the time when it is determined that the user gets up.

FIG. 10 is a diagram showing a first example of a device log of the information terminal device according to the present embodiment. The device log L10 illustrated in FIG. 10 indicates an operation history formed by sequentially accumulating event information indicating events that appear when two information terminal devices 30 execute a predetermined application. The device log L10 has the same configuration as the device logs L04 and L06, but does not include the item of the running operation information. “App 01” and “app 02” described in the column of the device ID shown in the second column are the names of the apps executed by the separate information terminal devices 30 used by the users A1 and A2, respectively. As the time information shown in the third column, the time at which the activity status of the user is determined is described as the time at which each event appears. As the input information shown in the fourth column, “wakeup detection”, “going out detection”, “going home detection”, or “sleep detection” is shown as the determination result of the case of each information terminal device 30. As the output information shown in the fifth column, the utterance content of the voice output according to the determination result and the command indicating the executed operation are described. However, the command is described in a part enclosed by link tags <link>... </link>. The link tag is originally used to describe the location of the reference data, but in this example, it is used to describe the command. In the sixth column, "A1" or "A2" is described as user identification information indicating each user. The user identification information of the user may be stored in each information terminal device 30 in advance, and may be included in the event information and transmitted to the information processing device 10.

Referring to the device log L10 shown in FIG. 10 as the second log, the log analysis unit 140 indicates that the user A1 wakes up at 5:44 on September 24, 2018, and goes out at 7:46 on September 24, 2018. It can be determined that he returned home at 18:05 on September 24, 2018, and went to bed at 22:3 2018. From this determination result, the log analysis unit 140 determines the time zone from 5:44 to 7:46 on September 24, 2018 and the time zone from 18:05 to 22:3 on September 24, 2018. , And can be determined as the usable time of the content presentation device 40 of the user A1.
Further, the log analysis unit 140 is such that the user A2 gets up at 5:45 on September 24, 2018, goes out at 10:03 on September 24, 2018, and returns home at 13:04 on September 24, 2018, It can be judged that he is going to sleep at 23:05 in 2018. From this determination result, the log analysis unit 140 determines the time zone from 5:45 to 10:03 on September 24, 2018 and the time zone from 13:4 to 23:5 on September 24, 2018. , And the available time of the content presentation device 40 of the user A2.

FIG. 11 is a diagram showing an operation example A12 of a communication robot (hereinafter, robot) as a third example of the linked device according to the present embodiment. FIG. 11 exemplifies the correspondence between the detection method and the operation for each case of the typical user activity situation. The “detected voice “...”” described in the detection method column in the second, fourth, sixth, and eighth lines is when the utterance content based on the input voice data is enclosed in parentheses (“”). , Indicates that the case has occurred. The robot recognizes the identified speaker as a user by performing speaker recognition processing on the voice data. The robot includes the user identification information indicating the recognized user in the event information.
In the detection method described in the third line, image recognition processing is performed on image data indicating an image captured by a camera provided in the robot (hereinafter, captured image data) to detect opening of the entrance and exit of the user's home. This is a method of determining the going out of the user who has left. The robot includes the user identification information indicating the exiting user in the event information.
The detection method described in the fifth line is a method of performing image recognition processing on the captured image data and determining the return of the user when the opening of the entrance and the entry of the user are detected. The robot includes the user identification information indicating the user who has entered in the event information.

The detection method described in the seventh line is a method of performing image recognition processing on the captured image data and determining sleep of the user when detecting the user's arrival in the bed. The robot includes the user identification information indicating the user who has entered the floor in the event information.
The detection method described in the ninth line performs image recognition processing on the captured image data and detects a user's getting up from the bed or a predetermined time (for example, 4 to 6 hours) after it is determined that the user is sleeping. This is a method for determining the wake-up of the user when the face of the user registered in advance is detected for the first time after the above. The robot includes the user identification information indicating the user who gets up in the event information.
The “voice output “...”” described in the column of the operation in the third column is a voice that has the utterance content that the robot is surrounded by key brackets (“ ”) when the case is determined. Is reproduced.

FIG. 12 shows an example of a device log of the communication robot according to this embodiment. The device log L14 illustrated in FIG. 12 indicates an operation history formed by sequentially accumulating event information indicating events that have occurred in the robot. The device log L14 has the same configuration as the device log L06. “Robo01” described in the column of the device ID shown in the second column is the name of the robot. As the time information shown in the third column, the time at which the activity status of the user is determined is described as the time at which each event appears. As the input information shown in the fifth column, "wake-up detection", "going out detection", "going home detection", "sleep detection" as the determination result of the case of each information terminal device 30, or an utterance recognized from the input voice data Indicates the content. Utterance contents are enclosed in key brackets.
As the output information shown in the sixth column, the utterance content of the voice output according to the determination result and the command indicating the executed operation are described. However, the command is described in a portion enclosed by command tags <command>...</command>. The link tag is originally used to describe the location of the reference data, but in this example, it is used to describe the command. As the user identification information shown in the seventh column, “A1” or “A2” is described as the user identification information showing each user.

Referring to the device log L14 shown in FIG. 12 as the second log, the log analysis unit 140 indicates that the user A1 wakes up at 5:44 on September 24, 2018, and goes out at 7:46 on September 24, 2018. It can be determined that he returned home at 18:05 on September 24, 2018, and went to bed at 22:3 2018. From this determination result, the log analysis unit 140 determines the time zone from 5:44 to 7:46 on September 24, 2018 and the time zone from 18:05 to 22:3 on September 24, 2018. , And can be determined as the usable time of the content presentation device 40 of the user A1.
Further, the log analysis unit 140 is such that the user A2 gets up at 5:45 on September 24, 2018, goes out at 10:03 on September 24, 2018, and returns home at 13:04 on September 24, 2018, It can be judged that he is going to sleep at 23:05 in 2018. From this determination result, the log analysis unit 140 determines the time zone from 5:45 to 10:03 on September 24, 2018 and the time zone from 13:4 to 23:5 on September 24, 2018. , And the available time of the content presentation device 40 of the user A2.

In the device log used for determining the usable time for each user, whether or not the content presentation device 40 is in the usable state, or the change from the usable state to the unusable state and the unusable state From the above, it is sufficient to include event information indicating a change in usable state. For example, the output information (Output) may be omitted in the device logs L04, L06, L10, and L14. The device log L16 shown in FIG. 13 corresponds to the device log L10 from which the output information is omitted. Therefore, the cooperation device does not necessarily need to include the utterance content of the output voice in the event information.

(Generation of combined log)
Next, a generation example of a combined log will be described as a processing example of the log analysis unit 140. The log analysis unit 140 adds information about the usable period for each user determined based on the second log to generate a combined log. The log analysis unit 140 normalizes the format of the event information at each time point forming the combined log so as to have a predetermined common format.
More specifically, the log analysis unit 140 is a user of a user who indicates that the time indicated by the time information associated with the operation information for each operation information forming the first log is within the usable period. Add identification information.

For example, the combined log L18 shown in FIG. 14 is obtained by adding the user identification information obtained from the device log L14 (FIG. 12) to the device log (hereinafter, viewing log) indicating the operation history of the content presentation device 40. It is the obtained log. In this example, the viewing log and the device log correspond to the first log and the second log, respectively.
The combined log L18 includes a log ID (logId), a device ID (device), time information (time), program name information (Title), broadcast station information (Broadcaster), and user identification information (Userinfo), and these log IDs are included. It is configured to correspond to each.
A part of the combined log L18, which is formed by accumulating a set of log ID, device ID, time information, program name information, and broadcast station information, excluding user identification information, corresponds to a device log of the content presentation device 40. ..

“Television 01” described in the device ID column is the name of the content presentation device 40 and indicates that the content presentation device 40 is a television receiver. The program name information indicates the program name of the broadcast program received by the content presentation device 40 at that time. The content presentation device 40 extracts the program name information of the broadcast program at that time from the control signal separated from the received signal from the broadcast station. The broadcasting station information is information indicating the broadcasting station that received the program at that time. As the broadcasting station information, information that can uniquely identify the broadcasting station such as the name of the broadcasting station and the number of the broadcasting channel can be used. The content presentation device 40 may transmit the operation information to the information processing device 10 without including the program name information. When acquiring the program name information, the log analysis unit 140 may refer to the program information (not shown) acquired by the external data acquisition unit, for example. The program information includes broadcast station information, broadcast time information, and program name information in association with each broadcast program. The log analysis unit 140 collates the broadcast station information and the broadcast time information included in the program information with the broadcast station information and the time information included in the operation information, and includes the broadcast station information and the operation information included in the program information. The broadcast program related to the time indicated by the time information included in the operation information is specified in the broadcast time zone indicated by the broadcast time information included in the program information, and the program name information of the broadcast program is extracted. To do. The program information includes not only program name information for each broadcast program, but also related information such as broadcast contents, advertised product information, CM contents, and casts in association with broadcast time information. Sometimes As the broadcasted content, the name of the corner (corner name), which is a unit that further subdivides the broadcast program, the content of the corner itself, the information of the product advertised in the corner, the name of the performer at the corner, etc.), the content of the CM May include a company name, brand name, performer name, and the like. Therefore, the log analysis unit 140 may form the combined log instead of the program name information or by including the related information in association with the program name information.

Regarding the log ID “1” in the second row, the log analysis unit 140 determines that the time period of 5:44 on September 24, 2018 is within the usable time period of the user A1, but is outside the usable time period of the user A2. Therefore, the log analysis unit 140 adds the user identification information of the user A1 to the event information of the log “1”.
For the log ID “2” in the third line, the log analysis unit 140 determines that 5:45 on September 24, 2018 is within the usable time of each of the users A1 and A2. Therefore, the log analysis unit 140 adds the user identification information of each of the users A1 and A2 to the event information of the log “2”.

For the log ID “5” in the sixth line, the log analysis unit 140 determines that 9:05 on September 24, 2018 is within the usable time of the user A2, but is outside the usable period of the user A1. Therefore, the log analysis unit 140 adds the user identification information of the user A2 to the event information of the log “5”.
For the log ID “6” in the seventh line, the log analysis unit 140 determines that 10:05 on September 24, 2018 is outside the usable period of the user A1 and outside the usable period of the user A2. .. Therefore, the log analysis unit 140 does not add the user identification information to the event information of the log “6”.

The log analysis unit 140 indicates the operation status of the content presentation device 40 at the end of the usable time of any user, and event information including the user identification information of other users whose time is within the usable time. May be added to generate a combined log. For example, the log analysis unit 140 indicates the same operation status as the operation status indicated by the log ID “4” immediately before the event information indicated by the log ID “4b” with respect to the combined log L18. Event information including the user identification information of the user A2 who is within the usable time at 7:46 a day is added to generate the combined log L20 (FIG. 15). Due to the log ID “4b”, the user A1 cannot use the content presentation device 40 while the operation status of the log ID “4” continues, and the user A2 is within the usable time of the content presentation device 40. The determination can be made without referring to the log ID “5” related to the event immediately after that which appears at 9:4 on September 24, 2018.

The combined log L22 shown in FIG. 16 is another example of the combined log obtained by adding the user identification information obtained from the device log L14 (FIG. 12) to the viewing log. The combined log L20 is a collection of event information indicating events classified by each user by the log analysis unit 140. The combined log L20 includes substantially the same information as the combined log L18, except that the device ID is omitted. The combined log L20 includes a log ID (logId), a user ID (UserID), time information (time), program name information (Title), and broadcast station information (Broadcaster), and these are accumulated for each log ID. User identification information of each user is described in the column of user ID. In the combined log L22, log IDs “11” to “14” are a set of event information related to the user A1, and log IDs “15” to “18” are a set of event information related to the user A2. Since the event information is sorted for each user, it is convenient for analyzing the usage status of the content presentation device 40 for each user.

The event information with the log ID “11” corresponds to the event information with the log ID “1”. Information obtained by integrating the event information of the log ID “12” and the event information of the log ID “15” at the same time as that corresponds to the event information of the log ID “2”.
Note that event information such as the log ID “6” that does not have a corresponding user is omitted from the combined log L20, but the log analysis unit 140 may include event information indicating that the operation of the user has stopped. Good. Therefore, information indicating the end of the usable time for each user is included in the combined log L20.

The first device shared by a certain group may be a device of another type instead of the content presentation device 40 or together with the content presentation device 40. The combined log L24 illustrated in FIG. 17 is generated from the device log acquired from the television receiver and the refrigerator as the first device.
However, the usable period of user A1 is from 5:44 to 7:05 on September 24, 2018, and the usable period of user A2 is from 5:44 to 10:10 on September 24, 2018. Suppose there is. Therefore, the user identification information of both the users A1 and A2 is described in association with the log IDs “1” to “4” which are the event information of the events from 5:44 to 7:4 on September 24, 2018. It Also, the user identification information of the user A2 is described in association with the log IDs "5" to "9" that are the event information of the events from 7:05 to 10:09 on September 24, 2018. The user identification information of is not described.

The combined log L24 includes a log ID (logID), a device ID (device), time information (time), event type information (action), additional event information (actionInfo), and user identification information (UserInfo), and these logs are recorded. It is configured to correspond to each ID. In the device ID column, “TV 01” indicating the name of the television receiver or “Refrigerator 01” indicating the name of the refrigerator is described. The event type information is information indicating the type of event that appears in the associated device. For example, “PowerOn” and “PowerOff” corresponding to the log IDs “1” and “7” respectively indicate power-on (operation start) and power-off (operation stop). “DTV” corresponding to the log IDs “2”, “9”, and “10”, respectively, indicates reception of a television program and program content (that is, at least one of video, audio, and text constituting a television broadcast program). Shows the presentation of.

Depending on the type of event, whether or not the event type information may include additional event information may differ. For example, additional event information is not set for the event type information “PowerOn”, “PowerOff”, and “PowerOn” corresponding to the log IDs “1”, “7”, and “8”, respectively. On the other hand, for the event type information “DTV” corresponding to the log IDs “2”, “9”, and “10”, broadcast channel “1028”, “1024”, and “1024” are added as additional event information. Is described. In other words, the event information indicates the reception of the reception signal from the broadcasting station on the broadcast channels “1028”, “1024”, and “1024” at the time indicated by the time information, and the presentation of the program content based on the received reception signal. Show.

The event type information “Open” corresponding to the log IDs “3” and “5” indicates that the door is open. The event type information “Close” corresponding to the log IDs “4” and “6” indicates that the door is closed. Further, the additional event information “Refrigerator” corresponding to the log IDs “3” and “4” indicates “refrigerator”. The additional event information “Freezer” corresponding to the log IDs “5” and “6” indicates “freezer room”. For example, the event related to the log ID “3” indicates the opening of the door of the refrigerating room. The event related to the log ID “6” indicates closing of the freezer compartment door. Therefore, not only the content presenting device 40 such as a television receiver, but also the household electric appliances such as a refrigerator can be analyzed for the usage status for each user.

In addition, the log analysis unit 140, regarding an event group including a plurality of events of a predetermined type that may occur sequentially within a predetermined short time period (for example, 1 to 3 minutes) by the same user operating the linked device, It may be determined that the users related to the event group are common. The plurality of events may be events having a causal relationship with each other. Here, even if the availability of the linked device changes for at least one user within the period of the event group, the log analysis unit 140 allows the user whose usable period includes the entire period. May be specified as an available user who can use the linked device. The log analysis unit 140 adds the user identification information indicating the identified user to each of the event information of the event group. For example, 7:05 on September 24, 2018 related to the log ID “5” is within the usable period of the refrigerators of the users A1 and A2, while September 24, 2018 related to the log ID “6”. The day 7:06 is within the usable period of the refrigerator of the user A2, but is outside the usable period of the refrigerator of the user A1. Further, the period from opening the freezer door to closing the freezer door is one minute. Therefore, the log analysis unit 140 identifies the user A2 including this one minute as the usable period as the user who is involved in opening and closing the door of the freezer, and sets the user identification information of the user A2 to the log IDs “5” and “5”. 6” Included in the event information related to each. As a result, more accurate usage status is recorded because users who are not within the usage period but who may not be used due to the relationship between the events are excluded.

The device log is not limited to the event information transmitted autonomously by the cooperation device, and may include event information transmitted by the cooperation device in response to reception of the event request information transmitted by the device log storage unit 126. .. Even if no special operation is performed, the cooperating device transmits event information indicating the operation status at the time of receiving the event request information as an event to the device log accumulation unit 126. The device log storage unit 126 may transmit event request information to a predetermined cooperation device at predetermined time intervals (for example, 5 to 15 minutes) (polling). For example, the event information related to the log ID “10” illustrated in FIG. 17 indicates that the program content whose broadcast channel is “1024” is being presented. At this time (10:10 on September 24, 2018), both the users A1 and A2 are outside the usable period. Therefore, even if the linked device is not operated, the combined log includes information including an event indicating the end of use of the user A2 who has started use up to that point. Although not shown in FIG. 17, the device log storage unit 126 is at a time within the usable period of the user A2 but outside the usable period of the user A1 (for example, 7:10 on September 24, 2018). ), it is assumed that the operation request information is transmitted to the television receiver. In that case, the device log storage unit 126 can acquire the operation information indicating the operation status at that time from the television receiver. At this time, the log analysis unit 140 identifies the user A2 as a user whose time is within the usable period, includes the user identification information of the user A2 in the operation information, and does not include the user identification information of the user A1. Therefore, even if the linked device is not operated, the combined log includes the operation information indicating the end of use of the user A2 that is out of the usable period by that time.

The combined log L26 illustrated in FIG. 18 is another example of the combined log obtained from the device logs acquired from the television receiver and the refrigerator. Similar to the combined log L22 (FIG. 16), the combined log L24 collects event information indicating events classified by each one user. The combined log L24 includes substantially the same information as the combined log L22, except that the device ID is omitted. The combined log L23 includes a log ID (logId), a user ID (UserID), time information (time), event type information (action), and additional event information (actionInfo), and these are included in the program name information (Title) for each log ID. ) And broadcasting station information (Broadcaster), and these are collected for each log ID. In the combined log L24, log IDs “101” to “104” are a set of event information related to the user A1, and log IDs “105” to “114” are a set of event information related to the user A2. Here, the event information related to the log ID “114” indicates the end of viewing of the program broadcast by the user A2 on the broadcast channel “1024”.
When generating the event information, the log analysis unit 140 compares the event information related to the log ID “10” with the event information related to the log ID “09” immediately before that, which is a common operation status, and compares the log ID. It is detected that the user identification information of the user A2 is deleted from the event information related to “10”. Then, the log analysis unit 140 generates, for the user A2, event information indicating stop of use in the operation status related to the event, as event information related to the log ID “114”. “DTV abort” described in the event type information column related to the log ID “114” indicates that reception of the television program is stopped. In addition, the log analysis unit 140, the device log accumulation unit 126 is also within the usable period of the user A2, but also at the time (10:10 on September 24, 2018) outside the usable period of the user A1. , Event information indicating the end of viewing of the program broadcast by the broadcast channel “1024” by the user A1 may be included in the combined log L26.

In the above description, the device log of the linked device having the interactive input operation function mainly using the voice recognition result is used as the second device, and the content presentation device 40 is shared as the first device by the group. The case where the usable period of the device is determined is described as an example, but the present invention is not limited to this. In the determination of the usable period, the log analysis unit 140 may use the device log or the access log of any type of linked device as long as it can acquire event information useful for determining whether it is in the usable state. However, a sensor log may be used.

Further, the device log storage unit 126 may collect operation information and sensor information from other devices directly via the network NW or indirectly via a linked device connectable to the network NW.
More specifically, the pressure sensor attached to the pillow measures the pressure applied to the surface at predetermined time intervals (for example, 5 to 15 minutes), and outputs sensor information indicating the measured pressure to the information terminal device 30. It is transmitted to the device log storage unit 126 via the device. The device log accumulation unit 126 accumulates sensor information indicating the measured pressure and accumulates it as a sensor log. The log analysis unit 140 determines whether or not the user of the pillow is sleeping, that is, whether or not it is within the usable period, depending on whether or not the pressure obtained by referring to the sensor log is equal to or higher than a detection threshold of a predetermined pressure. You may judge whether. The information terminal device 30 may determine the quality of sleep from a time series of pressure indicated by sensor information from the pressure sensor using a known method. When the information terminal device 30 determines to wake up the user, the information terminal device 30 may reproduce a voice including the utterance content indicating the determined sleep quality.
In addition, as home appliances such as an air purifier and an air conditioner, the second device receives an operation signal corresponding to an operation by a user via the information terminal device 30 and WLAN or PAN, and follows an instruction instructed by the operation signal. Living household appliances that operate may be applied. In that case, the second device transmits event information indicating the connection status with the information terminal device 30 to the information processing device 10. Therefore, the log analysis unit 140 of the information processing device 10 causes the user of the information terminal device 30 to return home when the second device establishes a connection with the information terminal device 30 based on the event information received from the second device 20. The determination may be made, or the disconnection of the connection may be made to determine the user's going out.

When using a plurality of types of logs, the log analysis unit 140 may estimate the usable period by using the above-mentioned method using each log. The estimated usable period (hereinafter, estimated usable period) may vary depending on the logs used, but the estimated usable period estimated from a plurality of logs may overlap between two or more logs. .. The larger the number of logs with overlapping estimated usable periods (hereinafter referred to as duplication), the higher the probability that the usable period will be. Therefore, the log analysis unit 140 may set a section in which the number of duplications is a predetermined number (for example, 2) or more as the usable period and the other sections as the unusable period in each estimated usable period. ..

In the above description, the case in which the activity status of the user is determined to be one of the categories of “going out”, “sleeping”, and “awakening” has been described as an example, but the present invention is not limited to this. Other categories may be adopted as long as they are useful for determining the usable period, such as “in the bath” and “in the toilet”. The time zones required for the categories such as “in the bath” and “in the toilet” are excluded from the usable period and included in the unusable period. The log analysis unit 140 uses, for example, the second sensor log including the sensor information acquired by the bathing monitoring device (so-called bathing watching sensor) installed in the bathroom to determine whether or not “bathing”. The bathing monitoring device is connected to, for example, a motion sensor that detects whether a person enters or leaves the bathroom, and a weight sensor that detects the weight (weight) of a person who enters the bathroom. The information and the weight information indicating the weight detected by the weight sensor are acquired at predetermined time intervals (for example, 1 to 3 minutes). The bathing monitoring device identifies the user who entered the room based on the weight information acquired during the bathing time period until the acquisition of the entry/exit information indicating the exit after acquisition of the entry/exit information indicating the entry. The bathing monitoring device compares, for example, the detected weight indicated by the acquired weight information with the preset weight of each user, and identifies the user whose weight is closest to the detected weight. The bathing monitoring device directly or indirectly transmits sensor information indicating entrance/exit information and user identification information indicating a user identified during bathing to the device log storage unit 126. The device log accumulation unit 126 accumulates the sensor information received from the bathing monitoring device and accumulates it as a second sensor log. The log analysis unit 140 determines the user identified during bathing from the sensor information for each predetermined time interval obtained by referring to the second sensor log, and the time zone during bathing for the user, and the other time zones It can be determined that it is not taking a bath.

The log analysis unit 140 uses, for example, the third sensor log including the sensor information acquired by the health condition determination device installed in the washroom to determine whether or not it is “in use”. The health condition determination device is connected to, for example, a weight sensor installed in a toilet bowl, and acquires weight information indicating the weight detected by the weight sensor at predetermined time intervals (for example, 1 to 3 minutes). The health condition determining device determines that one of the persons is in the room when the weight indicated by the acquired weight information is larger than a predetermined weight threshold, and determines that the person is absent when the weight is less than or equal to the weight threshold. To do. The health condition determination device compares the detected weight indicated by the weight information with the preset weight of each user, and identifies the user whose weight is closest to the detected weight. The health condition determination device directly or indirectly transmits sensor information indicating user identification information indicating a user identified within the period determined to be in the room to the device log accumulation unit 126. The device log accumulation unit 126 accumulates the sensor information received from the health condition determination device and accumulates it as a third sensor log. The log analysis unit 140 determines that the user is identified as being in the room from the sensor information at predetermined time intervals obtained by referring to the third sensor log, and that the user is in the toilet during the time period in which the user is in the room, It can be determined that the flight is not in use at other times.

(Example of viewing analysis)
Next, an example of program viewing analysis by the utilization system US according to the present embodiment will be described.
In the viewing analysis, the utilization system US calculates, for example, an individual rating of a broadcast program broadcast in a specific time zone. The utilization system US includes, for each broadcast program, a broadcast channel, a broadcast time, and related information (for example, a program name, a genre), and program information obtained by associating these is passed through the external data acquisition unit 130 and the log analysis unit 140. To get. The utilization system US specifies the viewing period and the broadcast channel for each user from the operation information and the user identification information included in the combined log for each content presentation device 40. The utilization system US refers to the program information to identify a broadcast program including a part or all of the broadcast channel and the viewing period specified for each user. The viewing period information indicating is specified. The utilization system US calculates the number of viewers by sequentially accumulating (incrementing) the number of users for each specified broadcast program.
The utilization system US uses the same method to calculate the number of viewers for broadcast programs that are broadcast on other broadcast channels during that time period. Then, the utilization system US calculates the total sum of the number of viewers for each broadcast channel during that time period between the broadcast channels as the total number of viewers, and calculates the total number of viewers of the broadcast program broadcast on a specific channel. The ratio of the number of viewers can be calculated as an individual viewer rating.

In addition, the utilization system US is associated with broadcast station information indicating a predetermined broadcast channel for each time period of a predetermined time interval (for example, 10 to 60 minutes), and a viewing time indicating a viewing time including the time period. The number of viewers may be accumulated and calculated as the total number of viewers for each content presentation device 40 related to the information, or may be accumulated one by one and counted as the total number of viewers. The utilization system US may generate viewing analysis information that illustrates the total number of viewers and the total number of viewers for each time period.

(Example of advertisement delivery)
Next, an example of advertisement distribution by the utilization system US according to the present embodiment will be described.
When the total number of viewers calculated for a given advertisement program is less than the predetermined target number of viewers, the utilization system US may determine to deliver the advertisement data related to the advertisement program. Each advertising program can also be specified as a type of broadcast program. The advertisement data may include, for example, video and audio similar to the advertisement program, or video and audio separate from the advertisement program, but may include video and audio including common products, services, and other guidance information. Good. The utilization system US transmits the advertisement data to the information terminal device 30 of each of the registered users registered in advance and not viewing the advertisement program via the network. In the utilization system US, user registration information including a user ID for each user and a device ID or advertisement ID of the information terminal device 30 of that user, and associating them with each other, is set in advance. Among the registered users indicated by the user registration information, the utilization system US sends the users whose broadcast time of the advertisement program indicated by the program information does not include a part or all of the viewing time of each user specified from the combination log. Define as a user. The utilization system US can identify the device ID or the advertisement ID of the information terminal device 30 associated with the user ID indicating the identified user as the destination by referring to the user registration information.

The utilization system US may transmit the predetermined advertisement data including the information related to the genre to each information terminal device 30 of the viewer who has watched the broadcast program of the predetermined genre (for example, travel). The utilization system US refers to the program information, and identifies the user relating to the viewing time including the broadcast program and a part or all of the broadcast time for each user from the acquired combined log. The utilization system US can refer to the user registration information and specify the information terminal device 30 indicated by the device ID or the advertisement ID associated with the user ID indicating the specified user as the transmission destination.

As described above, the information processing method according to the present embodiment includes the first log including the operation information indicating the operation status of the first device (for example, the content presentation device 40) shared by the group of users, and the first log. Information in the information processing system 1 that includes a log storage unit LC that stores a second log including event information indicating an event related to an individual user that appears in a second device (for example, the IoT device 20) corresponding to one device. The processing method has a first step and a second step. The first step estimates the usable period during which each user can use the first device based on the event information. In the second step, the user identification information indicating the user in the usable period is added to the operation information indicating the operating condition in the usable period.
According to this configuration, regarding the first device shared by the group of one or more users, the operation information within the usable period of the operation information indicating the operating state indicates the user related to the usable period. A combined log configured by adding the user identification information shown is obtained. Therefore, it is possible to analyze the usage status of each user of the first device. As a result, it is possible to provide various information and services according to the activity tendency and taste of each user based on the analysis result.

In addition, the first step includes a first time that is a time of a predetermined first event in which an individual user can use the first device and a predetermined second event in which the user cannot use the first device. The usable period of the user is estimated based on the second time which is the time.
According to this configuration, in estimating the usable period for each user, the first event indicating the opportunity to use the first device in the second device and the second event indicating the opportunity to disable the first device Should be detected. Therefore, the usable period for each user is estimated without complicated processing and configuration.

In addition, the second step includes a third step of generating operation information indicating a stop at the second time in the operation situation indicated by the operation information immediately before the second time, and a second step based on the operation information generated in the third step. A fourth step of adding user identification information indicating a user at two times.
According to this configuration, at the second time, which is the end of the usable period, the combined log includes information indicating the end of use of the first device by the user for the usable period. Therefore, when the use status of the first device is analyzed using the combined log, it is possible to reliably determine the end of use of the user.

Further, the first step overlaps with the fifth step of estimating the log-specific usable period during which each user can use the first device based on each of the plurality of second logs, and the log-based usable period overlaps. A sixth step of estimating, as a usable period, a period in which the number of the second logs is a predetermined number or more.
With this configuration, it is possible to more reliably determine the usable period of each user by using the plurality of second logs.

Also, the log storage unit LC has a step of transmitting an operation information request indicating a request for the operation information to the first device at predetermined time intervals, and the second step relates to the operation information within the usable period. The method includes a step of adding user identification information indicating a user regarding the usable period.
According to this configuration, the log storage unit LC can acquire operation information from the first device at predetermined time intervals even if the operation status does not change. From the first time or the second time determined from the second log, it is possible to analyze the time within a predetermined time as the start time or the end time of the usable period.

In the second step, user identification information indicating a user including all periods in which a plurality of predetermined operation situations in which the usable periods have a causal relationship with each other is displayed, and operation information indicating each of the plurality of predetermined operation situations. To add to.
With this configuration, users whose operating times are within the usable period are specified as users related to those operating conditions, and users whose operating time is within the usable period are excluded. To be done. Therefore, the users who are associated with those operating conditions are limited to those who have a higher possibility.

Further, the first device is the content presentation device 40 capable of presenting the content including at least one of the video and the audio, and the operation information indicates the presentation start or the presentation end of the content.
According to this configuration, the combined log indicating the presentation time of the content by the content presentation device and the usable period for each user is acquired. Therefore, it is possible to analyze the viewing period corresponding to the content presentation period for each user using the combined log.

The second device controls the operation based on the input audio data, and the first step estimates the end of the usable period when the event information indicates non-detection of the audio data for a predetermined period or more. Including steps.
According to this configuration, it can be estimated that the usable period of the first device has ended when the input voice data is not detected for a predetermined period or longer. Therefore, it is possible to determine the usable period of the first device without using the second device without requiring the user to perform a particular operation.

Further, the first step includes a step of identifying the second device corresponding to the first device by referring to the possessed device information indicating the first device and the second device for each group.
According to this configuration, by identifying the second device corresponding to the first device, the user associated with the second device can be reliably identified as the user who is the determination target of the usable period of the first device.

In addition, the log storage unit LC acquires operation information and event information from either the first device or the second device.
According to this configuration, the first log including the operation information and the first log including the event information can be set without presetting the information indicating the correspondence between the first device and the second device or the first log and the second log. Two logs can be associated and acquired. In addition, by reducing the information that should be set in advance, it is possible to reduce the possibility that information that identifies individual users will leak.

Although one embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes and the like without departing from the scope of the present invention. It is possible to

For example, the device log storage unit 126 may store a device log including operation information and sensor information, or may store a sensor log in which one or more pieces of sensor information are sequentially accumulated separately from the device log. Good. Further, the information processing device 10 may include a sensor log storage unit (not shown) that stores sensor information, separately from the device log storage unit 126. In that case, the device log storage unit 126 may not store the sensor information.

The second device (for example, the IoT device 20-1) may be transmitted to the information processing device 10 via the first device. The first device may transmit the event information received from the second device to the information processing device 10 in association with the operation information indicating the operation status of the own device. In that case, the registered user information management unit 128 does not have to set the owned device information indicating the correspondence between the device ID of the first device and the device ID of the second device. If the individual users can be identified, the user ID is not necessarily required, and thus the registered user information management unit 128 may be omitted.

The information processing system 1 may include a server group (not shown) including a plurality of server devices instead of the information processing device 10. Each of the plurality of server devices has the hardware configuration shown in FIG. 4, and shares the functional units included in the information processing device 10 as the entire server group. The plurality of server groups are connected to each other via a network so that various data can be transmitted and received. For example, the server group includes three server devices. The first server device of the three server devices includes a content providing unit 122, an access log storage unit 124, a device log storage unit 126, and a registered user information management unit 128. The second server device includes an external data acquisition unit 130 and a log analysis unit 140. The third server device includes a combined log storage unit 142 and a request reception unit 144.

The combination of the number of server devices forming the server group and the functional units provided in each server device is not limited to this. For example, the first server device may include the content providing unit 122 and the access log storage unit 124, and the device log storage unit 126 and the registered user information management unit 128 may be omitted. The server group may further include a fourth server device, and the fourth server device may include a device log storage unit 126 and a registered user information management unit 128.
The second server device may be configured as a single server device that further includes the functional unit of the first server device, and the first server device may be omitted. The second server device may be configured as a single server device that further includes the functional unit of the third server device, and the third server device may be omitted.
Moreover, the server group may be configured to include a part or all of the utilization system US. The third server device may include functional units similar to the functional units of one or more server devices that make up the utilization system US. In that case, the process of transmitting the combined log request information by the functional unit and the request receiving unit 144 may be omitted.

Further, in the server group, the server device including the access log storage unit 124 and the server device including the device log storage unit 126 may be separate. The log storage unit LC may be configured to include an independent log storage unit (hereinafter, device-specific device log storage unit) for each type of device. The individual device log identification unit may be configured as one server device. The device-specific device log identification unit receives event information indicating an event that appears in a device of that model from the device, and accumulates accumulated logs. Any one of these device-specific device log storage units is a first device-specific device log storage unit that stores a first log, and the other one is a second device-based device log storage unit that stores a second log. ..

Device registration information is set in advance in the device log accumulation unit for each first device, the second device corresponding to the first device that is the transmission source of the received operation information is specified, and the event of the specified second device is specified. The information request information may be transmitted to the second device-specific device log storage unit. The second device-specific device log accumulation unit reads the event information received from the second device indicated by the request information received from the first device-specific device log accumulation unit, and uses the read event information as a response to the request information. Send to the device log storage section for each device.

Alternatively, the device registration information may be set in advance in the device log storage unit for each second device, and the device identification information of the first device corresponding to the second device that is the transmission source of the received event information may be specified. The second device-specific device log storage unit associates the received event information with the specified device identification information and transmits the device-specific device log storage unit.
The first device-specific device log storage unit stores the event information received from the second-device-specific device log storage unit and the operation information received from the first device in association with each other, and stores the second log and the first log, respectively. Form. The log analysis unit 140 reads the first log and the second log from the device log storage unit for each second device.

In addition, the first device may transmit event information request information for the event information acquired by the second device corresponding to the first device to the second device-specific device log storage unit. When receiving the event information request information from the first device, the second device-specific device log storage unit reads out the event information indicated by the received event information request information from the stored event information. The first device transmits the read event information as response information to the event information request information. A conversion table in which user identification information of each user and analysis identification information used for analysis are associated with each other is set in advance in the first device. The first device refers to the conversion table, specifies the identification information for analysis corresponding to the user identification information acquired in association with the event information received from the second device-specific device log storage unit, and acquires the acquired device identification information. Is replaced with the identified identification information for analysis, and the event information updated by the replacement is associated with the operation information indicating the operation status of the own device and transmitted to the first device-specific device log storage unit. The device log storage unit for each first device stores the operation information and the detection information received from the first device in association with each other to form a first log and a second log, respectively. The log analysis unit 140 can read the first log and the second log from the device log storage unit for each first device and can use the identification information for analysis as the identification information of each user. The user identification information can be regarded as a part of the personal information, but the analysis identification information is not regarded as the personal information because it is not subject to user registration. Therefore, by using the identification information for analysis, it is possible to avoid the opportunity to use the personal information. Therefore, it is possible to avoid the use for the purpose other than the collection purpose and to limit the chance that the personal information is distributed more than necessary. Protected.

In the above example, when the individual user is specified, the user ID is used as the user identification information for specifying the individual user, but the user is uniquely specified directly or indirectly ( For example, it is not limited to this as long as each user can individually use the device and basically specify a device that is not shared by a plurality of users. Instead of the user ID, different information may be used for each user. For example, instead of the user ID, a device ID of a device used by the user, a mail address, a user name, an advertisement ID of an advertisement having the device as a delivery destination, an application ID of an application having the device as a delivery destination, and the device When a browser running in step 1 accesses a website, the client ID or the like that is uniquely assigned from the website and used in subsequent access can be used.

The information processing device 10, the IoT device 20, the information terminal device 30, the content presentation device 40, and the server device described above may be realized by computers. In that case, the program for realizing this control function may be recorded in a computer-readable recording medium, and the program recorded in this recording medium may be read by a computer system and executed.
Further, even if some or all of the information processing device 10, the IoT device 20, the information terminal device 30, the content presentation device 40, and the server device described above are realized by including an integrated circuit such as an LSI (Large Scale Integration). Good. Each of the functional blocks of the information processing device 10, the IoT device 20, the information terminal device 30, the content presentation device 40, and a part of the above server device may be individually made into a processor, or a part or all of them may be integrated to form a processor. May be turned into. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when a technique for forming an integrated circuit that replaces the LSI appears due to the progress of semiconductor technology, an integrated circuit according to the technique may be used.

DESCRIPTION OF SYMBOLS 1... Information processing system, 10... Information processing apparatus, 20... IoT apparatus, 30... Information terminal apparatus, 40... Content presentation apparatus, 102... CPU, 104... Storage medium, 106... Drive section, 108... Input section, 110... Output unit, 112... ROM, 114... RAM, 116... Auxiliary storage unit, 118... Interface unit, 122... Content providing unit, 124... Access log storage unit, 126... Device log storage unit, 128... Registered user information management unit, 130... External data acquisition unit, 140... Log analysis unit, 142... Combined log storage unit, 144... Request receiving unit

Claims (14)

A first log including operation information indicating an operation status of a first device shared by a group of users, and a second log including event information indicating an event related to each user appearing in a second device corresponding to the first device A log storage unit that stores logs and
Estimating a usable period during which the individual user can use the first device based on the event information;
A log analysis unit that generates combined logs by adding user identification information indicating a user related to the usable period to the operation information indicating the operating condition in the usable period,
An information processing apparatus including. A first log including operation information indicating an operation status of a first device shared by a group of users, and a second log including event information indicating an event related to each user appearing in a second device corresponding to the first device. A log storage unit that stores logs and
Estimating a usable period during which the individual user can use the first device based on the event information;
A log analysis unit that generates combined logs by adding user identification information indicating a user related to the usable period to the operation information indicating the operating condition in the usable period,
An information processing system including. A first log including operation information indicating an operation status of a first device shared by a group of users, and a second log including event information indicating an event related to each user appearing in a second device corresponding to the first device. An information processing method in an information processing system, comprising: a log and a log storage unit that stores a log,
A first step of estimating a usable period during which the individual user can use the first device based on the event information;
A second step of adding to the operation information indicating the operation status during the usable period, user identification information indicating a user during the usable period;
An information processing method including. The first step is
A first time, which is a predetermined first event time when the individual user can use the first device, and a predetermined second event time, when the user is unable to use the first device The information processing method according to claim 3, wherein the usable period of the user is estimated based on two times. The second step is
A third step of generating motion information indicating a stop at the second time of the motion situation indicated by the motion information immediately before the second time;
The information processing method according to claim 4, further comprising: a fourth step of adding user identification information indicating a user at the second time to the operation information generated in the third step. The first step is
A fifth step of estimating a log-specific usable period during which the individual user can use the first device based on each of the plurality of second logs;
6. A sixth step of estimating, as the usable period, a period in which the number of the second logs in which the usable periods for each log overlap is equal to or more than a predetermined number. 6. Information processing method described. The second step is
A step of adding user identification information indicating a user including all periods in which a plurality of predetermined operating situations in which the usable period has a causal relationship to each other, to the operating information indicating each of the plurality of predetermined operating situations. The information processing method according to any one of claims 3 to 6. The first device is a content presentation device capable of presenting content including at least one of video and audio,
The information processing method according to claim 3, wherein the operation information indicates a presentation start or a presentation end of the content. The second device controls operation based on input voice data,
The first step is
The information processing method according to claim 3, further comprising a step of estimating the end of the usable period when the event information indicates non-detection of the audio data for a predetermined period or more. The second device includes a communication unit that performs wireless communication,
As the event, it is determined whether the second device is within the communication range of a wireless network provided by a predetermined base station device,
The first step is
The information processing method according to claim 3, further comprising: estimating the usable period based on a period in which the second device is within the communication range. The second device includes a detection unit that detects acceleration,
The first step is
The information processing method according to claim 3, further comprising the step of estimating the usable period based on the acceleration information indicated by the event information. The first step is
12. The method according to claim 3, further comprising the step of identifying the second device corresponding to the first device by referring to owned device information indicating the first device and the second device for each group. The information processing method described in one item. The log storage unit,
The information processing method according to any one of claims 3 to 11, wherein the operation information and the event information are acquired from one of the first device and the second device. A first log including operation information indicating an operation status of a first device shared by a group of users, and a second log including event information indicating an event related to each user appearing in a second device corresponding to the first device. A computer of the information processing device in the information processing system, which includes a log and a log storage unit that stores the log,
A first step of estimating a usable period during which the individual user can use the first device based on the event information;
A second step of adding to the operation information indicating the operation status during the usable period, user identification information indicating a user during the usable period;
A program to execute.

Images