JP2018160728A - Personal identification system, personal identification program, portable information terminal, and portable information terminal program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a technology capable of identifying a content selected by a user and capable of identifying the user who views the content without forcing the user to perform a predetermined remote control operation.SOLUTION: A acquisition unit acquires content viewing information based on information acquired from a content output device that outputs a content selected according to viewing operation by a user or a remote operation device that remotely operates the content output device. The content viewing information is information capable of determining a content output from the content output device. A communication unit performs non-wire communication with a portable information terminal possessed by the user. A personal information receiving unit receives personal information that is information for identifying the user stored in advance in a storage unit of the portable information terminal from the portable information terminal via the communication unit. A transmission unit transmits the content viewing information and personal information to a predetermined server.SELECTED DRAWING: Figure 9

Description

  The present disclosure relates to a personal identification system, a personal identification program, a portable information terminal, and a portable information terminal program.

  Patent Document 1 discloses a configuration in which information indicating which television program a user has selected is acquired by a server.

JP 2010-239345 A

  By the way, it is conceivable not only to specify which television program the user has selected, but also to specify an individual in the home who is viewing the content. In this case, as a method for specifying an individual in the home, there is a method for specifying an individual by a user operating a button on a remote controller distributed for measurement.

However, in this method, the user is forced to perform a predetermined remote control operation.
One aspect of the present disclosure is to provide a technique capable of specifying content selected by a user and specifying a user who is viewing the content without forcing the user to perform a predetermined remote control operation. .

  One aspect of the present disclosure is a personal identification system including an acquisition unit, a communication unit, a personal information reception unit, and a transmission unit. The acquisition unit acquires content viewing information based on information acquired from a content output device that outputs content selected according to a user's viewing operation or a remote operation device for remotely operating the content output device. The content viewing information is information that can identify the content selected according to the viewing operation. The communication unit performs non-wired communication with a portable information terminal possessed by the user. The personal information receiving unit receives personal information, which is information for identifying a user stored in advance in the storage unit of the portable information terminal, from the portable information terminal via the communication unit. The transmission unit transmits the content viewing information and personal information to a predetermined server.

  According to such a configuration, the content selected by the user can be specified based on the content viewing information. Moreover, personal information is acquired by non-wired communication with the user's portable information terminal, and who is viewing the content is specified. For this reason, it is possible to specify the content selected by the user and to identify the user who is viewing the content without forcing the user to perform a predetermined remote control operation.

  One aspect of the present disclosure may further include a determination unit. The determination unit determines whether the signal strength of the received signal from the portable information terminal received by the communication unit is equal to or greater than a predetermined threshold value. The transmission unit transmits personal information to the server when the determination unit determines that the signal strength is equal to or greater than the threshold value, and transmits the personal information to the server when the signal strength is determined to be less than the threshold value. Do not send.

  Since the communication area of the communication unit has a certain extent, even if the personal information is received by the personal information receiving unit, the personal information may be for a user who is not viewing the content. On the other hand, in the above configuration, even if personal information is received, the personal information is transmitted to the server only when the signal strength of the received signal is equal to or higher than the determination threshold. Therefore, when personal information is received, the personal information of the user who is actually viewing can be transmitted more easily than the configuration in which the personal information is unconditionally transmitted to the server.

  One aspect of the present disclosure may include a calculation unit and a distance acquisition instruction unit. The calculation unit calculates the distance between the communication unit and the portable information terminal based on the signal strength of the received communication from the portable information terminal received by the communication unit. The distance acquisition instruction unit causes the server to acquire distance information that is information indicating the distance.

Therefore, it is possible to specify how far the user has viewed the content from the communication unit.
In one aspect of the present disclosure, the communication unit may perform non-wired communication with the portable information terminal using a plurality of types of communication schemes in which priorities are set in advance. Then, the calculation unit allows the communication unit to receive both the first communication method included in the plurality of types of communication methods and the second communication method having a lower priority than the first communication method from the portable information terminal. When a signal is received, the distance may be calculated based on the signal strength of the received signal received by the first communication method.

  According to such a configuration, for example, it is easier to transmit distance information of the user who is actually viewing by setting a higher priority for a communication method in which a signal from a mobile information terminal that exists far away is difficult to reach. be able to.

  According to an aspect of the present disclosure, the mobile information terminal includes a sensor that detects the movement of the mobile information terminal, and includes a first calculation unit, a second calculation unit, an estimation unit, and an estimated distance acquisition instruction unit. , May be further provided. The first calculation unit calculates the distance between the communication unit and the portable information terminal based on the signal strength of the received communication from the portable information terminal received by the communication unit. The second calculation unit calculates the distance between the communication unit and the portable information terminal based on the detection value of the sensor. The estimation unit estimates the distance between the communication unit and the portable information terminal based on the distance calculated by the first calculation unit and the distance calculated by the second calculation unit. The estimated distance acquisition instruction unit causes the server to acquire the distance estimated by the estimation unit.

According to such a configuration, for example, the estimation accuracy of the same distance can be improved as compared with a configuration that calculates only the distance between the communication unit and the portable information terminal based on the signal strength.
In one aspect of the present disclosure, the mobile information terminal may include a sensor that detects the movement of the mobile information terminal, and may include a state information generation unit and a state acquisition instruction unit. The state information generation unit generates state information that is information indicating the state of the user's action based on the detection value of the sensor. The state acquisition instruction unit causes the server to acquire state information.

According to such a configuration, it is possible to specify the state of the user's behavior when viewing the content.
One aspect of the present disclosure may include a determination unit and a display processing unit. The determination unit determines a display mode of content to be displayed on the display unit of the portable information terminal according to the state information. The display processing unit displays the content on the display unit in the display mode determined by the determination unit.

According to such a configuration, the content can be displayed in a display mode suitable for the state of the user's action.
One aspect of the present disclosure may further include an application information receiving unit. The application information receiving unit receives application information, which is information indicating the activated application software, from the portable information terminal via the communication unit. The transmission unit may transmit the application information to the server.

According to such a configuration, it is possible to specify the application that the user was viewing at the time of viewing the content.
One aspect of the present disclosure may further include an operation information receiving unit. The operation information receiving unit receives operation information, which is information indicating a user operation on the portable information terminal, from the portable information terminal via the communication unit. The transmission unit may transmit the operation information to the server.

According to such a configuration, it is possible to specify a user operation on the portable information terminal when viewing the content.
Another aspect of the present disclosure is a personal identification program that causes a computer of an apparatus including a communication unit that performs non-wired communication to function as an acquisition unit, a personal information reception unit, and a transmission unit. The acquisition unit acquires content viewing information based on information acquired from a content output device that outputs content selected according to a user's viewing operation or a remote operation device for remotely operating the content output device. The content viewing information is information that can identify the content selected according to the viewing operation. The personal information receiving unit receives personal information, which is information for identifying the user stored in advance in the storage unit of the portable information terminal possessed by the user, from the portable information terminal via the communication unit. The transmission unit transmits the content viewing information and personal information to a predetermined server.

According to such a configuration, the same effects as those of the personal identification system described above can be obtained.
Another aspect of the present disclosure is a portable information terminal, which includes a terminal-side communication unit and a terminal-side transmission unit. The terminal side communication unit is a unit for performing non-wired communication. The terminal side acquisition unit acquires personal information, which is information for identifying the user, from the storage unit of the portable information terminal. The terminal side transmission unit transmits the personal information to the content viewing information transmission device via the terminal side communication unit. The content viewing information transmitting device selects according to the viewing operation based on the content output device that outputs the content selected according to the viewing operation by the user or the information acquired from the remote operation device for remotely operating the content output device A portable information terminal, which is a device that acquires content viewing information, which is information that can identify the content that has been obtained, and transmits the acquired content viewing information to a predetermined server.

According to such a configuration, the content viewing information transmitting apparatus transmits the personal information received from the portable information terminal to the server, and thus has the same effect as that of the personal identification system described above.
Another aspect of the present disclosure is a portable information terminal program that causes a computer of a portable information terminal including a communication unit for performing non-wired communication to function as a terminal-side acquisition unit and a terminal-side transmission unit. The terminal side acquisition unit acquires personal information, which is information for identifying the user, from the storage unit of the portable information terminal. The terminal side transmission unit transmits the personal information to the content viewing information transmission device via the terminal side communication unit. The content viewing information transmitting device selects according to the viewing operation based on the content output device that outputs the content selected according to the viewing operation by the user or the information acquired from the remote operation device for remotely operating the content output device It is an apparatus that acquires content viewing information, which is information that can identify the obtained content, and transmits the acquired content viewing information to a predetermined server.

  According to such a configuration, the content viewing information transmitting apparatus transmits the personal information received from the portable information terminal to the server, and thus has the same effect as that of the personal identification system described above.

It is a block diagram which shows the structure of an action estimation system. It is a block diagram which shows the structure of a content output device. It is a block diagram which shows the structure of a dedicated apparatus. It is a block diagram which shows the structure of a portable information terminal. It is a block diagram which shows the structure of an action estimation server. It is a functional block diagram of a dedicated device, a portable information terminal, and an action estimation server. It is a flowchart of the viewing-and-listening information transmission process which a dedicated apparatus performs. It is a flowchart of the personal identification process which a dedicated apparatus performs. It is a flowchart of the personal information transmission process which a portable information terminal performs. It is a flowchart of the application information transmission process which a portable information terminal performs. It is a flowchart of the estimation process which an action estimation server performs. It is a flowchart of the advertisement information transmission process which an action estimation server performs. It is a flowchart of the display process which a portable information terminal performs. It is a sequence diagram in case a portable information terminal performs a personal information transmission process. It is a sequence diagram in case a portable information terminal performs application information transmission processing.

Hereinafter, embodiments for carrying out the present disclosure will be described with reference to the drawings.
[1. Configuration]
[1-1. Hardware configuration]
A behavior estimation system 100 illustrated in FIG. 1 includes a content output device 1, a dedicated device 2, a portable information terminal 3, a behavior estimation server 4, and a database 5. The behavior estimation system 100 includes a plurality of content output devices 1, dedicated devices 2, and portable information terminals 3. In FIG. 1, only one set of content output device 1, dedicated device 2, and portable information terminal 3 is shown. Yes.

  The behavior estimation system 100 is a system for specifying a television program selected in the content output device 1 (a television in this embodiment) installed in a plurality of households. As will be described later, the behavior estimation system 100 also performs personal recognition and behavior estimation of a user who is watching or watching a television program.

  The content output device 1 is configured to output a television program selected according to a viewing operation by a user. As shown in FIG. 2, the content output device 1 includes a display 11, a speaker 12, a control unit 13, an HDMI input terminal 14, and an infrared light receiving unit 15.

The display 11 is configured to display various images.
The speaker 12 is configured to output sound.
The HDMI input terminal 14 inputs video signals, audio signals, and control signals in a digital format with a single cable in accordance with a communication interface standard called HDMI (registered trademark), and outputs the control signals as well. It is a well-known thing that can be done. The HDMI input terminal 14 is provided on the rear side of the content output device 1 (the side opposite to the side on which the display 11 is provided). In the present embodiment, the HDMI input terminal 14 is connected to the HDMI connection unit 27 of the dedicated device 2.

  The infrared light receiver 15 receives an infrared code transmitted from the remote operation device 1 a for remotely operating the content output device 1, and outputs the infrared code to the control unit 13. The remote operation device 1a may be a dedicated remote controller attached to the content output device 1, or may be a smartphone or a mobile phone in which a program (application) for realizing the function as the dedicated remote controller is incorporated. May be.

  For example, the control unit 13 causes the TV tuner (not shown) to select a broadcast channel corresponding to the viewing operation by the user based on the infrared code input from the remote operation device 1a, thereby displaying the TV program of the broadcast channel. 11 outputs the sound to the speaker 12 while outputting the monitor.

  The control unit 13 receives information indicating the broadcast channel selected by the user (hereinafter referred to as viewing operation information) when the reply request described later is input from the dedicated device 2 via the HDMI input terminal 14. The data is output to the dedicated device 2 via the terminal 14.

The dedicated device 2 is a dedicated device that is used as an attachment to the content output device 1 in order to identify the selected television program in the behavior estimation server 4.
As shown in FIG. 3, the dedicated device 2 includes a microphone 21, an Internet communication unit 22, a BLE communication unit 23, an IC tag interface 24, a speaker 25, a storage unit 26, a power source 27, and an HDMI connection unit. 28 and a control unit 29. The interface is hereinafter abbreviated as “IF”.

The microphone 21 is configured to input sound.
The Internet communication unit 22 is configured to access the Internet network 10 shown in FIG. 1 by wired or wireless communication in accordance with a control signal from the control unit 29 and communicate with the behavior estimation server 4 and the like. As a communication system for wireless communication, for example, WiFi (Wireless Fidelity), 3G (third generation mobile communication system), and the like can be considered, and any one of them is used. WiFi is a registered trademark.

  The BLE communication unit 23 is configured to perform near field communication (hereinafter referred to as BLE communication) using Bluetooth (registered trademark) Low Energy (hereinafter referred to as BLE) in accordance with a control signal from the control unit 29.

  The IC tag IF 24 is an I / F for performing wireless communication (hereinafter referred to as NFC communication) in accordance with an NFC (Near Field Communication) system in accordance with a control signal from the control unit 29. The IC tag IF 24 performs NFC communication with an IC tag IF 33 (described later) provided in the portable information terminal 3. The method of supplying power to the IC tag IF 24 may be either a so-called passive type or active type.

  The speaker 25 is configured to output sound. In the present embodiment, the speaker 25 outputs a non-audible sound in accordance with a control signal from the control unit 29 and performs communication using the non-audible sound (hereinafter referred to as non-audible sound communication) with the portable information terminal 3.

  The storage unit 26 is a storage device such as a semiconductor memory element. The storage unit 26 stores identification information that is information for identifying the dedicated device 2 from other dedicated devices 2. In the present embodiment, the storage unit 26 stores signal characteristic information that is information that associates the signal strength of the received signal with the distance to the dedicated device 2. The signal characteristic information is prepared for each communication method of BLE communication, NFC communication, and non-audible sound.

The power source 27 is configured to supply power to each unit such as the control unit 29.
The HDMI connection unit 28 is connected to the HDMI input terminal 14 of the content output device 1. The HDMI connection unit 28 is used to input viewing operation information (information indicating a broadcast channel selected by the user) from the content output apparatus 1. Note that the HDMI connection unit 28 may be directly connected to the HDMI input terminal 14 or may be connected via a cable or the like.

  The control unit 29 is mainly configured by a known microcomputer having a CPU 291 and a semiconductor memory (hereinafter referred to as a memory 292) such as a RAM, a ROM, and a flash memory. Various functions of the control unit 29 are realized by the CPU 291 executing a program stored in a non-transitional physical storage medium. In this example, the memory 292 corresponds to a non-transitional tangible storage medium that stores a program. Further, by executing this program, a method corresponding to the program is executed. By executing this program, viewing information transmission processing shown in FIGS. 7 and 8 to be described later is executed. The number of microcomputers constituting the control unit 29 may be one or more.

  In the present embodiment, the control unit 29 always inputs a reply request to the content output device 1 via the HDMI connection unit 28. Then, viewing operation information is input from the content output device 1 as a response signal to the reply request. In other words, while the content output device 1 is outputting content, the viewing operation information is always input from the content output device 1.

  On the other hand, the portable information terminal 3 is an information device that can be carried and used by the user, and is a smartphone in the present embodiment. As shown in FIG. 4, the portable information terminal 3 includes a microphone 31, a BLE communication unit 32, an IC tag IF 33, a speaker 34, a touch panel display 35, a storage unit 36, an acceleration sensor 37, and a gyro sensor 38. And a control unit 39.

The microphone 31 is configured to input sound.
The BLE communication unit 32 is configured to perform BLE communication in accordance with a control signal from the control unit 39.

  The IC tag IF 33 is an I / F for executing NFC communication in accordance with a control signal from the control unit 39. The IC tag IF 33 performs NFC communication with the IC tag IF 24 provided in the dedicated device 2. Note that the method of supplying power to the IC tag IF 33 may be a so-called passive type or active type.

  The speaker 34 is configured to output sound. In the present embodiment, the speaker 34 outputs a non-audible sound according to a control signal from the control unit 39 and performs non-audible sound communication with the dedicated device 2.

  The touch panel display 35 is configured to display various images in accordance with control signals from the control unit 39. The touch panel display 35 receives a touch operation from the user and outputs an operation signal indicating the content of the touch operation to the control unit 39.

  The storage unit 36 is a storage device such as a semiconductor memory element. The storage unit 36 stores personal information that is information for identifying the user of the portable information terminal 3. The personal information is, for example, information indicating the user's name, date of birth, age, sex, physical information, hobbies or preferences. The personal information is registered in advance by the user.

The acceleration sensor 37 is a sensor configured to detect the acceleration of the portable information terminal 3. The acceleration sensor 37 outputs the detection value to the control unit 39.
The gyro sensor 38 is a sensor configured to detect the rotational angular velocity of the portable information terminal 3. The gyro sensor 38 outputs the detection value to the control unit 39.

  The control unit 39 is configured around a known microcomputer having a CPU 391 and a semiconductor memory (hereinafter referred to as a memory 392) such as a RAM, a ROM, and a flash memory. Various functions of the control unit 39 are realized by the CPU 391 executing a program stored in a non-transitional physical storage medium. In this example, the memory 392 corresponds to a non-transitional physical storage medium that stores a program. Further, by executing this program, a method corresponding to the program is executed. In the present embodiment, a dedicated application (hereinafter referred to as a dedicated application) is installed in the portable information terminal 3, and when this dedicated application is executed, personal information transmission processing shown in FIG. The application information transmission process shown in FIG. 13 and the display process shown in FIG. 13 are executed. The number of microcomputers constituting the control unit 39 may be one or plural.

On the other hand, the behavior estimation server 4 includes a network IF 41 and a control unit 42, as shown in FIG.
The network IF 41 is configured to be connected to the Internet network 10.

  The control unit 42 is mainly configured by a known microcomputer having a CPU 421 and a semiconductor memory (hereinafter referred to as a memory 422) such as a RAM, a ROM, and a flash memory. Various functions of the control unit 42 are realized by the CPU 421 executing a program stored in a non-transitional physical storage medium. In this example, the memory 422 corresponds to a non-transitional tangible storage medium that stores a program. Further, by executing this program, a method corresponding to the program is executed. In the present embodiment, by executing this program, an estimation process shown in FIG. 11 and an advertisement information transmission process shown in FIG. The number of microcomputers constituting the control unit 42 may be one or plural.

  The database 5 is a database for storing various data generated by the behavior estimation server 4. In the present embodiment, the database 5 stores advertisement information that is advertisement information to be displayed on the touch panel display 35 of the portable information terminal 3. In the present embodiment, a plurality of types of advertisement information having different information granularities are stored. Specifically, advertisement information of a plurality of types of character messages having different numbers of characters is stored as a plurality of types of advertisement information having different information granularities. In particular, first advertisement information and second advertisement information having more characters than the first advertisement information are stored. The first advertisement information is simple message advertisement information whose outline can be easily grasped, and the second advertisement information is advertisement information of a deep message.

[1-2. Functional configuration]
Next, functional configurations of the control unit 39 of the portable information terminal 3, the control unit 29 of the dedicated device 2, and the control unit 42 of the behavior estimation server 4 will be described in order with reference to FIG.

  First, the control unit 39 of the portable information terminal 3 causes the CPU 391 to execute the dedicated application described above, so that an advertising packet reception unit 393, a personal information acquisition unit 394, a state information generation unit 395, a synthesis processing unit 396, It functions as an application information acquisition unit 397, a transmission data generation unit 398, a data transmission unit 399, a data reception unit 400, and a display processing unit 401.

  The advertising packet receiving unit 393 receives the advertising packet transmitted from the dedicated device 2. In other words, in the present embodiment, the dedicated device 2 transmits an advertising packet, which is a wireless packet for notifying the existence of the own device, to the surroundings of the own device using three types of communication methods of BLE communication, NFC communication, and non-audible sound communication. To do. The advertising packet receiving unit 393 receives the advertising packet of each communication method via the BLE communication unit 32, the IC tag IF 33, and the microphone 31.

The personal information acquisition unit 394 acquires personal information from the storage unit 36 when the advertising packet reception unit 393 receives the advertising packet from the dedicated device 2.
When the advertising packet from the dedicated device 2 is received by the advertising packet receiving unit 393, the status information generating unit 395 generates status information. The state information is information indicating the state of user behavior. In the present embodiment, the state information includes detection values of the acceleration sensor 37 and the gyro sensor 38 mounted on the portable information terminal 3. The state information includes the state of the user's behavior estimated based on the detection values of the sensors 37 and 38. The user's behavior estimated in the present embodiment is a state where the user is sitting and moving.

  The composition processing unit 396 synthesizes the personal information and the status information, and converts the information obtained by the composition into a transmittable data format. Each communication system here refers to a communication system using BLE communication, NFC communication, and non-audible sound communication. The same applies hereinafter.

  When the advertising packet from the dedicated device 2 is received by the advertising packet receiving unit 393, the application information acquiring unit 397 acquires the application information. The application information is information indicating an application activated on the portable information terminal 3. In other words, the application information is information indicating the application that the user is viewing on the portable information terminal 3.

The transmission data generation unit 398 changes the application information to a data format that can be transmitted.
The data transmission unit 399 transmits the combined information of personal information and state information and application information to the dedicated device 2 by each communication method.

The data receiving unit 400 receives the advertisement information sent from the behavior estimation server 4 via the dedicated device 2.
The display processing unit 401 displays an advertisement indicated by the advertisement information received by the data receiving unit 400 on the touch panel display 35.

  On the other hand, the control unit 29 of the dedicated device 2 causes the CPU 291 to execute the program stored in the memory 292, thereby causing the advertising packet transmission unit 293, the viewing operation information acquisition unit 294, the content recognition processing unit 295, the data As a reception unit 296, a personal information processing unit 297, a first distance calculation unit 298, a state information processing unit 299, an application information processing unit 300, a transmission data generation unit 301, and a data transmission unit 302 Function.

The advertising packet transmission unit 293 transmits an advertising packet to the periphery of the dedicated device 2 by each communication method.
The viewing operation information acquisition unit 294 acquires viewing operation information from the content output device 1 via the HDMI connection unit 27.

  Based on the viewing operation information, the content recognition processing unit 295 generates content viewing information that can identify the television program selected according to the viewing operation of the user. The content viewing information may be any information that can identify the content selected according to the viewing operation on the behavior estimation server 4. In the present embodiment, the content viewing information is information including the broadcast channel indicated by the viewing operation information and the time when the dedicated device 2 acquires the viewing operation information.

  The data reception unit 296 receives various types of information transmitted by the data transmission unit 399 of the portable information terminal 3 by each communication method. Further, the data receiving unit 296 receives the advertisement information transmitted by the behavior estimation server 4 via the Internet communication unit 22.

The personal information processing unit 297 extracts personal information from various information acquired by the data receiving unit 296.
The first distance calculator 298 calculates the distance between the portable information terminal 3 and the dedicated device 2 based on the signal strength of the received signal received by each communication method. The signal strength here is a volume for non-audible sound communication, and a radio wave strength for BLE communication and NFC communication. The first distance calculator 298 calculates the distance between the portable information terminal 3 and the dedicated device 2 based on the signal characteristic information stored in the storage unit 26 and the signal strength of the received signal. The first distance calculation unit 298 generates distance information that is information indicating the calculated distance.

The state information processing unit 299 extracts state information from various information acquired by the data receiving unit 296.
The application information processing unit 300 extracts application information from various information acquired by the data reception unit 296.

The transmission data generation unit 301 changes each of the content viewing information, personal information, distance information, status information, and application information into a transmittable data format.
The data transmission unit 302 transmits various types of information whose data format has been changed to the behavior estimation server 4 through the Internet communication unit 22 together with the identification information and time stamp of the dedicated device 2. Further, the data transmission unit 302 transmits the advertisement information received by the data reception unit 296 to the portable information terminal 3 by each communication method.

  On the other hand, the behavior estimation server 4 causes the data reception unit 423, the first association processing unit 424, the second association processing unit 425, and the data storage when the CPU 421 executes the program stored in the memory 422. Functions as a unit 426, a data extraction unit 427, a movement amount calculation unit 428, a second distance calculation unit 429, an estimation unit 430, an advertisement determination unit 431, and a data transmission unit 432.

The data receiving unit 423 receives various types of information transmitted by the data transmitting unit 302 of the dedicated device 2 via the Internet communication unit 22.
The first association processing unit 424 associates the content viewing information, the personal information, the distance information, the state information, the identification information of the dedicated device 2 and the time stamp received by the data receiving unit 423 with each other.

The second association processing unit 425 associates the content viewing information, the application information, the identification information of the dedicated device 2 and the time stamp received by the data reception unit 423 with each other.
The data storage unit 426 stores (stores) various types of information associated with the first association processing unit 424 and the second association processing unit 425 in the database 5. Further, as will be described later, the data storage unit 426 stores the distance between the dedicated device 2 and the portable information terminal 3 estimated by the estimation unit 430 in the database 5.

  The data extraction unit 427 extracts various information from the database 5. In the present embodiment, the data extraction unit 427 periodically transmits the state viewing information transmitted from the dedicated device 2 when the content viewing information is transmitted from the dedicated device 2, in other words, when the content viewing is started. The database 5 is pulled out. The data extraction unit 427 provides the extracted state information to the advertisement determination unit 431 as needed. Further, the data extraction unit 427 collects state information and distance information transmitted in the past from the dedicated device 2 from the start of content viewing to the end of content viewing at the timing when the user finishes viewing the content. Pull out from 5. Then, the extracted state information and distance information are provided to the movement amount calculation unit 428. In the present embodiment, when content viewing information is not sent from the dedicated device 2 for a certain time or more, it is determined that the content viewing has ended.

  The movement amount calculation unit 428 is based on the detection values of the acceleration sensor 37 and the gyro sensor 38 in the state information extracted from the data extraction unit 427, and is a fixed time from when viewing of the content is started until it is ended. The movement amount of the user of each portable information terminal 3 is calculated. For the movement distance, the movement amount calculation unit 428 calculates the user's stride from the number of steps data obtained from the acceleration information and the body data included in the personal information, and calculates the approximate movement distance by the number of steps × step length.

  The second distance calculation unit 429 calculates the distance between the dedicated device 2 and the portable information terminal 3 every fixed time from when content viewing is started until it is ended. The second distance calculation unit 429 uses the distance information extracted from the data extraction unit 427 as an initial position, and adds the movement amount calculated by the movement amount calculation unit 428. The second distance calculation unit 429 calculates the distance between the dedicated device 2 and the portable information terminal 3 at regular time intervals by executing this process at regular time intervals.

  The estimation unit 430 performs a distance estimation process. In the distance estimation process, the distance calculated by the second distance calculation unit 429 is compared with the distance indicated by the distance information calculated by the first distance calculation unit 298 extracted from the data extraction unit 427. The difference between the two distances is calculated. If the deviation exceeds a predetermined value, the distance calculated by the second distance calculation unit 429 is the distance between the dedicated device 2 and the portable information terminal 3 at that time. Thereby, the distance for every fixed time of the exclusive apparatus 2 and the portable information terminal 3 is estimated.

  The advertisement determination unit 431 selects the touch panel display 35 of the portable information terminal 3 from the advertisements stored in the database 5 based on the state of user behavior indicated by the state information periodically extracted from the data extraction unit 427. Determine the advertising information to be displayed on. In the present embodiment, when the state information indicates a state where the user is sitting, the advertisement determination unit 431 arbitrarily selects one piece of advertisement information from the above-described second advertisement information (advertisement information having a larger number of characters). The advertisement information is extracted and displayed. On the other hand, when the state information indicates a state where the user is moving, the advertisement determination unit 431 arbitrarily extracts one piece of advertisement information from the above-described first advertisement information (advertisement information with a smaller number of characters). , And advertisement information to be displayed.

The data transmission unit 432 transmits the advertisement information of the advertisement determined by the advertisement determination unit 431 to the dedicated device 2 via the network IF 41.
[2. Processing]
[2-1. Viewing information transmission processing]
Next, viewing information transmission processing executed by the control unit 29 of the dedicated device 2 will be described with reference to the flowchart of FIG. The viewing information transmission process is periodically executed while the dedicated device 2 is powered on.

  First, in S110, the control unit 29 determines whether or not content is being viewed on the content output device 1. Here, the control unit 29 determines that the content is being viewed when the viewing operation information is input from the content output device 1. On the other hand, when the viewing operation information is not input from the content output device 1, the control unit 29 determines that the content is not viewed.

If it is determined that the content is not viewed, the control unit 29 executes the process of S110 again.
On the other hand, when it is determined that the content is being viewed, the control unit 29 executes the series of processes of S115 and S120 and the series of processes of S130 to S165 in parallel.

In S115, the control unit 29 generates and acquires content viewing information based on the viewing operation information acquired from the content output device 1.
In S120, the control unit 29 transmits the acquired content viewing information together with the identification information and time stamp of the dedicated device 2 to the behavior estimation server 4, and then ends the series of processes in S115 and S120.

  On the other hand, in S130, the control unit 29 transmits an advertising packet to the periphery of the dedicated device 2. Thus, in the present embodiment, the advertising packet is transmitted only when it is determined that the content is being viewed. In the present embodiment, sequence numbers are added to all transmitted advertising packets.

When executing S130, the control unit 29 executes the process of S140, the series of processes of S150 and S155, and the series of processes of S160 and S165 in parallel.
In S140, the control unit 29 executes the personal identification process shown in FIG. The personal identification process will be described later.

On the other hand, in S150, the control unit 29 determines whether or not application information from the dedicated device 2 has been received.
If the control unit 29 determines in S150 that the application information has not been received, it executes S150 again.

  On the other hand, when it is determined that the application information is received in S150, the control unit 29 proceeds to S155, transmits the application information to the behavior estimation server 4, and ends the series of processes of S150 and S155. In addition, if application information with the same content is received with another communication method after application information is received with one of the communication methods, even if the application information with the same content received later is discarded Good.

On the other hand, in S160, the control unit 29 determines whether or not the advertisement information from the behavior estimation server 4 has been received.
When it is determined that the advertisement information has not been received, the control unit 29 executes S160 again.

  On the other hand, if it is determined that the advertisement information has been received in 160, the control unit 29 proceeds to S165, transmits the advertisement information to the portable information terminal 3, and ends the series of processes in S160 and S165.

  When the series of processes of S115 and S120 is completed, and the process of S140, the series of processes of S150 and S155, and the series of processes of S160 and S165 are all completed, the control unit 29 performs viewing of FIG. The information transmission process ends.

  The control unit 29 functions as a viewing operation information acquisition unit 294, a content recognition processing unit 295, and an advertising packet transmission unit 293 by executing S115, S120, and S130. In addition, the control unit 29 functions as the data transmission unit 302 by executing S155 and S165.

[2-2. Personal identification processing]
Next, personal identification processing executed by the control unit 29 of the dedicated device 2 will be described with reference to the flowchart of FIG.

  First, in S <b> 141, the control unit 29 determines whether or not there is a response from the portable information terminal 3 using a communication method with a high priority. In this embodiment, a priority is set in advance for each communication method. Specifically, the communication method using non-audible sound is set to high priority, the communication method using NFC is medium priority, and the communication method using BLE is set to low priority. Therefore, in S141, it is determined whether or not there is a response from the portable information terminal 3 in the communication method using non-audible sound.

  In the present embodiment, when a response is received from the portable information terminal 3, the priority is set so that the communication method is considered to be highly likely that the user of the portable information terminal 3 is viewing the content. ing. That is, sound waves such as non-audible sounds are unlikely to pass through the building walls. Therefore, when there is a response with a non-audible sound, there is a high possibility that the mobile information terminal 3 that has responded exists in the room in which the dedicated device 2 and thus the content output device 1 are installed. In other words, when there is a response with a non-audible sound, the user of the mobile information terminal 3 that has responded is likely to be viewing the content. On the other hand, radio waves such as BLE communication and NFC communication easily pass through the walls of buildings. Therefore, when there is a response in BLE communication and NFC communication, a response signal from the mobile information terminal 3 of the user behind the wall is easily received. In other words, when there is a response in BLE communication or NFC communication, a response signal from the portable information terminal 3 of the user who is not viewing the content is more easily received than in non-audible sound communication. Therefore, in this embodiment, when there is a response, the non-audible sound communication in which the user of the responding portable information terminal 3 is more likely to view the content has priority over the BLE communication and the NFC communication. The degree is set high. For BLE communication and NFC communication, radio waves reach the other side of the wall, but in this embodiment, the communication method using NFC communication has a higher priority than the communication method using BLE communication. Yes.

  If the control unit 29 determines in S141 that there is no response in the high priority communication method, the control unit 29 proceeds to S142 and determines whether or not there is a response in the medium priority communication method. That is, the control unit 29 determines whether or not there is a response in the communication method using NFC communication.

  When the control unit 29 determines in S142 that there is no response in the communication method with the medium priority, the control unit 29 proceeds to S143 and determines whether there is a response in the communication method with the low priority. That is, the control unit 29 determines whether or not there is a response in the communication method using BLE communication.

If the control unit 29 determines that there is no response in the low priority communication method, that is, if it determines that there is no response in any communication method, the control unit 29 ends the personal identification processing of FIG.
On the other hand, the control unit 29 determines that there is a response in the communication method with a high priority in S141, determines that there is a response in the communication method with a high priority in S142, or communication with a low priority in S143. When it is determined that there is a response in the method, the process proceeds to S144.

  In S144, the control unit 29 determines whether or not the signal strength of the received signal of the communication method that has responded is equal to or greater than a predetermined threshold (hereinafter referred to as a determination threshold). The communication method having a response in S144 and S145 to be described later refers to a communication method having the highest priority among the communication methods having a response.

  The determination threshold is set with reference to the signal strength of the received signal when a signal transmitted from the portable information terminal 3 located on the boundary between the viewing area and the outside is received. That is, the determination threshold is set for each communication method. The viewing area is an area around the dedicated device 2 and, in turn, the content output device 1 and is a predetermined area where a user who is viewing the television program output to the content output device 1 is normally considered to exist. In the present embodiment, the viewing area is set to an area narrower than the communication area of any communication method by the dedicated device 2.

  If the control unit 29 determines in S144 that the signal strength is greater than or equal to the determination threshold value, in other words, if it is determined that the portable information terminal 3 is present in the viewing area, the control unit 29 proceeds to S145 and returns a response. The distance between the dedicated device 2 and the portable information terminal 3 is calculated based on the signal strength of the received signal of the communication method.

Subsequently, in S <b> 146, the control unit 29 extracts personal information and state information from various information acquired from the portable information terminal 3.
Subsequently, in S147, the control unit 29 transmits the extracted personal information and state information and distance information indicating the distance calculated in S145 to the behavior estimation server 4 together with the identification information and time stamp of the dedicated device 2. . The control part 29 will complete | finish the personal identification process of FIG. 8, if S147 is performed.

  On the other hand, if the control unit 29 determines that the signal strength is less than the determination threshold value in S144, in other words, if it is determined that the portable information terminal 3 does not exist within the viewing area, the above-described S145- The personal identification process of FIG. 8 is terminated without executing the process of 147. That is, information such as personal information is transmitted to the behavior estimation server 4 only when the signal strength is greater than or equal to the determination threshold, in other words, when it is determined that the portable information terminal 3 exists in the viewing area.

  The control unit 29 functions as the data receiving unit 296 by executing S141 to S143. The control unit 29 functions as the first distance calculation unit 298 by executing S145, and functions as the personal information processing unit 297 and the state information processing unit 299 by executing S146. Further, the control unit 29 functions as the data transmission unit 302 by executing S147.

[2-3. Personal information transmission processing]
Next, personal information transmission processing executed by the control unit 39 of the portable information terminal 3 will be described with reference to the flowchart of FIG. The personal information transmission process is periodically executed while the above-described dedicated application is activated.

First, in S410, the control unit 39 determines whether or not the advertising packet from the dedicated device 2 has been received by at least one communication method among the communication methods.
If the control unit 39 determines in S410 that an advertising packet has not been received, it executes S410 again.

  On the other hand, if the control unit 39 determines in S410 that an advertising packet has been received, the control unit 39 proceeds to S420 and determines whether or not the acceleration sensor 37 is mounted on the portable information terminal 3.

  If the control unit 39 determines in S420 that the acceleration sensor 37 is mounted on the portable information terminal 3, the control unit 39 proceeds to S430 and acquires acceleration information indicating the detection value from the acceleration sensor 37. Here, as described later, while the dedicated application is activated, acceleration information and azimuth information described later are periodically transmitted to the portable information terminal 3 as state information. In S430, the control unit 39 acquires acceleration information indicating a detection value from the time when the previous state information is transmitted to the present. Therefore, when the portable information terminal 3 leaves the communication area of the dedicated device 2 and enters again with the dedicated application being continued, a detection value when the portable information terminal 3 is outside the communication area is also acquired. If the status information has not been transmitted even after the dedicated application is activated, the acceleration information indicating the detection value from the time when the advertising packet is first received until the present is transmitted is transmitted. . When executing S430, the control unit 39 proceeds to S440.

On the other hand, if it is determined in S420 that the acceleration sensor 37 is not mounted on the portable information terminal 3, the control unit 39 skips S430 and proceeds to S440.
In S440, the control unit 39 determines whether or not the gyro sensor 38 is mounted on the portable information terminal 3.

  If the control unit 39 determines that the gyro sensor 38 is mounted on the portable information terminal 3 in S440, the control unit 39 proceeds to S450 and acquires the orientation information indicating the detection value from the gyro sensor 38. In S450, the control unit 39 transmits azimuth information indicating a detection value from the time when the previous state information is transmitted to the present. In addition, if status information has not been transmitted since the dedicated app was activated, direction information indicating detection values from when the advertising packet was first received until the present is transmitted To do. When executing S450, the control unit 39 proceeds to S460.

On the other hand, when it is determined in S440 that the gyro sensor 38 is not mounted on the portable information terminal 3, the control unit 39 skips S450 and proceeds to S460.
In S <b> 460, the control unit 39 acquires the user's personal information from the storage unit 36.

  Subsequently, in S470, the control unit 39 generates state information based on at least one of the acquired acceleration information and azimuth information. Here, when the acceleration information indicates that the change in acceleration exceeding a predetermined change width has periodically occurred during a certain period, state information indicating a state in which the user is moving is generated. On the other hand, when the acceleration information does not indicate that the change in acceleration exceeding a predetermined change width has periodically occurred during a certain period, state information indicating a state in which the user is sitting is generated.

Subsequently, in S480, the control unit 39 combines the personal information and the status information to generate combined information.
Subsequently, in S490, the control unit 39 transmits the combined information to the dedicated device 2 by each communication method, and then ends the personal information transmission process of FIG. In the present embodiment, the composite information is transmitted to the dedicated device 2 as a set with the sequence number of the received advertising packet. For this reason, the chronological order of the composite information sent from the portable information terminal 3 is guaranteed.

  The control unit 39 executes S410, S460, S470, S480, and S490, thereby providing an advertising packet reception unit 393, a personal information acquisition unit 394, a state information generation unit 395, a synthesis processing unit 396, and a data transmission unit 399. Function.

[2-4. Application information transmission process]
Next, application information transmission processing executed by the control unit 39 of the portable information terminal 3 will be described using the flowchart of FIG. The application information transmission process is periodically executed while the above-described dedicated application is activated.

First, in S510, the control unit 39 determines whether or not the advertising packet from the dedicated device 2 has been received by at least one communication method among the communication methods.
If the control unit 39 determines in S510 that an advertising packet has not been received, it executes S510 again.

On the other hand, if it is determined in S510 that the advertising packet has been received, the control unit 39 proceeds to S520 and acquires application information.
Subsequently, in S530, the control unit 39 changes the application information into a transmittable format, and generates transmission data.

  Subsequently, in S540, the control unit 39 transmits the transmission data to the dedicated device 2 by each communication method, and then ends the application information transmission process of FIG. The transmission data is transmitted to the dedicated device 2 as a set with the sequence number of the received advertising packet. For this reason, the time-sequential order of the transmission data (application information) sent from the portable information terminal 3 is guaranteed.

  The control unit 39 functions as an advertising packet reception unit 393, an application information acquisition unit 397, a transmission data generation unit 398, and a data transmission unit 399 by executing S510, S520, S530, and S540.

[2-5. Estimation process]
Next, the estimation process executed by the control unit 42 of the behavior estimation server 4 will be described with reference to the flowchart of FIG. The estimation process is executed when content viewing information is not sent from the dedicated device 2 for a certain period of time.

First, in S <b> 610, the control unit 42 extracts various information from the database 5.
Subsequently, in step S620, the control unit 42 starts and ends viewing content based on the detection values of the acceleration sensor 37 and the gyro sensor 38 in the state information extracted from the data extraction unit 427. The amount of movement of the user of the portable information terminal 3 at regular intervals is calculated.

Subsequently, in S630, the control unit 42 calculates the distance of the portable information terminal 3 with respect to the dedicated device 2 at regular intervals between the start and end of content viewing.
Subsequently, in S640, the control unit 42 executes the distance estimation process described above.

  Subsequently, in S650, the control unit 42 stores the estimated distance between the dedicated device 2 and the portable information terminal 3 every predetermined time in the database 5. The control part 42 will complete | finish the estimation process of FIG. 11, if S650 is performed.

  The control unit 42 functions as the data extraction unit 427, the movement amount calculation unit 428, the second distance calculation unit 429, the estimation unit 430, and the data storage unit 426 by executing S610 to S650.

[2-6. Advertising information transmission processing]
Next, advertisement information transmission processing executed by the control unit 42 of the behavior estimation server 4 will be described with reference to the flowchart of FIG. The advertisement information transmission process is periodically executed while the content viewing information is transmitted from the dedicated device 2.

First, in S710, the control unit 42 extracts state information.
Subsequently, in S720, the control unit 42 determines the number of characters of advertisement information corresponding to the state information.
Subsequently, in S730, the control unit 42 transmits the advertisement information determined in S720 to the dedicated device 2, and then ends the advertisement information transmission process of FIG.

The control unit 42 functions as the data extraction unit 427, the advertisement determination unit 431, and the data transmission unit 432 by executing S710 to S730.
[2-7. Display processing]
Next, advertisement display processing executed by the control unit 39 of the portable information terminal 3 will be described using the flowchart of FIG. The advertisement display process is periodically executed while the dedicated application is activated.

First, in S810, the control unit 39 determines whether or not the advertisement information from the dedicated device 2 has been received.
When the control unit 39 determines that the advertisement information is not received from the dedicated device 2, the control unit 39 executes S810 again.

On the other hand, if it is determined that the advertisement information has been received, the control unit 39 displays the advertisement indicated by the advertisement information on the touch panel display 36 in S820, and ends the advertisement display process of FIG.
The control unit 39 functions as the data reception unit 400 and the display processing unit 401 by executing S810 and S820.

[2-8. Sequence]
Next, a sequence among the dedicated device 2, the portable information terminal 3, and the behavior estimation server 4 will be described.

  First, a sequence when the portable information terminal 3 executes the personal information transmission process will be described with reference to FIG. In the following, it is assumed that content is being viewed on the content output device 1.

  First, at T <b> 101, the dedicated device 2 transmits content viewing information to the behavior estimation server 4. Subsequently, the dedicated device 2 transmits the advertising packet to the portable information terminal 3 at T102. However, at this time, the portable information terminal 3 exists outside the communication area of the dedicated device 2 and does not receive the advertising packet from the dedicated device 2. Therefore, there is no response from the portable information terminal 3.

T103 and T104 are the same as T101 and T102 described above. Further, T105 and T106 are the same as T101 and T102 described above.
However, when the advertising packet is transmitted to the portable information terminal 3 at T106, the portable information terminal 3 exists in the communication area of the dedicated device 2. Therefore, the portable information terminal 3 acquires acceleration information and azimuth information from the acceleration sensor 37 and the gyro sensor 38 at T107. In FIG. 14, the portable information terminal 3 enters the communication area of the dedicated device 2 at time T1, and leaves the communication area of the dedicated device 2 at time T2.

  Subsequently, at T108, the portable information terminal 3 acquires personal information from the storage unit 36, and generates state information based on the acquired acceleration information and orientation information. Thereafter, at T109, the combined information of the personal information and the state information is transmitted to the dedicated device 2.

In T110, the dedicated device 2 that has received the transmitted composite information transmits the content viewing information and the received personal information and state information to the behavior estimation server 4.
T111 to T115 and T116 to T120 are the same as T106 to T110.

  At T121, the dedicated device 2 transmits an advertising packet to the portable information terminal 3. However, at this time, the portable information terminal 3 is out of the communication area of the dedicated device 2 and no response is received from the portable information terminal 3.

Therefore, the dedicated device 2 transmits only the content viewing information program information to the behavior estimation server 4 at T122.
Next, a sequence when the portable information terminal 3 executes the application information transmission process will be described with reference to FIG.

  First, at T <b> 201, the dedicated device 2 transmits an advertising packet to the portable information terminal 3. However, at this time, the portable information terminal 3 exists outside the communication area of the dedicated device 2 and does not receive the advertising packet from the dedicated device 2. Therefore, there is no response from the portable information terminal 3.

  At T202, the dedicated device 2 transmits the advertising packet to the portable information terminal 3. At this time, the portable information terminal 3 exists in the communication area of the dedicated device 2. Therefore, the portable information terminal 3 acquires application information at T203. In FIG. 15, the portable information terminal 3 enters the communication area of the dedicated device 2 at time T3 and leaves the communication area of the dedicated device 2 at time T4.

  At T204, the portable information terminal 3 generates transmission data. At T <b> 205, the portable information terminal 3 transmits transmission data (application information) to the dedicated device 2. At T206, the dedicated device 2 transmits the application information to the behavior estimation server 4.

T207 to T211 are the same as T202 to T206.
At T212, the dedicated device 2 transmits the advertising packet to the portable information terminal 3. However, at this point, the portable information terminal 3 is out of the communication area of the dedicated device 2 and no response is received from the portable information terminal 3.

[3. Effect]
According to the embodiment detailed above, the following effects can be obtained.
(1) In the present embodiment, the dedicated device 2 acquires content viewing information. The dedicated device 2 receives personal information from the portable information terminal 3 by BLE communication, NFC communication, or non-audible sound communication when the portable information terminal 3 enters the communication area of the dedicated device 2. Then, the dedicated device 2 transmits the content viewing information and personal information to the behavior estimation server 4.

Therefore, it is possible to specify the user who is viewing the content without specifying the content selected by the user and forcing the user to perform a predetermined remote control operation.
(2) In the present embodiment, the dedicated device 2 transmits personal information to the behavior estimation server 4 when it is determined that the signal strength of the received signal from the portable information terminal 3 is equal to or greater than the determination threshold value. On the other hand, the dedicated device 2 does not transmit personal information to the behavior estimation server 4 when it is determined that the signal strength of the received signal is less than the determination threshold.

  The communication area of the dedicated device 2 is relatively wide. For this reason, even when the dedicated device 2 receives the personal information, the personal information may belong to a user who has not viewed the content. On the other hand, in the present embodiment, even when personal information is received, if the signal strength of the received signal is equal to or higher than the determination threshold, in other words, only when the portable information terminal 3 exists in the viewing area. Information is transmitted to the behavior estimation server 4. Therefore, when personal information is received, the personal information of the user who is actually watching can be transmitted more easily than the configuration in which the personal information is unconditionally transmitted to the behavior estimation server 4.

  (3) In the present embodiment, the dedicated device 2 calculates the distance between the dedicated device 2 and the portable information terminal 3 based on the signal strength of the received signal from the portable information terminal 3. Then, distance information indicating the distance is transmitted to the behavior estimation server 4.

Therefore, it is possible to specify the distance from which the user was viewing the content from the dedicated device 2 and thus the content output device 1.
(4) In the present embodiment, the dedicated device 2 communicates with the portable information terminal 3 using a plurality of types of communication schemes in which priorities are set in advance. When the dedicated device 2 receives a signal from the portable information terminal 3 in both the first communication method and the second communication method having a lower priority than the first communication method, the dedicated device 2 has a higher priority. The distance is calculated based on the signal strength of the received signal received by the first communication method. Further, in this embodiment, since the priority is set higher for a communication method in which a signal from the mobile information terminal 3 that exists far away is difficult to reach, it is easy to transmit distance information of the user who is actually watching Can do.

  (5) In this embodiment, the behavior estimation server 4 calculates the distance between the dedicated device 2 and the portable information terminal 3 based on the detection values of the acceleration sensor 37 and the gyro sensor 38. The behavior estimation server 4 estimates the distance based on the distance calculated based on the detection values of the sensors 37 and 38 and the distance based on the signal intensity acquired from the dedicated device 2. Therefore, for example, the distance estimation accuracy can be improved as compared with a configuration in which only the distance based on the signal strength is calculated.

  (6) In the present embodiment, the portable information terminal 3 generates state information based on the detection values of the acceleration sensor 37 and the gyro sensor 38. Then, the dedicated device 2 causes the behavior estimation server 4 to acquire the state information received from the portable information terminal 3.

Therefore, it is possible to specify the state of user behavior during content viewing.
(7) In the present embodiment, the behavior estimation server 4 determines the granularity of the advertisement information displayed on the touch panel display 35 of the portable information terminal 3 according to the state information. In addition, the mobile information terminal 3 displays an advertisement having a granularity determined by the behavior estimation server 4 on the touch panel display 35.

Therefore, the content can be displayed with the granularity of information suitable for the user's behavior.
(8) In the present embodiment, the dedicated device 2 receives the application information from the portable information terminal 3 and transmits it to the behavior estimation server 4.

Therefore, it is possible to specify the application that the user was viewing when viewing the content.
In the present embodiment, the microphone 21, the BLE communication unit 23, the IC tag IF 24, and the speaker 25 correspond to a communication unit, and the microphone 31, the BLE communication unit 32, the IC tag IF 33, and the speaker 34 correspond to a terminal side communication unit. The touch panel display 35 corresponds to a display unit. The viewing operation information acquisition unit 294 and S115 correspond to processing as an acquisition unit, the data reception unit 296 and S141 to S143 correspond to processing as a personal information reception unit and an application information reception unit, and S144 as a determination unit. The first distance calculation unit 298 and S145 correspond to the processing as the calculation unit and the first calculation unit, and the data transmission unit 302 and S147 correspond to the processing as the transmission unit and the distance acquisition instruction unit. The personal information acquisition unit 394 and S460 correspond to processing as a terminal side acquisition unit, and the data transmission unit 399 and S490 correspond to processing as a terminal side transmission unit. The state information generation unit 395 and S470 correspond to processing as a state information generation unit, the data transmission unit 399, the data transmission unit 302, S490, and S147 correspond to processing as a state acquisition instruction unit, and the movement amount calculation unit 428 and S620 corresponds to the processing as the movement amount acquisition unit, the second distance calculation unit 429 and S630 correspond to the processing as the second calculation unit, and the estimation units 430 and S640 serve as the estimation unit and the estimated distance acquisition instruction unit. The advertisement determination unit 431 and S720 correspond to processing as a determination unit, and the display processing unit 401 and S820 correspond to processing as a display processing unit.

[4. Other Embodiments]
As mentioned above, although the form for implementing this indication was demonstrated, this indication is not limited to the above-mentioned embodiment, and can carry out various modifications.

  (1) In the above embodiment, the content output device 1 is a television and the content is a television program, but the content output device and the content are not limited to this. For example, the content output device may be a radio, a monitor, a speaker, headphones, a recording / playback device, or the like. Further, for example, the content may be radio broadcast data, moving image data, still image group data, audio data, or the like.

  (2) In the above embodiment, the content viewing information is information based on the broadcast channel information acquired from the content output device 1, but the content viewing information is not limited to this. For example, the content viewing information may be information based on sound information or image information of content acquired from the content output device 1. Specifically, for example, the content viewing information may be information (for example, an audio fingerprint) indicating the characteristics of the sound information or image information of the content. Further, for example, the content viewing information may be information based on information acquired from the remote operation device 1a of the content output device 1. Specifically, for example, the content viewing information may be information indicating the content of the user viewing operation included in the infrared code output from the remote operation device 1a.

Further, for example, the content viewing information is not limited to information for identifying the content being viewed, such as broadcast channel information, and may be information indicating the identified content.
The content specified by the behavior estimation server is not limited to the content that the user is currently viewing, but may be content that the user has viewed in the past.

  (3) In the above embodiment, the viewing information transmitting device that transmits the content viewing information to the behavior estimation server 4 is the dedicated device 2 that is used attached to the content output device 1, but the viewing information transmitting device is not limited thereto. It is not something that can be done. For example, the viewing information transmitting apparatus may be a recording / playback device such as a set-top box or an HD recorder, a game machine, a stick personal computer, or the like. Further, the viewing information transmitting device may be built in the content output device. In addition to the HDMI format, the connection format between the viewing information transmitting device and the content output device may be a USB format, an optical digital cable format, a wireless format, etc., and the connection format is not limited. Further, for example, when the content being viewed is specified based on sound information output from the content output device, the sound information from the content output device is input to the microphone of the viewing information transmission device, so that the viewing information transmission device And the content output device may be connected.

  (4) In the said embodiment, although the portable information terminal 3 is a smart phone, a portable information terminal is not restricted to this. For example, the portable information terminal may be a smart device other than a smartphone such as a tablet terminal, a wearable device that is an information device that a user can wear, and the like.

  (5) In the above-described embodiment, the dedicated device 2 and the portable information terminal 3 communicate with each other using BLE communication, NFC communication, and non-audible sound communication as non-wired communication that is communication other than wired communication. Non-wired communication performed by the dedicated device and the portable information terminal is not limited to this. The dedicated device and the portable information terminal may perform communication using any one or two communication methods of BLE communication, NFC communication, and non-audible sound communication. The dedicated device and the portable information terminal may perform non-wired communication other than BLE communication, NFC communication, and non-audible sound communication.

  (6) The processing content of the distance estimation processing is not limited to that of the above embodiment. For example, by taking the average of the distance calculated by the second distance calculation unit 429 and the distance calculated by the first distance calculation unit 298 extracted from the data extraction unit 427, the same distance is obtained. It may be estimated. In other words, the first distance may be corrected with the second distance.

  (7) In the above embodiment, the dedicated device 2 calculates the distance from the portable information terminal 3 based on the received signal from the portable information terminal 3, but the calculation target is not limited to this. For example, the dedicated device 2 may calculate the relative position of the portable information terminal 3 with respect to the dedicated device 2 based on the received signal from the portable information terminal 3. In this case, for example, taking BLE communication as an example, the dedicated device 2 is equipped with two BLE communication units 23, and triangulation is performed using the distance between the two BLE communication units 23. The position may be calculated. The same applies to NFC communication and non-audible sound communication.

  (8) In the above embodiment, the advertisement is exemplified as the content displayed on the portable information terminal 3, but the content displayed on the portable information terminal is not limited to this. For example, the content may be an application of a portable information terminal.

  (9) In the above embodiment, an advertisement with a different number of characters is exemplified as an advertisement with a different information granularity. However, an advertisement with different information granularity, and content, is not limited to this. Content with different information granularity may be content with different sizes of characters, graphics, etc. displayed on the portable information terminal 3. In this case, for example, when the state information indicates a state where the user is moving, the larger content, that is, the content is grasped than when the state information indicates a state where the user is sitting, that is, not moving. Easy-to-use content may be displayed. In this case, the amount of information contained in the plurality of types of displayed content may be different.

  Moreover, in the said embodiment, although the granularity of the content information was illustrated as a display mode of the content determined according to state information, the display mode of the content determined according to state information is not restricted to this. Absent. For example, the display range of the content on the touch panel display 35 may be determined according to the state information. For example, when the state information indicates a state where the user is moving, the content display mode may be determined so that the content display range is larger than when the user indicates a state where the user is not moving. .

  (10) In the above embodiment, the state indicated by the state information is a state where the user is sitting and moving, but the state indicated by the state information is not limited to this. For example, the state information may also represent a state where the user is walking, running, standing, and the like. In this case, for example, when the state information indicates a state where the user is running, content with a larger granularity of information or content with a larger display range than when the state information indicates a state where the user is walking, That is, content that makes it easier to understand the content may be displayed. In other words, the state information represents a plurality of types of movement states having different movement speeds, and content corresponding to the movement speed of the user may be displayed.

  (11) In the above embodiment, the dedicated device 2 receives the application information from the portable information terminal 3, and transmits the received application information to the behavior estimation server 4. However, the information received and transmitted by the dedicated device 2 is It is not limited.

For example, the mobile information terminal 3 detects a user operation on the mobile information terminal 3 and transmits operation information that is information indicating the user operation to the dedicated device 2.
Here, as a user's operation which the portable information terminal 3 detects, the touch operation with respect to the touchscreen display 35 is mentioned, for example. The information indicating the touch operation is, for example, the information indicating the type of the touch operation from when the touch operation is started until it is finished (the user's finger touches the touch panel display 35 and then leaves), or touched on the touch panel display 35. For example, the coordinate information of the location and the information on the time when the touch operation is performed. The type of touch operation here is, for example, a scroll operation or a multi-touch operation that touches a plurality of locations simultaneously.

Then, the dedicated device 2 may transmit the received operation information to the behavior estimation server 4.
According to such a configuration, the user's operation on the portable information terminal 3 at the time of viewing the content can be specified.

In this configuration, the process in which the dedicated device 2 receives the operation information from the portable information terminal 3 corresponds to the process as the operation information receiving unit.
Note that the operation information may be transmitted to the behavior estimation server 4 together with the application information.

  (12) In the above embodiment, the state information includes a detection value of the acceleration sensor 37 or the like, but the state information is not limited to this. The state information may not include the detection value of the sensor, but may include only the state of the user's action (such as the user moving).

  (13) In the above embodiment, the display form of the content displayed on the portable information terminal 3 is determined by the behavior estimation server 4, but the subject that determines the display form is not limited to this. For example, the display mode of the content to be displayed may be determined by executing a dedicated application on the mobile information terminal 3 side. In this case, the process for determining the display mode of the content on the portable information terminal 3 corresponds to the process as the determination unit.

  (14) The method of setting the priority is not limited to that of the above embodiment. For example, all communication methods may have the same priority. In this case, variation may occur in the result of distance calculation between the dedicated device and the portable information terminal depending on the signal strength for each communication method. Therefore, when performing the distance calculation, for example, an average value of distances in all communication methods or an intermediate value may be used to supplement the calculated distance.

  (15) In the above embodiment, the distance calculation between the dedicated device 2 and the portable information terminal 3 based on the signal strength is executed on the dedicated device 2 side, but the subject for calculating the distance is not limited to this. . For example, the dedicated device 2 may transmit the signal strength to the behavior estimation server 4 and the distance may be calculated on the behavior estimation server 4 side.

  In this case, the process that the behavior estimation server 4 calculates the distance corresponds to the process as the calculation unit and the first calculation unit, and the process that is acquired by calculating the distance corresponds to the process as the distance acquisition instruction unit.

  (16) In the above embodiment, the distance between the dedicated device 2 and the portable information terminal 3 based on the detection values of the sensors 37 and 38 is calculated on the behavior estimation server 4 side. It is not limited to. For example, the dedicated device 2 may acquire the movement amount of the portable information terminal 3, and the distance to the portable information terminal 3 based on the detection values of the sensors 37 and 38 may be calculated on the dedicated device 2 side. In this case, the process of calculating the distance to the portable information terminal 3 in the dedicated device 2 corresponds to the process as the second calculation unit. The process in which the dedicated device 2 transmits information indicating the distance based on the detection values of the sensors 37 and 38 to the behavior estimation server 4 corresponds to the process as the estimated distance acquisition instruction unit.

  (17) In the above embodiment, the state information is generated by the portable information terminal 3, but the subject that generates the state information is not limited to this. The state information may be generated on the dedicated device 2 side based on the detection value of the sensor acquired from the portable information terminal 3 and transmitted to the behavior estimation server 4. In this case, the process of generating the state information by the dedicated device 2 corresponds to the process as the state information generation unit, and the process of transmitting the state information generated by the dedicated device 2 to the behavior estimation server 4 is the process as the state acquisition instruction unit. It corresponds to.

  Further, for example, the state information may be generated and acquired by the behavior estimation server 4 based on the detection value of the sensor acquired from the portable information terminal 3. In this case, the process in which the behavior estimation server 4 generates state information corresponds to the process as the state information generation unit, and the process in which the behavior estimation server 4 generates the state information corresponds to the process as the state acquisition instruction unit. .

(18) In the above embodiment, some or all of the functions executed by the control units 29, 39, and 42 may be configured in hardware by one or a plurality of ICs.
(19) In addition to the control units 29, 39, and 42 described above, a system including the control units 29, 39, and 42 as components, a program for causing a computer to function as the control units 29, 39, and 42, and this program The present disclosure can also be realized in various forms such as a non-transitional physical storage medium such as a stored semiconductor memory, a method of acquiring content viewing information, personal information, and the like.

  (20) A plurality of functions of one constituent element in the above embodiment may be realized by a plurality of constituent elements, or a single function of one constituent element may be realized by a plurality of constituent elements. . Further, a plurality of functions possessed by a plurality of constituent elements may be realized by one constituent element, or one function realized by a plurality of constituent elements may be realized by one constituent element. Moreover, you may abbreviate | omit a part of structure of the said embodiment. In addition, at least a part of the configuration of the above embodiment may be added to or replaced with the configuration of the other embodiment. In addition, all the aspects included in the technical idea specified by the wording described in the claims are embodiments of the present disclosure.

  DESCRIPTION OF SYMBOLS 1 ... Content output apparatus, 2 ... Dedicated apparatus, 3 ... Portable information terminal, 4 ... Action estimation server, 5 ... Database, 23 ... BLE communication part of exclusive apparatus, 24 ... IC tag IF of exclusive apparatus, 25 ... Dedicated apparatus Speaker: 29 ... Control unit of dedicated device 2, 31 ... Microphone of portable information terminal, 32 ... Communication unit of portable information terminal, 33 ... IC tag IF of portable information terminal, 34 ... Speaker of portable information terminal, 35 ... Touch panel display , 36 ... storage unit, 39 ... control unit of portable information terminal, 42 ... control unit of action estimation server.

Claims (12)

An acquisition unit for acquiring content viewing information based on information acquired from a content output device that outputs content selected according to a viewing operation by a user or a remote operation device for remotely operating the content output device, The content viewing information is information that can identify the content selected in accordance with the viewing operation, and the acquisition unit;
A communication unit that performs non-wired communication with a portable information terminal possessed by the user;
A personal information receiving unit for receiving personal information, which is information for identifying the user stored in advance in the storage unit of the mobile information terminal, from the mobile information terminal via the communication unit;
A transmission unit for transmitting the content viewing information and the personal information to a predetermined server;
Personal identification system with The personal identification system according to claim 1,
A determination unit for determining whether the signal strength of the received signal from the portable information terminal received by the communication unit is equal to or greater than a predetermined threshold;
The transmission unit transmits the personal information to the server when the determination unit determines that the signal strength is greater than or equal to the threshold value, and determines that the signal strength is less than the threshold value. A personal identification system that does not transmit the personal information to the server in the event of a failure. The personal identification system according to claim 1 or claim 2,
A calculation unit for calculating a distance between the communication unit and the portable information terminal based on the signal strength of the received communication from the portable information terminal received by the communication unit;
A distance acquisition instruction unit that causes the server to acquire distance information that is information indicating the distance;
A personal identification system further comprising: The personal identification system according to claim 3,
The communication unit performs the non-wired communication with the portable information terminal by a plurality of types of communication methods in which priorities are set in advance.
The calculation unit uses the communication unit to perform both the first communication method included in the plurality of types of communication methods and the second communication method having a lower priority than the first communication method. A personal identification system that calculates the distance based on the signal strength of a received signal received by the first communication method when a signal is received from a portable information terminal. The personal identification system according to claim 1 or claim 2,
The portable information terminal is equipped with a sensor for detecting the movement of the portable information terminal,
A first calculation unit for calculating a distance between the communication unit and the portable information terminal based on the signal strength of the received communication from the portable information terminal received by the communication unit;
A second calculation unit for calculating a distance between the communication unit and the portable information terminal based on a detection value of the sensor;
An estimation unit for estimating a distance between the communication unit and the portable information terminal based on the distance calculated by the first calculation unit and the distance calculated by the second calculation unit;
An estimated distance acquisition instruction unit that causes the server to acquire the distance estimated by the estimation unit;
A personal identification system further comprising: The personal identification system according to any one of claims 1 to 4,
The portable information terminal is equipped with a sensor for detecting the movement of the portable information terminal,
A state information generation unit that generates state information that is information indicating the state of the user's action based on the detection value of the sensor;
A state acquisition instruction unit for causing the server to acquire the state information;
A personal identification system further comprising: The personal identification system according to claim 6,
A determination unit for determining a display mode of content to be displayed on the display unit of the portable information terminal according to the state information;
A display processing unit for displaying content on the display unit in the display mode determined by the determination unit;
The personal identification system further comprising: The personal identification system according to any one of claims 1 to 7,
An application information receiving unit that receives application information, which is information indicating the activated application software, from the portable information terminal via the communication unit;
The personal identification system, wherein the transmission unit transmits the application information to the server. The personal identification system according to any one of claims 1 to 8,
An operation information receiving unit that receives operation information, which is information indicating an operation of the user with respect to the portable information terminal, from the portable information terminal via the communication unit;
The transmission unit is a personal identification system that transmits the operation information to the server. A computer having a communication unit that performs non-wired communication,
An acquisition unit for acquiring content viewing information based on information acquired from a content output device that outputs content selected according to a viewing operation by a user or a remote operation device for remotely operating the content output device, Content viewing information is information that can identify the content selected in accordance with the viewing operation, the acquisition unit,
A personal information receiving unit for receiving personal information, which is information for identifying the user stored in advance in a storage unit of the mobile information terminal possessed by the user, from the mobile information terminal via the communication unit; ,
A transmission unit for transmitting the content viewing information and the personal information to a predetermined server;
Personal identification program to function as. A portable information terminal,
A terminal-side communication unit for performing non-wired communication;
A terminal-side acquisition unit that acquires personal information, which is information for identifying a user, from the storage unit of the portable information terminal;
Transmitting the personal information to the content viewing information transmitting apparatus via the terminal-side communication unit;
With
The content viewing information transmitting device is configured to perform the viewing operation based on information acquired from a content output device that outputs content selected according to a viewing operation by the user or a remote operation device for remotely operating the content output device. A portable information terminal, which is a device that acquires content viewing information that is information that can identify the content selected in response to the content and transmits the acquired content viewing information to a predetermined server. A portable information terminal computer comprising a communication unit for performing non-wired communication,
A terminal-side acquisition unit that acquires personal information, which is information for identifying a user, from the storage unit of the portable information terminal;
A terminal-side transmitting unit that transmits the personal information to the content viewing information transmitting device via the terminal-side communication unit;
The content viewing information transmitting device is based on information acquired from a content output device that outputs content selected according to a viewing operation by the user or a remote operation device for remotely operating the content output device, The portable information terminal program which is an apparatus which acquires the content viewing information which is the information which can specify the said content selected according to the said viewing operation, and transmits the acquired said content viewing information to a predetermined | prescribed server.

Images