JP7246289B2 - Information processing device and information processing method - Google Patents

Description

The present invention relates to an information processing apparatus and information processing method, for example, an information processing system for recommending broadcast programs.

Program information, which is meta information about individual television broadcast programs, is sometimes used to analyze viewing trends of users and to recommend programs to users. Program information may also be used to recommend related information related to the program.
For example, in Patent Document 1, extraction processing is performed to extract recommended content to be recommended to a user, the recommended content is specified, a recommendation icon for performing operation instructions regarding the specified recommended content is displayed, and the extraction processing is performed. a recommended icon corresponding to the recommended content extracted from the first population in the extraction process, and a recommended icon corresponding to the recommended content extracted from the second population having different attributes from the first population in the extraction process. A content recommendation device for simultaneous display is described.
On the other hand, a service that uploads a photograph taken privately by the user and content including the attributes and description of the photograph to a server device connected to the network, and presents the user with the ability to select any of the uploaded content. was proposed.

Japanese Patent No. 5369214

In general, a user may prefer to view a program related to memories of an event that the user experienced in the past over other programs. However, such programs are not necessarily extracted only by analysis of viewing tendencies, and users sometimes search for them by relying on their memory. Typically, program information and user's own content are managed independently of each other. If the user has lost his memory of the past, he cannot retrieve the desired program in the first place. Even if such a program can be discovered, viewing may be forgotten before the start of broadcasting.

SUMMARY OF THE INVENTION It is an object of the present invention to provide an information processing apparatus and an information processing method that enable a user to more reliably view programs related to memories.

The present invention has been made to solve the above-described problems, and one aspect of the present invention is a program information acquisition unit that acquires program information including program-related information about the content of a broadcast program, an image, and an image. Requesting a content storage unit that stores content including image-related information in association with user identification information indicating a user of the receiving device to notify the program-related content, which is content including image-related information corresponding to the program-related information. recommended program information indicating at least one of a content requesting unit and a broadcast program whose program-corresponding content is notified from the content storage unit, to the device of the user indicated by the user identification information associated with the program-corresponding content. and an information providing unit.

According to this embodiment, the user can more reliably view programs related to memories.

1 is a schematic block diagram showing a configuration example of an information processing system according to an embodiment; FIG. 1 is a schematic block diagram showing a hardware configuration example of an information processing apparatus according to an embodiment; FIG. It is a figure which shows the example of the program information which concerns on this embodiment. It is a figure which shows the example of the program related information which concerns on this embodiment. It is a figure which shows the example of the motion information which concerns on this embodiment. It is a figure which shows the example of the map data which concerns on this embodiment. It is a figure which shows the example of the user data which concerns on this embodiment. FIG. 4 is a diagram showing an example of stored content according to the embodiment; FIG. FIG. 4 is a diagram showing a first display example of recommended program information according to the embodiment; FIG. 9 is a diagram showing a second display example of recommended program information according to the embodiment; FIG. 13 is a diagram showing a third display example of recommended program information according to the present embodiment; FIG. 5 is a diagram showing a display example of recording completion information according to the embodiment; FIG. 14 is a diagram showing a fourth display example of recommended program information according to the present embodiment; It is a figure which shows the 2nd example of the user data which concerns on this embodiment. FIG. 5 is a diagram showing a second example of stored content according to the embodiment; It is a figure which shows the 2nd example of the operation information which concerns on this embodiment. It is a figure which shows the 3rd example of the user data which concerns on this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(System overview)
First, an overview of the information processing system 1 according to the present embodiment will be described.
FIG. 1 is a schematic block diagram showing a configuration example of an information processing system 1 according to this embodiment.
The information processing system 1 includes an information processing device 10 connected to a network NW. A content storage server 30, a program information distribution server 50, a terminal device 60, and a receiving device 70 are connected to the network NW, enabling transmission and reception of various data. Further, the information processing system 1 may be configured including the broadcasting equipment 40 and the program information distribution server 50 .

The information processing apparatus 10 receives program information of television broadcast programs (hereinafter referred to as programs) from the program information distribution server 50 . The program information is meta information including program-related information regarding the content of the program.
Program-related information includes, for example, geographic names for locations represented in received programs. The position indicated in the received program means the point (location) where the video was shot. Typical programs in which such images are broadcast include, for example, travelogue programs, programs introducing regions or specific facilities, programs introducing local products, and the like. In addition, the program-related information may be information of other types associated with the program (for example, sports, hobbies such as lessons, events such as sports festivals and weddings, stores, cooking, etc.) instead of or together with geographical names. , performers such as artists, seasons, crops such as flowers, movies, books, etc., and phrases indicating names and contents), etc., or a combination thereof. "Event" means an event or function.

The information processing apparatus 10 transmits to the content storage server 30 a program-related content request for instructing notification of program-related content, which is content corresponding to program-related information included in the acquired program information. Program-related content is content that includes image-related information (described later) corresponding to program-related information.
The information processing apparatus 10 receives program-corresponding content notification information indicating program-corresponding content as a response to the program-corresponding content request from the content storage server 30 . In the following description, it is mainly assumed that the program-corresponding content notification information can include part or all of the program-corresponding content.
The information processing apparatus 10 determines, as recommended programs, programs related to program information including program-related information corresponding to image-related information included in the received program-related content. Then, the information processing apparatus 10 transmits recommended program information indicating the determined recommended program to the device of the user indicated by the user identification information associated with the received program-corresponding content.

The device of the user to which the recommended program information is transmitted can be one or both of the receiving device 70 and the terminal device 60 . The information processing apparatus 10 may transmit the received program-corresponding content to the device to which the recommended program information is transmitted. This program-corresponding content corresponds to stored content received by the content storage server 30 from the terminal device 60 as will be described later. When the receiving device 70 is a television receiver, the user of the receiving device 70 may correspond to the viewer of the broadcast program and the user of the terminal device 60 . Therefore, the information processing apparatus 10 functions as a recommendation server for notifying the user of the receiving apparatus 70 of programs indicated by the recommended program information.

The content storage server 30 holds stored content in advance for each receiving device 70 . The stored content is content that includes an image and image-related information related to the image and is associated with the image. Image-related information includes, for example, location information about the capture location where the image was captured. The acquisition position is, for example, the imaging location. Location information may include a latitude and longitude set, a geographic name, or both. Geographic names may include place names, names of geographical features. The place names are not limited to formal names such as country names, district names, prefecture names, municipal names, block names, etc., but may be aliases such as common names, abbreviated names, and former names. Geographical features include, for example, topography such as mountains, rivers, and lakes, as well as objects (so-called landmarks) such as buildings, structures, and facilities that can serve as landmarks of their locations and areas. In addition, the image-related information includes other information (text, people, photo analysis information, and other SNS (Social Network Service) servers) associated (tag) with the image instead of or together with the location information. provided information that may be provided via, etc.) may be included. Image-related information includes names and content of hobbies such as sports and lessons, events such as weddings and sports days, shops, cuisine, performers such as artists, seasons, crops such as flowers, movies, books, etc. may be included.

The content storage server 30 accumulates the posted information received from each of the terminal devices 60 for each of the receiving devices 70 corresponding to the terminal devices 60 and stores them as stored content. Posted information includes an image and image-related information about the image. An image is, for example, a photograph representing a landscape, a person, an animal, a plant, or the like. The image may be a still image or a moving image. The positional information included in the image-related information may be, for example, a set of latitude and longitude (hereinafter referred to as latitude and longitude) at the acquisition position where the image was captured. Posted information may have a structure defined by a data format standard such as Exif (Exchangeable Image File Format), for example. Posted information may include additional information such as shooting date and time in addition to location information for each image. Also, the additional information may include text information represented by a character string. Textual information may represent, for example, a description of the image. These additional information can be included in the image-related information.

In the content storage server 30, for example, each of a plurality of geographical names and map data indicating the range thereof are stored in advance. Thereby, the position information is used as the image-related information. The content storage server 30 refers to the map data and stores the position information indicating the latitude and longitude within the geographical range corresponding to the position corresponding to the geographical name indicated in the program corresponding content request received from the information processing apparatus 10 as image-related data. Search stored content for information.
In addition, when the posted information received from terminal device 60 includes location information, content storage server 30 refers to the map data to specify a geographical name corresponding to the location information, and may be included as part of the image-related information associated with the image. When the content storage server 30 receives a program-corresponding content request indicating a geographical name from the receiving device 70, the content storage server 30 does not refer to the map data again, and saves the image-related information including the geographical name that matches the geographical name. You can search for content. Also, the content storage server 30 performs known image recognition processing on the image included in the posted information received from the terminal device 60, and obtains the geographical name of the place having the scenery indicated by the image or the image indicated by the image. A person's name may be specified as a recognition result. Then, the content storage server 30 may include the specified recognition result in part of the image-related information associated with the image. Recognition results such as geographical names and personal names obtained by image recognition are mainly stored as text information.

It should be noted that the program-related content request received from the information processing apparatus 10 includes, as described above, types other than geographical names (for example, names of performers such as celebrities, names of hobbies such as baseball, events such as weddings, etc.). name) program-related information may be included. In this case as well, the content storage server 30 searches for stored content containing image-related information corresponding to the program-related information.
The content storage server 30 transmits the retrieved stored content to the information processing apparatus 10 as a response to the program-related content request.

The content storage server 30 may be configured as a web server, and store in advance user data consisting of a set including a member ID, a password, a receiving device ID and a registered device ID, which are associated with each other. The member ID is identification information indicating the user of the receiving device 70 as well as the user of the content storage and viewing service for storing and viewing the stored content. A password is an example of authentication information for authenticating whether a user indicated by a member ID is a valid user. The receiver ID is identification information for identifying each receiver 70 . The registered device ID is identification information for identifying each terminal device 60 . A registered device ID for each of a plurality of terminal devices 60 may be associated with one member ID or receiving device ID. The content storage server 30 may acquire a set of the member ID, password, receiver ID, and registered device ID when registering for use of the receiving device 70 or when registering for use of the content storage and browsing service.

When receiving an access request from the terminal device 60, the content storage server 30 transmits predetermined authentication screen data to the terminal device 60 as a response to the access request.
At the time of user authentication, for example, the content storage server 30 refers to the user data, and depending on the presence or absence of the member ID and password that match the member ID and password set included in the authentication request information received from the terminal device 60, Determine whether user authentication is successful or not. When determining that the user authentication has succeeded, the content storage server 30 permits the terminal device 60 to use the content storage and browsing service, and transmits permission information indicating the permission to the terminal device 60 .
The content storage server 30 refers to the user data to identify the receiving device 70 corresponding to the terminal device 60 permitted to use the content storage and browsing service, and transmits the posted information received from the terminal device 60 to the identified receiving device. 70 as saved content. When the content storage server 30 determines that the user authentication has failed, the content storage server 30 does not permit the terminal device 60 to use the content storage and browsing service.
For example, the content storage server 30 accumulates posted information for each terminal device 60 and stores it as stored content.

The broadcasting facility 40 transmits program data of a television broadcast program provided from the broadcasting station BR by broadcasting waves of a frequency band corresponding to a predetermined broadcasting channel.

The program information distribution server 50 accumulates and stores program information for each program. The program information distribution server 50 extracts, for example, from the broadcast waves received from the broadcasting facility 40, program information carried by the broadcast waves. The program information stored in the program information distribution server 50 may include, in addition to programs that have already been broadcast, program information related to programs scheduled to be broadcast at that point in time and programs that are currently being broadcast. Individual program information is organized as a set including broadcast time, program name, broadcast channel and event summary (Fig. 3). The event summary includes text information that outlines the contents of the broadcast.
The program information distribution server 50 , for example, aggregates newly acquired program information at predetermined time intervals (for example, several hours to several days) and transmits the aggregated program information to the information processing apparatus 10 . The program information distribution server 50 may sequentially transmit newly acquired program information to the information processing apparatus 10 .

Note that the program information may be configured for each corner obtained by further dividing one program in terms of time. The program information may include, in addition to the main program, program information related to an advertisement program (CM: Commercial Advertisement) whose main purpose is to advertise a product or service. Also, the program information includes program-related information as described above. The program-related information includes, for each program or corner, a keyword representing the content of the program, a genre to which the content or the keyword belongs, and information indicating a search method for stored content, which are associated with each other (FIG. 4).

The terminal device 60 is an electronic device mainly used by the user of the receiving device 70 . The terminal device 60 includes an imaging unit that captures an image of a surrounding subject, a position detection unit that detects the position of the device itself, a display unit that displays various display information, an operation input unit that receives operation input, and a control unit. (not shown). The imaging unit is, for example, a CCD (Charge Coupled Device) camera. The position detector includes, for example, a GPS (Global Positioning System) receiving module. The GPS reception module calculates the latitude and longitude indicating the position of the device based on the time difference between signals received from at least four or more GPS satellites. The imaging unit of the terminal device 60 adds the position information indicating the calculated latitude and longitude to the image data indicating the photographed image and stores the image data when photographing is instructed by the operation signal input from the operation input unit.

The control unit of the terminal device 60 includes a processor that executes processes instructed by various commands described in a predetermined application program (hereinafter referred to as application). The control unit, for example, transmits an access request to the content storage server 30 when executing a predetermined application. When receiving the authentication screen data as a response to the access request from the content storage server 30, the control section displays the authentication screen on the display section according to the authentication screen data. The authentication screen shows guidance for inputting a user ID and a password. The control unit transmits to the content storage server 30 a set of the user ID and password indicated by the operation signal input from the operation input unit. Thereafter, after receiving permission information indicating permission to use the content storage and browsing service from the content storage server 30, the control unit downloads the stored image data when a posting is instructed by an operation signal input from the operation input unit. It is transmitted to the content storage server 30 as posted information.
The control unit may add text information instructed by an operation signal input from the operation input unit to the image data and store the image data, add the stored text information to the image data, and transmit the image data as posted information.

The receiving device 70 receives the broadcast waves sent from the broadcasting facility 40 and presents a television broadcast program based on the program data carried by the received broadcast waves. The receiving device 70 is, for example, a television receiver.
The receiving device 70 includes an operation input unit that accepts operation input, a reception unit that receives program data in a frequency band corresponding to a broadcast channel indicated by an operation signal input from the operation input unit, and a receiving unit that receives program data indicated by the received program data. A control unit (not shown) that controls display of an image on the display unit. The control unit of the receiving device 70 transmits motion information indicating the motion information to the information processing device 10 . The control unit of the receiving device 70 controls functions as the receiving device 70 according to the operation signal input from the operation input unit. The operation information includes, for example, operation start (Power On), operation stop (Power Off), or reception information indicating the reception status of the program at that time. The operation information may include, as reception information related to program reception, information indicating a broadcast channel for receiving program data. The operation information may include information indicating operation modes such as reception/playback, recording, and recording/playback.

The control unit of the receiving device 70 receives recommended program information indicating recommended programs from the information processing device 10, and causes the display unit to display guidance information for guiding recommended programs indicated by the received line-of-sight program information.
The timing at which the control unit displays the guidance information may be, for example, an arbitrary time immediately after power supply to the receiving device 70 (Power On) and before the end of the broadcast of the recommended program.
Further, when program-related content is received from the information processing apparatus 10, the control unit may cause the display unit to display an image included in the received program-related content.

The control unit of the receiving device 70 may control the operation mode according to the broadcast time of the recommended program. For example, when guide information for a recommended program currently being broadcast is indicated by an operation signal input from the operation input unit, the control unit receives and reproduces the recommended program (channel selection). When guidance information for a future recommended program whose broadcast start time is later than the current time is instructed by an operation signal input from the operation input unit, the control unit receives and reproduces the recommended program at the broadcast start time. start (channel reservation). Instead of reproducing the recommended program, the control unit may record the recommended program simultaneously with the reproduction (recording reservation). When the guidance information is instructed, the control unit further displays buttons for instructing reproduction and recording of the recommended program, and controls reproduction, recording, or both according to the operation signal input from the operation input unit. It may be selectable. When the recording is completed, the control unit may cause the display unit to display a recording completion notification to that effect. When guidance information of a past recommended program whose broadcast end time is earlier than the current time is instructed by an operation signal input from the operation input unit and the recommended program has already been recorded, control is performed. The unit starts playing back the recommended program (recording playback).
Although the number of terminal devices 60 and the number of receiving devices 70 shown in FIG. 1 are respectively one, they may be two or more.

(Functional configuration)
Next, a functional configuration example of the information processing apparatus 10 will be described. The information processing device 10 is configured including a control unit 120 . The control unit 120 controls various processes and performs various functions. The control section 120 includes a program information acquisition section 122 , a content request section 126 and an information provision section 128 .

The program information acquisition unit 122 receives program information for each program from the program information distribution server 50 . The information processing apparatus 10, for example, waits for program information transmitted every predetermined time (for example, several hours to several days) or sequentially.
The information processing device 10 may transmit a program information request to the program information distribution server 50 and receive program information as a response to the program information request.
On the other hand, the program information distribution server 50 waits for a program information request from the information processing apparatus 10, and transmits newly acquired program information to the information processing apparatus 10 as a response to the received program information request.
The program information acquisition section 122 outputs the acquired program information to the content request section 126 .

The content requesting unit 126 extracts program-related information from each piece of program information input from the program information acquiring unit 122 . As will be described later, the program-related information may be included as keywords indicating typical features of the program. The content requesting unit 126 generates a program-related content request indicating notification of program-related content, which is content including image-related information corresponding to the extracted program-related information. The content requesting unit 126 transmits the generated program content request to the content storage server 30 .
On the other hand, when the content storage server 30 receives the program-related content request from the content requesting unit 126, the content storage server 30 selects the content including the image-related information corresponding to the program-related information included in the received program-related content request as the program-related content. , stored content stored in association with the user of the receiving device 70 in advance. The content storage server 30 associates the program-corresponding content found by the search with the user identification information indicating the user of the program-corresponding content, and transmits it to the information processing apparatus 10 as a response to the program-corresponding content request. The user identification information may be a dedicated user ID indicating an individual user, or may be a registered device ID indicating the terminal device 60 used by the user.

The content requesting unit 126 receives the program-corresponding content and the user identification information in association with each other as a response to the program-corresponding content request. The program associated with the program information for which the program-corresponding content has been acquired becomes a recommended program or a candidate for the user indicated by the user identification information received in association with the program-corresponding content.
The content requesting unit 126 outputs the received user identification information, the program-related content, and the program information extracted from the program-related information corresponding to the image-related information to the information providing unit 128 in association with each other.

The user identification information, the program-related content, and the program-related information corresponding to the image-related information are input from the content requesting unit 126 to the information providing unit 128 in association with each other. The information providing unit 128 refers to the user data (FIG. 7) set in advance in itself and specifies the receiving device 70 corresponding to the input user identification information as a transmission destination. The user data includes a receiving device ID for each member ID indicating each user. A member ID is an example of user identification information that indicates an individual user. The member ID may be dedicated identification information, or may be a registered device ID indicating the terminal device 60 of each user. The user data may explicitly or implicitly include information indicating the terminal device 60 or the receiving device 70 as a transmission destination device for each user. The information providing unit 128 can refer to the information and specify one or both of the user's terminal device 60 and the receiving device 70 as the destination device.

The information providing unit 128 sets the programs related to the program information included in the input program-related information as recommended program candidates (hereinafter, referred to as recommended candidate programs), and determines part or all of the recommended candidate programs as recommended programs. Recommended program information indicating recommended programs is generated based on the program information. The information providing unit 128 may include part or all of the program information as the recommended program information. The information providing unit 128 transmits the generated recommended program information to the destination device specified for the user identification information corresponding to the program-related information.
The number of recommended candidate programs for each user is not limited to one, and may be multiple. Therefore, the information providing unit 128 may select recommended programs within a predetermined number of recommended programs (for example, 1 to 6) from a plurality of recommended candidate programs. In the following description, the process of selecting recommended programs from recommended candidate programs may be referred to as recommended program selection.
The information providing unit 128 selects from the recommended candidate programs, as a first selection criterion, the period from the current time (current time) to the future broadcast start time, or the period from the past broadcast end time to the current time is short. A program may be selected as a recommended program with higher priority. Therefore, the closer the broadcast time is to the current program, the stronger the user's impression of the program and the stronger the motivation to view it, and the more likely the user will use the recommended program.

The timing at which the information providing unit 128 transmits the recommended program information may be, for example, when the user's receiving device 70 starts operating, or may be during program reception. The information providing unit 128 waits for reception information transmitted from each reception device 70, refers to the received reception information, and can determine the operating state of the transmission source.
In selecting a recommended program, the information providing unit 128 selects a program that satisfies the second selection criterion in place of the first selection criterion or together with the first selection criterion. It may be determined as a recommended program to be transmitted to the user's device associated with the receiving device 70 .
The second selection criterion is, for example, to select, as recommended programs, recommended candidate programs up to the broadcast end time of the program being received on the broadcast channel whose broadcast start time is currently selected, and to select other recommended candidate programs as recommended programs. is to exclude from Therefore, since a program that starts broadcasting after the end of the program currently being viewed is guided as a recommended program, there is a high possibility that the recommended program will be used by the user.
Broadcasting on the broadcast channel currently selected in the receiving device 70 may be further imposed as a condition of the recommended program on the second selection criteria.

The information providing unit 128 may determine, among the recommended candidate programs, programs that satisfy the third selection criteria instead of the first selection criteria or together with the first selection criteria as recommended programs. A third selection criterion is to remove, from among the recommended programs selected in the past for a certain user, programs that have not been received a predetermined number of times (for example, 1 to 4 times) from the recommended candidate programs, and newly recommend them. It is not selected as a recommended program to be notified including part or all of the program information in the program information. The information providing unit 128 can refer to the operation information received from the receiving device 70 of the user and determine whether or not the receiving device 70 is receiving a program. Therefore, since programs that have not been received in the past are not guided as recommended programs, useless recommended program guidance can be avoided.

The operation information acquired from the receiving device 70 that is receiving the program can describe the operation mode of the receiving device 70 that is involved in receiving the program. As will be described later, the operation modes include normal reception (reception/reproduction), channel reservation, recording reservation, recording/reproduction, and the like.
The information providing unit 128 may transmit part or all of the stored content of each recommended program to the destination device in association with the recommended program information. The information provider 128 may include, as part of the stored content, images that make up the stored content.

Note that the information providing unit 128 of the information processing apparatus 10 associates the recommended program with the broadcast start time later than the current time, and includes operation mode information indicating the operation mode in the recommended program information and transmits the information to the reception apparatus 70 . good too. Either channel reservation or recording reservation can be specified as the operation mode. The control unit of the receiving device 70 refers to the recommended program information received from the information processing device 10 and identifies the recommended program including the operation mode information. When the control unit of the receiving device 70 detects that the guide information displayed for the recommended program has been pressed, the control unit of the receiving device 70 uses the operation mode indicated by the operation mode information associated with the recommended program to process the recommended program. (For example, one of channel reservation and recording reservation) may be performed.

Also, the information providing unit 128 may transmit the recommended program information to the terminal device 60 instead of the receiving device 70 or together with the receiving device 70 . In this case, the terminal device 60 may display guidance information based on the recommended program information, and control the receiving device 70 to receive the recommended programs and to control the operation mode based on the received operation input.

(Hardware configuration)
Next, a hardware configuration example of the information processing apparatus 10 according to this embodiment will be described. FIG. 2 is a schematic block diagram showing a hardware configuration example of the information processing apparatus 10 according to this embodiment.
The information processing apparatus 10 includes a processor 102, a storage medium 104, a drive unit 106, an input unit 108, an output unit 110, a ROM (Read Only Memory) 112, a RAM (Random Access Memory) 114, an auxiliary storage unit 116, and an interface unit 118. composed of
Processor 102, drive unit 106, input unit 108, output unit 110, ROM 112, RAM 114, auxiliary storage unit 116 and interface unit 118 are interconnected using bus BS. Accordingly, the information processing apparatus 10 is configured at least partly as a computer.

The processor 102 , for example, reads programs and various data stored in the ROM 112 and executes the programs to control the operation of the information processing apparatus 10 . The processor is, for example, a CPU (Central Processing Unit). Processor 102 executes a predetermined application program and cooperates with a storage medium such as RAM 114 to implement the functions of control unit 120 described above. In the present application, "executing a program" may mean executing a process indicated by instructions (commands) written in the program.
The storage medium 104 stores various data. The storage medium 104 is, for example, a portable storage medium such as a magneto-optical disk, flexible disk, or flash memory.
The drive unit 106 is, for example, a device that performs one or both of reading various data from the storage medium 104 and writing various data to the storage medium 104 .

The input unit 108 is an input device that receives a user's operation, generates an operation signal according to the received operation, and outputs the generated operation signal to the processor 102 . The input unit 108 corresponds to, for example, an operation input unit such as a mouse and a keyboard. In the present application, operating in accordance with information indicated by an input operation signal may simply be referred to as "operating in accordance with an operation".
The output unit 110 is, for example, a display unit such as a display and a playback unit such as a speaker.
ROM 112 stores, for example, programs for processor 102 to execute.
The RAM 114 temporarily stores various data and programs used by the processor 102, for example.

Auxiliary storage unit 116 is a storage medium such as an HDD (Hard Disk Drive) or flash memory. A storage medium capable of storing various data and programs is collectively referred to as a storage unit.
The interface unit 118 enables input and output of various data by connecting with other devices by wire or wirelessly. The interface unit 118 includes a communication module that connects to the network NW by wire or wirelessly, and enables transmission and reception of various data to and from other devices connected to the network NW.

Note that the content storage server 30, the program information distribution server 50, the terminal device 60, and the receiving device 70 may each have the hardware configuration shown in FIG. However, in server devices such as information processing device 10, content storage server 30, and program information distribution server 50, configurations corresponding to storage medium 104, drive unit 106, input unit 108, and output unit 110 may be omitted.

(program information)
Next, a configuration example of program information according to this embodiment will be described.
FIG. 3 is a diagram showing an example of program information according to this embodiment.
In the example shown in FIG. 3, the program information includes an event ID, start time, end time, program name, corner name, event outline, and broadcast station ID, and includes a set that associates these items. The event ID is identification information for identifying individual programs or corners. A corner is a temporally segmented portion of one program. A corner corresponds to, for example, a topic in a news program, a scene in a movie, or the like. Corners are sometimes called segments. In other words, in FIG. 3, an event means a program or a corner, which is a unit of broadcasting services provided by a broadcaster, and does not indicate an event or occurrence.
The start time and end time indicate the start time and end time of the broadcast time of the program or section indicated by the event ID, respectively.

The program name is the name of the program indicated by the event ID or the program included in the segment.
The corner name is the name of the corner indicated by the event ID. Corner names may be omitted if the program is not divided into one or more corners.
The event summary is text information indicating a summary of the program or section indicated by the event ID in sentences.
The broadcast station ID is identification information indicating the broadcast channel of the program indicated by the event ID or the program included in the segment.
Program related information may be included in the program name, corner name, and event summary of the program information. "Fukuoka Prefecture" included in the event summary on the second line in FIG. 3 and "Atami" included in the event summary on the third line are program-related information indicating geographical names.
The content requesting unit 126 can extract program-related information from program information for each program acquired by the program information acquiring unit 122 when generating a program-based content request.

Alternatively, the content requesting unit 126 may refer to program information relating to a specific corner instead of a specific program, and extract program-related information without referring to program information relating to other corners. Thereby, the content requesting unit 126 can request the content storage server 30 for the program corresponding content corresponding to the corners that are part of the program in units of corners. Therefore, the program associated with the program information for which the program-corresponding content has been acquired from the content storage server 30 is a recommended corner candidate (hereinafter referred to as a recommended corner) for the user indicated by the user identification information received in association with the program-corresponding content. Become. The information providing unit 128 may apply the above program-by-program processing to each corner for the selection criteria for determining the recommended corner from the recommended corner candidates and the timing of transmitting the recommended program information indicating the recommended corner. In the present application, processing for each program will be mainly described, and recommended corners will also be collectively referred to as recommended programs.

(Program-related information)
Next, an example of program-related information according to this embodiment will be described. FIG. 4 is a diagram showing an example of program-related information according to this embodiment.
The program-related information shown in FIG. 4 includes an event ID, a keyword, a genre, and a search method, and includes a set in which these are associated with each other.
A keyword is a phrase that represents the content of the program indicated by the event ID.
Genre indicates the type to which the keyword belongs. In FIG. 4, the genre of each keyword is classified into one of "geographical name", "landmark", "personal name", "hobby" and "event". However, although the genre "landmark" of "ND land" in FIG. 4 is classified separately from "geographical name", it may be classified as "geographical name".

The search method indicates a technique used by the content storage server 30 to search for stored content containing image-related information corresponding to a keyword.
For example, when "location information" is specified as shown in the second line of FIG. A geographic range associated with the location corresponding to the geographic name that is the keyword indicated in the stored content search request received from unit 126 is identified. Content storage server 30 identifies, as a search result, content stored in receiving device 70, which is the source of the received information, and includes location information indicating latitude and longitude within the specified geographical range.
Map data may be stored in advance in the content requesting unit 126 of the information processing apparatus 10 instead of the content storage server 30 . In that case, the content requesting unit 126 refers to the map data to specify the geographical range corresponding to the geographical name that is the keyword corresponding to the acquired received program. The content requesting unit 126 includes the identified geographical range in a stored content search request and transmits the stored content search request to the content storage server 30 .
Content storage server 30 identifies, as a search result, stored content that includes location information indicating a location included in the geographical range indicated by the stored content search request, among the stored content of receiving device 70 that is the transmission source of the received information. .

When "image recognition" is instructed as in the third line of FIG. and search for stored content corresponding to the receiving device 70 related to the stored content search request. The content storage server 30 performs image recognition processing on the image included in the received posted information, acquires in advance a name indicating the recognition result, and stores it as a part or all of the image-related information in association with the image. You should leave it.
Note that even when "image recognition" is specified as the search method, the content storage server 30 does not search for stored content in response to receiving a stored content search request, but stores the recognition result in advance as text information. Then, matching with the keyword can be performed. In other words, when the recognition result is stored in advance, the content storage server 30 performs the same processing as when "text information" is specified as the search method when searching for stored content based on a stored content search request. should be done.
When "text information" is instructed as in the fourth line of FIG. A stored content having text information including a character string corresponding to the keyword indicated in the content search request is searched.

The program-related information may be configured separately from the program information, or may be configured as part of the program information. When it becomes a part of the program information, it is sufficient if the keyword, genre, and search method are associated with each event ID. Therefore, the event ID shown in FIG. 4 is set separately from the event ID shown in FIG. It doesn't have to be.
In addition, the program name, corner name, and event name, which are part of the program information, can also be regarded as program-related information, and the content requesting unit 126 may use these information as program-related information. In that case, the program-related information shown in FIG. 4 may be omitted.
Note that the program information distribution server 50 may transmit program-related information related to the program information to the information processing apparatus 10 separately from the program information.

If the program-related information includes a search method in addition to the keyword, the content requesting unit 126 transmits a program-related content search request indicating the search method and keyword to the content storage server 30 .
The content storage server 30 uses the search method indicated by the program-corresponding content search request received from the content requesting unit 126 of the information processing apparatus 10 to search for the saved content corresponding to the keyword indicated by the saved content search request. The content storage server 30 transmits the stored content found by the search to the information processing device 10 . It should be noted that when one search method is determined in advance, it is sufficient to use that method, so the search method need not be specified in the program-related information and stored content search request.

(operation information)
Next, an example of motion information according to this embodiment will be described. FIG. 5 is a diagram showing an example of motion information according to this embodiment.
The operation information exemplified in FIG. 5 includes information indicating a receiver ID, date and time, reception channel, and operation status, and associates them. The receiver ID is identification information for identifying each receiver 70 . The date and time indicates the year, month, day and hour and minute at that time. The receiving channel indicates the broadcast channel that receives the program at that time. The operating status indicates the operating status at that time. As the operation status, for example, any one of operation start, standby, reception/playback, recording, recording/playback, operation stop, and the like can be described. Standby means a state in which neither program reception/playback, recording, reception/recording, or recording/playback is being performed, and is waiting for a user's operation. Receiving and reproducing is a state in which a program is received and video, audio, etc. of the received program are reproduced. Recording is a state in which a program is received and recorded without being reproduced. Receiving and recording is a state in which a program is received and recorded while being reproduced. Recorded playback is a state in which a program recorded in the past is played back without receiving the program. When the operation status is operation start, standby, or operation playback, the reception channel is not described and may be omitted because the program is not received.

The receiving device 70 , for example, generates reception information at predetermined time intervals (typically every 1 to 10 minutes) and transmits the generated reception information to the information processing device 10 . As for the timing at which the receiving device 70 transmits the operation information, the recommended program information may be provided to the receiving device 70 immediately after the start of operation, when reception of the program is started, or after reproduction during reception. Even in this case, viewing of the program is not hindered by the recommended program information or the stored content transmitted together with the recommended program information. If the recommended corner is determined for each corner, the timing at which the receiving device 70 transmits the operation information may be based on the broadcast time of the corner instead of the broadcast time of the program as described above.

A series of processes from acquisition of program information by the program information acquisition unit 122, storage content search request by the content request unit 126, and identification of recommended candidate programs by the information provision unit 128 are allowed to be executed in the background. Therefore, the program information acquiring unit 122, the content requesting unit 126, and the information providing unit 128 execute a series of these processes in a time zone (for example, late at night or early in the morning) when the load of other processes is relatively small. good too.

(map data)
Next, an example of map data according to this embodiment will be described. FIG. 6 is a diagram showing an example of map data according to this embodiment. The map data includes reference position information indicating the geographical position of each geographical name. In other words, the map data is used to identify the location or area from the geographical name. In the example shown in FIG. 6, "Fukuoka", "Atami", "Mt. Fuji", and "Tokyo Tower" are described as geographical names in the name column. "Fukuoka" and "Atami" correspond to place names, respectively, and "Mt. Fuji" and "Tokyo Tower" correspond to geographical features, respectively. As the reference position information, a representative position indicated by the corresponding geographical name or an area indicated by the geographical name is represented. In the example shown in FIG. 6, a representative position is indicated by one latitude and longitude (point), and each vertex of a polygon forming the outer edge of an area (surface), which can be said to be a set of positions, is indicated by latitude and longitude. . In the following description, representative positions and areas may be collectively referred to as reference positions unless otherwise specified.

Here, an example of using map data will be described. However, a case where map data is preset in the content storage server 30 and the content requesting unit 126 instructs "location information" as a search method will be taken as an example.
The content storage server 30 waits for a stored content search request from the information processing device 10 . When receiving a stored content search request, the content storage server 30 attempts to extract program-related information indicating "location information" and keywords as a search method from the received stored content search request. When the content storage server 30 extracts program-related information indicating a search method indicating "location information" and a keyword, the content storage server 30 refers to the map data stored in advance in its own device, and corresponds to the geographical name that is the extracted keyword. Identify the geographic extent indicated by the reference location information. The content storage server 30 searches stored content stored in its own device for stored content including image-related information (for example, latitude and longitude) indicating a position within the specified geographical range. The content storage server 30 adds the user identification information stored in association with the stored content to the stored content found by the search, and transmits the stored content to the information processing apparatus 10 .

Also, the map data may be set in advance in the content requesting unit 126 and the map data may not be set in the content storage server 30 . In this case, the content requesting unit 126 performs a known morphological analysis on the text information that is part of the acquired program information and can form the program-related information, and segments the text information into words. The content requesting unit 126 refers to map data stored in advance, extracts, as a keyword, a word matching any geographical name from among words whose parts of speech are nouns, and also extracts a word corresponding to the extracted keyword. Extract reference position information. If a keyword independently described as program-related information is included, content requesting unit 126 refers to map data and extracts reference position information corresponding to the keyword without performing morphological analysis. may

The content requesting unit 126 generates a saved content search request that instructs a search for saved content indicating the geographical range indicated by the extracted reference position information. The stored content search request is request information indicating a search for stored content including position information related to the reference position information among the user's stored content related to the receiving device 70 . The content requesting unit 126 transmits the generated stored content search request to the content storage server 30 . In this case, the search method need not be specified in the saved content search request.
When the content storage server 30 receives a stored content search request from the information processing apparatus 10, the content storage server 30 extracts program-related information including keywords from the received stored content search request, and uses the extracted keywords as part or all of the image-related information. Search for stored content that contains The content storage server 30 transmits the stored content found by the search to the information processing device 10 .

If the reference position information is indicated by the latitude and longitude of one point or the latitude and longitude of two or more points on the curve, the content storage server 30 searches within a predetermined range (for example, radius 10 to 50 meters) to search for stored content that includes location information. When the reference position information indicates an area using the latitude and longitude of each vertex, stored content including position information indicating a point within the area is searched.
The geographical range, which is the search range for the reference position information added to the stored content, may differ according to individual geographical names or their types. For example, if the geographical name is a man-made structure such as a building, it should be within the range of 10 to 50m from the outer edge of the structure, and if it is a mountain, it should be within 1 to 10km from the summit. If the range is a river, it may be an area including the river and the riverbed.

(user data)
Next, an example of user data according to this embodiment will be described. FIG. 7 is a diagram showing an example of user data according to this embodiment. The user data includes a password, a receiving device ID and a registered device ID for each member ID and associates them. The member ID is identification information for identifying an individual member who is a representative user of the content storage and browsing service user for each receiving device 70 . The member ID corresponds to an example of the above user identification information. The member ID is not limited to one user, and may be shared by two or more users using the receiving device 70 . A password is an example of user authentication information identified by a member ID. The receiving device ID is identification information for identifying the receiving device 70 mainly used by the user identified by the member ID. The registered device ID is identification information for identifying the terminal device 60 mainly used by the user identified by the member ID. One receiving device ID may be associated with two or more registered device IDs each having a different main user.

User data is stored in advance in the content storage server 30, and one or more stored contents are associated with each member ID and accumulated. The content storage server 30 transmits the stored content retrieved in response to the stored content search request received from the information processing apparatus 10 to the information processing apparatus 10 in association with the member ID stored in association with the stored content. Also, the content storage server 30 can refer to the user data and identify the member ID corresponding to the receiving device ID.

(saved content)
Next, an example of stored content according to this embodiment will be described. FIG. 8 is a diagram showing an example of stored content according to this embodiment. The saved content includes member ID, date and time, title, image data and description, and associates them. The date and time indicates the date and hour when the content storage server 30 acquires the title, image data, and description of the stored content from the terminal device 60 . The title is the title of the saved content. The image data is data representing an image (photograph) captured by the terminal device 60 . Position information is added to the image data. The position information is information indicating the latitude and longitude of the position where the terminal device 60 was photographed. The description is text information indicating a description of the image. Part or all of the location information, date and time, title and description may be omitted. Also, a content ID for identifying the stored content may be included for each stored content.

Any one of the position information, the title, the description, or any combination thereof corresponds to the above example of the image-related information. Either or both of the title and description may be used to search for stored content in response to a stored content search request. Therefore, titles and descriptions may include names of hobbies such as sports and lessons, names of artists, names of events, names of dishes and their types, etc., as image-related information.
When "text information" is specified as the search method, or when the search method is not specified and text information is assumed to be searched, the content storage server 30 matches the keyword specified by the stored content search request. Search for stored content that contains program-related information.

In addition, the program-related information may include a person's name, a geographical name, and the like, which are the results of image recognition processing executed on image data by the content storage server 30 . The result of the image recognition process, in the form of text information, may be appended to the title or description field, or may be appended to a separate field.
When "image recognition" is specified as the search method, or when the search is based on image recognition, the content storage server 30 selects an image recognition result that matches the keyword specified in the stored content search request as a program-related search method. Search for stored content to include as information. When the image recognition result is text information, "text information" may be specified as the search method.

(Display example)
Next, a display example of recommended program information will be described.
FIG. 9 is a diagram showing a first display example of recommended program information according to the present embodiment. In the example shown in FIG. 9, the message bar Ms12 indicates recommended program information, and is arranged in contact with the lower right corner of the display area forming the display section of the receiving device 70 . However, most of the display area of the display unit is occupied by the video (program video) of the program 11 being broadcast at that time.
In the message bar Ms12, "program 12" as the program name of the recommended program, "13:50" as the broadcast start time, and a character string "start" indicating the broadcast start time are arranged. This time is five minutes after the current time "13:45". The control unit of the receiving device 70 can notify the user that the recommended program will be broadcast immediately after the recommended program information is displayed before the immediately preceding program 11 or corner ends. Further, when detecting that the message bar Ms12 is pressed, the control unit of the receiving device 70 may select the broadcast channel when the current time is the start time of the recommended program. Here, "pressing" indicates that an operation signal indicating the position within the display area is input from the operation input unit in addition to the actual pressing. Accordingly, the receiving device 70 starts receiving and playing the recommended program. Further, when the current time is the start time of the recommended program, the control unit of the receiving device 70 may start recording the recommended program instead of or along with the playback.

FIG. 10 is a diagram showing a second display example of recommended program information according to the present embodiment. In the second display example, four vertically long card-shaped images (hereinafter referred to as cards) Cd21, Cd22, Cd23, and Cd24 are placed from left to right in the middle of the display area of the display unit of the receiving device 70. They are arranged in that order. Cards Cd21, Cd22, Cd23, and Cd24 are images for guiding programs 21, 22, 23, and 24, respectively, as recommended programs. Each card contains the program name, related image, and broadcasting status information of each recommended program. The control unit of the receiving device 70 can extract the program name from the received recommended program information. The control unit of the receiving device 70 can use, as the related image, an image forming a part of the stored content received in association with the recommended program information. The control unit of the receiving device 70 can compare the broadcast time included in the recommended program information with the current time to determine whether the program is currently being broadcast, has already been broadcast, or is scheduled to be broadcast as the broadcast status information. However, the control unit of the receiving device 70 determines that the program that has already received the program data and has been recorded (recorded) among the recommended programs that have been determined to have been broadcast is already recorded, and includes it in the guidance target. Recommended programs that have already been broadcast may be excluded from the guide targets.

For example, the card Cd21 displays the title of the program 21, “Program 21,” the image 21, which is a related image of the program 21, and the broadcast status information of the program 21, “currently being broadcast.” The control unit of the receiving device 70 can determine that the program 21 is currently being broadcast based on the fact that the current time is within the broadcasting time of the program 21 . When the control unit of the receiving device 70 detects that the card Cd21 has been pressed during the broadcast time of the program 21, it refers to the broadcast information of the program 21, selects the broadcast channel of the program 21 (channel selection), and selects the broadcast channel of the program 21. You may start receiving. Then, the control section of the receiving device 70 erases the display of the cards Cd21 to Cd24 and reproduces the received program 21. FIG. Here, the control unit of the receiving device 70 outputs the video data of the program 21 to the display unit to display the video, and outputs the audio data to the reproduction unit to reproduce the audio.

On the card Cd22, the title of the program 22, "Program 22", the image 22, which is a related image of the program 22, and the broadcast status information of the program 22, "Broadcast schedule" are displayed. The control unit of the receiving device 70 can determine that the program 22 is scheduled to be broadcast based on the fact that the current time is before the broadcast start time of the program 22 . "18:00 to 19:00 on Saturday, September 13" is added to the broadcast status information as the broadcast time of program 22 .
When the control unit of the receiving device 70 detects that the card Cd 22 has been pressed before the broadcast of the program 22 starts, it refers to the broadcast information of the program 22 to specify the broadcast start time. 22 broadcast channel may be tuned in (channel reservation) and reception and playback of program 22 may begin. The control unit of the receiving device 70 may start recording instead of reproducing the program 22 or simultaneously with the reproduction (recording reservation). When the selection unit of the receiving device 70 detects that the card Cd 22 has been pressed, the selection unit causes the display unit to display a mode selection screen indicating one of reproduction, recording, and both reproduction and recording as options for the processing mode of the program 22. , may operate in a processing mode indicated by the detected operation.

On the card Cd23, the title of the program 23, "Program 23", the image 23, which is a related image of the program 23, and the broadcast status information of the program 23, "Recorded" are displayed. The control unit of the receiving device 70 determines that the program 23 has already been broadcast based on the fact that the current time is later than the broadcast end time of the program 23, and the stored program data of the program 23 exists. Accordingly, it can be determined that the program 23 has been recorded. "September 11 (Thursday) 18:00 to 19:00" is added to the broadcast status information as the broadcast time of program 23 .
When the control unit of the receiving device 70 detects that the card Cd23 has been pressed, it erases the display of the cards Cd21 to Cd24 and starts playing the program 23. FIG.

On the card Cd24, the title of the program 24, "Program 24", the image 24, which is a related image of the program 24, and the broadcast status information of the program 24, "Broadcast schedule" are displayed. The control unit of the receiving device 70 can determine that the program 24 is scheduled to be broadcast based on the fact that the current time is before the broadcast start time of the program 24 . "14:00 to 14:30 on Friday, September 12" is added to the broadcast status information as the broadcast time of program 24 .
When the control unit of the receiving device 70 detects that the card Cd24 has been pressed, it erases the display of the cards Cd21 to Cd24, refers to the broadcast information of the program 24 to specify the broadcast start time, and sets the current time to the broadcast start time. Channel reservation, recording reservation, or both may be made executable in the same way as when the program 22 becomes.

FIG. 11 is a diagram showing a third display example of recommended program information according to the present embodiment. In the third display example, cards Cd31-Cd34 are displayed at the same positions and sizes as cards Cd21-Cd24 shown in FIG. In the following description, differences from FIG. 10 are mainly described.
In cards Cd31-Cd34, representative images 31-34 are arranged instead of images 21-24, respectively. The representative images 31-34 are still images showing representative scenes of the programs 31-34, which are recommended programs. The representative images 31-34 are included in the program information of the programs 31-34, respectively, and the information providing unit 128 of the information processing apparatus 10 receives the representative images 31-34 included in the program recommendation information of the programs 31-34, respectively. It may be sent to device 70 .
The control unit of the receiving device 70 extracts images from the stored content corresponding to the program information of each of the programs 31 to 34 and causes the display unit to display one of the extracted images as the background image 30 . The stored content can be common between all or at least two of the programs 31-34, or can be different for each. Therefore, the images extracted from the saved content that can be the background image 30 can be one to four. When there are a plurality of images extracted from the stored content, the control unit of the receiving device 70 sequentially switches one of the plurality of images each time the display area is pressed. It may be displayed on the display unit (slide show).
Note that the control unit of the receiving device 70 may select whether or not to display the stored content based on the operation signal input from the operation input unit. The control unit of the receiving device 70 displays the received stored content on the display unit when the display requirement of the stored content is set, and displays the received stored content on the display unit when the display of the stored content is not set. do not display on

When the recording of the recommended program is completed, the control unit of the receiving device 70 may generate recording completion information indicating completion of recording, and display the generated recording completion information on the display unit.
FIG. 12 is a diagram showing a display example of recording completion information according to the present embodiment. In the example shown in FIG. 12, the message bar Ms42 indicates recording completion information, and is arranged in contact with the lower right corner of the display area forming the display section of the receiving device 70. In the example shown in FIG. However, most of the display area of the display unit is occupied by the video (program video) of the program 41 being broadcast at that time.
In the message bar Ms42, the program name of the recorded recommended program is "Program 34", the broadcast time is "2019.9.12 14:00-14:30", and the character string "Recording Done” is placed. The control unit of the receiving device 70 may limit the display period of the recording completion information to a predetermined time (for example, 1 to 5 minutes) after the end of recording, and erase the recording completion information after the display period ends.
Further, when the control unit of the receiving device 70 detects that the message bar Ms42 is pressed while the recording completion information is being displayed, the control unit may start playing the program 34 related to the completion of recording notified by the recording completion information.

As described above, the information providing unit 128 of the information processing device 10 may transmit the recommended program information to the user's terminal device 60 instead of the receiving device 70 . When receiving the recommended program information from the information processing apparatus 10, the control section of the terminal device 60 displays the recommended program information on the display section of the terminal device 60 using the same technique as the receiving device 70. FIG.
FIG. 13 is a diagram showing a fourth display example of recommended program information according to the present embodiment.
In the example shown in FIG. 13 , the message bar Ms52 indicates recommended program information and is arranged substantially in the center of the display area forming the display section of the terminal device 60 . In the message bar Ms52, "program 12" as the program name of the recommended program, "13:50" as the broadcast start time, and a character string "start" indicating the broadcast start time are arranged. This time is five minutes after the current time "13:45". The control unit of the terminal device 60 can notify the user that the recommended program will be broadcast immediately after the recommended program information is displayed before the immediately preceding program 11 or corner ends. However, since the program image received at that time is displayed on the display unit of the receiving device 70, the control unit of the terminal device 60 does not need to display the program image. A "view" button is superimposed on the message bar Ms52. The "watch" button is a button for instructing reproduction of a recommended program indicated by the superimposed recommended program information when pressed. When the control section of the terminal device 60 detects that the “view” button has been pressed, it transmits the program information of the program 11 and an operation signal indicating reception of the program 11 to the receiving device 70 .

On the other hand, the operation input unit of the receiving device 70 receives operation signals input from, for example, a dedicated remote control device (a so-called remote controller) or the terminal device 60 wirelessly using a predetermined wireless communication method such as infrared rays or millimeter waves. make it possible. The operation input unit of the receiving device 70 may include an input/output interface that outputs the received operation signal to another functional unit (eg, control unit). The control unit of the receiving device 70 specifies the broadcast start time of the program 12 instructed by the operation signal input from the operation input unit of the own device, and when the current time reaches the broadcast start time, the instructed broadcast channel is selected. Tune in and start receiving and playing program 12 . Therefore, the terminal device 60 also functions as a control device for operating the receiving device 70 . In addition to receiving and playing back recommended programs, the control unit of the receiving device 70 may realize recording and playback of recommended programs based on operation signals input from the terminal device 60, recording reservation, and channel reservation.
Note that when receiving an image that is part of the stored content from the information processing device 10, the control unit of the terminal device 60 uses the same method as the receiving device 70 to display the image on the display unit of its own device. may be displayed.

(Modification)
Next, a modified example of this embodiment will be described.
In the first modification of the present embodiment, the user data stored in the content storage server 30 is such that one member ID is associated with a plurality of user IDs, and each user ID is independently associated with a registered device. An ID may be associated. In the example shown in FIG. 14, user data includes a member ID, a receiver ID, a user ID, and a registered device ID, and includes a set in which these are associated with each other. However, one receiving device ID is associated with one member ID.
When the content storage server 30 receives stored content from the receiving device 70, the content storage server 30 refers to the user data, identifies the user ID corresponding to the receiving device 70, and accumulates for each identified user ID. In the example shown in FIG. 15, the saved content includes member ID, user ID, date and time, title, image data and description, and associates them.

On the other hand, the control section of the receiving device 70 includes a user recognition section (not shown) that recognizes the user in use. The receiving device 70 includes, for example, an imaging unit (not shown), and the imaging unit acquires image data representing an image of the user's face (face image) as a subject within its field of view, and outputs the image data to the control unit. The control unit performs known image recognition processing on the image data input from the imaging unit, and recognizes the user having the face indicated by the face image indicated by the image data. The control unit of the receiving device 70 stores in advance recognition data (not shown) including recognition data relating to the face image of the user and the user ID of the user and associating them. As illustrated in FIG. 16 , the control unit of the receiving device 70 adds the user ID of the recognized user to the motion information, and transmits the motion information further including the user ID to the information processing device 10 .

The information providing unit 128 of the information processing device 10 extracts the user ID from the motion information received from the receiving device 70 . The information providing unit 128 identifies the saved content associated with the extracted user ID from among the saved content received from the content saving server 30, and further provides program-related information corresponding to the image-related information included in the identified saved content. A program related to the program information including is determined as a recommended candidate program. The information providing unit 128 generates recommended program information for the determined recommended candidate programs using the above-described method, and transmits the recommended program information to the receiving device 70 . Therefore, the receiving device 70 is guided to recommended programs according to the user who is using the receiving device 70 .

In a second modification of the present embodiment, the user data may be configured to include individual user IDs in association with one or more related user IDs, as illustrated in FIG. 17 . A related user ID is identification information for permitting a user associated with a user ID to refer to stored content and for identifying a user different from the user indicated by the user ID. A distinct user can be any person designated by the user, for example, a friend, colleague, relative, etc. of the user indicated by the user ID. User data illustrated in FIG. 17 is stored in advance in the information providing unit 128 of the information processing apparatus 10 .

The information providing unit 128 of the information processing device 10 extracts the user ID from the motion information received from the receiving device 70 . The information providing unit 128 refers to the user data and extracts related user IDs associated with the extracted user IDs. Then, the information providing unit 128 identifies stored content associated with each of the extracted user IDs and related user IDs among the stored content received from the content storage server 30, and further identifies images included in the specified stored content. A program related to program information including program-related information corresponding to related information can be determined as a recommended candidate program. Then, the information providing unit 128 generates recommended program information for the determined recommended candidate program using the above-described method, and transmits the recommended program information to the receiving device 70 . Therefore, in addition to the user of the receiving device 70, the receiving device 70 is guided to recommended programs corresponding to related users corresponding to the user.
Note that the information providing unit 128 of the information processing device 10 extracts the receiving device ID instead of the user ID from the operation information received from the receiving device 70, refers to the user data, and associates the extracted receiving device ID with the user data. Related user IDs may be extracted.

The content storage server 30 may be configured as a so-called SNS (Social Networking Service) server. The SNS server exchanges various data between a plurality of terminal devices 60 indicated by registered device IDs registered in advance. As the related user ID, a user ID of another user registered in a so-called friend list set for each user may be used.
For example, the content storage server 30 may transfer invitation information indicating an offer as a related user from one terminal device 60 to another terminal device 60b (not shown). When the content storage server 30 receives acceptance information indicating acceptance of the offer from the other terminal device 60b as a response to the invitation status, the content storage server 30 defines the user ID of the other terminal device 60b as the related user ID of the terminal device 60. FIG.

The information providing unit 128 may transmit image-related information accompanying the image or text information including the image-related information to the receiving device 70 together with the image that is part of the stored content. The control unit of the receiving device 70 may include the text information received from the information processing device 10 instead of the image or together with the image in the recommended program information and cause the display unit of the own device to display the text information. The information providing unit 128 may transmit the text information to the terminal device 60 instead of the receiving device 70 . As with the receiving device 70, the control unit of the terminal device 60 may include the received text information in the recommended program information and cause the display unit of the terminal device 60 to display the recommended program information.
The information providing unit 128 pre-stores predetermined fixed phrases (templates) for constructing text information. The fixed phrase indicates, for example, a notification of the existence of the stored content related to the image-related information, or a content that induces recollection of the image-related information. More specifically, the standard sentence is represented by a character string such as "Would you like to look back on the memories of...?" The information providing unit 128 generates text information by substituting the image-related information as a keyword into the blanks of the pre-stored standard sentences. When the control unit of the terminal device 60 or the receiving device 70 detects that the recommended program information is pressed, it may start receiving processing for the recommended program.

In addition to the recommended program information, the information providing unit 128 does not necessarily have to transmit part or all of the stored content to the receiving device 70 or the terminal device 60 . In that case, the content requesting unit 126 and the information providing unit 128 should be notified at least of the presence or absence of the program-corresponding content and the user identification information associated with the program-corresponding content from the content storage server 30 . The content storage server 30 may transmit, to the information processing apparatus 10, a content list including at least user identification information associated with the program-corresponding content found by the search as a response to the program-corresponding content request. The content requesting unit 126 can specify the program related to the program-related content request corresponding to the content list received from the content storage server 30 as a program having program-related content. The content requesting unit 126 associates the received user identification information and the request for program-corresponding content with the program information of the program for which the program-corresponding content was found, and outputs the information to the information providing unit 128 .

Note that the information providing unit 128 may omit the selection of recommended programs and transmit recommended program information indicating all of the determined recommended candidate programs to one or both of the terminal device 60 and the receiving device 70 . The controller of one or both of the terminal device 60 and the receiving device 70 selects recommended programs indicated by the recommended program information received from the information processing device 10 using the same method as the information providing unit 128 described above. may be executed. The control unit of the device causes the display unit to display recommended program information indicating the recommended program selected by the recommended program selection.

Further, the control unit of one or both of the terminal device 60 and the receiving device 70 displays the recommended program information indicating the recommended program selected by the information processing device 10 or the information processing device 10 instead of or in addition to the display of the recommended program information. Existing text-to-speech processing may be performed on some or all of the included text information. The control unit of the device outputs the audio data generated by the text-to-speech synthesis processing to the reproduction unit, thereby causing the reproduction unit to reproduce the voice indicating the recommended program (speech reading). As a result, the recommended programs are guided by voice. The text information that is the target of the text-to-speech synthesis process may include information that allows identification of individual recommended programs. If it is a recommended program that is being broadcasted or will be started within a predetermined period (most recent, for example, 5 to 15 seconds) from the current time, at least the broadcast channel of the recommended program should be included in the target text information. If the program is a program after that or a program whose broadcast has ended in the past, the program name of the recommended program should be included in the target text information. More preferably, the target text information may include the broadcast start time of the recommended program, and the target text information may include a keyword forming image-related information.

As described above, the information processing apparatus 10 according to this embodiment includes the program information acquisition section 122, the content request section 126, and the information provision section 128. FIG. The program information acquisition unit 122 acquires program information including program-related information regarding the contents of broadcast programs. The content requesting unit 126 stores content (eg, stored content) including an image and image-related information about the image in association with user identification information indicating the user of the receiving device 70 (eg, a content storage server). 30) is requested to notify program-related content, which is content including image-related information corresponding to program-related information. The information providing unit 128 stores the recommended program information indicating the broadcast program for which the program-corresponding content is notified from the content storage unit on the device of the user indicated by the user identification information associated with the program-corresponding content (for example, the terminal device 60, the receiving device). 70).
According to this configuration, of the content stored in the content storage unit by the user of the receiving device 70, the content related to the content of the broadcast program is determined as the program-corresponding content, and the user can receive the broadcast program related to the program-corresponding content. It is introduced as a recommended program. for that reason,
Since the user of the receiving device 70 is guided to the program corresponding to the content stored by the user as a recommended program, the user can recall the experience related to the content stored by the user by viewing the recommended program. In addition, since the user is encouraged to use the saved content and to save new content, the use of the content storage and viewing service is activated.

Further, in this embodiment, the program-related information includes a geographical name related to the location indicated in the received program, and the content requesting unit 126 requests the image-related information indicating the geographical name or the location indicated by the geographical name. You may request notification of content that contains.
According to this configuration, the program corresponding to the content related to the geographical name of the program received by the receiving device 70 is guided as the recommended program. Therefore, the user of the receiving device 70 can recall his/her experience in the location or area in the geographical name by viewing the recommended program.

Further, in the present embodiment, the image-related information indicates latitude and longitude as the image acquisition position, and the content requesting unit 126 sends map data including the latitude and longitude indicating the position of each geographical name as reference position information. By referring to it, notification of content including image-related information indicating a geographical name related to the content of the received program or a position indicated by the geographical name may be requested.
According to this configuration, the program corresponding to the content including the latitude and longitude added to the image or the image-related information indicating the position indicated by the geographical name of the received program is guided as the recommended program. Since the existing data format can be used as the data format of the position information added to the image, the introduction cost can be suppressed.

Also, in this embodiment, the program-related information includes the name of a geographical feature (for example, a landmark) represented in the broadcast program, and the content requesting unit 126 sends the name of the geographical feature to the image-related information. You may request notification of content that includes as
According to this configuration, by using the name of the geographical feature that the user can recognize as the geographical position, it is possible to acquire the content related to the geographical feature.

In addition, the information providing unit 128 refers to the user data including the related user identification information associated with each user identification information indicating the user of the receiving device 70, and the related user identification information associated with the user identification information. is specified, and the program information of the broadcast program for which the program corresponding content is notified in association with the specified related user identification information may be included in the recommended program information as a recommended candidate program for the user.
According to this configuration, in addition to the content related to the user of the receiving device 70, broadcast programs corresponding to the content of related users of the user can be determined as recommended candidate programs. Therefore, by presenting the broadcast program corresponding to the related user's content as a recommended program, the user of the receiving device 70 can recall the experience related to the related user's stored content.

In addition, the information providing unit 128 may further provide an image included in the program content acquired from the content storage unit (for example, the content storage server 30) to the device of the user of the receiving device 70. FIG.
According to this configuration, it is possible to provide the user of the receiving device 70 with an image of the content corresponding to the recommended program. Therefore, the user of the receiving device 70 can recall the experience related to the image more deeply, and is further encouraged to use the content.

In addition, among the recommended candidate programs, the information providing unit 128 preferentially recommends the program information of the broadcast program whose period from the present to the future broadcast start time or the period from the past broadcast end time to the present is short. may be included in the information.
According to this configuration, the closer the broadcast time is to the current recommended candidate program, the stronger the user's impression of the program and the stronger the motivation for viewing the program.

In addition, the information providing unit 128 may include, in the recommended program information, program information of a broadcast program whose broadcast start time is later than the end time of the broadcast program currently being broadcast among the recommended candidate programs being broadcast.
According to this configuration, since a program that starts broadcasting after the end of the program currently being viewed is guided as a recommended program, there is a high possibility that the recommended program will be used by the user.

In addition, the information providing unit 128 does not include, in the recommended program information, the program information of the broadcast programs that have not been received by the user's device for a predetermined number of times or more, among the broadcast programs related to the recommended program information transmitted to the user's device in the past. may
According to this configuration, a recommended program that has not been used in the past is not again guided as a recommended program, thus increasing the possibility of avoiding unnecessary recommended program guidance.

Although one embodiment of the present invention has been described in detail above with reference to the drawings, the specific configuration is not limited to the above, and various design changes, etc., can be made without departing from the gist of the present invention. It is possible to

For example, the information processing device 10, the content storage server 30, and the program information distribution server 50 provide various information about programs to the terminal device 60 or the receiving device 70 via a computer network such as the Internet. It can be regarded as a so-called cloud service. In the above description, the information processing device 10, the content storage server 30, and the program information distribution server 50 are respectively one server device, but each may be realized by a plurality of server devices. Any combination of the information processing device 10, the content storage server 30, and the program information distribution server 50 may be realized as one server device. For example, in the above description, the information processing system 1 includes the content storage server 30 separate from the information processing device 10 as an example of the content storage unit, but the content storage server 30 is not limited to this. The information processing apparatus 10 may include a content storage unit having functions corresponding to the content storage server 30 . In that case, the content storage server 30 may be omitted.
Moreover, although the case where the information processing system 1 includes the program information distribution server 50 separate from the information processing device 10 has been described, the present invention is not limited to this. The information processing apparatus 10 may include a program information accumulation unit having functions corresponding to the program information distribution server 50 . In that case, the program information distribution server 50 may be omitted.
Also, one or a plurality of server devices that implement the above cloud service are managed as a so-called cloud. For example, each server device may be set in advance with information indicating another server device to which various types of data are to be sent and received. Information on the server device to which the posted information is to be sent may be set in advance in the terminal device 60 . In the receiving device 70, it is sufficient to set information on a server device as a transmission destination of operation information, a server device as a transmission source of recommended program information, and a server device as a transmission source of stored content.

In the above example, a unique user ID is used as the user identification information that identifies an individual user and the related user identification information. However, if a user can be uniquely identified directly or indirectly, It is not limited to this. As described above, if different information is used for each individual user, it may be possible to identify devices that are used individually by each user and are basically not shared among multiple users. For example, instead of the user identification information, the registered device ID of the terminal device 60 that is mainly used by each user, the e-mail address, the user name, the application ID to which the device is provided, and the website from the browser running on the device A client ID, which is uniquely assigned by the website when accessing the website and is used for subsequent accesses, etc., can be used.
Also, a receiving device ID may be used in place of the member ID that identifies the user of the content storage and viewing service.
Other types of authentication information, for example, biometric information such as fingerprint images, iris images, and hand vein images, may be used instead of passwords as authentication information for individual users.

In the above description, the content storage server 30 refers to the map data, includes the location information indicating the latitude and longitude within the geographical range related to the location corresponding to the geographical name indicated in the stored content search request, and stores the stored content. Although the case of searching for stored content corresponding to the user or the receiving device 70 related to the search request has been described as an example, the present invention is not limited to this. The content storage server 30 may search for stored content that includes the geographical name indicated in the stored content search request as part of the text information, among the stored content corresponding to the receiving device 70 or the user that includes the text information. . The map data may include, for each geographical name, one or more aliases indicating the location or area indicated by the individual geographical name. Therefore, the content storage server 30 refers to the map data, and among the stored content corresponding to the receiving device 70 or the user that includes the text information, the alias corresponding to the geographical name indicated in the stored content search request is added to the text information. You may search for stored content that includes as part of a .

In the above description, the case where the terminal device 60 is a mobile phone is mainly taken as an example, but the present invention is not limited to this. The terminal device 60 is not limited to a mobile phone, and may be a tablet terminal device, a personal computer, a wearable terminal, or other forms of information terminal device mainly used by individual users. The wearable terminal may take any form, for example, a glasses-type terminal device, a wristwatch-type terminal device, a key holder-type terminal device, or the like.

In the above description, the case where the receiving device 70 is mainly a television receiver is taken as an example, but the present invention is not limited to this. The receiving device 70 may be, for example, a recording device, a home projector, or the like, as long as it has a function of receiving television broadcasts. Further, in the receiving device 70, the display section and other members may be separated from each other, and the display section may be omitted.
Also, the functions and configurations according to the above embodiments and modifications may be combined or partly omitted as long as there is no contradiction.

The information processing device 10, the content storage server 30, the program information distribution server 50, the terminal device 60, and the receiving device 70 may each be realized by a computer. In that case, a program for realizing this control function may be recorded in a computer-readable recording medium, and the program recorded in this recording medium may be read into a computer system and executed.
Also, part or all of the information processing device 10, the content storage server 30, the program information distribution server 50, the terminal device 60, and the receiving device 70 may each be implemented as an integrated circuit such as an LSI (Large Scale Integration). . Some functional blocks of the information processing device 10, the content storage server 30, the program information distribution server 50, the terminal device 60, and the receiving device 70 may be individually processorized, or a part or all of them may be integrated into a processor. may be changed. Also, the method of circuit integration is not limited to LSI, but may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integration circuit technology that replaces LSI appears due to advances in semiconductor technology, an integrated circuit based on this technology may be used.

Reference Signs List 1 information processing system 10 information processing apparatus 30 content storage server 40 broadcasting equipment 50 program information distribution server 60, 60b terminal device 70 receiving device 102 processor 104 storage medium , 106 drive section 108 input section 110 output section 112 ROM 114 RAM 116 auxiliary storage section 118 interface section 120 control section 122 program information acquisition section 126 content request part, 128... information providing part

Claims (10)

a program information acquisition unit that acquires program information including program-related information about the content of a broadcast program;
Program correspondence, which is content including image-related information corresponding to the program-related information, in a content storage unit that stores an image and content including image-related information about the image in association with user identification information indicating a user of the receiving device. a content requesting unit that requests notification of content;
an information providing unit that provides recommended program information indicating at least one of broadcast programs for which program-related content is notified from the content storage unit to a device of a user indicated by user identification information associated with the program-related content;
Information processing device. the program-related information includes a geographical name for the location represented in the broadcast program;
The information processing apparatus according to claim 1, wherein the content requesting unit requests notification of content including image-related information indicating the geographical name or a position indicated by the geographical name. The image-related information indicates latitude and longitude as the acquisition position of the image,
The content request unit
determining reference position information corresponding to the geographical name by referring to map data including latitude and longitude indicating the position of each geographical name as reference position information;
3. The information processing apparatus according to claim 2, wherein notification of content including position information corresponding to said reference position information as said image-related information is requested. The program-related information includes names of geographical features represented in the broadcast program,
The information processing apparatus according to claim 1, wherein the content requesting unit requests notification of content including the name of the geographical feature as the image-related information. The information providing unit
Identifying related user identification information associated with user identification information indicating a user of the device by referring to user data including related user identification information associated with each user identification information;
5. The information processing apparatus according to any one of claims 1 to 4, wherein the recommended program information further includes program information of a broadcast program whose program corresponding content is notified in association with the specified related user identification information. The information processing apparatus according to any one of claims 1 to 5, wherein the information providing unit further provides the device with an image included in the program corresponding content acquired from the content storage unit. From claim 1, wherein the information providing unit preferentially includes program information of a broadcast program having a short period from the present to the future broadcast start time or from the past broadcast end time to the present in the recommended program information. The information processing apparatus according to claim 6 . 8. The information processing according to any one of claims 1 to 7, wherein said information providing unit includes, in said recommended program information, program information of a broadcast program whose broadcast start time is after the end time of a broadcast program being broadcast. Device. The information providing unit does not include, in the recommended program information, program information of a broadcast program that has not been received by the user's device more than a predetermined number of times, among broadcast programs related to recommended program information transmitted to the user's device in the past. The information processing apparatus according to any one of claims 1 to 8. An information processing method in an information processing device,
a first step of acquiring program information including program-related information about the content of a broadcast program;
Program correspondence, which is content including image-related information corresponding to the program-related information, in a content storage unit that stores an image and content including image-related information about the image in association with user identification information indicating a user of the receiving device. a second step of requesting content notification;
a third step of providing recommended program information indicating at least one of the broadcast programs for which the program-corresponding content is notified from the content storage unit to the device of the user indicated by the user identification information associated with the program-corresponding content;
An information processing method comprising:

Images