JP2013102284A - Book mark management device, book mark management system, information processing terminal and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To collect information in which object a user is interested in a program which the user views.SOLUTION: A fixed receiver 2 transmits video data to a portable terminal 3 while a broadcast program is reproduced. When there is an interesting object while a user views the broadcast program by the fixed receiver 2, the user touches the object on a touch panel display of the portable terminal 3 displaying the broadcast program. The portable terminal 3 transmits program specification information on the broadcast program, touched time, and a touched position on a screen to a book mark management server 4. The book mark management server 4 stores object information showing a display region and display time of the object by the individual program, and reads and stores object identification information when object information in which the touch position is included in the display region and the touch time is included in the display time is specified among object information of the program specified by the received program specification information.

Description

  The present invention relates to a bookmark management device, a bookmark management system, an information processing terminal, and a program.

  In recent years, in the broadcasting industry, with the completion of digitalization of television broadcasting, further enhancement of functions of televisions such as those found in broadcast communication cooperation services such as Hybridcast (registered trademark) has been advanced. On the other hand, in the Internet industry, high-functional terminals such as smartphones and tablet terminals have become widespread, and users who use social network services (SNS) using these terminals are also increasing. In this way, with the advancement of broadcasting and Internet technology, the TV viewing style is changing. Recently, when watching a broadcast program on TV, you can search for information related to the program, such as the performer's profile or store information introduced in the program, using your mobile device. The number of viewers who use SNS to send opinions and impressions about programs is increasing.

  In addition, in Patent Document 1, when there is a place of concern while the user is watching a broadcast program, the time information is recorded as a bookmark, and information related to a scene in the program prepared in advance. Techniques for providing are described. With this technology, information related to a program can be acquired for each scene, and it can be searched using the Internet as a key.

JP 2010-87595 A

  In Patent Literature 1, when there is a scene that the user is interested in during the program, time information of the scene is transmitted from the user terminal to the server and recorded. However, generally, a plurality of objects are represented in one scene. In Patent Document 1, since only time information is used as a bookmark, it is not possible to determine which object in one scene is the target of the user's interest. For example, when a user bookmarks a scene where two people are having a conversation, it cannot be determined which person is interested. As described above, in the server that manages the bookmark of the user, it has not been possible to accurately obtain information about what object the user is interested in from the registered bookmark. For this reason, when the server provides related information to the user based on the bookmark, it cannot be determined which person is used as a key, and there is a risk of providing information that does not match the user's interest.

  The present invention has been made in consideration of such circumstances, and a bookmark management device, a bookmark management system, and information that can collect information on which object is interested in a program that the user is viewing A processing terminal and a program are provided.

[1] One embodiment of the present invention stores object identification information that identifies an object, program identification information that identifies a program, and object information that associates display time information and display area information of the object in the program. An object storage unit, a bookmark storage unit that stores object identification information of an object specified by the user in association with program identification information, program identification information corresponding to the object specified by the user, and the object A designated object information collecting unit that receives designated object information including designated time information indicating a designated time and designated position information indicating a designated position of the object on the video display screen of the program; and storing the designated object information in the object storage unit The previous object information The program specifying information in the specified object information is set, the time indicated by the specified time information in the specified object information is included in the time zone indicated by the display time information, and the specified object information The specified position indicated by the specified position information in the object specifies object information included in the display area indicated by the display area information, and the object identification information in the specified object information and the program specification in the specified object information A bookmark management unit comprising: a bookmark management unit that associates information and writes the information in the bookmark storage unit.
According to this aspect, the bookmark management server stores object information indicating in which area of each program each object is displayed at which time. The bookmark management server includes a specified object including program specifying information of a program being played back by the user on the information processing terminal, and specified time information and specified position information when the user specifies an object on the video display screen of the program. Receive information. The bookmark management device specifies object information based on program specifying information, specified time information, and specified position information set in specified object information, and stores object identification information read from the specified object information for each program as a bookmark storage unit. Write to.
Thereby, the bookmark management server can obtain information about which object is interested in a plurality of objects included in the program that the user is viewing. Therefore, it is possible to provide information about the designated object to the user and to obtain statistics on what object the user is interested in.

[2] One aspect of the present invention is a bookmark management system including a bookmark management device and an information processing terminal, the information processing terminal including a display unit that displays video and video of program data in the display unit. A reproduction unit to be displayed; an input unit that receives designation of an object by a user on a video display screen of the program data displayed on the display unit; and the program data corresponding to the object that is designated by the input unit Generating specified object information including program specifying information, specified time information indicating a time when the object is specified, and specified position information indicating a specified position of the object on the video display screen of the program; A designated object information generation unit to be transmitted to the management device. An object storage unit that stores object identification information that identifies a subject, program identification information that identifies a program, and object information that associates display time information and display area information of the object in the program, and is specified by a user A bookmark storage unit that stores object identification information of the selected object in association with program identification information, a specified object information collection unit that receives the specified object information from the information processing terminal, and the object storage unit that stores the object identification information. Among the object information, the program specifying information in the designated object information is set, and the time indicated by the designated time information in the designated object information is included in the time zone indicated by the display time information, In the specified object information The specified position indicated by the specified position information specifies object information included in the display area indicated by the display area information, and the object identification information in the specified object information and the program specifying information in the specified object information, A bookmark management unit that associates and writes to the bookmark storage unit.
According to this aspect, the information processing terminal reproduces and displays the video of the program received by broadcasting or communication. When the user designates an object on the video display screen of the program during the reproduction of the program, the information processing terminal designates the designated object including program identification information of the program being reproduced, designated time information and designated position information of the object Send information to the bookmark management device. The bookmark management apparatus stores object information indicating in which area of each program each object is displayed at which time. The bookmark management server identifies object information based on program identification information, designation time information and designation position information set in the received designated object information, and bookmarks the object identification information read from the identified object information for each program. Write to storage.
As a result, when there is an object of interest while watching a program, the user simply designates the object of interest on the screen on which the video of the program is displayed, It can be registered as a target (bookmark). For example, when the information processing terminal has a touch panel display, the user can register the object as a bookmark only by touching the position where the object is displayed while watching the program displayed on the touch panel display. it can. Therefore, the user can easily and reliably specify an object in the program as a target of interest. Then, the bookmark management server can obtain information on which object the user is interested in among a plurality of objects included in the program.

[3] One aspect of the present invention is the bookmark management system described above, wherein the object information further includes related information of the object, and the bookmark management unit specifies a program to be bookmarked from the information processing terminal. When the information is received, the object identification information corresponding to the received program acquisition information of the bookmark acquisition target is read from the bookmark storage unit, and the object information stored in the object storage unit is read by the read object identification information. Specifying and transmitting bookmark list data including the display time information and the related information read from the specified object information to the information processing terminal, wherein the information processing terminal is specified by the program specifying information to be bookmarked. Program data A program content acquisition unit that acquires and outputs to the playback unit and displays the video of the program data on the display unit, and the display time information and the related information in the bookmark list data received from the bookmark management device. Bookmark expansion for reading and displaying the information obtained from the information storage location indicated by the related information or the information stored at the time indicated by the display time information together with the video display screen of the program data displayed by the display unit And a section.
According to this aspect, when the bookmark management apparatus receives the program identification information to be bookmarked from the information processing terminal, the bookmark management apparatus identifies an object registered for the program of the received program identification information, and the display time information of the identified object And the related information are transmitted to the information processing terminal as bookmark list data. The information processing terminal obtains and displays the program data to be bookmarked from the communication or recording area and displays the data at the time when the object specified by the user is displayed in the program based on the received bookmark list data. Displays object related information.
As a result, the bookmark management device can cause the information processing terminal to display the related information of the object designated as the bookmark in the program together with the video in the program designated by the user after the user has viewed the program once. it can. Therefore, the user can concentrate on the program while viewing the program, and browse the information related to the object designated as the object of interest after the program ends. At this time, the user can browse the related information while confirming the object designated as the object of interest on the video.

[4] One aspect of the present invention is the bookmark management system described above, wherein the specified object information generation unit transmits specified object information further including user identification information, and the bookmark management unit includes the specified object. The object identification information in the object information identified based on the information, the program identification information in the designated object information, and the user identification information are associated and written to the bookmark storage unit, and a bookmark is acquired from the information processing terminal When the target program identification information and the user identification information are received, the received program identification information and the object identification information corresponding to the user identification information are read from the bookmark storage unit, and the read object identification information is used. The object The object information stored in the object storage unit is specified, and bookmark list data including the display time information and the related information read from the specified object information is transmitted to the information processing terminal. .
According to this aspect, the bookmark management apparatus registers an object designated for each program for each user. When the bookmark management apparatus receives the program identification information and user identification information to be bookmarked from the information processing terminal, the user of the user identification information identifies the object registered for the program of the program identification information, and the identified object Display time information and related information are transmitted as bookmark list data to the information processing terminal. Based on the bookmark list data, the information processing terminal obtains and displays the program specified by the program specifying information from the communication or recording area, and at the time when the object specified by the user is displayed in the program. Displays object related information.
As a result, the bookmark management apparatus displays the related information of the object specified by the specific user as the bookmark in the program together with the video in the program specified by the user, after the user once viewed the program. Can be made. For example, while viewing a program, the user can concentrate on the program and browse the information about the object that he or another user is interested in again after the program ends. At this time, the user can view related information while confirming on the video which object he or another user has designated as an object of interest.

[5] One aspect of the present invention is the bookmark management system described above, wherein the bookmark management unit responds to the received user identification information when receiving the user identification information to be bookmarked from the information processing terminal. The program specific information read out from the bookmark storage unit and returned to the information processing terminal, and the program specific information to be bookmarked selected from the returned program specific information is received from the information processing terminal. It is characterized by that.
According to this aspect, the bookmark management apparatus receives the user identification information to be bookmarked from the information processing terminal, and returns a list of programs in which the user of the received user identification information has registered the bookmark. Then, the bookmark management apparatus receives from the information processing terminal the program specifying information of the bookmark acquisition target program selected by the user from the program list.
Thereby, the bookmark management apparatus can display on the information processing terminal a list of programs for which the designated user has designated the bookmark, and can allow the user to select a program for which related information is to be displayed. Therefore, the user wants to obtain related information about the bookmark without having to input the program name or program identification information, which is difficult to input and is difficult to store accurately, into the information processing terminal. A program can be selected.

[6] One aspect of the present invention is the bookmark management system described above, wherein the bookmark management unit further transmits the bookmark list data including the display area information to the information processing terminal, and the bookmark expansion unit includes: The display unit displays the information obtained from the information storage location indicated by the related information or the related information by reading the display time information, the display area information, and the related information in the bookmark list data. It is characterized in that it is displayed on the video display screen of data at a display area indicated by the display area information at a time indicated by the display time information or at a position adjacent to the display area.
According to this aspect, the bookmark management device transmits bookmark list data further including display position information of the object specified in the bookmark acquisition target program specified by the user to the information processing terminal. The information processing terminal acquires and displays program data, and when the object designated as the bookmark is displayed in the program based on the bookmark list data, the display area of the object or the display of the object The related information of the object is displayed at a position adjacent to the area.
As a result, the bookmark management apparatus can cause the information processing terminal to display the related information of the object together with the video in the program in which the object designated as the bookmark is displayed after the user views the program once. it can. At this time, the information processing terminal displays the related information at a position where the object is displayed or a position adjacent to the display of the object. Therefore, the user can browse the content of the related information while comparing it with the video of the object that he / she cares about.

[7] One aspect of the present invention is the bookmark management system described above, wherein the information processing terminal includes a first information processing terminal and a second information processing terminal, and the first information processing terminal displays video. A video display unit for displaying; an audio output unit for outputting audio; a video playback unit for displaying video of program data received by broadcasting or communication on the video display unit; and audio for the program data in the audio output unit An audio reproduction unit to be output; and a video conversion unit that generates video data obtained by encoding video of the program data and transmits the video data to the second information processing terminal, wherein the second information processing terminal includes the display unit The playback unit, the input unit, and the designated object information generation unit, wherein the playback unit displays the video data received from the first information processing terminal on the display unit. To do.
According to this aspect, the first information processing terminal reproduces the program data received by broadcasting or communication, generates video data from the program data, and transmits it to the second information processing terminal. The second information processing terminal reproduces the video data of the program received from the first information processing terminal and displays it on the display unit. When the user designates an object on the video display screen of the program during the reproduction of the video data, The specified object information including the program specifying information of the program data being reproduced and the specified time information and specified position information of the object is transmitted to the bookmark management apparatus.
Thereby, the user designates the position where the object is displayed by the portable user terminal (second information processing terminal) while watching the program by the fixed television receiver (first information processing terminal). be able to. Therefore, the user can quickly and easily designate an object that is interested in a user terminal such as a mobile phone or a tablet terminal as a bookmark while enjoying a program on the large screen of the television receiver.

[8] According to one aspect of the present invention, a display unit that displays video, a playback unit that displays video of program data on the display unit, and a video display screen of the program data displayed on the display unit An input unit that receives designation of an object by the program, program specifying information of the program data corresponding to the object that has been designated by the input unit, designated time information indicating a time when the object is designated, and the program Generating a specified object information including a specified position information indicating a specified position of the object on the video display screen, and transmitting the specified object information to the bookmark management device; and specifying the program to be bookmarked by the bookmark management device. A transmission unit that transmits information, and the program identification information that is acquired by the transmission unit and that is the target of bookmark acquisition. Corresponding to the information, the receiving unit for receiving the bookmark list data including the display time information and the related information of the specified object from the bookmark management device, and the program data specified by the program specifying information of the bookmark acquisition target is acquired The program content acquisition unit that outputs to the playback unit and displays the video of the program data on the display unit, and reads the display time information and the related information in the bookmark list data received from the bookmark management device In addition to the video display screen of the program data displayed by the display unit, the bookmark development unit that displays the related information or the information obtained from the information storage location indicated by the related information at the time indicated by the display time information. And an information processing terminal.
According to this aspect, the information processing terminal reproduces and displays the video of the program received by broadcasting or communication. When the user designates an object on the video display screen of the program during the reproduction of the program, the information processing terminal designates the designated object including program identification information of the program being reproduced, designated time information and designated position information of the object Send information to the bookmark management device. In addition, the information processing terminal transmits a program specified as a bookmark acquisition target by the user to the bookmark management apparatus, and receives display time information and related information of an object specified in the program as bookmark list data. The information processing terminal obtains and displays the program data to be bookmarked from the communication or recording area and displays the data at the time when the object specified by the user is displayed in the program based on the received bookmark list data. Displays object related information.
As a result, when there is an object of interest while watching the program, the information processing terminal simply designates the object of interest on the screen on which the video of the program is displayed, and It can be registered as an object of interest (bookmark). Then, once the user views the program, the related information of the object designated as the bookmark can be displayed together with the video in the program. Therefore, the user can concentrate on the program while viewing the program, and browse the information related to the object designated as the object of interest after the program ends. At this time, the user can browse the related information while confirming the object designated as the object of interest on the video.

[9] According to one aspect of the present invention, a computer used in the bookmark management apparatus includes: object identification information that identifies an object; program identification information that identifies a program; display time information and display area information of the object in the program An object storage unit that stores object information associated with each other, a bookmark storage unit that stores object identification information of an object designated by the user in association with program identification information, and program identification information corresponding to the object designated by the user A designated object information collecting unit that receives designated object information including designated time information indicating a time when the object is designated, and designated position information indicating a designated position of the object on the video display screen of the program; In the object storage unit Among the stored object information, a time zone in which the program specifying information in the designated object information is set and the time indicated by the designated time information in the designated object information is indicated by the display time information And the object identification information in the specified object information is specified by specifying the object information included in the display area indicated by the display area information in the specified position information indicated by the specified position information in the specified object information. And a bookmark management unit that associates the program specifying information in the designated object information with each other and writes the program specifying information in the bookmark storage unit.

  According to the present invention, it is possible to collect information about which object is interested in a program that the user is viewing.

1 is an overall configuration diagram of a bookmark management system according to an embodiment of the present invention. It is a functional block diagram of the fixed receiver according to the same embodiment. It is a functional block diagram of the portable terminal by the same embodiment. It is a functional block diagram of the bookmark management server by the embodiment. It is a figure which shows the data setting example of the touch information by the embodiment. It is a figure which shows the data structural example of the user information by the embodiment. It is a figure which shows the data structural example of the program information by the embodiment. It is a figure which shows the data structural example of the object information by the embodiment. It is a figure showing an example of data composition of touch information management data by the embodiment. It is a figure which shows the example of a data structure of the bookmark management data by the embodiment. It is a figure which shows the data structural example of the unregistered object information by the embodiment. It is a figure which shows the data structural example of the bookmark program list data by the embodiment. It is a figure which shows the data structural example of the bookmark list data by the embodiment. It is a figure for demonstrating the method of showing the display area of the object by the embodiment. It is a figure which shows the touch information registration sequence of the bookmark management system by the embodiment. It is a figure which shows the bookmark utilization sequence of the bookmark management system by the embodiment. It is a figure which shows the processing flow of the bookmark management server in step S170-S175 of FIG. It is a figure which shows the processing flow of the bookmark management server in step S220 of FIG. It is a figure which shows the processing flow of the bookmark management server in step S240 of FIG. It is a figure which shows the example of a screen display of the bookmark program list by the embodiment. It is a figure which shows the example of a screen display of the bookmark by the embodiment. It is a figure which shows the other example of a screen display of the bookmark by the same embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
FIG. 1 is an overall configuration diagram of a bookmark management system according to an embodiment of the present invention. As shown in the figure, the bookmark management system includes a broadcast transmission device 1, a fixed reception device 2 (first information processing terminal), a portable terminal 3 (second information processing terminal), and a bookmark management server 4 (bookmark management device). , A VoD (Video On Demand) distribution server 5 and a related information distribution server 6.

  The broadcast transmission device 1, the bookmark management server 4, the VoD distribution server 5, and the related information distribution server 6 are devices owned by the content transmission side provider. Although only one broadcast transmission device 1, VoD distribution server 5, and related information distribution server 6 are shown in the figure, a plurality of units may be provided. Further, the content transmission side operators possessing the broadcast transmission device 1, the bookmark management server 4, the VoD distribution server 5, and the related information distribution server 6 may be the same or different.

  The fixed receiver 2 and the portable terminal 3 constitute an information processing terminal held by a user who is a program viewer. In the figure, only one fixed receiving device 2 and one portable terminal 3 are shown, but in reality, a plurality of devices are provided.

  The broadcast transmission device 1 provides a television broadcast service. There are a plurality of types of television broadcast services. In this embodiment, a case where a digital television broadcast service based on an ISDB (Integrated Services Digital Broadcasting) method is used will be described.

  The fixed receiver 2 is, for example, a television receiver installed in a user's house or the like, and receives a broadcast wave transmitted from the broadcast transmitter 1. The mobile terminal 3 is a tablet terminal or a smartphone equipped with a touch panel display. The fixed receiving device 2 and the portable terminal 3 communicate with each other by local communication. The fixed receiving device 2 and the portable terminal 3 communicate with the bookmark management server 4, the VoD distribution server 5, and the related information distribution server 6 via the Internet 7.

  The user views the broadcast program with the fixed receiver 2. At this time, the broadcast program being viewed is also displayed on the touch panel display of the mobile terminal 3. For example, if the mobile terminal 3 has a one-segment or full-segment tuner for receiving broadcasts, a broadcast program received by the tuner is displayed. On the other hand, when the tuner is not provided, the mobile terminal 3 displays the broadcast program retransmitted from the fixed receiver 2 using local communication.

  The user is interested on the screen of the touch panel display of the mobile terminal 3 on which the video of the broadcast program is displayed when there is an object of interest while viewing the broadcast program with the fixed receiver 2. Specify the object by touching it with your finger. The object designated by the user is referred to as “bookmark”, and an operation in which the user designates an object as a bookmark is referred to as “bookmark operation”. The object includes, for example, a performer, clothes worn by the performer, the location of the scene being reflected, and information on the telop. Since the broadcast program viewed by the fixed receiver 2 is displayed on the touch panel display of the mobile terminal 3, the user can perform a bookmark operation reliably and easily at hand.

  Information on the object touched by the user (designated as a bookmark) is transmitted from the portable terminal 3 to the bookmark management server 4 and managed. After viewing the broadcast program, the user accesses the bookmark management server 4 from the fixed receiver 2 or the portable terminal 3 and searches and browses information related to the touched object (bookmark). At this time, not only displaying a bookmark as a list for each broadcast program, but also displaying a broadcast program distributed as VoD from the VoD distribution server 5 or a broadcast program recorded in the fixed receiver 2, In addition, bookmarks can be displayed as the program progresses.

  In the following, an embodiment in which the mobile terminal 3 does not have a tuner and displays a broadcast program retransmitted from the fixed receiving apparatus 2 using local communication will be described. Furthermore, an embodiment will be described in which bookmarks are displayed while a broadcast program distributed as VoD is played by the fixed receiving device 2 or the portable terminal 3.

First, each device constituting the bookmark management system will be described.
The broadcast transmission apparatus 1 is a general digital broadcast broadcasting facility including a program organization facility, a program transmission facility, a transmission facility, and the like. A broadcaster broadcasts a broadcast program by a broadcast signal using the broadcast transmission device 1.

  The fixed receiver 2 is a general television receiver having a digital broadcast receiving function and an Internet connection function, and a function for handling bookmarks is installed as an application. Details of the internal configuration of the fixed receiving apparatus 2 will be described later with reference to FIG.

  The portable terminal 3 is a portable computer terminal equipped with an Internet connection function and a touch panel display, such as a tablet terminal or a smartphone, and has a function for handling bookmarks as an application. Details of the internal configuration of the mobile terminal 3 will be described later with reference to FIG.

  The bookmark management server 4 is a computer server that manages bookmarks handled by the fixed receiving device 2 and the portable terminal 3. Details of the internal configuration of the bookmark management server 4 will be described later with reference to FIG.

  The VoD distribution server 5 is a general VoD distribution computer server that distributes moving image content data via the Internet 7. The moving image includes the same program as the broadcast program broadcast from the broadcast transmission device 1. The fixed receiver 2 and the mobile terminal 3 can receive and display content data of a moving image (program) distributed from the VoD distribution server 5.

  The related information distribution server 6 is a computer server that distributes related information of bookmarks as content data. The related information distribution server 6 includes not only a computer server for distributing related information of a company that manages bookmarks, but also a computer server of another company that provides a general Web site.

  FIG. 2 is a block diagram showing the configuration of the fixed receiving apparatus 2, and only functional blocks related to this embodiment are extracted and shown. As shown in the figure, the fixed receiver 2 includes a broadcast receiving unit 201, a storage unit 202, a separation unit 203, a channel selection / program acquisition unit 204, a device cooperation unit 205, a terminal information management unit 206, and a video reproduction unit 207. , Display 208 (video display unit), audio reproduction unit 209, speaker 210 (audio output unit), video conversion unit 211, user input unit 212, communication input / output unit 213, user information management unit 214, bookmark program list acquisition unit 215 , A bookmark expansion unit 216, and a VoD acquisition unit 217.

  The broadcast receiving unit 201 is a general tuner that receives and demodulates digital broadcast broadcast signals. The accumulation unit 202 is a storage unit that records and accumulates broadcast signals. The separation unit 203 is a general demultiplexer, which is demodulated by the broadcast reception unit 201 and output MPEG (Moving Picture Experts Group) -2 TS (Transport Stream) signal as video data, audio data, PSI / SI ( Separated into Program Specific Information / Service Information) data.

  The video reproduction unit 207 decodes and reproduces the video data of the broadcast program and the video data of the program content data. The display 208 displays the video reproduced by the video reproduction unit 207 and the data input from the bookmark development unit 216. The audio reproduction unit 209 decodes and reproduces the audio data of the broadcast program and the audio data of the program content data. The speaker 210 outputs the sound reproduced by the sound reproducing unit 209.

  The channel selection / program acquisition unit 204 acquires channel selection information and program information of the program being reproduced. Specifically, the channel selection / program acquisition unit 204 acquires channel selection information and program information from the PSI / SI of the broadcast signal. The video conversion unit 211 converts the resolution and encoding method of the video data input from the separation unit 203 in order to transmit a broadcast video to the mobile terminal 3 that cooperates with the fixed receiving device 2. Note that video data is encrypted by local encryption in order to protect the copyright of the broadcast video.

  The device cooperation unit 205 transmits / receives data to / from the mobile terminal 3 through local communication such as WiFi (registered trademark) or Bluetooth (registered trademark). The device cooperation unit 205 acquires a device identifier (device_id) for identifying the mobile terminal 3 from the terminal information management unit 206 in order to associate the fixed reception device 2 and the mobile terminal 3, and performs device authentication. The terminal information management unit 206 manages the device identifier (device_id) of the mobile terminal 3.

  The user input unit 212 is an interface that receives an operation by a user. The user input unit 212 receives data input by, for example, a remote controller or a key.

  The communication input / output unit 213 is an interface for communicating with the bookmark management server 4, the VoD distribution server 5, and the related information distribution server 6 via the Internet 7. Further, the communication input / output unit 213 transmits the user identifier (user_id) acquired from the user information management unit 214 to the bookmark management server 4 or the VoD distribution server 5 and requests user authentication. The user information management unit 214 manages a user identifier (user_id). The user identifier (user_id) is information for identifying a user who uses the fixed receiving device 2 or the portable terminal 3.

  The bookmark program list acquisition unit 215 acquires bookmark program list data indicating a list of programs with bookmarks from the bookmark management server 4. Further, when the bookmark program list acquisition unit 215 receives information on a program selected from the bookmark program list data by the user input unit 212, the bookmark program list acquisition unit 215 sets the content identifier (content_id) of the selected program to the bookmark management server 4 and the bookmark development unit. 216 is notified.

When the content identifier (content_id) of the program selected from the bookmark program list acquisition unit 215 is input, the bookmark development unit 216 transfers it to the VoD acquisition unit 217 to instruct acquisition of program content data. Further, the bookmark development unit 216 receives the bookmark list data returned by notifying the bookmark management server 4 of the content identifier (content_id) of the program selected by the bookmark program list acquisition unit 215. The bookmark list data indicates a list of bookmarks and describes the display time, display area, and related information of each bookmark. The display time is indicated by a display start time and a display end time, and these are represented by times based on the beginning of the program. The bookmark expansion unit 216 synchronizes the reproduction time acquired from the video reproduction unit 207 and the display time of the bookmark, and displays related information on the bookmark on the display 208. Further, when the acquisition destination of the related information is described in the bookmark list data, the bookmark expanding unit 216 acquires the related information of the bookmark from the related information distribution server 6 specified by the acquisition destination, and displays it on the display 208. .
The VoD acquisition unit 217 acquires the program content data of the content identifier (content_id) input from the bookmark development unit 216 from the VoD distribution server 5.

  FIG. 3 is a block diagram showing the configuration of the mobile terminal 3, and only the functional blocks related to the present embodiment are extracted and shown. As shown in the figure, the mobile terminal 3 includes a communication input / output unit 301 (reception unit, transmission unit), a user information management unit 302, a device cooperation unit 303, a terminal information management unit 304, and a video reproduction unit 305 (reproduction unit). , Touch panel display 306 (display unit, input unit), touch information generation unit 307 (designated object information generation unit), clock 308, bookmark program list acquisition unit 309, bookmark expansion unit 310, and VoD acquisition unit 311. The

  The communication input / output unit 301 is an interface for communicating with the bookmark management server 4, the VoD distribution server 5, and the related information distribution server 6 via the Internet 7. Further, the communication input / output unit 301 transmits the user identifier (user_id) acquired from the user information management unit 302 to the bookmark management server 4 or the VoD distribution server 5 and requests user authentication. The user information management unit 302 manages a user identifier (user_id).

  The device cooperation unit 303 transmits and receives data to and from the fixed receiving device 2 through local communication. The device cooperation unit 303 acquires a device identifier (device_id) from the terminal information management unit 304 and performs device authentication in order to associate the fixed receiving device 2 and the mobile terminal 3 with each other. The terminal information management unit 304 manages the device identifier (device_id) of the mobile terminal 3.

  The video playback unit 305 decodes the video data of the broadcast video received by the device cooperation unit 303 from the fixed receiving device 2 through local communication, outputs the video data to the touch panel display 306, and plays back. The touch panel display 306 displays video data input from the video playback unit 305 and data input from the bookmark development unit 310. Furthermore, when the user performs a bookmark operation in which the user touches the playback video displayed on the touch panel display 306 by the video playback unit 305 with a finger or a pen, the touch information generation unit 307 is notified of information indicating the touched position. . When the bookmark expanding unit 310 touches the data displayed on the touch panel display 306, the bookmark expanding unit 310 is notified of information indicating the touched position. The clock 308 generates time information.

  The touch information generation unit 307 generates touch information (designated object information) including channel selection information, program information, designated time information, designated position information, and a user identifier. The channel selection information and the program information are notified from the fixed receiver 2 via the device cooperation unit 303. The designated time information indicates the time when the user touches the object, and is acquired from the clock 308. The designated position information indicates a position on the screen where the user touches the object, and is notified from the touch panel display 306. The user identifier is acquired from the user information management unit 302. The channel selection information, program information, and designated time information are used as information for specifying a broadcast program. In addition, since it is assumed that the resolution of the touch panel display 306 varies depending on the device, the designated position information represents the pixel position touched by the user by coordinates expressed as a relative value with respect to the number of pixels of the touch panel display 306.

  The bookmark program list acquisition unit 309 acquires bookmark program list data from the bookmark management server 4. When the bookmark program list acquisition unit 309 receives information on the program selected by the user from the bookmark program list data from the touch panel display 306, the bookmark management server 4 and the bookmark development unit 310 receive the content identifier (content_id) of the selected program. Notify

When the content identifier (content_id) of the program selected from the bookmark program list acquisition unit 309 is input, the bookmark development unit 310 transfers it to the VoD acquisition unit 311 and instructs acquisition of program content data. Further, the bookmark development unit 310 receives the bookmark list data returned by the bookmark program list acquisition unit 215 notifying the bookmark management server 4 of the content identifier (content_id) of the selected program. The bookmark expanding unit 310 synchronizes the reproduction time acquired from the video reproduction unit 305 and the display time of the bookmark, and displays related information on the bookmark on the touch panel display 306. Further, when the bookmark list data describes the acquisition destination of the related information, and the user touches the bookmark displayed on the touch panel display 306, the bookmark expanding unit 310 distributes the related information specified by the acquisition destination. Information related to the bookmark is acquired from the server 6 and displayed on the touch panel display 306.
The VoD acquisition unit 311 acquires the program content data of the content identifier (content_id) input from the bookmark development unit 310 from the VoD distribution server 5.

  FIG. 4 is a block diagram showing the configuration of the bookmark management server 4 and shows only functional blocks related to the present embodiment. As shown in the figure, the bookmark management server 4 includes a server cooperation unit 401, a program information database 402 (hereinafter referred to as “DB”), an object DB 403 (object storage unit), a communication input / output unit. 404, authentication unit 405, user DB 406, touch information collection unit 407 (designated object information collection unit), touch information DB 408, bookmark management unit 409, bookmark DB 410 (bookmark storage unit), unregistered object DB 411, and bookmark transmission unit 412. It is prepared for.

  The program information DB 402, object DB 403, user DB 406, touch information DB 408, bookmark DB 410, and unregistered object DB 411 are realized by a hard disk device, a semiconductor memory, or the like.

The program information DB 402 stores program information for integrating and managing the broadcast program broadcast from the broadcast transmission apparatus 1 and the content identifier (content_id) of the VoD content distributed from the VoD distribution server 5. The program information indicates a correspondence between a content identifier (content_id) and information for specifying a broadcast program (channel selection information, program information, and broadcast date and time).
The object DB 403 stores object information in which a program in which an object is displayed, an object display area and display time in a program video, and attribute information indicating information about the object such as related information and a source of the related information are associated with each other. .

The user DB 406 stores user information for registering and managing users who use the bookmark management server 4.
The touch information DB 408 stores touch information management data for managing touch information received from the mobile terminal 3.

The bookmark DB 410 stores bookmark management data for managing each user's bookmark.
The unregistered object DB 411 stores unregistered object information for managing objects that have been bookmarked by the user but are not registered in the object DB 403. The unregistered object DB 411 is used for the administrator of the bookmark management server 4 to grasp unregistered objects. In addition, when a business entity newly registers an object registered in the unregistered object DB 411 in the object DB 403, the business operator deletes the corresponding data in the unregistered object DB 411.

  The server cooperation unit 401 is an interface for communicating with the broadcast transmission device 1 and the VoD distribution server 5. The program information DB 402 is connected to the broadcast transmission device 1 and the VoD distribution server 5 via the server cooperation unit 401.

  The communication input / output unit 404 is an interface for communicating with the fixed receiver 2 and the portable terminal 3 via the Internet 7. The authentication unit 405 authenticates a user who uses the bookmark management server 4 based on the user identifier (user_id) received from the fixed receiving device 2 or the portable terminal 3. The authentication unit 405 issues a user identifier (user_id) when the user uses the bookmark management server 4 for the first time, and registers it in the user DB 406. Thereafter, the authentication unit 405 determines whether the user identifier (user_id) is registered when accessed from the fixed receiving device 2 or the portable terminal 3. Allow use.

The touch information collection unit 407 receives touch information generated by the mobile terminal 3 and registers it in touch information management data stored in the touch information DB 408.
The bookmark management unit 409 acquires data registered in the touch information DB 408, the program information DB 402, and the object DB 403 in order to collect the touch information received from the mobile terminal 3 and manage it as bookmark management data. Perform data construction. In addition, the bookmark management unit 409 generates bookmark program list data and bookmark list data with reference to the bookmark DB 410 and the object DB 403 and outputs the bookmark program list data to the bookmark sending unit 412 so that the user can use the bookmark. .

  The bookmark sending unit 412 receives a bookmark acquisition request from the fixed receiving device 2 or the portable terminal 3, and receives the bookmark program list data and the bookmark list data generated by the bookmark management unit 409 as the fixed receiving device 2 or the portable terminal 3. Return to

  Next, various data used in the bookmark management system will be described.

FIG. 5 is a diagram illustrating a data setting example of touch information. In the figure, touch information is described in XML (extensible markup language) as a general-purpose format, but other description formats may be used.
The touch information indicates channel selection information, program information, designated time information, designated position information, and a user identifier. It is used as information for specifying a broadcast program by a combination of channel selection information and program information, or a combination of channel selection information, program information and designated time information. The channel selection information indicates a broadcast station of a broadcast program in which the user has touched an object (performed a bookmark operation). As the channel selection information, a network ID (network_id) described in the NIT (Network Information Table) of the broadcast signal and a service ID (service_id) described in the SDT (Service Description Table) of the broadcast signal are used. The program information indicates a broadcast program in which the user touches the object, and an event ID (event_id) described in an EIT (Event Information Table) of the broadcast signal is used. The designated time information (time_stamp) indicates the time when the user touches the object. The designated position information indicates a position on the screen where the user touches the object, and is represented by a relative coordinate position (x) in the x-axis direction and a relative coordinate position (y) in the y-axis direction. The user identifier (user_id) specifies the user who touched the object.

  FIG. 6 is a diagram illustrating a data configuration example of user information stored in the user DB 406. As shown in the figure, the user information stores a user identifier (user_id), which is a primary key, and personal information such as the user's name in association with each other.

  FIG. 7 is a diagram illustrating a data configuration example of program information stored in the program information DB 402. As shown in the figure, program information includes a content identifier (content_id) that uniquely identifies a broadcast program, a network ID (network_id), a service ID (service_id), an event ID (event_id), a broadcast date and time, And the program name. The primary key is a network ID (network_id), a service ID (service_id), and an event ID (event_id). The broadcast date / time information indicates the broadcast date, broadcast start time, and broadcast end time. For example, in the case of a rebroadcast broadcast program, the event ID and broadcast date / time are different, but the content identifier (content_id) is the same.

  FIG. 8 is a diagram illustrating a data configuration example of object information stored in the object DB 403. As shown in the figure, the object information includes an object identifier (object_id) as a primary key, a content identifier (content_id), object display area information, display time information, and attribute information 1 to attribute information n (hereinafter collectively referred to as generic names). Is described as “attribute information”). n is the number of attributes.

  The display area information indicates the coordinates of the area (area) where the object is displayed in the video of the program. The display time information indicates the display start time and display end time of the object in the video of the program. The display start time and the display end time are represented by a time based on the beginning of the program. The attribute information indicates the object name, the content of the related information of the object, a link (information storage location) to the related information of the object, and the like. The link to the related information indicates a URL (Universal Resource Locator) of a web page that provides the related information as content data. Note that the content of related information or data without a link to the related information may be null.

  FIG. 9 is a diagram illustrating a data configuration example of touch information management data stored in the touch information DB 408. As shown in the figure, the touch information management data includes a touch identifier (touch_id) as a primary key, a user identifier (user_id) acquired from the touch information, a network ID (network_id), a service ID (service_id), and an event ID ( event_id), specified time information, and specified position information.

  FIG. 10 is a diagram illustrating a data configuration example of bookmark management data stored in the bookmark DB 410. As shown in the figure, the bookmark management data includes a user identifier (user_id) as a primary key, a content identifier (content_id) of a program with a bookmark, a program name, a broadcast date / time or a viewing date / time, and an object identifier (object_id). ).

  FIG. 11 is a diagram illustrating a data configuration example of unregistered object information stored in the unregistered object DB 411. As shown in the figure, unregistered object information includes a touch identifier (touch_id) as a primary key, a content identifier (content_id) of a program for which a bookmark operation has been performed, specified time information and specified position information acquired from the touch information. Is information that associates. The specified time information of the unregistered object information is represented by a time based on the program start time.

  FIG. 12 is a diagram illustrating a data configuration example of bookmark program list data notified from the bookmark management server 4. As shown in the figure, the bookmark program list data is information in which a user identifier (user_id) is associated with a content identifier (content_id) of a program to which a bookmark is attached, a broadcast date and time, a viewing date and time, and a program name. It is.

  FIG. 13 is a diagram illustrating a data configuration example of bookmark list data notified from the bookmark management server 4. As shown in the figure, the bookmark list data includes a user identifier (user_id), a content identifier (content_id) and a program name of a bookmarked program, an object identifier (object_id) of each bookmark, and an object identifier (object_id). Display area information, display time information, and attribute information are shown. The display area information, display time information, and attribute information are the same as the display area information, display time information, and attribute information of the object information, respectively.

  FIG. 14 is a diagram for explaining a method of representing a display area of an object. It is assumed that the resolution of the touch panel display 306 included in the mobile terminal 3 varies depending on the device. Therefore, the display area information indicating the display position of the object and the designated position information indicating the position on the screen touched by the user are represented by relative positions.

  As shown in the figure, the program display area on the touch panel display 306 of the portable terminal 3 is 1920 pixels in the horizontal (x-axis direction) × 1080 pixels in the vertical (Y-axis direction). And, from T seconds to (T + α) seconds from the broadcast start time, (pixels in the x-axis direction, pixels in the Y-axis direction) are (300, 100), (700, 100), (300, 600), Assume that the object A is displayed in the display area of the broadcast screen surrounded by four points (700, 600). In this case, the display area information of the object A is (300/1920, 100/1080), (700/1920, 100/1080), (300/1920, 600/1080), (700/1920, 600/1080). It is expressed as

  Similarly, the position touched by the user is also expressed as “(pixel position in the touched x-axis direction / total number of pixels in the x-axis direction of the touch panel display 306”, “pixel position in the touched y-axis direction / y axis of the touch panel display 306”. The total number of pixels in the direction ")". For example, when the touch position (pixels in the x-axis direction and pixels in the Y-axis direction) is (600, 400), the designated position information is expressed as (600/1920, 400/1080). .

Next, the operation of the bookmark management system will be described.
First, the server cooperation unit 401 of the bookmark management server 4 registers program information received from the broadcast transmission apparatus 1 in the program information DB 402 in advance. Further, the server cooperation unit 401 of the bookmark management server 4 registers the object information received from the broadcast transmission device 1 or the VoD distribution server 5 in the object DB 403.

  The user accesses the bookmark management server 4 from the mobile terminal 3 to transmit user personal information, and performs user registration processing. Thereby, the authentication unit 405 of the bookmark management server 4 issues a new user identifier (user_id) and registers user information in the user DB 406, and the communication input / output unit 404 uses the issued user identifier (user_id). Notify the mobile terminal 3. The user information management unit 302 of the mobile terminal 3 stores the user identifier (user_id) received via the communication input / output unit 301. Further, the user identifier (user_id) is also stored in the user information management unit 214 of the fixed receiving apparatus 2.

  FIG. 15 is a diagram showing a touch information registration sequence of the bookmark management system. The sequence shown in the figure is the fixed receiving device 2 when the user touches an object of interest in the broadcast program on the touch panel display 306 of the portable terminal 3 and the bookmark management server 4 collects the touch information. , Data exchange between the portable terminal 3 and the bookmark management server 4 is shown.

  In the figure, the device cooperation unit 303 of the mobile terminal 3 reads the device identifier (device_id) of the own terminal from the terminal information management unit 304 and transmits it to the fixed receiving apparatus 2 (step S105). Further, the communication input / output unit 301 reads the user identifier (user_id) from the user information management unit 302 and transmits it to the bookmark management server 4 (step S110).

  The communication input / output unit 404 of the bookmark management server 4 receives the user identifier (user_id) transmitted from the mobile terminal 3 via the Internet 7 and outputs it to the authentication unit 405. The authentication unit 405 determines that the authentication is successful if the user identifier (user_id) input from the communication input / output unit 404 is registered in the user information stored in the user DB 406, and a response (ACK) that sets authentication OK. ) Is output to the communication input / output unit 404 (step S115). The communication input / output unit 404 returns a response (ACK) to the mobile terminal 3 that is the transmission source of the user identifier (user_id) (step S120). When the communication input / output unit 301 of the mobile terminal 3 receives a response (ACK) via the Internet 7, it determines that the user authentication is successful.

  On the other hand, the device cooperation unit 205 of the fixed receiving device 2 receives the device identifier (device_id) transmitted from the mobile terminal 3 by local communication. If the received device identifier (device_id) is the same as the device identifier (device_id) managed by the terminal information management unit 206, the device cooperation unit 205 determines that the authentication is successful (step S125). The device cooperation unit 205 returns a response (ACK) in which authentication OK is set to the mobile terminal 3 (step S130), and when the device cooperation unit 303 of the mobile terminal 3 receives the response (ACK), the terminal authentication is successful. Judge.

  The broadcast receiving unit 201 of the fixed receiving device 2 receives the broadcast signal broadcast from the broadcast sending device 1 and demodulates it. The separation unit 203 separates the broadcast signal demodulated by the broadcast reception unit 201 into video data, audio data, and PSI / SI, and outputs the separated data.

  The channel selection / program acquisition unit 204 acquires channel selection information and program information of the currently received broadcast program from the PSI / SI output from the separation unit 203 (step S135). As the channel selection information, a network ID (network_id) described in an NIT (Network Information Table) and a service ID (service_id) described in an SDT (Service Description Table) are used. As the program information, an event ID (event_id) described in an EIT (Event Information Table) is used. The channel selection / program acquisition unit 204 outputs channel selection information in which the network ID (network_id) and service ID (service_id) are set, and program information in which the event ID (event_id) is set to the device linkage unit 205, and the device linkage unit 205 transmits channel selection information and program information to the portable terminal 3 (step S140). The device cooperation unit 303 of the mobile terminal 3 outputs the received channel selection information and program information to the touch information generation unit 307.

  The video reproduction unit 207 of the fixed receiver 2 decodes the video data input from the separation unit 203 and causes the display 208 to display the video of the broadcast program based on the video data. At the same time, the audio reproduction unit 209 causes the speaker 210 to output the audio of the broadcast program based on the audio data input from the separation unit 203. The video conversion unit 211 converts the resolution and encoding method of the video data output from the separation unit 203, and generates and outputs encrypted video data (step S145). The device cooperation unit 205 transmits the video data input from the video conversion unit 211 to the mobile terminal 3 as a video stream (step S150).

  The device cooperation unit 303 of the portable terminal 3 outputs the video stream received from the fixed receiving device 2 to the video reproduction unit 305. The video playback unit 305 decodes the video stream input from the device cooperation unit 303 and displays the video of the broadcast program based on the video data obtained by the decoding on the touch panel display 306 (step S155).

  When a user is watching a broadcast program with the fixed receiving device 2 and there is an object of interest, the user displays the object on the video display screen of the broadcast program displayed on the touch panel display 306 of the mobile terminal 3. The object is touched with a finger or a touch pen (step S160). The touch panel display 306 outputs designated position information indicating the x-coordinate pixel and the y-coordinate pixel of the touched position to the touch information generation unit 307.

  The touch information generation unit 307 converts the designated position information input from the touch panel display 306 into designated position information using a relative position. The touch information generation unit 307 receives the channel selection information (network_id, service_id) and program information (event_id) received in step S140, the specified position information using the relative position, and the specified time indicating the current time output from the clock 308. Touch information in which information (time_stamp) and a user identifier (user_id) read from the user information management unit 302 are set is generated (step S160). The touch information generation unit 307 outputs the generated touch information to the communication input / output unit 301 and instructs transmission to the bookmark management server 4. The communication input / output unit 301 transmits the touch information input from the touch information generation unit 307 to the bookmark management server 4 (step S165).

  The bookmark management server 4 generates touch information management data based on the touch information received from the portable terminal 3 via the Internet 7 and stores it in the touch information DB 408 (step S170). Furthermore, the bookmark management server 4 registers the bookmark management data generated based on the received touch information in the bookmark DB 410 (step S175).

FIG. 17 is a diagram showing a detailed processing flow of the bookmark management server 4 in steps S170 to S175 of FIG.
The communication input / output unit 404 of the bookmark management server 4 outputs the received touch information to the touch information collection unit 407. When touch information is input from the communication input / output unit 404, the touch information collection unit 407 assigns a new touch identifier (touch_id). The touch information collection unit 407 includes the assigned touch identifier (touch_id), channel selection information (network_id, service_id) described in the touch information, program information (event_id), designated position information, designated time information, and a user identifier (user_id). ) Is generated and registered in the touch information DB 408 (step S505).

  When new touch information management data is registered in the touch information DB 408, the bookmark management unit 409 reads channel selection information, program information, and designated time information from the registered touch information management data. From the time indicated by the designated time information, the bookmark management unit 409 searches the program information DB 402, and the read channel selection information (network_id, service_id) and program information (event_id) are set and read. The program information whose date and time indicated by the designated time information is included in the broadcast date and time is specified. The bookmark management unit 409 acquires information on the content identifier (content_id), the program name, and the broadcast date and time of the broadcast program touched by the user from the specified program information (step S510).

  The bookmark management unit 409 searches the object DB 403 and extracts object information in which the acquired content identifier (content_id) is set (step S515). The bookmark management unit 409 reads display time information from the extracted object information. Further, the bookmark management unit 409 subtracts the date and time indicated by the broadcast date and time of the broadcast date and time read in step S510 from the date and time indicated by the specified time information of the newly registered touch information management data, A designated time is calculated based on the broadcast start time. The bookmark management unit 409 determines whether or not the time zone indicated by any of the read display time information includes the designated time calculated with reference to the broadcast start time (step S520).

  When it is determined that the specified time is included in the time zone indicated by any of the display time information (step S520: YES), the bookmark management unit 409 determines from the object information for which the display time information is set. An object identifier (object_id) is extracted (step S525). Furthermore, the bookmark management unit 409 reads display area information from the object information in which the extracted object identifier (object_id) is set. The bookmark management unit 409 determines whether or not the display area (area) indicated by any of the read display area information includes the coordinates of the touch position indicated by the designated position information of the newly registered touch information management data. Judgment is made (step S530).

  When it is determined that the display area (area) indicated by any of the display area information includes the coordinates of the touch position indicated by the designated position information (step S530: YES), the bookmark management unit 409 displays the display area information. The object identifier (object_id) is read out from the object information in which is set (step S535). The bookmark management unit 409 reads the read object identifier (object_id), the user identifier (user_id) read from the newly registered touch information management data, the content identifier (content_id) read in step S510, the program name, and the broadcast date and time. Are registered in the bookmark DB 410 (step S540).

  On the other hand, if it is determined in step S520 that the designated time is not included in the time zone indicated by the display time information (step S520: NO), or the area (area) indicated by the display area information in step S530. When it is determined that the coordinates of the touch position indicated by the designated position information are not included (step S530: NO), the bookmark management unit 409 registers unregistered object information in the unregistered object DB 411 (step S545). The unregistered object information includes the content identifier (content_id) read in step S510, the user identifier (user_id) and specified position information read from the newly registered touch information management data, and the broadcast start time as a reference. Designated time information indicating the computed designated time is set.

  FIG. 16 is a diagram showing a bookmark use sequence of the bookmark management system. The sequence shown in FIG. 3 is for a fixed receiving apparatus when a user selects a program with a bookmark in the fixed receiving apparatus 2 or the portable terminal 3 and displays the bookmark on the display while reproducing the program. 2 shows data exchange among the mobile terminal 3, the VoD distribution server 5, the bookmark management server 4, and the related information distribution server 6. Below, the case where the portable terminal 3 selects a program with a bookmark will be described.

  The user inputs a bookmark program list acquisition instruction via the touch panel display 306 of the mobile terminal 3. The bookmark program list acquisition unit 309 of the portable terminal 3 outputs the user identifier (user_id) to the communication input / output unit 301 and instructs the bookmark management server 4 to transmit a bookmark program list acquisition request. The user identifier (user_id) may be read from the user information management unit 302, may be input by the touch panel display 306, an input unit (not shown), or may be a user identifier (user_id) indicating all users. If no user identifier (user_id) is set, all users may be specified. The communication input / output unit 301 transmits the bookmark program list acquisition request input from the bookmark program list acquisition unit 309 to the bookmark management server 4 (step S205).

  The communication input / output unit 404 of the bookmark management server 4 receives the bookmark program list acquisition request transmitted from the mobile terminal 3 via the Internet 7 and outputs it to the authentication unit 405. If the user identifier (user_id) set in the bookmark program list acquisition request is registered in the user information stored in the user DB 406, the authentication unit 405 determines that the authentication is successful, and a response that sets authentication OK ( ACK) is instructed to the communication input / output unit 404 (step S210). The communication input / output unit 404 returns a response (ACK) to the portable terminal 3 that is the transmission source of the bookmark program list acquisition request (step S215). When the communication input / output unit 301 of the mobile terminal 3 receives a response (ACK) via the Internet 7, it determines that the user authentication is successful.

  The bookmark management server 4 searches the bookmark DB 410 and identifies bookmark management data in which the user identifier (user_id) in the bookmark program list acquisition request is set. The bookmark management server 4 creates bookmark program list data in which a user identifier (user_id), a program name acquired from the specified bookmark management data, a content identifier, and a list of broadcast dates and times are set (step S220), to the portable terminal 3 Transmit (step S225).

  The communication input / output unit 301 of the portable terminal 3 receives the bookmark program list data transmitted from the bookmark management server 4 via the Internet 7 and outputs it to the bookmark program list acquisition unit 309. The bookmark program list acquisition unit 309 causes the touch panel display 306 to display a list of program names and broadcast dates set in the received bookmark program list data.

  When the user selects a bookmark acquisition target program name from the bookmark list data displayed on the touch panel display 306 of the mobile terminal 3, the user touches information specifying the selected program name (step S230). When the bookmark expansion unit 310 of the portable terminal 3 acquires information on the position touched by the user from the touch panel display 306, the communication input / output unit 301 displays a content identifier (content_id) corresponding to the program name displayed at the acquired position. And instruct to send the bookmark acquisition request to the bookmark management server 4. The communication input / output unit 301 transmits a bookmark acquisition request in which a user identifier (user_id) and a content identifier (content_id) are set to the bookmark management server 4 (step S235).

  When the bookmark management server 4 receives a bookmark acquisition request from the mobile terminal 3 via the Internet 7, the bookmark management server 4 searches the bookmark DB 410 and sets the user identifier (user_id) and content identifier (content_id) in the bookmark acquisition request. Identify management data. The bookmark management server 4 reads an object identifier (object_id) from the specified bookmark management data, and further reads display area information, display time information, and attribute information from the object DB 403 based on the read object identifier (object_id). The bookmark management server 4 generates bookmark list data including the read information (step S240) and transmits it to the portable terminal 3 (step S245). The communication input / output unit 301 of the portable terminal 3 outputs the bookmark list data received via the Internet 7 to the bookmark program list acquisition unit 309.

  The user inputs a VoD acquisition instruction via the touch panel display 306 of the mobile terminal 3. The bookmark program list acquisition unit 309 outputs the bookmark list data received in step S245 to the bookmark development unit 310. The bookmark expansion unit 310 outputs the content identifier (content_id) described in the bookmark list data to the VoD acquisition unit 311 and instructs acquisition of program content data. The VoD acquisition unit 311 outputs a VoD content acquisition request in which the content identifier (content_id) input from the bookmark expansion unit 310 is set to the communication input / output unit 301 and instructs the VoD distribution server 5 to transmit it. The communication input / output unit 301 transmits the user identifier (user_id) transmitted to the bookmark management server 4 in step S205 to the VoD distribution server 5 (step S250).

  The VoD distribution server 5 performs authentication based on the user identifier (user_id) received from the mobile terminal 3 via the Internet 7 (step S255). If the authentication is successful, the VoD distribution server 5 transmits a response (ACK) in which authentication OK is set to the mobile terminal 3 (step S260).

  When the communication input / output unit 301 of the mobile terminal 3 receives a response (ACK) via the Internet 7, the communication input / output unit 301 determines that the user authentication is successful and sends a content distribution request in which the content identifier (content_id) is set to the VoD distribution server 5. Transmit (step S265). When the VoD distribution server 5 receives a content distribution request from the mobile terminal 3 via the Internet 7, the VoD distribution server 5 acquires a content identifier (content_id) set in the content distribution request. The VoD distribution server 5 transmits the program content data specified by the acquired content identifier (content_id) to the mobile terminal 3 (step S270).

  The communication input / output unit 301 of the portable terminal 3 receives the program content data via the Internet 7 and outputs it to the VoD acquisition unit 311, and the VoD acquisition unit 311 outputs the received program content data to the video playback unit 305. . The video playback unit 305 displays the program video based on the received video content data on the touch panel display 306, and outputs the playback time of the video content data being played back to the bookmark development unit 310 (step S275).

  When the playback time input from the video playback unit 305 matches the display start time indicated by the display time information described in the bookmark list data, the bookmark development unit 310 corresponds to the display time information in the bookmark list data. Read display area information and attribute information described. The bookmark expanding unit 310 displays the object name in the attribute information superimposed on the program video displayed on the touch panel display 306 by the video playback unit 305 (by overlay) or divided with the program video (step S280). ). When displaying the program video as an overlay, the bookmark developing unit 310 displays the object name in the display area of the object indicated by the display area information.

  The user instructs display of related information by touching an object name displayed on the touch panel display 306 of the mobile terminal 3. When the bookmark developing unit 310 of the mobile terminal 3 acquires information on the position touched by the user from the touch panel display 306, the bookmark list data displays the related information corresponding to the program name displayed at the acquired position and a link to the related information. The video playback unit 305 superimposes (overlays) the program video displayed on the touch panel display 306 or displays it separately from the program video. When displaying the program video as an overlay, the bookmark developing unit 310 displays related information and a link to the related information in the display area of the object indicated by the display area information.

  The user instructs acquisition of related information from the link by touching the link displayed on the touch panel display 306 of the mobile terminal 3 (step S285). When the bookmark expansion unit 310 of the mobile terminal 3 acquires information on the position touched by the user from the touch panel display 306, the bookmark expansion unit 310 outputs the link displayed at the acquired position to the communication input / output unit 301 and instructs acquisition of the information. . The communication input / output unit 301 accesses the related information distribution server 6 using the received link (URL) (step S290), and acquires content data including the related information of the object (step S295). The bookmark expanding unit 310 displays the content data acquired by the communication input / output unit 301 on the program video displayed on the touch panel display 306 by the video playback unit 305 or on the outside of the program video (step S300). .

  The bookmark expanding unit 310 does not allow the user to touch the object name or link, and when the reproduction time matches the display start time indicated by the display time information, the related information read from the bookmark list data and the link destination The related information read from may be displayed on the touch panel display 306.

FIG. 18 is a diagram showing a detailed processing flow of the bookmark management server 4 in step S220 of FIG.
The portable terminal 3 transmits a bookmark program list acquisition request in which a user identifier (user_id) is set. The communication input / output unit 404 of the bookmark management server 4 receives the bookmark program list acquisition request transmitted from the portable terminal 3 via the Internet 7 (step S605). The communication input / output unit 404 outputs the user identifier (user_id) set in the received bookmark program list acquisition request to the authentication unit 405 and the bookmark transmission unit 412. The authentication unit 405 performs user authentication processing in the same manner as step S210 in FIG.

  When the user authentication is successful, the bookmark sending unit 412 outputs the user identifier (user_id) input from the communication input / output unit 404 to the bookmark management unit 409 (step S610). The bookmark management unit 409 searches the bookmark DB 410 and identifies bookmark management data in which the user identifier (user_id) input from the bookmark transmission unit 412 is set. The bookmark management unit 409 creates bookmark program list data in which the user identifier (user_id), the content identifier (content_id) read from the specified bookmark management data, the program name, and the broadcast date and time are set (step S615), and the bookmark is transmitted. The data is output to the unit 412 (step S620). The bookmark sending unit 412 outputs the bookmark program list data input from the bookmark management unit 409 to the communication input / output unit 404 and gives an instruction to return it to the mobile terminal 3. The communication input / output unit 404 transmits the bookmark program list data to the portable terminal 3 that is the transmission source of the bookmark program list acquisition request (step S625).

FIG. 19 is a diagram showing a detailed processing flow of the bookmark management server 4 in step S240 of FIG.
The portable terminal 3 transmits a bookmark acquisition request in which a user identifier (user_id) and a content identifier (content_id) are set. The communication input / output unit 404 of the bookmark management server 4 receives the bookmark acquisition request transmitted from the portable terminal 3 via the Internet 7 and outputs it to the bookmark transmission unit 412 (step S705). The bookmark sending unit 412 outputs the user identifier (user_id) and content identifier (content_id) set in the bookmark acquisition request input from the communication input / output unit 404 to the bookmark management unit 409 (step S710). The bookmark management unit 409 searches the bookmark DB 410 and identifies bookmark management data in which the user identifier (user_id) and content identifier (content_id) input from the bookmark sending unit 412 are set.

  When the bookmark management unit 409 reads the object identifier (object_id) from the specified bookmark management data (step S715), the bookmark management unit 409 searches the object DB 403 and specifies the object information in which the read object identifier (object_id) is set. The bookmark management unit 409 reads the display time information, the display area information, and the attribute information from the specified object information, the read information, the user identifier (user_id), and the object identifier (object_id) read in step S715. The bookmark list data in which is set to are created (step S720).

  The bookmark management unit 409 outputs the created bookmark list data to the bookmark transmission unit 412 (step S725), and the bookmark transmission unit 412 outputs the bookmark list data input from the bookmark management unit 409 to the communication input / output unit 404. And instructing the mobile terminal 3 to return it. The communication input / output unit 404 transmits the bookmark list data input from the bookmark transmission unit 412 to the mobile terminal 3 that has transmitted the bookmark acquisition request (step S730).

  In the above embodiment, the case where a bookmark program list acquisition request and a bookmark acquisition request are transmitted from the mobile terminal 3 has been described. However, a bookmark program list acquisition request and a bookmark acquisition request are transmitted from the fixed receiver 2. May be. In this case, the communication input / output unit 213, the user information management unit 214, the bookmark program list acquisition unit 215, the bookmark development unit 216, and the VoD acquisition unit 217 of the fixed receiver 2 are respectively connected to the communication input / output unit 301 of the mobile terminal 3. The same operations as the user information management unit 302, bookmark program list acquisition unit 309, bookmark development unit 310, and VoD acquisition unit 311 are performed. Further, instead of the touch panel display 306 of the portable terminal 3, input by the user is performed by the user input unit 212 of the fixed receiving device 2, and the bookmark list data, the video of the program, the object name, the related information, and the related information are input. An image such as a link is displayed on the display 208.

  In step S275 of FIG. 16, the VoD acquisition unit 217 of the fixed receiver 2 outputs the video data of the program content data received from the VoD distribution server 5 to the video playback unit 207, and the audio data of the program content data is output. The sound is output to the audio playback unit 209. The video playback unit 207 displays a program video based on the input video data on the display 208, and the audio playback unit 209 causes the speaker 210 to output audio based on the input audio data. The video playback unit 207 outputs the playback time of the video data being played back to the bookmark development unit 310.

In the above embodiment, the case of registering a bookmark in a broadcast program has been described. However, a bookmark may be registered in a program based on a broadcast signal once stored in the storage unit 202 or a program received as program content data.
When registering a bookmark in a program based on a broadcast signal stored in the storage unit 202, the channel selection / program acquisition unit 204 of the fixed receiver 2 in step S140 of FIG. The broadcast date and time described in the EIT (Event Information Table) of the broadcast signal is transmitted to the portable terminal 3. In step S160, the touch information generation unit 307 sets the date and time when the touch time of the object and the broadcast date and time are added to the designated time information of the touch information as a reference.

  Further, the difference in processing when a bookmark is registered in a program received as program content data is as follows.

In step S135 of FIG. 15, the VoD acquisition unit 217 of the fixed receiving apparatus 2 receives program content data that the user has instructed to acquire using the user input unit 212 from the VoD distribution server 5 via the communication input / output unit 213. The VoD acquisition unit 217 outputs the received video data of the program content data to the video playback unit 207, and outputs the audio data of the program content data to the audio playback unit 209.
In step S140, the channel selection / program acquisition unit 204 outputs the content identifier (content_id) given to the program content data to the device cooperation unit 205, and the device cooperation unit 205 sends the content identifier (content_id) to the mobile terminal 3. Send to. The device cooperation unit 303 of the mobile terminal 3 outputs the received content identifier (content_id) to the touch information generation unit 307.

  In step S160, the touch information generation unit 307 of the mobile terminal 3 generates touch information in which a content identifier (content_id) is set instead of channel selection information (network_id, service_id) and program information (event_id). Further, the touch information generation unit 307 sets the touch time of the object based on the playback start time of the program in the specified time information of the touch information.

  In step S505 in FIG. 17, the touch information collection unit 407 of the bookmark management server 4 performs the touch information in which the content identifier (content_id) is set instead of the channel selection information (network_id, service_id) and the program information (event_id). Management data is registered in the touch information DB 408. In step S510, the bookmark management unit 409 searches the program information DB 402 using the content identifier (content_id) instead of the channel selection information and the program information. The bookmark management unit 409 reads only the program name from the program information specified by the search. In step S540, the bookmark management unit 409 determines the object identifier (object_id), the user identifier (user_id) and content identifier (content_id) read from the newly registered touch information management data, and the program name read from the program information. Is registered in the bookmark DB 410.

In step S520, the bookmark management unit 409 determines whether the time indicated by the specified time information of the newly registered touch information management data is included in the time zone indicated by any display time information. to decide.
Note that the touch information generation unit 307 of the portable terminal 3 manages the viewing time indicating the time from the start of playback of the program content data to the end of playback, the user identifier, and the content identifier when the playback of the program content data ends. Send to server 4. The bookmark management unit 409 of the bookmark management server 4 identifies the bookmark management data stored in the bookmark DB 410 based on the user identifier and the content identifier, and writes the viewing time in the identified bookmark management data.

  In the above embodiment, the fixed receiving device 2 and the mobile terminal 3 acquire the bookmark acquisition target program selected by the user from the VoD distribution server 5 from the bookmark list data. The program may be acquired from the broadcast signal stored in the storage unit 202 of the device 2.

  In this case, in step S540 of FIG. 17, the bookmark management unit 409 further registers the channel selection information and program information read from the newly registered touch information management data in the bookmark management data. Then, in step S615 in FIG. 18, the bookmark management unit 409 generates bookmark program list data in which channel selection information and program information read from the bookmark management data are further set.

  When the bookmarked program list is acquired by the fixed receiving apparatus 2, the user inputs an instruction to acquire a recorded program through the user input unit 212 in step S250 of FIG. The bookmark development unit 216 causes the storage unit 202 to output the channel selection information described in the bookmark program list data and the broadcast signal of the program specified by the program information. The separation unit 203 separates the broadcast signal input from the storage unit 202 into video data, audio data, and PSI / SI, and outputs the separated data. And the fixed receiver 2 performs the process after step S275.

  On the other hand, when the bookmark program list is acquired by the mobile terminal 3, the user inputs an instruction to acquire the recorded program on the touch panel display 306 of the mobile terminal 3 in step S250 of FIG. The bookmark expanding unit 310 transmits the channel selection information and program information described in the bookmark program list data to the fixed receiving apparatus 2. The bookmark expanding unit 216 of the fixed receiving apparatus 2 causes the storage unit 202 to output a broadcast signal of a program specified by the received channel selection information and program information. The separation unit 203 separates the broadcast signal input from the storage unit 202 into video data, audio data, and PSI / SI, and outputs the separated data.

  The video playback unit 207 of the fixed receiver 2 decodes the video data and displays the video of the broadcast program based on the video data on the display 208, and the audio playback unit 209 transmits the audio of the broadcast program based on the audio data to the speaker 210. Output from. The video conversion unit 211 generates video data obtained by converting the resolution and encoding method of the video data output from the separation unit 203 and transmits the video data to the mobile terminal 3 as a video stream. The video playback unit 305 of the portable terminal 3 decodes the video stream and causes the touch panel display 306 to display the video of the broadcast program based on the video data obtained by the decoding. And the portable terminal 3 performs the process after step S275.

  In the above embodiment, the user performs input using the touch panel display 306 of the mobile terminal 3, but the mobile terminal 3 may perform input using input means such as a mouse. In this case, for example, instead of touching the touch panel display 306 and specifying the object, the user specifies the object by clicking the cursor with the mouse at the display position of the object.

  In the above embodiment, the information processing terminal of the user is constituted by two devices, that is, the fixed receiving device 2 and the portable terminal 3. For example, a personal computer having a television receiving function, a mobile phone, etc. You may implement | achieve with one apparatus.

  FIG. 20 is a diagram illustrating a screen display example of the bookmark program list in the fixed receiver 2 or the mobile terminal 3. This figure shows an example displayed when the user performs a bookmark operation for both a program provided by broadcasting (broadcast program) and a program provided by VoD.

When the program on which the bookmark operation has been performed is a program provided by broadcasting, the fixed receiving device 2 or the portable terminal 3 displays the broadcast date and time and the program name of the program. As such information, broadcast date and time or program information described in an EIT (Event Information Table) set in the broadcast signal may be used. When EIT is used, the channel selection / program acquisition unit 204 of the fixed receiver 2 transmits the broadcast date and program information acquired from the EIT to the mobile terminal 3 together with the channel selection information and program information. The touch information generation unit 307 of the portable terminal 3 generates touch information further set with the broadcast date and time and program information received from the fixed receiver 2. The bookmark management unit 409 of the bookmark management server 4 sets the broadcast date and time and program information set in the touch information in the bookmark management data.
On the other hand, when the program on which the bookmark operation is performed is a program distributed by VoD, the fixed receiver 2 or the portable terminal 3 displays the viewing date and time of the program and the program name.

  As shown in the figure, the program on which the bookmark operation has been performed is displayed as a list, and the user can select a program from the list.

  FIGS. 21 and 22 show bookmark display examples on the fixed receiving apparatus 2 or the portable terminal 3. When the user selects a program from the bookmark program list shown in FIG. 20, the fixed receiving device 2 or the portable terminal 3 reproduces and displays the program and displays bookmark information.

  In the display example 1 shown in FIG. 21, the fixed receiver 2 or the portable terminal 3 displays a program display screen and a bookmark name display screen in a divided manner. On the other hand, in the display example 2 shown in FIG. 22, the fixed receiver 2 or the mobile terminal 3 displays the bookmark name on the program display screen in an overlay manner. In both display examples, when the user selects a displayed bookmark name, the fixed receiving device 2 and the portable terminal 3 provide links to related information described in the bookmark list data and related information of the object. A transition is made to display or display related information indicating the details of the object obtained from the link.

  The bookmark object name is displayed from the display start time of the bookmarked object to a predetermined time (α seconds), or from the display start time of the bookmarked object to the display end time + predetermined time ( β seconds). This enables the user to see and grasp the bookmark for a certain time after the bookmarked object is displayed or for a certain time longer than the time during which the object is displayed. Note that the fixed receiving device 2 and the portable terminal 3 obtain the display start time and the display end time from the display time information of the bookmark list data.

  Note that the values of α and β may be changed in the fixed receiver 2 or the portable terminal 3. The display of the bookmark contents (links to detailed information and related information) continues until the user selects and deletes the bookmark contents. Regarding display example 2, if information is overlaid on an object and displayed, the visibility may deteriorate. For example, the information is displayed outside the display area such as the position adjacent to the area indicated by the display area information of the object. You may take the means of doing.

As shown in FIGS. 21 and 22, when information of a plurality of attributes is given to one object, the fixed receiving device 2 and the portable terminal 3 use the object names for the plurality of attributes as bookmarks. indicate. For example, when a person on a screen is touched and bookmarked during a drama program, a plurality of attributes such as an actor, a role, and a costume worn by the actor may be given. At this time, it cannot be determined from the touch information which attribute information the user has touched to acquire. Therefore, when information of a plurality of attributes is associated with one object, the fixed receiving device 2 and the mobile terminal 3 present the object name for each of the plurality of attributes to the user, and give the object name to the user. Reach to the information you are interested in by selecting.
When only one attribute is associated with one object, the fixed receiving device 2 and the portable terminal 3 can be obtained from the related information of the object, the link to the related information, or the link without the designation by the user. The attribute information may be displayed.

According to the above-described embodiment, the user can perform a simple operation of designating an object to be worried on the display screen of the program video displayed on the information processing terminal. You can bookmark the scene. In particular, when the information processing terminal includes a touch panel display, it is only necessary to touch the object on the display screen of the playback video displayed on the touch panel display. The information processing terminal is a touch including a time touched by the user, a position on the screen touched, and program identification information (a combination of channel selection information, program information and time information, or a content identifier) of a program being played back. Information is transmitted to the bookmark management server 4.
The bookmark management server 4 can specify the information touched by the user based on the object DB 403 that manages the display area information and display time information of the objects displayed in the program, and the received touch information. As a result, an object in which the user is interested can be specified, so that information related to the object can be provided to the user.

In addition, the information processing terminal may acquire the related information of the bookmarked program and the bookmarked object in the program, and display the related information of the bookmarked object in synchronization with the reproduction of the bookmarked program. it can. Thereby, the information regarding the object recorded by the touch operation can be used for viewing the program.
Further, the information processing terminal can be configured by a fixed receiving device such as a television receiver and a mobile terminal such as a tablet terminal or a smartphone. Therefore, when the same program is displayed on the television receiver and the portable terminal, and the user usually watches the program on the television receiver and there is an object to be worried about, there is a touch panel display on the portable terminal at hand. The object can be recorded by simply touching the object displayed on the screen.

In the above-described embodiment, when a user is watching a broadcast program on a television and is interested in an object in the program and wants to acquire detailed information on the object, the user touches the screen of a mobile terminal linked with the television. You can create and save bookmarks with a simple operation. Then, after the program ends, it is possible to obtain information on the object that interests the user from the bookmark through the Internet or the like. Therefore, the user can enjoy an environment in which he / she can easily access the information he / she cares about while watching the broadcast program without being disturbed. As described above, even when media having different characteristics such as passive media broadcasting and the Internet of active media are linked, content can be provided while taking advantage of the characteristics of both.
By providing such an environment, the business operator can collect information that the user is interested in as a bookmark. Accordingly, the business operator can form collective intelligence such as what information a plurality of users are interested in, and can use the information for content marketing.

  The broadcast transmission device 1, the fixed receiving device 2, the portable terminal 3, the bookmark management server 4, the VoD distribution server 5, and the related information distribution server 6 described above have a computer system therein. The operation processes of the broadcast transmission device 1, the fixed receiving device 2, the portable terminal 3, the bookmark management server 4, the VoD distribution server 5, and the related information distribution server 6 are recorded on a computer-readable recording medium in the form of a program. The above processing is performed by the computer system reading and executing this program. The computer system here includes a CPU, various memories, an OS, and hardware such as peripheral devices.

Further, the “computer system” includes a homepage providing environment (or display environment) if a WWW system is used.
The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage unit such as a hard disk built in the computer system. Furthermore, the “computer-readable recording medium” dynamically holds a program for a short time like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. In this case, a volatile memory in a computer system serving as a server or a client in that case, and a program that holds a program for a certain period of time are also included. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.

DESCRIPTION OF SYMBOLS 1 Broadcast transmission apparatus 2 Fixed receiving apparatus 3 Portable terminal 4 Bookmark management server 5 VoD distribution server 6 Related information distribution server 7 Internet 201 Broadcast receiving part 202 Storage part 203 Separation part 204 Channel selection / program acquisition part 205, 303 Device cooperation part 206, 304 Terminal information management unit 207, 305 Video playback unit 208 Display 209 Audio playback unit 210 Speaker 211 Video conversion unit 212 User input unit 213, 301, 404 Communication input / output unit 214 User information management unit 215, 309 Acquisition of bookmark program list Units 216, 310 Bookmark expansion unit 217, 311 VoD acquisition unit 302 User information management unit 306 Touch panel display 307 Touch information generation unit 308 Clock 401 Server cooperation unit 402 Program information DB
403 Object DB
405 Authentication unit 406 User DB
407 Touch information collection unit 408 Touch information DB
409 Bookmark management unit 410 Bookmark DB
411 Unregistered object DB
412 Bookmark sending part

Claims (9)

An object storage unit that stores object identification information that identifies an object; program identification information that identifies a program; and object information that associates display time information and display area information of the object in the program;
A bookmark storage unit for storing object identification information of an object designated by a user in association with program identification information;
Program specifying information corresponding to an object specified by a user, specified time information indicating a time when the object is specified, and specified position information indicating a specified position of the object on the video display screen of the program A designated object information collection unit that receives the designated object information;
Of the object information stored in the object storage unit, the program specifying information in the designated object information is set, and the time indicated by the designated time information in the designated object information is the display time information. The object information included in the display area indicated by the display area information is specified by the specified position indicated by the specified position information in the specified object information. A bookmark management unit for writing the object identification information in the bookmark storage unit in association with the program identification information in the designated object information;
A bookmark management device comprising: A bookmark management system having a bookmark management device and an information processing terminal,
The information processing terminal
A display unit for displaying images;
A reproduction unit for displaying video of program data on the display unit;
An input unit for receiving designation of an object by a user on a video display screen of the program data displayed on the display unit;
Program specifying information of the program data corresponding to the object specified by the input unit, specified time information indicating a time when the object is specified, and a specified position of the object on the video display screen of the program A designated object information including a designated position information indicating, and a designated object information generation unit that transmits the designated object information to the bookmark management device;
With
The bookmark management device includes:
An object storage unit that stores object identification information that identifies an object; program identification information that identifies a program; and object information that associates display time information and display area information of the object in the program;
A bookmark storage unit for storing object identification information of an object designated by a user in association with program identification information;
A designated object information collection unit that receives the designated object information from the information processing terminal;
Of the object information stored in the object storage unit, the program specifying information in the designated object information is set, and the time indicated by the designated time information in the designated object information is the display time information. The object information included in the display area indicated by the display area information is specified by the specified position indicated by the specified position information in the specified object information. A bookmark management unit for writing the object identification information in the bookmark storage unit in association with the program identification information in the designated object information;
Comprising
A bookmark management system characterized by that. The object information further includes related information of the object,
When the bookmark management unit receives the program identification information to be bookmarked from the information processing terminal, the bookmark management unit reads out the object identification information corresponding to the program identification information to be received from the bookmark storage unit, and reads the read Identify the object information stored in the object storage unit by object identification information, send the display time information read from the identified object information and bookmark list data including the related information to the information processing terminal,
The information processing terminal
A program content acquisition unit that acquires program data specified by the program specifying information to be bookmarked, outputs the program data to the playback unit, and displays a video of the program data on the display unit;
The display time information and the related information in the bookmark list data received from the bookmark management device are read out, and the related information or the related information is displayed together with the video display screen of the program data displayed by the display unit. A bookmark expansion unit that displays information obtained from the information storage location shown at a time indicated by the display time information.
The bookmark management system according to claim 2. The designated object information generation unit transmits designated object information further including user identification information,
The bookmark management unit
The object identification information in the object information identified based on the designated object information, the program identification information and the user identification information in the designated object information are associated and written to the bookmark storage unit, and the information processing terminal When the program identification information and user identification information to be acquired from bookmark are received from the bookmark storage unit, the object identification information corresponding to the received program identification information and user identification information to be received is read from the bookmark storage unit and read out. The object information stored in the object storage unit is identified by identification information, and bookmark list data including the display time information and the related information read from the identified object information is transmitted to the information processing terminal. That,
The bookmark management system according to claim 3. When the bookmark management unit receives user identification information to be bookmarked from the information processing terminal, the bookmark management unit reads the program identification information corresponding to the received user identification information from the bookmark storage unit and returns it to the information processing terminal And receiving from the information processing terminal the program specifying information to be bookmarked selected from the returned program specifying information.
The bookmark management system according to claim 4. The bookmark management unit further transmits the bookmark list data including the display area information to the information processing terminal,
The bookmark expansion unit reads the display time information, the display area information, and the related information in the bookmark list data, and the display unit displays information obtained from the information storage location indicated by the related information or the related information. Displaying on the video display screen of the program data being displayed at the display area indicated by the display area information of the time indicated by the display time information or at a position adjacent to the display area;
The bookmark management system according to any one of claims 3 to 5, wherein the bookmark management system is any one of the above. The information processing terminal comprises a first information processing terminal and a second information processing terminal,
The first information processing terminal is
A video display unit for displaying video;
An audio output unit for outputting audio;
A video playback unit for displaying video of program data received by broadcasting or communication on the video display unit;
An audio reproduction unit for outputting the audio of the program data to the audio output unit;
A video conversion unit that generates video data obtained by encoding video of the program data and transmits the video data to the second information processing terminal;
With
The second information processing terminal includes the display unit, the playback unit, the input unit, and the designated object information generation unit.
The reproduction unit displays the video data received from the first information processing terminal on the display unit;
The bookmark management system according to claim 2. A display unit for displaying images;
A reproduction unit for displaying video of program data on the display unit;
An input unit for receiving designation of an object by a user on a video display screen of the program data displayed on the display unit;
Program specifying information of the program data corresponding to the object specified by the input unit, specified time information indicating a time when the object is specified, and a specified position of the object on the video display screen of the program A designated object information generating unit that generates designated object information including the designated position information indicating, and transmits the designated object information to the bookmark management device;
A transmission unit that transmits the program identification information to be bookmarked to the bookmark management device;
A reception unit that receives bookmark list data including display time information and related information of a specified object from the bookmark management device in response to the program identification information of the bookmark acquisition target transmitted by the transmission unit;
A program content acquisition unit that acquires program data specified by the program specifying information to be bookmarked, outputs the program data to the playback unit, and displays a video of the program data on the display unit;
The display time information and the related information in the bookmark list data received from the bookmark management device are read out, and the related information or the related information is displayed together with the video display screen of the program data displayed by the display unit. A bookmark expansion unit that displays information obtained from the information storage location indicated at the time indicated by the display time information;
An information processing terminal comprising: The computer used for the bookmark management device
An object storage unit that stores object information that associates object identification information that identifies an object, program identification information that identifies a program, and display time information and display area information of the object in the program;
A bookmark storage unit for storing object identification information of an object designated by a user in association with program identification information;
Program specifying information corresponding to an object specified by a user, specified time information indicating a time when the object is specified, and specified position information indicating a specified position of the object on the video display screen of the program A designated object information collection unit for receiving designated object information;
Of the object information stored in the object storage unit, the program specifying information in the designated object information is set, and the time indicated by the designated time information in the designated object information is the display time information. The object information included in the display area indicated by the display area information is specified by the specified position indicated by the specified position information in the specified object information. A bookmark management unit that writes the object identification information in the bookmark storage unit in association with the program identification information in the designated object information,
A program characterized by functioning as

Images