JP2014236257A - Terminal device and network terminal system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a terminal device that receives information related to keywords in a program or the like when a viewer is watching television broadcast.SOLUTION: A terminal device is used in a network terminal system comprising a program receiving device, the terminal device, and a related information distribution device. The terminal device comprises: input means; a communication unit for receiving, from the related information distribution device, program related information identified by program state information identifying a viewing program transmitted to the related information distribution device from the program receiving device receiving the program transmitted via a broadcast wave or network; and display means for displaying a program related information display screen for displaying keywords included in the received program related information, and furthermore for displaying information related to a keyword if the keyword is selected by the input means.

Description

  The present invention relates to a terminal device and a network terminal system.

  While watching TV broadcasts, viewers are required to examine the store information introduced in the program and information on cooking recipes in more detail. In addition, there is a request to know information such as a distribution destination of related contents such as a program missed such as a previous program of a broadcast program and a scheduled distribution date. On the other hand, in recent years, not only PCs but also TV receivers and mobile terminals with built-in Internet functions have been put into practical use so that program-related information can be easily searched with a browser, and missed programs can be viewed from a content distribution service. It has become to.

  As background art of this technical field, Patent Document 1 describes that “image database information on the Internet is searched from TV screen video and related information linked with broadcasting is provided by a simple operation”. .

JP 2006-270869 A

  On a PC, it takes time to start up the PC itself, and in the case of a TV receiver or the like, it takes time to start up the browser screen, and the input interface is mainly a remote control, so it is necessary to enter the keyword you want to check. It was difficult. In addition, since the Internet function is a function different from the TV broadcast viewing function on a TV with a built-in Internet function, it is necessary to interrupt the viewing screen and display the search screen. , There was a problem that it was difficult to find the delivery content of the missed program.

  In the case of the invention described in Patent Document 1, a feature mark, a program mark, a texture, etc. displayed on a program are photographed with a camera in order to obtain information about the contents of the program broadcast or the program itself from information sources on the Internet. However, although an invention for acquiring data from the color and form has been disclosed, there is a problem that information cannot be obtained unless these marks are always displayed on the screen, and the image quality and form recognition process of the camera. There was a problem that correct information might not be obtained.

In order to solve the above problems, for example, the configuration described in the claims may be adopted.
For example, the present invention is a terminal device used in a network terminal system including a program receiving device, a terminal device, and a related information distribution device, and is transmitted via an input means and a broadcast wave or a network. A program receiving device for receiving a program to be received, a communication unit for receiving from the related information distribution device program-related information specified by the program status information identifying the viewing program transmitted to the related information distribution device, and the received program-related information A program-related information display screen for displaying a keyword included in the information, and display means for displaying information on the keyword when the keyword is selected by the input means.

  According to the present invention, it is possible to provide a terminal device and a network terminal system that can accurately provide information in a program and related information related to the program when the viewer is watching the broadcast, and it is convenient for the viewer. There is an effect that it can contribute to the improvement of.

It is an example of the network terminal system which concerns on 1st embodiment. It is an example of the block diagram of a television receiver. It is an example of the block diagram of a radio | wireless terminal. It is an example of a block diagram of a program related information delivery server. It is an example of the internal structure of the storage and memory of a television receiver. It is an example of the internal structure of the storage and memory of a wireless terminal. It is an example of the internal structure of the storage and memory of a program related information delivery server. It is a figure which shows an example of the data format of the program status information transmitted to a program relevant information delivery server from a television receiver. It is a figure which shows an example of the data format of the user management information managed by the program related information delivery server. It is a figure which shows an example of the data format of the setting content of the television receiver managed by the program related information delivery server. It is a figure which shows an example of the data format of the program relevant information transmitted to a wireless terminal according to an attribute from a program relevant information delivery server. It is a figure which shows an example of the operation | movement flow / sequence of the initial setting by a television receiver. It is a figure which shows an example of the operation | movement flow / sequence of the initial setting by a radio | wireless terminal. It is a figure which shows an example of an operation | movement flow / sequence in case a television receiver transmits the program status information regarding the program in view to the program related information delivery server 7. FIG. It is a figure which shows an example of the operation | movement flow / sequence for displaying a program related detailed information. The display example of the menu screen of a television receiver is shown. The example of a display of the program related information setting screen of a television receiver is shown. The example of a display of the menu screen of a wireless terminal is shown. The example of a display of the program related information setting screen of a radio | wireless terminal is shown. The example of a display of a program related information screen is shown. It is a figure which shows an example of the pop-up display screen of the search screen in a wireless terminal. It is a figure which shows the modification of the popup display screen of the search screen in a radio | wireless terminal. It is a figure which shows an example of the operation | movement flow / sequence of the initial setting by the television receiver which concerns on 2nd embodiment. It is a figure which shows an example of the operation | movement flow / sequence for displaying a program related detailed information. The example of a display in the case of a program related information notification screen is shown. It is a figure which shows an example of the operation | movement flow / sequence for displaying the program relevant detailed information which concerns on 3rd embodiment. The example of a display of a program related information screen is shown. It is a figure which shows an example of the operation | movement flow / sequence for displaying the program relevant detailed information which concerns on 4th embodiment. The example of a display of a program related information screen is shown. The example of a content detail display screen is shown. The example of a display of a program related information screen is shown.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  In the following, a television receiver with a digital broadcast receiving function for receiving a digital broadcast wave including program sequence information (event information) and displaying an electronic program guide (EPG) of the digital broadcast based on the received program sequence information, and a radio A description will be given using a communication terminal system including the device as an example.

  In BS digital broadcasting, CS digital broadcasting, and terrestrial digital television broadcasting operated in Japan, a plurality of transport streams (hereinafter abbreviated as “TS”) are multiplexed on one transponder (frequency channel). Is transmitting. The TS has a data structure that conforms to the standards of the Radio Industries Association (ARIB), and for the element signal (ES: Elementary Stream) as the content data, the header is the program sequence information as event information. As a TS packet added.

  The data structure of the program arrangement information conforms to ARIB STD-B10 “Program arrangement information standard used for digital broadcasting” which is the ARIB standard. The program sequence information includes PSI (Program Specific Information), which is transmission control information defined in the Moving Picture Expert Group (MPEG) -2 system standard, and SI (Service Information: service for constructing EPG). Information).

  SI is BIT (Broadcaster Information Table: Broadcast Station Information Table), SDT (Service Description Table: Service Description Table), EIT (Event Information Table: Event Information Table), and TOT (Time Offset Table 4: Time Offset Table). It consists of a table.

  The BIT describes information about a broadcasting station in the network. The SDT is divided into a TS information part and a service information part, and the TS information part includes a network ID for identifying the network and a TS ID (Identifier) for identifying the TS.

  Different network IDs are assigned to the BS network, the CS1 network, and the CS2 network, respectively. In the case of digital terrestrial broadcasting, network IDs having different values are assigned to different broadcasting stations in the same region.

  The service information part includes a service ID (so-called channel number) that is an identifier for identifying each service (channel) in the network.

  The EIT describes program information for each event (so-called program), and is divided into a service information section and an event information section. The service information part includes a service ID (so-called channel number) that is an identifier for identifying each service (channel) in the network.

  The event information section includes an event ID, event start time, event duration, event name (so-called program title), event genre, and the like. TOT describes the current time.

  Although the digital broadcasting operated in Japan has been described above, the same program information as the above-described program arrangement information is transmitted also in the digital broadcasting operated in each country. Therefore, the present invention described below can be applied to digital broadcasting in each country.

  The first embodiment according to the present invention will be described below.

[System configuration]
FIG. 1A is a block diagram showing an example of the network terminal system according to the first embodiment.

  The network terminal system of the present embodiment includes, for example, a television receiver 1, a television receiver 2, a wireless terminal 3, a wireless terminal 4, a wireless router 5, an external network 6, and a program related information distribution server 7. In the illustrated example, a user of a wireless terminal 3 or 4 that is a mobile communication terminal such as a mobile phone as an information communication terminal has the wireless terminal at home, a store, etc. This is an example when viewing a program.

  The wireless router 5 has a wireless LAN function such as Wi-Fi and can be connected to the external network 6 via a communication line. The wireless router 5 is connected to the television receiver 1, the television receiver 2, the wireless terminal 3, the wireless terminal 4, and the external network 6. The television receiver 1, 2 or the wireless terminals 3, 4 are connected to the Internet network. You can get information from

  The wireless router 5 is connected to the television receivers 1 and 2 via a wired LAN or a wireless LAN, and is connected to the wireless terminals 3 and 4 via a wireless LAN. Here, Wi-Fi is a standard for a wireless LAN (Local Area Network) established by the IEEE (American Institute of Electrical and Electronics Engineers) standard “IEEE 802.11a / IEEE 802.11b”.

  The program related information distribution server 7 is connected to the external network 6, and the television receivers 1, 2 or the wireless terminals 3, 4 are connected to the program related information distribution server 7 connected to the external network 6 via the wireless router 5 and information. Can be sent and received. The wireless terminals 3 and 4 can also connect to the communication network through the base station 9 using a mobile communication network, and can transmit and receive information via an external network connected to the communication network. In the present embodiment, the program related information distribution server 7 is described as an example of connection on an external network, but may be connected on a communication network.

  Hereinafter, a first embodiment according to the present invention will be described with reference to the drawings.

[Hardware configuration of TV receiver]
FIG. 1B is an example of a configuration diagram of the television receiver 1. In addition, since the structure of each part of the television receiver 2 is the same as that of the television receiver 1, description is abbreviate | omitted.

  The television receiver 1 is connected to an antenna 11, and includes a tuner / demodulation unit 12, a channel selection control unit 13, a signal separation unit 14, an audio decoding unit 15, a speaker 16, an audio output unit 17, a video decoding unit 18, and a superposition unit 19. A display unit 20, a video output unit 21, a communication I / F 22, an input unit 23, a control unit 24, a memory 25, a storage 26, an imaging unit 27, and the like. Each processing unit is connected via a bus 29.

  The television receiver 1 can store an application program in the storage 26. The control unit 24 develops the program from the storage 26 to the memory 25, and the control unit 24 executes the program to thereby perform various functions. Can be realized.

  In the following description, in order to simplify the description, it is assumed that various functions realized by the control unit 24 executing each application program are realized mainly by various program function units.

  Note that the application program may be stored in the storage 26 before the television receiver 1 is shipped, or a medium such as a CD (Compact Disk) / DVD (Digital Versatile Disk) or a semiconductor memory. And installed in the television receiver 1 via a medium connection unit (not shown). It is also possible to download and install from the external network 6 via the communication I / F 22 and the wireless router 5.

  Various functions of the application program can also be realized by hardware as a processing unit having similar functions. When implemented as hardware, each processing unit plays a main role in realizing each function.

  The input unit 23 is an input unit that receives an operation on the television receiver 1 from a user and inputs control information related to the input operation, and is realized by a pointing device such as a remote controller, a keyboard, and a mouse, for example.

  The control unit 24 receives a user operation request via the input means 23, and receives the signal separation unit 14, the channel selection control unit 13, the memory 25 (various program function units), the storage 26, the superposition unit 19, the communication I / O. Control each processing unit such as F22. Further, program status information such as a network ID and a service ID for identifying the program being viewed is transmitted to the program related information distribution server 7 connected to the external network via the communication I / F 22 and the wireless router 5. Send.

  The storage 26 is controlled by an instruction from the control unit 24 and can store an application program. In addition, various information created by the application program is stored. It is also possible to save content such as a video / audio stream from signals received from the tuner / demodulator 12 or the communication I / F 22.

  The memory 25 is controlled by an instruction from the control unit 24. The function part of the application program stored in the storage 26 is expanded in the memory 25.

  The tuner / demodulator 12 receives a broadcast signal from the broadcast station 8 by tuning to a desired service channel by the channel selection controller 13, and demodulates the received broadcast signal to obtain a transport stream. In the example of FIG. 1B, the tuner / demodulator 12 has one configuration for the sake of simplicity. However, when a function for performing viewing and recording in parallel and a function for simultaneously viewing content of a plurality of channels having different transmission frequencies, a plurality of tuners / demodulators 12 may be installed. Therefore, the tuner / demodulators 12 in the following description need not all be the same. Different tuners / demodulators may be used depending on the respective processes.

  The channel selection control unit 13 receives an instruction to select a service via the input unit 23, and controls the tuner / demodulation unit 12 to switch the channel to be selected according to the instruction. The channel selection control unit 13 can receive instructions from various program function units, and switches to a service (channel number) that broadcasts an event (program) currently being broadcast and a broadcast presentation unit to which the service belongs. Thus, the tuner / demodulator 12 is controlled.

  The communication I / F 22 is connected to the wireless router 5 by a wired LAN or a wireless LAN. In addition to or in place of the communication function with the wireless router 5, the communication I / F 22 is a wireless LAN such as Wi-Fi (registered trademark), IrDA (registered trademark), Bluetooth (registered trademark), NFC (Near). It may be configured to directly communicate with an external device without using the wireless router 5 by a method such as Field Communication. The communication I / F 22 may be mounted with chips that perform different communication methods. Moreover, you may mount as one chip | tip which handles several communication systems. Further, the communication I / F 22 can transmit and receive program information and various types of information to and from an apparatus connected to an external network via the wireless router 5. For example, it is possible to receive a content stream (video / audio stream) from a server connected to an external network in the form of IP broadcast, video on demand, or the like. It is also possible to receive program related information in a data format such as IP data cast (IPDC). It is also possible to download video streams and application programs from a server connected to an external network. The downloaded information is stored in the storage 26, for example. Hereinafter, an example in which the communication I / F 22 transmits / receives various information to / from the program related information distribution server 7 connected to the external network via the wireless router 5 will be described.

  The signal separation unit 14 includes video data, audio data, subtitle sentence data, program information, program related information, etc. for the transport stream obtained by the tuner / demodulation unit 12 and the content stream obtained via the communication I / F 22. , Separate by type. Further, it has a function of acquiring program information (for example, program arrangement information SI) and program-related information (data format such as IP data cast (IPDC)) and transmitting it to other processing blocks. When there is a data transmission request from another processing unit, the designated data is transmitted to the request source.

  Here, IP data cast (IPDC) refers to the use of IP (Internet Protocol) as a content delivery protocol in any digital infrastructure, regardless of communication and broadcasting, and services using the protocol. .

  The voice decoding unit 15 decodes the voice data separated by the signal separation unit 14. The audio information decoded by the audio decoding unit 15 is output from the speaker 16. The audio information decoded by the audio decoding unit 15 may be output from the audio output unit 17 to an external device.

  The video decoding unit 18 decodes the video data separated by the signal separation unit 14. The video information decoded by the video decoding unit 18 is sent to the superimposing unit 19.

  The superimposing unit 19 adds EPG images and OSD images created by various program function units to the decoded video information sent from the video decoding unit 18 and various types of information (caption information, subtitle super, data broadcasting separated from the signal separation unit 14). Data etc. generated from data etc. are superimposed.

  The video information that has passed through the superimposing unit 19 is displayed on the display unit 20. The display unit 20 is configured by, for example, a television or personal computer display or a liquid crystal panel. The video information that has passed through the superimposing unit 19 may be output from the video output unit 21 to an external device.

  Further, a digital I / F 28 that separates the transport stream for a predetermined program by the signal separation unit 14 and outputs the video and audio without decoding may be provided.

  The imaging unit 27 captures a face image of the viewer of the television receiver 1, and the captured face image is sent to a face image acquisition unit that is realized by executing a program to be described later, and is converted into a specific format. The digital face image information is transmitted to the program related information distribution server 7 via the communication I / F 22. The viewer's face image by the imaging unit 27 is continuously photographed at a fixed time period while the television receiver 1 is operating. The imaging unit 27 may be a built-in device or an external device. In the case of an external device, the captured image is transmitted to the control unit 24 or the like via the digital I / F 28.

  In this embodiment, an example in which the signal separation unit 14 extracts and acquires digital broadcast program information and various types of information will be described. However, program information from an external network or a distribution source via the communication I / F 22 and the wireless router 5 is described. It is also possible to acquire various information. Further, the television receiver 1 of the present embodiment can be replaced with an STB or a recorder provided with an external display unit. In this case, the speaker 16 and the display are made from the configuration of the television receiver of FIG. The unit 20 can be omitted.

[Hardware configuration of wireless terminal]
FIG. 1C is an example of a configuration diagram of the wireless terminal 3. Note that the configuration of each unit of the wireless terminal 4 is the same as that of the wireless terminal 3, and thus the description thereof is omitted.

  The wireless terminal 3 includes, for example, a tuner / demodulation unit 31, a signal separation unit 142, a memory 33, a storage 34, an acceleration sensor unit 35, a geomagnetic sensor unit 36, a control unit 37, a display unit 38, a communication I / F 39, and mobile communication. An I / F 40, an input unit 41, a GPS receiving unit 42, and a gyro sensor unit 43 are configured, and each processing unit is connected via a bus 44.

  The wireless terminal 3 stores an application program in the storage 34, the control unit 37 develops the program from the storage 34 to the memory 33, and the control unit 37 executes the program to realize various functions. be able to. In the following description, in order to simplify the description, various functions realized by the control unit 37 executing each application program will be described as being realized mainly by various program function units.

  The application program may be stored in the storage 34 before the wireless terminal 3 is shipped, or may be stored in a medium such as an optical medium such as a CD (Compact Disk) or a DVD (Digital Versatile Disk), or a semiconductor memory. It may be stored and installed in the wireless terminal 3 via a medium connection unit (not shown). Alternatively, it may be downloaded from the external network 6 via the communication I / F 39 and the wireless router 5 and installed. Alternatively, it may be downloaded from the distribution source via the mobile communication I / F 40 and the base station 9 and installed. Furthermore, it is also possible to connect to a personal computer (PC) that has acquired an application program via a network via an external device connection I / F (not shown), and move or copy the PC to the wireless terminal 3 for installation.

  The application program can also be realized by hardware as a processing unit having the same function. When implemented as hardware, each processing unit plays a main role in realizing each function.

  The communication I / F 39 is connected to the wireless router 5 by a wireless LAN or the like. In addition to or in place of the communication function with the wireless router 5, a wireless LAN such as Wi-Fi (registered trademark), IrDA (registered trademark), Bluetooth (registered trademark), NFC (Near Field Communication), or the like Thus, it is possible to directly communicate with other devices such as the television receiver 1 or the television receiver 2 without using the wireless router 5. The communication I / F 39 is connected to an external network via the wireless router 5 and transmits / receives information to / from a Web server such as a content distribution server on the external network. The communication I / F 39 may be mounted with chips that perform different communication methods. Moreover, you may mount as one chip | tip which handles several communication systems. The mobile communication I / F 40 includes a GSM (Global System for Mobile Communications) system (registered trademark), a W-CDMA (Wideband Code Division Multiple Access) system, a CDMA2000 system, a UMTS (universal mobile network) system, and the like. A mobile communication system (hereinafter referred to as “3G”) or a mobile communication network such as the LTE (Long Term Evolution) system is used to connect to the communication network through the base station 9 and transmit / receive information to / from a server on the communication network. It can be performed. Further, the connection with the external network by the communication I / F 39 can be prioritized over the communication network connection by the mobile communication I / F 40.

  The control unit 37 receives user operation requests via the input means 41 and various sensor units, and receives a signal separation unit 142, a display unit 38, a memory 33 (various program function units), a storage 34, a communication I / F 39, Each processing unit such as the mobile communication I / F 40 is controlled. Further, the control unit 37 also receives program information (for example, program information) from the external network 6 via the communication I / F 39 and the wireless router 5 or from the external network 6 via the mobile communication I / F 40 and the base station 9. Arrangement information SI) and program related information (data format such as IP data cast (IPDC)) can be acquired, and it has a function of passing to various program function units.

  In the present embodiment, an example in which program information and program related information are acquired from an external network or a distribution source via the communication I / F 39 or the mobile communication I / F 40 will be described. It is also possible to extract and acquire program information and program related information.

  The storage 34 is controlled by an instruction from the control unit 37 and can store an application program. In addition, various information created by the application program is stored. Further, content such as a video / audio stream may be stored from a signal received from the tuner / demodulator 31, the communication I / F 39, or the mobile communication I / F 40.

  The memory 33 is controlled by an instruction from the control unit 37. The function unit of the application program stored in the storage 34 is expanded in the memory 33 by the control unit 37.

  The display unit 38 displays an image or video stored in the storage 34, a broadcast / distributed video, a UI for performing various operations, a browser display screen created by the browser engine 3101 described later, and the like. The image or video to be displayed may be an image generated by an application program, or may be a content image or video received via the tuner / demodulator 31, or an image received from a server on an external network via the communication I / F 39. It may be a video, an image and a video received from the television receiver 1 via the communication I / F 39, or an image and a video distributed from a server on the communication network via the mobile communication I / F 40. Moreover, the display part 38 may be comprised integrally with the following touch panel etc., for example.

  The input unit 41 is an input unit that receives an operation on the wireless terminal 3 from the user and inputs control information related to the input operation. For example, a physical button or a touch panel can be used. Hereinafter, although an example using a touch panel will be described in the present embodiment, various operations may be configured using physical buttons.

  By using the touch panel, performing an operation to move an arbitrary object (icon) on the touch panel while touching it with a finger (drag operation) or an operation to move the screen by flicking the finger (flick operation) Objects can be moved freely. Further, when an operation of tapping an object or the like with a finger (tap operation) or an operation of tapping twice (double tap operation) is performed, the object (icon) or the like can be activated or switched to another screen. Further, by directly touching on the Web content, it is possible to freely move the screen of the Web content by performing an operation (drag operation) for moving an arbitrary position while touching with a finger. In addition, when an operation (tap operation) is performed by tapping an anchor tag such as a text or an image specified with a URL (Uniform Resource Locator) of link destination information once with a finger, a desired Web content is browsed on the browser. Can do. In the present embodiment, each operation of the touch panel described above will be referred to as a drag operation, a flick operation, and a tap operation.

  The tuner / demodulator 31 and the signal separator 142 have the same functions as the tuner / demodulator 12 and the signal separator 14 of the television receiver 1, respectively. Since these functions have already been described, description thereof will be omitted.

  The acceleration sensor unit 35 measures the acceleration applied to the wireless terminal 3. For example, the control unit 37 can determine which part of the wireless terminal 3 is above by measuring the gravitational acceleration by the acceleration sensor unit 35, and the acceleration sensor unit 35 can display the upper part of the screen displayed on the display unit 38. Is displayed so as to be aligned with the measured upper direction, it is possible to display a screen according to how the user holds the wireless terminal 3.

  The geomagnetic sensor unit 36 measures geomagnetism by using a plurality of magnetic sensors.

  The GPS receiver 42 receives signals transmitted from a plurality of satellites using GPS (Global Positioning System). The control unit 37 can calculate the position information of the wireless terminal 3 based on the signal received by the GPS receiving unit 42. For example, when acquiring the program arrangement information SI from the network via the communication I / F 39 or the mobile communication I / F 40, the control unit 37 transmits the position information of the wireless terminal 3 to the transmission source of the program arrangement information SI. The transmission source of the program arrangement information SI can transmit the program arrangement information SI corresponding to the area where the wireless terminal 3 is located to the wireless terminal 3.

  The gyro sensor unit 43 measures the angular velocity of the wireless terminal 3 that occurs when the user moves the wireless terminal 3.

[Hardware configuration of server]
FIG. 1D is an example of a configuration diagram of the program related information distribution server 7.

  The program related information distribution server 7 includes, for example, a communication I / F 50, a control unit 51, a memory 52, and a storage 53, and each processing unit is connected via a bus 58.

  The program-related information distribution server 7 stores application programs in the storage 53, the control unit 51 expands the programs from the storage 53 to the memory 52, and the control unit 51 executes the programs to perform various functions. Can be realized. In the following description, in order to simplify the description, various functions realized by the control unit 51 executing each application program will be described as being realized mainly by various program function units.

  The communication I / F 50 is connected to the external network 6 and is connected to the wireless router 5 via the external network 6. The communication I / F 50 transmits / receives various information to / from the communication I / F 39 of the wireless terminal 3 or the communication I / F 22 of the television receiver 1.

  The control unit 51 controls the communication I / F 50, the memory 52, the storage 53, and various program function units. In addition, the control unit 51 receives program status information such as a network ID and a service ID for identifying a program viewed by the viewer of the television receiver 1 or 2 via the external network 6 and the communication I / F 50. Receive. Further, the control unit 51 communicates information related to the program specified by the program status information from the programs, advertisements, contents, and the like stored in the program related information database 54, the advertisement information database 55, and the content database 56 of the storage 53. It also has a function of passing to the wireless terminal 3 via the I / F 50 and the external network 6.

  The storage 53 is controlled by an instruction from the control unit 51 and can store an application program. In addition, various information created by the application program is stored. It also has a function of accumulating information such as program-related information such as keywords associated with a program, content location information, additional information, and face information for identifying a user.

  The memory 52 is controlled by an instruction from the control unit 51. The function unit of the application program stored in the storage 53 is expanded in the memory 52 by the control unit 51.

  The content 4201 stores missed programs such as previous broadcasts, related video content, and the like, and the content can be distributed by link information from the content database 56. Note that the content may be stored in another distribution server.

[TV receiver software configuration]
FIG. 2A is a diagram showing a configuration of the memory 25 and the storage 26 in the configuration of the television receiver 1 or the television receiver 2 in FIG. In FIG. 2A, the storage 26 stores a browser program 2001, a user / device authentication program 2006, a program-related information App program 2007, and a face image acquisition program 2008. The state in which these programs are expanded as a browser engine 2101, a user / device authentication unit 2106, a program related information App unit 2107 and a face image acquisition unit 2108 by the control unit 24 is shown. The browser program 2001, the user / device authentication program 2006, the program related information App program 2007, and the face image acquisition program 2008 may be stored in the storage 26 at the time of product shipment, and downloaded via the communication I / F 22. May be. The control unit 24 executes these programs to realize various functions. In the following description, it is assumed that each program function unit in the memory 25 is mainly realized.

  The browser engine 2101 includes functional blocks of an HTML parser 2102, a database generation unit 2103, a rendering unit 2104, and an image processing unit 2105.

  The HTML parser 2102 analyzes the logical structure of HTML data such as a program related information setting screen acquired via the control unit 24. Moreover, the acquired HTML data can be interpreted and converted into internal data used by the television receiver 1.

  The database generation unit 2103 generates a database related to the HTML data structure.

  The rendering unit 2104 generates a layout structure including information on the expression format determined by each tag based on the database, and based on this layout structure, the browser display screen is displayed according to the size, position, and image data. (Program related information setting screen etc.) is generated.

  The image processing unit 2105 converts the acquired image file into image data such as a bitmap format based on the image file information such as the arrangement and image file name of the image file specified by the image tag in the HTML data.

  When the control unit 24 activates the program related information App unit 2107 by the input received by the input unit 23, the program related information App unit 2107 activates the browser engine 2101, and the browser engine 2101 links the program related information linked by the link information. The distribution server 7 is accessed. Next, the browser engine 2101 specifies a request message for requesting a resource such as an HTTP-compliant Web content from the external network 6 by the URL on the network via the control unit 24, the communication I / F 22, and the wireless router 5. To the program related information distribution server 7 to be transmitted. The server specified by the URL creates a response message corresponding to the received request message and sends it back. The returned response message is input to the browser engine 2101 via the external network 6. An HTML document is embedded in the response message, and a browser display screen is generated by the HTML parser 2102, the database generation unit 2103, the rendering unit 2104, and the image processing unit 2105 of the browser engine 2101 and displayed on the display unit 20.

  The user / device authentication unit 2106 receives a user account input by the user using the input means 23 and a password associated with the user account (hereinafter referred to as user authentication information) in order to receive authentication from the program related information distribution server 7. Then, the data is transmitted to the program related information distribution server 7 connected to the external network 6 via the communication I / F 22 and the wireless router 5. The user authentication information can be stored in various data in the storage 26. When authentication is performed for the second time or later, the input of the authentication information can be omitted by referring to the user authentication information stored in the various data. . In addition, it is assumed that the user authentication information is displayed on the display unit 20 by a user operation, or can be confirmed by a user with a document attached when the television receiver 1 is purchased. Further, the MAC address of the television receiver 1 may be stored as a device ID in the storage 26 of the television receiver 1 or a non-illustrated nonvolatile memory.

  The program related information distribution server 7 compares the authentication information transmitted from the television receiver 1 with the pre-registered authentication information, and if the authentication information matches, the program related information distribution server 7 checks the user / device authentication unit 2106 of the television receiver 1. Allow connection. On the other hand, if the authentication information is incorrect, the program related information distribution server 7 does not authenticate the connection.

  The above is an example of an authentication method, and a known technique may be used for the authentication method and the method for encrypting information transmitted and received when the authentication is successful, and there is no particular limitation in this embodiment. Further, the authentication information of the program related information distribution server 7 can be registered in advance using the television receivers 1 and 2, the wireless terminals 3 and 4, or a PC.

  The program related information App section 2107 indicates an application of program related information. The input unit 23 receives an operation from the user, and is activated by a tap operation of an application activation icon displayed on the display unit 20. Also, program status information such as a network ID and service ID for identifying a program that the user is currently viewing is created from the program arrangement information SI of the program, and the program related information is transmitted via the communication I / F 22 and the wireless router 5. The information is transmitted to the information distribution server 7. In this embodiment, an example in which the setting unit of the program related information application is used is described. However, when the television is operated alone, the program related information application of the wireless terminals 3 and 4 to be described later is used. Similarly to the above, keywords or link information of program-related information or part or all of content information can be displayed on the display unit 20, and search, link, etc. can be performed by the browser engine 2101.

  The face image acquisition unit 2108 acquires digital face image information including the face image captured by the imaging unit 27. The acquired digital face image information can be converted into various formats such as a compressed format or an uncompressed format. Further, the compression format can vary the compression rate according to the communication line capacity by setting not shown. The digital face image information converted into a specific format is transmitted to the program related information distribution server 7 connected to the external network 6 via the communication I / F 22 and the wireless router 5.

[Software configuration of wireless terminal]
FIG. 2B is a diagram showing the configuration of the memory 33 and the storage 34 in the configuration of the wireless terminal 3 in FIG. In FIG. 2B, the storage 34 stores a browser program 3001, a user authentication program 3006, a program related information App program 3007, and a content reproduction program 3008. These programs are expanded as a browser engine 3101, a user authentication unit 3106, a program related information App unit 3107 and a content playback unit 3108 in the memory 33 by the control unit 37, and various functions are performed by the control unit 37 executing the program. Can be realized. The browser program 3001, the user authentication program 3006, the program related information App program 3007, and the content reproduction program 3008 may be stored in the storage 34 at the time of product shipment, and the communication I / F 39 or the mobile communication I / F 40 may be stored. You may download via.

  In the following description, in order to simplify the description, various functions realized by the control unit 37 executing each application program will be described as being realized mainly by various program function units.

  Similar to the browser engine 2101 of the television receiver 1, the browser engine 3101 includes functional blocks of an HTML parser 3102, a database generation unit 3103, a rendering unit 3104, and an image processing unit 3105. The description of the HTML parser 3102, the database generation unit 3103, the rendering unit 3104, and the image processing unit 3105 is the same as that of the browser engine 2101, and detailed description thereof is omitted.

  When the control unit 37 activates the program-related information App unit 3107 according to the operation of the input means 41, the program-related information App unit 3107 activates the browser engine 3101, and the browser engine 3101 enters the server linked by the link information. Access. Next, the browser engine 3101 specifies a request message for requesting a resource such as an HTTP-compliant Web content from the external network 6 by a URL on the network via the control unit 37, the communication I / F 39, and the wireless router 5. To the program related information distribution server 7 to be transmitted. The program related information distribution server 7 specified by the URL creates a response message according to the received request message and sends it back. The returned response message is input to the browser engine 3101 via the external network 6. An HTML document is embedded in the response message, and a browser display screen is generated by the HTML parser 3102, the database generation unit 3103, the rendering unit 3104, and the image processing unit 3105 of the browser engine 3101 and displayed on the display unit 38.

  In order to receive authentication from the program-related information distribution server 7, the user authentication unit 3106 is preliminarily stored in various data in the storage 34 by a user using the input means 41 and a password associated with the user account. (Hereinafter referred to as user authentication information) is transmitted to the program related information distribution server 7 connected to the external network 6 via the communication I / F 39 and the wireless router 5. When authentication is performed for the second time or later, the authentication information input can be omitted by referring to the authentication information of the connected device stored in various data in the storage 34.

  The program related information App unit 3107 acquires program related information or keyword presentation information such as keywords and link information transmitted from the program related information distribution server 7 through the communication I / F 39 or the mobile communication I / F 40, and acquires the acquired program. The related information screen information is passed to the browser engine 3101 to create a program related information display screen and display it on the display unit 38. Part or all of the keyword or link information acquired from the program related information distribution server 7 can be displayed in each program related information column of the program related information display screen. The program related information App unit 3107 controls the presentation timing based on the keyword presentation information associated with the program or the scene of the program.

  The content playback unit 3108 receives data (for example, movies and dramas) and content information distributed from a content server or the like via the communication I / F 39 or the mobile communication I / F 40, and sequentially receives received video, Present it to the user by playing back audio. In this embodiment, a case of content distribution and reproduction by streaming will be described. Further, the information on the playback stop position of the content is stored as resume information in various data in the storage 34, and when playback of the same content is resumed, the playback stop position data is acquired from the resume information and used as the playback start position. it can.

Server software configuration
FIG. 2C is a diagram showing the configuration of the memory 52 and the storage 53 in the configuration of the program related information distribution server 7 in FIG. FIG. 2C shows a user / device management program 4001, a program related information extraction program 4002, an advertisement information extraction program 4006, a face recognition program 4009, a program related information screen generation program 4010, a program scene synchronization processing program 4011 in the storage 53. And a content distribution program 4012 is stored. These programs are stored in the memory 52 by the control unit 51, such as a user / device management unit 4101, a program related information extraction unit 4102, an advertisement information extraction unit 4106, a face recognition unit 4109, a program related information screen generation unit 4110, a program scene synchronization process. Various functions can be realized by developing as the unit 4111 and the content distribution unit 4112 and causing the control unit 51 to execute the program. A user / device management program 4001, a program related information extraction program 4002, an advertisement information extraction program 4006, a face recognition program 4009, a program related information screen generation program 4010, a program scene synchronization processing program 4011, and a content distribution program 4012 are preliminarily stored in an external storage or the like. Can be stored from. Note that the program-related information database 54, the advertisement information database 55, the content database 56, and the face information database 57 are various databases, and the description in FIG.

  The user / device management unit 4101 performs authentication for each user based on the user authentication information of the television receivers 1 and 2 or the wireless terminals 3 and 4, and the authenticated television receivers 1 and 2 or wireless terminals 3 and 4 Are managed separately by user account. User authentication information is stored in various data in the storage 53. The user / equipment management unit 4101 receives user authentication information input by input using the input means 41 or the input means 23 by the user of the wireless terminals 3 and 4 and the television receivers 1 and 2 through the communication I / F 50 and the external network 6. To check if you are a regular registered user. If the user authentication information is not correct, it has a function to return error information. Further, the user / device management unit 4101 can separately set a user account (primary administrator) having the setting authority of the television receiver 1 or 2 connected via the external network 6 and the wireless router 5. In this embodiment, it is assumed that the user of the wireless terminal 3 is registered as a primary administrator who has the authority to set the television receiver 1 or 2, but a user other than the users of the wireless terminals 3 and 4 is registered. May be set. Further, the television receiver 1 or 2 may be set using a PC or the like according to the user account of the wireless terminal 3.

  As shown in FIG. 2C, the program-related information extraction unit 4102 includes functional blocks of a keyword extraction unit 4103, a link information extraction unit 4104, and a content information extraction unit 4105, and passes through the communication I / F 50 and the external network 6. Program related information is extracted from program information acquired from program arrangement information SI or metadata from a broadcaster or a program information provider. Also, recommended information corresponding to attribute information such as sex, age, and hobbies is generated and registered in the database.

  The keyword extraction unit 4103 extracts information or a character string serving as a keyword from each program information such as a program title and program detailed information. For example, the keyword extraction unit 4103 detects a phrase from each program information in units of independent words or words, and the phrase dictionary 4202 uses a phrase such as one character in order from the first character of the character string or a combination of the first and next two characters. If there is a corresponding phrase by comparing with the dictionary data, this independent word unit or word unit phrase is registered as a keyword in the program related information database 54 of the storage 53 shown in FIG. In addition, keywords recommended by broadcasters can be registered.

  If the keyword extracted by the keyword extraction unit 4103 includes detailed information recommended by a broadcaster or a program information provider, the link information extraction unit 4104 links the extracted keyword and the detailed information in association with each other. Information is registered in the program related information database 54.

  The keyword or link information extracted from the keyword extraction unit 4103 or the link information extraction unit 4104 can be acquired from the program sequence information SI or metadata, etc., and primary information that can be provided in advance by the broadcast start time, and the program that is actually broadcast It consists of secondary information that can be obtained from metadata extracted from the contents and can be provided after the broadcast starts or after the broadcast ends.

  When secondary information is provided before the start of broadcasting, it is automatically presented after the start of broadcasting so that it cannot be presented to the user before the start of broadcasting by encrypting it according to a predetermined procedure or adding keyword presentation information. The presentation timing can be controlled according to the scene of the program. Moreover, secondary information can present only a keyword previously as a notice after the presentation start time. In this case, it is possible to notify the user of the advance information by displaying information such as scheduled presentation time of detailed information as a message, displaying a message when presented, or mailing to the user's wireless terminal.

  The content information extraction unit 4105 extracts video distribution link information such as the previous broadcast, today's broadcast, and related video from the content database 56 in which video content related to the program is registered, and associates it with the content related information. Similarly, content-related information can be obtained from primary information that can be provided in advance by the broadcast start time and metadata extracted from the contents of the program that was actually broadcast, and secondary that can be provided after the broadcast starts or after the broadcast ends. Consists of information.

  The advertisement information extraction unit 4106 includes functional blocks of a keyword extraction unit 4107 and a link information extraction unit 4108 as shown in FIG.

  The keyword extraction unit 4107 extracts keyword information from advertisement information provided in advance by the program sponsor, and registers it in the advertisement information database 55 of the storage 53 shown in FIG. In addition, keywords recommended by program sponsors can be registered.

  When the keyword extracted by the keyword extraction unit 4107 includes detailed information recommended by the program sponsor, the link information extraction unit 4108 registers link information in which the extracted keyword and the detailed information are associated with each other in the advertisement information database 55. To do.

  The keyword or link information extracted from the keyword extraction unit 4107 and the link information extraction unit 4108 includes primary information that can be provided in advance by the broadcast start time in the same manner as the program-related information extraction unit 4102 described above, and after the broadcast starts or ends. Secondary information that can be provided from. The advertisement information may be only the secondary information when the information cannot be provided in advance as the primary information due to the intention of the sponsor. In addition, when providing secondary information before the start of broadcasting, it can be encrypted by a predetermined procedure or added to the presentation start time information so that it cannot be presented to the user before the broadcast starts. It can be automatically presented later. Moreover, secondary information can present only a keyword as a prior notice without link information. In this case, it is possible to notify the user of the advance information by displaying information such as scheduled presentation time of detailed information as a message, displaying a message when presented, or mailing to the user's wireless terminal.

  Based on the program status information for identifying the program viewed by the viewer of the television receiver 1 acquired through the communication I / F 50 and the external network 6, the control unit 51 uses the program related information extraction unit 4102 or the advertisement information. The program related information is acquired from the program related information database 54 or the advertisement information database 55 registered by the extraction unit 4106 and is passed to the program related information screen generation unit 4110.

As the information limited to the area, area identification information for identifying the reception area, such as an area code registered at the time of initial setting in the television receivers 1 and 2 and the wireless terminals 3 and 4 may be used. As a registration method of the area identification information in the television receivers 1 and 2,
(1) Enter the region code of the corresponding region described in the instruction manual.
(2) A correspondence table between address and area code is held in the device in advance, and the user inputs the address and registers the corresponding area code as area identification information.
(3) A correspondence table of postal codes and area codes is held in the device in advance, and the user inputs a postal code to register the corresponding area code as area identification information.
Such a method may be adopted. In addition to the above (1), (2) and (3), the registration method of the area identification information in the wireless terminals 3 and 4 is as follows:
(4) Register the corresponding area code as area identification information using the address information acquired by the GPS receiver.
It is also possible to use this method. The registered area identification information may be stored in a nonvolatile memory (not shown).

  The face recognition unit 4109 receives the digital face image information acquired by the face image acquisition unit 2108 of the television receiver 1, detects the facial features of the person included in the digital facial image information, and detects facial feature data in the facial images. To extract. When a plurality of faces are captured in one frame of the captured image, the faces of a plurality of persons are detected, and feature data of each face is extracted. The face feature data is an example of face information that is information about the face.

  The extracted facial feature data can be registered as facial recognition information feature data in the facial information database 57 of the storage 53 shown in FIG. Further, the similarity is determined by comparing the feature data of the face acquired by the face image acquisition unit 2108 with the feature data of the face recognition information registered in the face information database 57, and the user information of which user account is the acquired face information. It is specified whether it is. If the specified user exists in the face information database 57, it is determined that the user is currently viewing the program, and the control unit 51 adds the program related information App to the wireless terminal owned by the user. A communication network or an external network connected to the communication network via the communication I / F 50 sends a notification (message) indicating the start of program-related information display or an instruction to automatically start the program-related information App. 6 to transmit.

  As a mechanism for notifying the wireless terminals 3 and 4 of an application activation command or message from the program-related information distribution server 7, a notification method such as push notification may be employed. For example, Apple (registered trademark) is called APNS (Apple Push Notification Service), which is adopted in a portable terminal called iphone (registered trademark). Push notification refers to a mechanism for automatically sending information from a server to a client terminal.

  The program related information screen generation unit 4110 generates display screen information for displaying a setting screen, a program related information screen, and the like on the display unit 38 of the wireless terminals 3 and 4. Further, the program related information screen generation unit 4110 generates display screen information corresponding to the user account or the user attribute. The display screen information and the like are transmitted to the television receivers 1 and 2 or the wireless terminals 3 and 4 via the communication I / F 50, the external network 6 and the wireless router 5, and the television receivers 1 and 2 or the wireless terminals 3 and 4 The program related information App section 2107 or 3107 of No. 4 displays a display screen such as a setting screen or a program related information screen on the display section 20 or the display section 38.

  The program scene synchronization processing unit 4111 uses keyword information in order to synchronize the keyword information or link information extracted by the program related information extraction unit 4102 or the advertisement information extraction unit 4106 with a presentation scene such as a program or CM that presents the keyword information or link information. Alternatively, keyword presentation information for associating link information with a presented program or a presentation scene is generated and stored in the program related information database 54 or the advertisement information database 55 of the storage 53 in association with the keyword information and link information. As keyword presentation information, information such as a time code that is updated according to the progress of the program can be given, and the keyword presentation information is presented at the current time, or time code information within a predetermined time from the current time is displayed. If so, the keyword can be presented. Further, keywords and link information that should be presented in units of programs may be in a state where there is no keyword presentation information (for example, null (empty) data).

  The content distribution unit 4112 receives content such as video stored in the content 4201 of the storage 53 based on a distribution request from a device such as the wireless terminal 3 or the television receiver 1 through the communication I / F 50 and the external network 6. Distribution control can be performed in accordance with display performance.

[data form]
Next, a data format related to the network terminal system according to the present embodiment will be described with reference to FIGS.

  FIG. 3A is a diagram illustrating an example of a data format of program status information transmitted from the television receiver 1 to the program-related information distribution server 7.

  As shown in FIG. 3A, the program status information transmitted from the television receiver 1 to the program-related information distribution server 7 includes a network ID (so-called broadcast) 101, a service ID (so-called channel number) 102, an event ID. (So-called program) 103, event start time 104, event duration 105, event name (so-called program title) 106, and other information for specifying the program being viewed. The event start time 104 includes year, month, day, hour, minute, and second information, and the event duration 105 includes hour, minute, and second information.

  In the present embodiment, a case where a digital broadcast program is received and viewed is described as an example. However, a content stream in a form such as IP broadcast or video on demand from a server connected to an external network is described. In the case of receiving (video / audio stream), it may be configured from information that can identify the program being viewed, such as the name of the provider of the distribution source and program identification information.

  FIG. 3B is a data table showing an example of contents of user management information managed by the user / device management unit 4101 of the program related information distribution server 7. The user management information stores a user account 107 as a user authentication information, a password 108, and a user name 109, a mail address 110, an address, an attribute 111, and the like as detailed information on the user account.

  The user account 107 is associated with the password 108 and referred to as user authentication information of the wireless terminals 3 and 4.

  The e-mail address 110 uses information such as registration information to distribute e-mail for each user. The attribute 111 is an attribute that indicates the user's gender, age, hobbies and other preferences in order to provide detailed program-related information for each user. Also, in this embodiment, the description will be made on the premise that user authentication is performed using a password. However, general biometric authentication such as finger veins, fingerprints, voices, facial images, and irises may be used. The item changes.

  FIG. 3C is a data table showing an example of setting contents of the television receiver 1 among the device management information managed by the user / device management unit 4101 of the program related information distribution server 7. The device management information managed by the user / device management unit 4101 stores a primary administrator (user account) 112, a user (user account) 113, a device name 114, a device ID 115, a device IP address 116, and the like.

  A primary administrator (user account) 112 indicates a user account when a user (wireless terminal owner) having administrator authority capable of setting initial settings of the television receiver 1 or 2 is set as a primary administrator. A user (user account) 113 indicates a user account of a user who uses the television receiver 1 or 2. The device name 114 indicates a device name arbitrarily input by the user. The device ID 115 indicates an identification ID for uniquely identifying the television receiver 1 or 2, can be confirmed from a label attached to the device, and is set by the user. The device IP address 116 indicates a private IP address assigned to the television receiver 1 or 2.

  FIG. 3D is a diagram illustrating an example of a data format of program related information transmitted from the program related information distribution server 7 to the wireless terminals 3 and 4 according to attributes.

  The program related information transmitted from the program related information distribution server 7 to the wireless terminal 3 or 4 is configured in the form of type 117, level 118, and keyword / content 119, as shown in FIG.

  The type 117 indicates the type of related information, and includes “program related information”, “advertisement related information”, and “content related information”. The “program related information” is extracted from the program related information database 54 in which performers of the program, related information, and the like are registered as keywords. The “advertisement related information” is extracted from the advertisement information database 55 in which company information, product information, etc. of the program sponsor provided in the program are registered. The “content related information” is extracted from the content database 56 in which moving image content related to a program is registered, and includes link information for video distribution such as the previous broadcast, broadcast today, and related video. Each related information has a level 118 and a keyword / content 119.

  The level 118 is composed of a plurality of hierarchies. In this embodiment, the level 118 includes level 1 and level 2. Each level includes a keyword / content 119 including one or more keywords or contents. Some of the levels may be omitted depending on the type of program and content. In the present embodiment, description will be made assuming that the content related information is level 2 only.

  Level 1 indicates a keyword with no link designation, and a free word search can be performed by a search engine using the keyword.

  Level 2 indicates a keyword (content) with link designation, and link destination information (URL) to detailed information such as a WEB page related to the keyword is designated in advance. Also, the level 2 keyword can be searched for free words using the keyword in the same manner as the level 1 keyword.

  Moreover, the keyword (content) of the level 1 or level 2 of the secondary information can specify the keyword presentation information including the presentation start time and the presentation period, and is synchronized with the start of the program or the switching of scenes such as CM. Can be presented. Further, when the keyword presentation information is not specified, it can be presented immediately when the related information is received. Furthermore, for keywords for which detailed information is presented within a predetermined period, it is possible to perform reservation registration so as to notify the start of presentation. The keyword / content 119 can be set up to a predetermined upper limit number.

  In this embodiment, a keyword (content) with a link designation by text information is used, but a link designation from an object such as an image may be used. In this embodiment, program related information data corresponding to the attributes of the users of the wireless terminals 3 and 4 is provided. However, program related information data can be provided as a batch by attaching a user account for each device ID. Good. In this case, information about the user account designated on the wireless terminal side may be displayed. Furthermore, the program-related information data includes common program-related information data not specified in the user account, and the common program-related information can be displayed by setting on the wireless terminal side.

[Initial setting]
Hereinafter, an operation example at the initial setting when the network terminal system is used for the first time will be described with reference to FIGS. 4, 5, and 8 to 11.

  FIG. 4 shows that the primary administrator of the television receiver 1 makes the initial setting in the data format shown in FIG. 3C to the program related information distribution server 7 by input using the input means 23 of the television receiver 1. It is a sequence diagram which shows the operation | movement in the case of performing. Since it is the same when the initial setting is performed by the television receiver 2, the description thereof is omitted.

  FIG. 8 shows a display example of the menu screen of the television receiver 1.

  S101: In FIG. 8, when “program related information setting” 202 on the menu screen 201 is selected by the input means 23, the control unit 24 of the television receiver 1 instructs activation of the program related information App unit 2107, and “program related information” Launch the "Information Settings" app.

  S102: The program related information App unit 2107 activates the browser engine 2101, and the browser engine 2101 accesses the program related information distribution server 7 linked by the preset link information and requests login screen information.

  S103: The program related information distribution server 7 generates login screen information and transmits it to the television receiver 1.

  S104: The browser engine 2101 generates a login screen and displays the login screen of the program related information setting screen on the display unit 20.

  S105: When the control unit 24 of the television receiver 1 receives input of login information such as a user account and a password through the input unit 23, the control unit 24 sends the login information as a request message to the program information distribution server 7 to the browser engine 2101. To send to.

  S106: The user / device management unit 4101 of the program related information distribution server 7 refers to the user management information of various data, and authenticates the user if it is a regular registered user.

  S107: When the user related authentication is successful in S106, the program related information distribution server 7 returns the program related information setting screen information generated by the program related information screen generation unit 4110 to the browser engine 2101 as a response message.

  S108: The browser engine 2101 displays a program related information setting screen 203 as shown in FIG. 9 on the display unit 20 based on the received program related information setting screen information. FIG. 9 shows a display example of the program related information setting screen of the television receiver 1.

  In FIG. 9, a “device name” tab 204 is selected by a user from a device name list in which device names are listed for each manufacturer, but not specified, by a GUI such as a pull-down format or a check box format, or arbitrarily selected by the user. Indicates the input device name. The “device ID” tab 205 indicates an identification ID for uniquely identifying a device used by the user, which can be confirmed from a label attached to the device, a menu setting screen, and the like. To do. An “IP address” tab 206 indicates a private IP address assigned to the device, and is set by the user using the input unit 23. A “user” tab 207 indicates a user account of a user (including a primary administrator) who uses the device, and is input by the user using the input unit 23.

  S109: In the screen of FIG. 9, after the setting information is input to the “device name” tab 204, “device ID” tab 205, “IP address” tab 206, and “user” tab 207, the “confirm” button 207 is selected. When the input means 23 detects, the setting information is transmitted to the program related information distribution server 7.

  S110: The program related information distribution server 7 registers the received setting information.

  S111: Notify the television receiver 1 of a response including a message such as when registration is successful.

  Next, the operation when the user who is the owner of each wireless terminal performs the initial setting such as the device ID and the attribute for specifying the television receiver 1 or 2 by the input using the input means 41 of the wireless terminal 3 An example will be described.

  FIG. 5 is a sequence diagram showing an operation when the user of the wireless terminal 3 performs the initial setting for the program related information distribution server 7. Since the same applies when the user of the wireless terminal 4 performs the initial setting, the description thereof is omitted.

  FIG. 10 shows a display example of the menu screen of the wireless terminal 3.

  S201: In FIG. 10, when “program related information setting” 302 on the menu screen 301 is selected by the input means 41, the control unit 37 of the wireless terminal 3 commands the activation of the program related information App unit 3107, and “program related information” Launch the Settings app.

  S202: The program related information App unit 3107 activates the browser engine 3101, and the browser engine 3101 accesses the program related information distribution server 7 linked by the preset link information and requests login screen information.

  S203: The program related information distribution server 7 generates login screen information and transmits it to the wireless terminal 3.

  S204: The browser engine 3101 generates a login screen and displays the login screen of the program related information setting screen on the display unit 38.

  S205: When the control unit 37 of the wireless terminal 3 receives input of login information such as a user account and a password by the input means 41, the browser engine 3101 sends the login information as a request message to the program related information distribution server 7 To send.

  S206: The program related information distribution server 7 refers to the user management information of various data by the user / device management unit 4101 and authenticates the user if it is a regular registered user.

  S207: The program related information distribution server 7 returns the program related information setting screen information generated by the program related information screen generation unit 4110 to the browser engine 3101 as a response message when the user authentication is successful in S206. If the user authentication fails, screen information for displaying that fact is returned to the browser engine 3101, and the browser engine 3101 displays a display indicating that the authentication has failed on the display unit 38 based on the received screen information. Display.

  S208: The browser engine 3101 displays a program related information setting screen 304 as shown in FIG. FIG. 11 shows a display example of the program related information setting screen of the wireless terminal 3.

  In FIG. 11, a “user ID” tab 305 indicates a user account for identifying a user registered in advance in the program related information distribution server 7. The “device ID” tab 306 indicates a device ID for specifying the television receiver 1 or 2, and is set by the user using the input unit 41. A “basic information” tab 307 such as a user name and an “option” tab 308 such as a hobby indicate user attributes and the like, and are set by the user using the input unit 41.

  S209: When the input unit 41 detects selection of the “confirm” button 309 after setting information is input to the “device ID” tab 306, the “basic information” tab 307, and the “option” tab 308 on the screen of FIG. The setting information is transmitted to the program related information distribution server 7.

  S210: The program related information distribution server 7 registers the received setting information.

  S211: Notify the wireless terminal 3 of a response including a message, such as when registration is successful.

[Operation flow / sequence]
Next, an example in which the input unit 41 of the wireless terminal 3 receives an operation from the user and displays the program related information on the display unit 38 will be described with reference to FIGS. 6, 7, and 12 to 14.

  FIG. 6 is a diagram illustrating an example of an operation flow / sequence in the case where the television receiver 1 transmits program state information regarding the program being viewed to the program-related information distribution server 7.

  S2001: The input unit 23 of the television receiver 1 instructs the control unit 24 of the television receiver 1 to turn on the power.

  S2002: Upon receiving a power-on command, the control unit 24 of the television receiver turns on the power and, in conjunction with this, commands activation of the program-related information App unit 2107, and activates the “program-related information” application. to start.

The program related information App unit 2107 activates the browser engine 2101, and the browser engine 2101 accesses the program related information distribution server 7 linked by preset link information and requests login screen information. The program related information distribution server 7 generates login screen information and transmits it to the television receiver 1. The browser engine 2101 generates a login screen and displays a login screen of the program related information setting screen on the display unit 20. (Fig. 4 Same as steps S102 to S104)
S2003: The control unit 24 of the television receiver refers to the user authentication information stored in advance in various data, and transmits the user authentication information to the program related information distribution server 7.

  S2004: The program related information distribution server 7 refers to the user management information of various data by the user / equipment management unit 4101, authenticates the user if it is a legitimate registered user, and successfully authenticates to the control unit 24 of the television receiver. Notify that it has been done.

  S2005: Upon receiving a notification that the authentication is successful, the television receiver 1 transmits a device ID for authenticating the device to the program-related information distribution server 7.

  S2006: The program related information distribution server 7 authenticates the device if the device ID received from the television receiver 1 is a previously registered device.

  S2007: The control unit 24 of the television receiver 1 monitors whether or not the channel being viewed on the television receiver 1 has been changed. If there is no update (S2007: NO), the update wait state is entered.

  S2008: If the channel has been updated (S2007: YES), the updated program status information is transmitted to the program related information distribution server 7. Whether or not the program status information has been updated may be determined to have been updated only when the update cycle exceeds a predetermined time in order to prevent an increase in communication traffic.

  S2009: The program related information distribution server 7 stores the device ID of the television receiver 1 and the updated program state information in association with each other.

  S2010: When the input unit 23 of the television receiver 1 instructs the control unit 24 of the television receiver 1 to turn off the power, the control unit 24 receives the power-off command and turns off the power.

  S2011: The control unit 24 of the television receiver transmits logout information to the program related information distribution server 7.

  S2012: The program related information distribution server 7 makes a logout response and treats the television receiver 1 as an unviewed state.

  As described above, even when the channel of the television receiver 1 is switched, the program related information on the currently viewed program is transmitted by transmitting the program status information of the new channel after channel selection to the program related information distribution server 7. Program related information can be acquired from the distribution server 7 via the external network 6.

  FIG. 7 is a diagram showing an example of an operation flow / sequence for displaying program-related detailed information.

  S3001: In FIG. 10, when “program related information” 303 on the menu screen 301 is selected by the input means 41, the control unit 37 of the wireless terminal 3 commands the activation of the program related information App unit 3107, and “program related information”. Launch the app.

The program related information App unit 3107 activates the browser engine 3101, and the browser engine 3101 accesses the program related information distribution server 7 linked by the preset link information, and requests login screen information. The program related information distribution server 7 generates login screen information and transmits it to the wireless terminal 3. The browser engine 3101 generates a login screen and displays the login screen of the program related information setting screen on the display unit 38. (Same as steps S202 to S204 in FIG. 5)
S3002: The browser engine 3101 of the wireless terminal 3 transmits the user account and password login information input by the input means 41 to the program related information distribution server 7.

  S3003: The program related information distribution server 7 refers to the user authentication information stored in various data in the storage 53 by the user / device management unit 4101, and authenticates the user if it is a regular registered user.

  S3004: The program related information App unit 3107 of the television receiver 1 requests the transmission of program related information in the data format shown in FIG. 3 (d) via the browser engine 3101.

  S3005: Upon receiving a transmission request for viewing program related information from the wireless terminal 3 via the communication I / F 50, the control unit 51 of the program related information distribution server 7 confirms the user attribute corresponding to the user account of the wireless terminal 3. To do.

  S3006: The control unit 51 of the program-related information distribution server 7 refers to the data in the program-related information database 54 and the advertisement information database 55 in the storage 53, and displays information related to the viewing program corresponding to the user account or user attribute as shown in FIG. Program related information is created in the data format shown in (d), and is transmitted to the wireless terminal 3 via the communication I / F 50, the external network 6, and the communication I / F 39 of the wireless terminal 3. Moreover, keyword presentation information is added to the program related information, and the program related information can be presented in accordance with the presentation timing indicated by the keyword presentation information.

  S3007: The control unit 51 of the program related information distribution server 7 determines whether or not there is an update of keyword information, and if there is update information, transmits the program related information to the wireless terminal 3 (S3007: YES). If there is no update information (S3007: NO), monitoring is continued. Such automatic updating is useful when the program related information is presented in accordance with the presentation timing indicated by the keyword presentation information as described above, and the presentation timing is synchronized with the program or the scene of the program.

  S3008: The program related information App unit 3107 displays a program related information screen on the display unit 38 based on the received program related information.

  FIG. 12 shows a display example of the program related information screen.

  In FIG. 12, the program title display section 401 displays the program title, broadcast time, and channel number of the currently broadcast program, and the program related display section 402 displays related information such as performers, keywords, and sponsors. The Further, by tapping an “update” button 406, the latest information can be manually updated.

  In the present embodiment, the keyword “program related information” of type 117 shown in the data format of FIG. 3D is displayed in the “performer” section 403 and the “keyword” section 404. In addition, the keyword of “advertisement related information” of type 117 is displayed in the “sponsor” section 405.

  Also, the keyword designated as level 1 at level 118 in FIG. 3D is displayed without a frame in FIG. 12, and the keyword at level 2 is displayed with a frame. If there is a frame of level 2, it may be displayed separately from that of level 1 such as changing the character color or performing underline display.

  S3009: The control unit 37 detects that the keyword displayed on the program related information display screen is selected by the input means 41.

  S3010: The control unit 37 determines whether the selected keyword is level 1 or level 2.

  S3011: If the keyword determined in S3010 is level 1 (S3010: YES), display by keyword search is performed.

  S3012: If the keyword determined in S3010 is level 2 (S3010: NO), display by the designated URL is performed.

  S3013: The browser engine 3101 specifies a request message for requesting a resource such as Web content complying with HTTP from the external network 6 via the control unit 37, the communication I / F 39, and the wireless router 5, by the URL on the network. To the server.

  The server specified by the URL creates a response message corresponding to the received request message and sends it back. The returned response message is input to the browser engine 3101 via the external network 6. An HTML document is embedded in the response message, a browser display screen is generated by the HTML parser 3102 of the browser engine 3101, the database generation unit 3103, the rendering unit 3104, and the image processing unit 3105, and the program related detailed information is displayed on the display unit 38. indicate.

  In FIG. 12, the program related display unit 402 displays a mixture of level 1 and level 2, and when a level 1 (no frame) is tapped, a pop-up screen of the search screen of FIG. 13 is displayed.

  FIG. 13 is a diagram illustrating an example of a pop-up display screen 407 of the search screen in the wireless terminal 3.

  In FIG. 13, level 1 (no frame) has only link information but no keyword information, so various searches can be performed using this keyword as a search term.

  When “search in the program guide” 408 is selected by a tap operation, although not shown, the same program such as a continuous drama from the program arrangement information SI currently being broadcast or scheduled to be broadcasted by the wireless terminal 3 is obtained. It is possible to search for a title program or a program in which the same performer appears.

  When “Check by XXX search” 409 is selected, if the browser engine 3101 is not activated, the browser engine 3101 is activated, and a web search can be performed using a predetermined web search engine.

  Even when “Check with YYY” 410 is selected, the browser engine 3101 can be activated and related information can be searched from keywords using a Web service such as a free encyclopedia on the Web.

  Note that “search by XXX search” 409 and “search by YYY” 410 can be displayed in a plurality according to the number of Web search engines and Web services to be used, and a database (not shown) is stored in the wireless terminal 3. It is also possible to search for keywords from the database.

  When the database included in the wireless terminal 3 is used, the program-related information App unit 3107 can obtain the search result from the database and display the search result in a form such as a pop-up. Can be transmitted to an application that manages the search result, and the search result can be displayed on the operation screen of the application. When canceling the search, selecting “Cancel” 411 returns to the original screen of FIG.

  Next, an example when the level 2 (with a frame) in FIG. 12 is tapped will be described.

  When a keyword is selected by a tap operation in FIG. 12, a pop-up screen 412 of the search screen in FIG. 14 is displayed.

  FIG. 14 is a diagram showing a modification of the pop-up display screen 407 of the search screen in FIG.

  In FIG. 14, since level 2 (with a frame) has link information, “to specified URL” 413 is added to the search screen of FIG. When a “to specified URL” 413 is tapped, Web content information is acquired from the server specified by the URL, and a Web content screen (not shown) is displayed. The level 2 keyword can be “search by program guide” 408, “search by XXX search” 409, and “search by YYY” 410 to perform various searches as search terms. “Check with program guide” 408, “Check with XXX search” 409, “Check with YYY” 410 and “Cancel” 411 are the same as those in FIG.

  Here, by giving priority to the connection with the external network by the communication I / F 39 over the communication network connection by the mobile communication I / F 40, it is possible to use only when at home.

  Further, when the television receiver 1 is in a logout state with the power off, the program related information is provided when the wireless terminal 3 activates the program related information App and connects to the program related information distribution server 7. It is also possible to notify a message to the wireless terminal side as a case where it cannot be done.

  Further, in the same case, it is possible to provide related information related to a program selected from the electronic program guide without specifying a viewing program by cooperating with the electronic program guide. In this case, the program related information screen generation unit 4110 uses the communication I / F 50 and the external network 6 to acquire the program related information screen generation unit 4110 based on the program arrangement information SI acquired from the broadcaster or the program information provider. A program guide may be created, and program related information display screen information associated with each program in the electronic program guide may be provided to the wireless terminal.

  In this way, a user who views a program such as a television broadcast on the television receiver 1 selects a character string related to a keyword on the wireless terminal 3 by a tap operation, and the user's via an external network such as the Internet network. Related information according to the attribute can be acquired.

  Moreover, even when there are a plurality of viewers, related information customized according to the attributes of each user can be acquired. Further, even a wireless terminal that does not incorporate a digital broadcast receiver can display program related information in accordance with a program or a scene of the program. Even when data acquisition is expected to be delayed due to an external network load or the like, program related information can be presented in accordance with the program or the scene of the program.

  In addition, since a television receiver that displays a program such as a television broadcast is different from a wireless terminal that displays a character string for information retrieval, viewing of the television broadcast is interrupted for information retrieval, or OSD The problem of making it difficult to view the program being viewed by displaying the display or special symbols is solved.

  Hereinafter, a second embodiment according to the present invention will be described with reference to FIGS. 15, 16, and 17. In addition, a description will be given with emphasis on differences from the first embodiment.

[System configuration]
The network terminal system in this embodiment is similar to FIG. 1 in the first embodiment. The television receiver 1, the television receiver 2, the wireless terminal 3, the wireless terminal 4, the wireless router 5, the external network 6, and the program related It is composed of an information distribution server 7.

  Since the configuration of each part of the television receiver 1, the wireless terminal 3, and the program related information distribution server 7 is the same as that of the first embodiment, the description thereof is omitted.

Software configuration
Since the software configuration is the same as that of the first embodiment, the description thereof is omitted.

[Initial setting]
Hereinafter, an operation example at the time of initial setting by the television receiver 1 in the present embodiment will be described with reference to FIG. Since it is the same when the initial setting is performed by the television receiver 2, the description thereof is omitted.

  FIG. 15 is a sequence diagram illustrating an operation when the primary administrator of the television receiver 1 performs initial setting for the program-related information distribution server 7 by input using the input unit 23 of the television receiver 1. . Since it is the same when the initial setting is performed by the television receiver 2, the description thereof is omitted.

  Steps S301 to S305 are added after step S111 to FIG. 4 of the first embodiment.

  S101-S111: Since it is the same as the operation | movement step of FIG. 4, description is abbreviate | omitted.

  S301: In FIG. 8, when “program related information setting” 202 on the menu screen 201 is selected by the input means 23, the control unit 24 of the television receiver 1 instructs the activation of the program related information App unit 2107 to display “program related information”. Launch the Settings app. The “program related information setting” application includes a “face recognition setting” application, and the “face recognition setting” application is activated from a submenu (not shown).

  S302: The face image acquisition unit 2108 acquires digital face image information including the face image captured by the imaging unit 27, and converts the digital face image information into a specific format.

  S303: The control unit 24 transmits the digital face image information acquired by the face image acquisition unit 2108 to the program related information distribution server 7.

  S304: The face recognition unit 4109 of the program related information distribution server 7 extracts facial feature data from the digital face image information received from the television receiver 1, and stores it as face recognition information in the face information database 57 in association with the user account. To do.

  S305: The television receiver 1 is notified of a message response when registration is successful. Also, if the image is unclear due to the surrounding environment or image compression rate, or cannot be recognized correctly due to the distance to the viewer, the position of the face, etc., a message including the error estimation cause is notified.

[Operation flow / sequence]
FIG. 16 is a diagram illustrating an example of an operation flow / sequence in the case where the television receiver 1 transmits program state information relating to a program being viewed to the program related information distribution server 7 and the wireless terminal 3 acquires the program related information. It is. Since the same applies when the television receiver 2 or the wireless terminal 4 is used, the description thereof is omitted.

  Step S3101 to step S3104 are added between step S2006 and step S2007 with respect to FIG. 6 of the first embodiment. Further, steps S3105 and S3106 are added after step S2012.

  S2001-S2006, S102-S104: Since they are the same as the operation steps of FIGS.

  S3101: The face image acquisition unit 2108 acquires digital face image information including the face image captured by the image capturing unit 27, and converts the digital face image information into a specific format.

  S 3102: The control unit 24 transmits the digital face image information acquired by the face image acquisition unit 2108 to the program related information distribution server 7.

  S3103: The face recognition unit 4109 of the program-related information distribution server 7 extracts facial feature data from the digital face image information received from the television receiver 1. When a plurality of faces are captured in one frame of the captured image, the faces of a plurality of persons are detected, and the feature data of each face is distinguished and extracted. The extracted feature data of the face is compared with feature data stored in the face recognition information of the face information database 57 to determine the similarity, and to which user account the detected face is a user is specified. . If there is registered face information (S3103: YES), the program is because the TV receiver 1 being viewed is logged in to the wireless terminal (in this case, the wireless terminal 3) having the detected user account. Send a message notifying the start of display of related information screen. Also, a command for instructing automatic activation of the program related information App can be transmitted. In this case, it may be executed by a user operation from a selection button or the like displayed on the message image. If it is determined that there is no registered face information (S3103: NO), no message or instruction command is transmitted.

  S3104: The wireless terminal 3 displays a display start message for the program related information screen. Alternatively, the program related information App can be automatically activated by a setting not shown. Further, whether to receive a message to the wireless terminal 3 or whether to automatically start the program related information App can be set in advance by a setting (not shown) on the wireless terminal 3 side. It can also be set in advance not to receive or automatically start depending on the genre and time zone of the viewing program.

  FIG. 17 shows a display example in the case of the program related information notification screen.

  In FIG. 17, a notification display unit 414 is displayed on the program related information notification screen 414, and a message as to whether or not to display the program related information screen is displayed because the television receiver 1 is activated and the login is completed. . When the “Yes” button 416 is selected by a tap operation, the program related information App can be activated to display the program related information screen. When the “No” button 416 is selected, the program related information screen can be terminated by stopping.

  S2007 to S2012: Since it is the same as the operation | movement step of FIG. 6, description is abbreviate | omitted.

  S3105: When the program-related information distribution server 7 makes a logout response to the television receiver 1, the program-related information distribution server 7 notifies the wireless terminal 3 of the end of display of the program-related information screen because the television receiver being viewed is logged out. A message or a command for instructing automatic termination of the program related information App is transmitted. If it is determined in step S3103 that there is no registered face information (S3103: NO), a message or instruction command may not be transmitted. When the notification of the end of the display of the program related information screen is received, the end of the display of the program related information screen can be selected by using the selection button as in FIG.

  S3106: The wireless terminal 3 displays a display end message of the program related information screen by logout of the television receiver 1. Alternatively, the program-related information App activated on the wireless terminal 3 can be automatically terminated by a setting not shown. Similarly to the setting in the case of S3104, message reception and instruction command reception can be set in advance.

  As described above, when watching a television broadcast with a television receiver, it is possible to notify the start of program-related information of the wireless terminal or to start or stop the program-related information application in accordance with the power operation of the television receiver. In addition, since the wireless terminal and the television receiver can be used in synchronization, the usability of the viewer is improved.

  In this embodiment, in S3101 to S3103 of FIG. 16, the digital face image information including the face image captured by the image capturing unit 27 is converted into a specific format and transmitted to the program related information distribution server 7, and the program related information distribution is performed. The face recognition unit 4109 of the server 7 is configured to extract facial feature data from the digital face image information received from the television receiver 1. The television receiver 1 extracts facial feature data, and a program related information distribution server Even if it is configured to transmit to 7, the same effect as the present embodiment can be obtained, and further, network traffic can be suppressed. In this case, the television receiver 1 includes a face recognition unit, and the face recognition unit extracts feature data.

  The third embodiment according to the present invention will be described below with reference to FIGS. In addition, a description will be given with emphasis on differences from the first embodiment.

[System configuration]
The network terminal system in this embodiment is similar to FIG. 1 in the first embodiment. The television receiver 1, the television receiver 2, the wireless terminal 3, the wireless terminal 4, the wireless router 5, the external network 6, and the program related It is composed of an information distribution server 7.

  Since the configuration of each part of the television receiver 1, the wireless terminal 3, and the program related information distribution server 7 is the same as that of the first embodiment, the description thereof is omitted.

Software configuration
Since the software configuration is the same as that of the first embodiment, the description thereof is omitted.

[Operation flow / sequence]
FIG. 18 is a diagram illustrating an example of an operation flow / sequence for displaying program-related detailed information.

  Step S4001 to step S4004 are added between step S3012 and step S3013 with respect to FIG. 7 of the first embodiment.

  The detailed information on the level 2 keyword may not be confirmed yet at the presentation timing such as the start of broadcasting or after the end of broadcasting. In the present embodiment, a case will be described in which a designated URL is not displayed due to selection by a broadcaster or the like, and only keywords are presented.

  S3001 to S3007: Since they are the same as the operation steps of FIG.

  S3008: The program related information App unit 3107 displays the program related information on the display unit 38 based on the received program related information.

  S3009: The control unit 37 detects that the keyword displayed on the program related information display screen is selected by the input means 41.

  S3010: The control unit 37 determines whether the selected keyword is level 1 or level 2.

  S3011: If the keyword determined in S3010 is level 1 (S3010: YES), display by keyword search is performed.

  S3012: If the keyword determined in S3010 is level 2 (S3010: NO), display by the designated URL is performed.

  S4001: The control unit 37 determines whether there is currently unpresented information in the selected keyword. “With unpresented information” means that the presentation start time included in the keyword presentation information has already been reached, but the link information for detailed information has not been disclosed, and only the keyword is displayed. Show. If there is no unpresented information (S4001: NO), the screen of the designated URL is displayed.

  S4002: If it is determined in S4001 that there is unpresented information (S4001: YES), the control unit 37 confirms whether or not the user has made a reservation for information presentation by the input means 41, and a presentation reservation is made. (S4002: YES), the reservation information is transmitted from the external network 6 to the program related information distribution server 7 on the network via the communication I / F 39 and the wireless router 5. When the presentation information is not reserved (S4002: NO), the step ends here.

  S4003: The control unit 51 of the program related information distribution server 7 determines whether or not link information for detailed information is disclosed. The standby state is continued until link information for detailed information is disclosed in S4003 (S4003: NO).

  S4004: When link information for detailed information is disclosed in S4003 (S4003: YES), a presentation start message is transmitted to the wireless terminal 3. If the mail address of the user of the wireless terminal 3 is registered in advance, a presentation start message by mail may be transmitted. Further, only the presentation start information may be transmitted in step S4004, a mail may be generated by the wireless terminal 3, and the mail may be issued to itself.

  S3013: Since it is the same as the operation | movement step of FIG. 4, description is abbreviate | omitted.

  FIG. 19 shows a display example of a program related information screen according to the third embodiment. FIG. 19 shows a case where the selected keyword is level 2 and the detailed information related to the level 2 keyword is not yet confirmed at the presentation timing such as the start of broadcasting or after the end of broadcasting, and only the keyword is presented. A display example is shown. When a keyword having no link information such as detailed information is selected, it is determined that there is unpresented information and a message 418 is displayed. If the message 418 is currently unregistered and the scheduled presentation start time (or date) is known, the scheduled time (or date) can be displayed as prior information. Further, when the presentation reservation button 419 is selected by a tap operation, reservation registration can be performed.

  Note that the level 2 keyword with unpresented information is handled in the same manner as level 1 on the display screen in FIG. 12 until the start of presentation, with no frame displayed, and with the frame displayed after the start of presentation. it can.

  Further, the level 2 keyword in which the presentation period is set can be handled and displayed as a frameless display after the presentation period, in the same manner as the level 1 keyword.

  Further, the level 2 keyword that cannot currently display detailed information can be displayed in a display format different from both level 1 and level 2 in FIG.

  Thus, when there is unpresented information in the program-related information, a presentation start message or mail can be received at the timing of the presentation start, and oversight of the program-related information can be prevented. Further, it becomes possible to identify a level 2 keyword that cannot display detailed information and a level 2 keyword that can display detailed information, thereby improving the usability of the user. In addition, a level 2 keyword that cannot display detailed information can make a presentation reservation.

  The fourth embodiment according to the present invention will be described below with reference to FIGS. In addition, a description will be given with emphasis on differences from the first embodiment.

[System configuration]
The network terminal system in this embodiment is similar to FIG. 1 in the first embodiment. The television receiver 1, the television receiver 2, the wireless terminal 2, the wireless terminal 3, the wireless router 5, the external network 6, and the program related It is composed of an information distribution server 7.

  Since the configuration of each part of the television receiver 1, the wireless terminal 3, and the program related information distribution server 7 is the same as that of the first embodiment, the description thereof is omitted.

Software configuration
Since the software configuration is the same as that of the first embodiment, the description thereof is omitted.

[Operation flow / sequence]
FIG. 20 is a diagram illustrating an example of an operation flow / sequence for displaying program-related detailed information.

  In contrast to FIG. 7 of the first embodiment, steps S5001 to S5010 are added instead of steps S3009 to S3013.

  In the first to third embodiments, the case where the keyword or the detailed information related to the keyword is displayed as the program-related information has been described. However, in the present embodiment, contents such as video, audio, and character information are displayed on the Internet as the program-related information. The content related information when using the service to be distributed will be described.

  S3001 to S3003: Since they are similar to the operation steps of FIG.

  S3004: The program related information App unit 3107 of the wireless terminal 3 requests the program related information to be transmitted in the data format shown in FIG. 3D via the browser engine 3101.

  S3005: Upon receiving a transmission request for viewing program related information from the wireless terminal 3 via the communication I / F 50, the control unit 51 of the program related information distribution server 7 confirms the user attribute corresponding to the user account of the wireless terminal 3. To do.

  S3006: The control unit 51 of the program related information distribution server 7 refers to the data in the content database 56 of the storage 53, and shows the information related to the viewing program corresponding to the user account or the user attribute in the data format shown in FIG. Then, the program related information is created and transmitted to the program related information App unit 3107 via the communication I / F 50, the external network 6 and the communication I / F 39 of the wireless terminal 3. Moreover, content presentation information is added to the program related information, and the program related information can be presented in accordance with the presentation timing indicated by the content presentation information.

  S3007: The control unit 51 of the program related information distribution server 7 determines whether there is an update of the content distribution information, and when there is update information, transmits the program related information to the wireless terminal 3 as update information (S3007: YES). ). If there is no update information (S3007: NO), monitoring is continued.

  S3008: The program related information App unit 3107 displays a program related information screen on the display unit 38 based on the received program related information.

  S5001: The control part 37 detects that the content displayed on the program related information display screen by the input means 41 was selected.

  S5002: The control unit 37 determines whether the selected content currently has unpresented information.

  S5003: If it is determined in S5002 that “unpresented information is present” (S5002: YES), the control unit 37 confirms whether or not the user has made a reservation for the presentation information by the input means 41, and the presentation reservation is made. In the case (S5003: YES), the reservation information is transmitted from the external network 6 to the program related information distribution server 7 on the network via the communication I / F 39 and the wireless router 5. When the presentation information is not reserved (S5003: NO), the step ends here.

  S5004: The control unit 51 of the program related information distribution server 7 determines whether or not the content related information is disclosed. The standby state is continued until content-related information is disclosed in S5004 (S5004: NO).

  S5005: When content-related information is disclosed in S5004 (S5004: YES), a distribution start message is transmitted to the wireless terminal 3. If the mail address of the user of the wireless terminal 3 is registered in advance, a delivery start message by mail may be transmitted. Further, the distribution start message can include a distribution start date and time or a distribution end date and time. Alternatively, only the distribution start information may be transmitted in step S5005, and the wireless terminal 3 may generate a mail and issue the mail to itself.

  S5006: After the determination in S5002 or S5004, the control unit 37 activates the content reproduction unit 3108.

  S5007: The control unit 37 transmits the URL information of the content distribution destination to the program related information distribution server 7, and requests the start of distribution.

  S5008: The content distribution unit 4112 of the program related information distribution server 7 starts content distribution to the wireless terminal 3. When decryption key information for decrypting content is necessary, key information is transmitted prior to content distribution.

  S5009: A reproduction operation is performed by a user operation via the input means 41.

  S5010: The content playback unit 3108 of the wireless terminal 3 performs content playback processing. If there is a decryption key, the content information encrypted using the decryption key is decrypted, and the reproduction of the content is started.

  21 to 23 show display examples of the program related information screen according to the fourth embodiment. FIG. 21 shows a display example of the program related information in which the related content 420 is added to the program related display unit 402 with respect to FIG.

  In this embodiment, as the related content 420, there is the level 2 content “last broadcast” or “today broadcast”, the content related information of “last broadcast” has already been presented, and “today broadcast” The content will be distributed in the future. Although the presentation start time has already been reached, content distribution for detailed information has not been disclosed, and only the title is disclosed. For this reason, “today's broadcast” is determined as “unpresented information present”.

  FIG. 22 shows a display example of the content detail display screen of the wireless terminal 3.

  When the “previous broadcast” of the related content 420 is selected by a tap operation using the input means 41, the content detail display screen shown in FIG. 22 is displayed. In FIG. 22, the content detail section 421 displays a title, performers, details of details, and the like. The “Preview” button 422 is a button for confirming a part of the content before purchasing. The index screen 423 is a still image representing one scene of content. The “Purchase” button 424 is a button for selecting and purchasing content. The “return” button 425 is a button for returning to the program related information screen of FIG.

  In FIG. 22, when the “Purchase” button 424 is selected by the input means 41, the control unit 37 transmits a content distribution request to the content distribution server 7, and the content distribution server 7 starts content distribution, A playback screen is displayed on the display unit 38 by a user operation via the input means 41.

  FIG. 23 shows a display example of a program related information screen when the message 426 is displayed when there is unpresented information.

  When the “Today's broadcast” of the related content 420 is tapped, a message 426 shown in FIG. 23 is displayed, and the message 426 indicates that it is currently unregistered and the scheduled presentation start time (or date). In this case, the scheduled time (or date) can be displayed as prior information. Further, when the distribution reservation button 427 is selected by a tap operation, reservation registration can be performed.

  It should be noted that level 2 content with unpresented information is handled in the same way as level 1 on the display screen of FIG. 21 until the start of presentation, and is displayed without a frame, and may be displayed with a frame after the presentation starts. it can.

  Further, the level 2 content related information that cannot display the link information of the current content distribution destination can be displayed in a display format different from both level 1 and level 2 in FIG.

  As described above, even when there is content-related information as the program-related information, the content can be played back, and user convenience can be improved. In addition, even when detailed information on content distribution cannot be displayed, it is possible to know information about the distribution start schedule and distribution end schedule, and by making a distribution reservation, a distribution start message or e-mail can be sent at the timing of distribution start. Can be received, so that oversight can be prevented.

  In addition, this invention is not limited to an above-described Example, Various modifications are included. For example, the above-described embodiments are described in detail for the entire system in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

  Each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor. Information such as programs, tables, and files for realizing each function can be stored in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.

  The programs described in each processing example may be independent programs, or a plurality of programs may constitute one application program.

  Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

  In the above embodiment, the embodiment has been described using the television receiver 1, the television receiver 2, and the like provided with the display unit 20, but the same applies to an STB or a recorder provided with the display unit outside. The present invention can be implemented.

1 TV receiver 1
2 TV receiver 2
3 Wireless terminal 1
4 Wireless terminal 2
DESCRIPTION OF SYMBOLS 5 Wireless router 6 External network 7 Program related information delivery server 8 Broadcast station 9 Base station 12 Tuner / demodulation part 13 Channel selection control part 14 Signal separation part 15 Audio | voice decoding part 16 Speaker 17 Audio | voice output part 18 Video | video decoding part 19 Superimposition part 20 Display unit 21 Video output unit 22 Communication I / F
23 Input Means 24 Control Unit 25 Memory 26 Storage 27 Imaging Unit 28 Digital I / F
31 tuner / demodulation unit 32 signal separation unit 33 memory 34 storage 35 acceleration sensor unit 36 geomagnetic sensor unit 37 control unit 37
38 Display 39 Communication I / F
40 Mobile communication I / F
41 Input means 42 GPS receiver 43 Gyro sensor 50 Communication I / F
51 Control unit 52 Memory 53 Storage

Claims (16)

A terminal device used in a network terminal system comprising a program receiving device, a terminal device, and a related information distribution device,
Input means;
Program related information specified by program state information for identifying a viewing program transmitted to the related information distribution device by the program receiving device that receives a program transmitted via a broadcast wave or a network is transmitted to the related information distribution device. A communication unit to receive from
A display means for displaying a program related information display screen for displaying a keyword included in the received program related information, and a display means for displaying information on the keyword when the keyword is selected by the input means;
A terminal device comprising: The terminal device according to claim 1,
It has a user authentication part that generates authentication information,
The communication unit is
Sending the authentication information to the related information delivery device;
The terminal device characterized by receiving the program related information when the related information distribution device authenticates the terminal device with the authentication information. The terminal device according to claim 2,
The communication unit receives the program related information associated with user identification information for identifying one or more users based on the authentication information by the related information distribution device. The terminal device according to claim 3,
The terminal device, wherein the program related information is generated according to the attribute by an attribute determination unit that determines an attribute of a user associated with the user identification information included in the related information distribution device. The terminal device according to claim 1,
The communication unit is associated with face recognition information recognized by the related information distribution device based on face image information acquired by the program receiving device and user identification information for identifying one or more users registered in advance. The terminal device receives the program related information associated with the user identification information when the face recognition information matches. The terminal device according to claim 5,
The communication unit is
The device status information indicating the status of the program receiving device that the program receiving device transmits to the related information distribution device,
When the status of the program receiving device indicates the start of authentication, information indicating the start of the program related information display is received,
When the status of the program receiving apparatus indicates the end of authentication, the terminal apparatus receives information indicating the end of displaying the program related information. The terminal device according to any one of claims 1 to 6,
The program related information includes keyword presentation information indicating keyword presentation timing of a keyword associated with a program or a scene of the program identified by the program status information,
The terminal device displays the keyword on the program related information display screen in synchronization with a program or a scene of the program based on the keyword and the keyword presentation information. The terminal device according to claim 7,
The keyword presentation information includes time code information,
The display unit displays the keyword on the program related information display screen when the keyword presentation information includes the time code information within a predetermined time from a current time. A network terminal system comprising a program receiving device, a terminal device, and a related information distribution device,
The program receiving device includes:
Program identification generating means for generating program state information for identifying a viewing program transmitted via a broadcast wave or a network;
A first communication unit for transmitting the program status information to the related information distribution device;
With
The related information distribution device includes:
A program related information generating unit for receiving the program status information transmitted from the program receiving device and generating program related information specified by the received program status information;
A second communication unit that transmits the program-related information to the terminal device;
With
The terminal device
Input means;
A third communication unit for receiving the program related information transmitted from the related information distribution device;
A display unit for displaying a program related information display screen for displaying a keyword included in the received program related information, and further displaying information regarding the keyword when the keyword is selected by the input unit;
A network terminal system comprising: The network terminal system according to claim 9, wherein
The terminal device includes a user authentication information generation unit that generates authentication information,
The third communication unit is
Sending the authentication information to the related information delivery device;
The network terminal system, wherein a user authentication unit included in the related information distribution device receives the program related information when the terminal device is authenticated by the authentication information. The network terminal system according to claim 10,
The related information distribution device has means for setting user identification information based on the authentication information for one or more of the terminal devices and associating the program related information with the user identification information. . The network terminal system according to claim 11, wherein
The related information distribution device includes:
An attribute determination unit for determining an attribute of a user associated with the user identification information;
The network terminal system, wherein the program related information generation unit generates program related information according to the attribute. The network terminal system according to claim 9, wherein
The program receiving device includes:
A face image information acquisition unit for acquiring face image information;
The related information distribution device includes:
Face recognition unit for recognizing a face based on the face image information acquired via the first communication unit, and a face for determining whether the face information associated with the user identification information registered in advance matches A determination unit,
A network terminal system that transmits the program related information associated with the user identification information via the second communication unit when the face determination unit determines that the face information matches the face information. . The network terminal system according to claim 13,
The first communication unit transmits device state information representing state information of the program receiving device,
The related information distribution device includes:
When the device status information indicates the start of authentication of the program receiving device, information indicating the start of the program related information display is transmitted from the second communication unit to the terminal device,
When the device status information indicates the end of authentication of the program receiving device, information indicating the end of the program related information display is transmitted from the second communication unit to the terminal device,
The terminal device displays information indicating the start or end of the program related information display, or starts or ends display of the program related information. The network terminal system according to any one of claims 9 to 14,
The program related information includes keyword presentation information indicating keyword presentation timing of a keyword associated with a program or a scene of the program identified by the program status information,
The display means displays the keyword on the program-related information display screen in synchronization with a program or a scene of the program based on the keyword and the keyword presentation information. The network terminal system according to claim 15,
The keyword presentation information includes time code information,
The network terminal system, wherein the display means displays the keyword on the program related information display screen when the keyword presentation information includes the time code information within a predetermined time from a current time.

Images