CN114009057A - Information linkage system and server - Google Patents

Information linkage system and server Download PDF

Info

Publication number
CN114009057A
CN114009057A CN202080006661.9A CN202080006661A CN114009057A CN 114009057 A CN114009057 A CN 114009057A CN 202080006661 A CN202080006661 A CN 202080006661A CN 114009057 A CN114009057 A CN 114009057A
Authority
CN
China
Prior art keywords
information
receiving
terminal device
viewing history
content
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202080006661.9A
Other languages
Chinese (zh)
Other versions
CN114009057B (en
Inventor
片冈秀夫
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hisense Visual Technology Co Ltd
Toshiba Visual Solutions Corp
Original Assignee
Hisense Visual Technology Co Ltd
Toshiba Visual Solutions Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2020093745A external-priority patent/JP7321975B2/en
Priority claimed from JP2020093744A external-priority patent/JP7229200B2/en
Priority claimed from JP2020093641A external-priority patent/JP7229199B2/en
Application filed by Hisense Visual Technology Co Ltd, Toshiba Visual Solutions Corp filed Critical Hisense Visual Technology Co Ltd
Publication of CN114009057A publication Critical patent/CN114009057A/en
Application granted granted Critical
Publication of CN114009057B publication Critical patent/CN114009057B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254Management at additional data server, e.g. shopping server, rights management server
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The information linkage system according to an embodiment includes a receiving device and a server. The server has a specifying information storage unit, a viewing history receiving unit, a startup receiving unit, and a list transmitting unit. The determination information storage section associates and stores reception device determination information for determining a terminal device capable of displaying information to a user who can view content on the reception device, and terminal device determination information. The list transmitting section transmits, to the terminal device, an information list generated based on the viewing history information received by the viewing history receiving section from the receiving device specified by the receiving device specifying information associated with the terminal device specifying information for specifying the terminal device at the specifying information storing section, and represents the information related to the viewed content as a selectable item list, in a case where the start notification is received by the start receiving section. According to the application, the time and labor for acquiring the information related to the content can be reduced.

Description

Information linkage system and server
Cross Reference to Related Applications
This application claims priority to Japanese patent applications Nos. 2020-093744, 2020-093745 and 2020-093641, filed on 28/5/2020 and incorporated herein by reference in their entirety.
Technical Field
The embodiment of the application relates to an information linkage system and a server.
Background
There is a receiving apparatus capable of viewing broadcast content such as programs in the related art.
Patent document 1: japanese patent laid-open publication No. 2019-017075
Disclosure of Invention
Technical problem to be solved by the invention
When a user viewing broadcast content using the receiving apparatus is interested in an object or the like presented in the broadcast content and wants to acquire information of the object or the like, the user accesses a search site via a terminal apparatus such as a smartphone and searches for the object using the search site. Therefore, there are problems as follows: it is troublesome to acquire information of an object related to broadcast content.
An object of the present invention is to provide an information linkage system and a server that can reduce the time and effort required for a user to acquire information related to content.
Technical solution for solving technical problem
According to an aspect of the present application, an information linkage system of an embodiment is constituted by a receiving device and a server. The receiving device has a receiving unit and a transmitting unit. The receiving unit receives content. The transmission unit transmits viewing history information indicating a viewing history of the content to the server. The server has a specifying information storage section, a viewing history receiving section, a start receiving section, and a list transmitting section. The determination information storage section associates and stores reception device determination information for determining the reception device and terminal device determination information for determining a terminal device capable of displaying information to a user who can view the content on the reception device. The viewing history receiving section receives viewing history information from the receiving apparatus. The start receiving unit receives a start notification of a predetermined program from the terminal device. The list transmitting section transmits, to the terminal device, an information list which is generated based on the viewing history information received by the viewing history receiving section from the receiving device specified by the receiving device specifying information associated with the terminal device specifying information for specifying the terminal device in the specifying information storing section and which represents information related to the viewed content as a selectable item list, in a case where the start notification is received by the start receiving section.
In some embodiments, the server further has an interest information receiving section that receives, from the receiving apparatus or the terminal apparatus, interest information indicating interest in the content. The list transmitting section transmits the information list including information on the content of interest to the user as a selectable item to the terminal apparatus according to the viewing history information and a time at which the content of interest is of interest to the user indicated by the interest information.
In some embodiments, the server further has a scene information storage unit that stores time information in association with information indicating an object or a place of a scene as the content displayed at a time indicated by the time information. The list transmitting section transmits the information list including information on an object or a place displayed as a scene of the content as a selectable item to the terminal apparatus at the time of the user's interest, based on the viewing history information, the time of the user's interest in the content indicated by the interest information, and the scene information storing section.
In some embodiments, the content comprises at least one of broadcast content and video content provided by a video distribution service.
According to another aspect of the present application, a server of an embodiment has a determination information storage section that associates and stores reception device determination information for determining a reception device that receives content, the reception device determination information being used to determine a terminal device that can display information to a user who can view the content on the reception device, with terminal device determination information; the viewing history receiving section receives viewing history information indicating a viewing history of the content from the receiving apparatus; the start receiving unit receives a start notification of a predetermined program from the terminal device; the list transmitting section transmits, to the terminal device, an information list which is generated based on viewing history information received by the viewing history receiving section from a receiving device specified by the receiving device specifying information associated with terminal device specifying information for specifying a terminal device in the specifying information storing section and which represents information related to the viewed content as a selectable item list, in a case where the start notification is received by the start receiving section.
According to still another aspect of the present application, an information linkage system of an embodiment is constituted by a receiving device, a first server, and a second server. The receiving device is provided with a receiving part and a transmitting part, wherein the receiving part is used for receiving contents; the transmission unit transmits viewing history information indicating a viewing history of the content to the first server.
The first server has a specifying information storage section, a viewing history receiving section, a start receiving section, and a list transmitting section. Wherein the determination information storage section associates and stores reception device determination information for determining the reception device and terminal device determination information for determining a terminal device capable of displaying information to a user who can view content on the reception device; the viewing history receiving section receives the viewing history information from the receiving apparatus; the start receiving unit receives a start notification of a predetermined program from the terminal device; the list transmitting unit transmits, to the terminal device, an information list that is generated based on the viewing history information received by the viewing history receiving unit from the receiving device specified by the receiving device specifying information and that shows information on the viewed content as a selectable item list, when the activation receiving unit receives the activation notification. The reception device determination information is associated with terminal device determination information for determining a terminal device in the determination information storage section.
The information related to the content includes information indicating an object displayed in the content.
The second server has a receiving unit and a transmitting unit. Wherein the receiving unit receives a transmission request of page information on which the object can be purchased from the terminal device, and the terminal device receives a selection of information indicating the object; the transmitting unit transmits page information on purchasable objects to the terminal device when the receiving unit receives the transmission request.
In some embodiments, the first server further has an interest information receiving unit that receives interest information indicating interest in the content from the receiving apparatus or the terminal apparatus. The list transmitting section transmits the information list including information on the content of interest to the user as a selectable item to the terminal apparatus according to the viewing history information and a time at which the content of interest is of interest to the user indicated by the interest information.
In some embodiments, the first server further has a scene information storage unit that stores time information in association with information indicating an object or a place of a scene as the content displayed at a time indicated by the time information. The list transmitting section transmits, to the terminal apparatus, an information list including information about an object or a place displayed as a scene of the content as a selectable item at a time point of interest to the user, the time point of interest to the content being indicated by the interest information, and the scene information storing section.
In some embodiments, the information linkage system further has a terminal device that displays the information list.
In some embodiments, the content comprises at least one of broadcast content and video content provided by a video distribution service.
According to still another aspect of the present application, a terminal device of an embodiment has a display unit, a list receiving unit, a start receiving unit, and a display control unit. Wherein the list receiving section is configured to receive an information list which is generated based on viewing history information indicating a viewing history of a content received by a receiving apparatus for receiving the content associated with the terminal apparatus and which represents information related to the viewed content as a selectable item list; the starting receiving part receives a starting request of a specified program; the display control unit causes the display unit to display the information list received by the list receiving unit when the start receiving unit receives the start request of the predetermined program.
According to still another aspect of the present application, a terminal device of an embodiment has a display section, a first display control section, a list receiving section, and a second display control section. Wherein the first display control unit causes the display unit to display reception device identification information for identifying a reception device that receives content; the list receiving section is configured to receive an information list which is generated based on viewing history information indicating a viewing history of the content received by the receiving apparatus and which represents information related to the viewed content as a selectable item list; the second display control unit causes the display unit to display the information list received by the list receiving unit.
In some embodiments, the terminal device further has a selection receiving section, a transmitting section, a receiving section, and a third display control section. Wherein the selection receiving part is configured to receive a selection of an item included in the information list; the transmission unit transmits a transmission request of information associated with the selected item received by the selection reception unit to an external server; the receiving unit receives information from the external server; the third display control unit displays the information received by the receiving unit on the display unit.
In some embodiments, the second display control unit displays information indicating an object indicated by the content as an item included in the information list in a selectable manner. The transmission unit transmits a transmission request for page information, which is available for purchase of the object, to the external server when the selection reception unit receives the selection of the information indicating the object. The receiving unit receives page information on the object from the external server. The third display control unit displays page information on which the object can be purchased.
In some embodiments, the terminal device further has a fourth display control section for displaying a selection section that notifies that the content displayed on the receiving device is of interest. The transmission unit transmits interest information indicating that the content is interested to the server when the selection unit is selected.
In some embodiments, the list receiving section receives the information list showing items of information related to an object shown in a scene of the content displayed by the receiving apparatus in the vicinity of a time at which the selecting section is selected in accordance with the interest information transmitted by the transmitting section. The second display unit displays information related to the object included in the information list, the object being shown in a scene near a time at which the selection unit is selected.
In some implementations, the content includes any one of broadcast content and video content provided by a video distribution service.
Drawings
Fig. 1 is a diagram showing an example of the configuration of an information linkage system according to the embodiment.
Fig. 2 is a block diagram showing an example of the configuration of the terminal device according to the embodiment.
Fig. 3 is a block diagram showing an example of a functional configuration of a terminal device according to the embodiment.
Fig. 4 is a block diagram showing an example of the configuration of the receiving apparatus according to the embodiment.
Fig. 5 is a block diagram showing an example of a functional configuration of a receiving apparatus according to the embodiment.
Fig. 6 is a block diagram showing an example of the configuration of the viewing history management server according to the embodiment.
Fig. 7 is a block diagram showing an example of a functional configuration of the viewing history management server according to the embodiment.
Fig. 8 is a diagram showing an example of information stored in the identification information management database according to the embodiment.
Fig. 9 is a diagram showing an example of information stored in the viewing history management database according to the embodiment.
Fig. 10 is a diagram showing an example of information stored in the interest information management database according to the embodiment.
Fig. 11 is a diagram showing an example of information stored in the scene information management database according to the embodiment.
Fig. 12 is a block diagram showing an example of the configuration of the product sales management server according to the embodiment.
Fig. 13 is a block diagram showing an example of a functional configuration of the product sales management server according to the embodiment.
Fig. 14 is a flowchart showing an example of the association processing executed by the information linkage system according to the embodiment.
Fig. 15 is a diagram showing an example of a terminal device and a receiving device in association processing according to the embodiment.
Fig. 16 is a diagram illustrating an example of image switching of the terminal device according to the embodiment.
Fig. 17 is a diagram illustrating another example of image switching of the terminal device according to the embodiment.
Fig. 18 is a diagram showing an example of images of a terminal device and a receiving device according to the embodiment.
Fig. 19 is a diagram illustrating another example of image switching of the terminal device according to the embodiment.
Fig. 20 is a diagram showing an example of displaying an interest key on the terminal device according to the embodiment.
Fig. 21 is a diagram showing an example of the viewing history information storage process executed by the information linkage system according to the embodiment.
Fig. 22 is a flowchart showing an example of information providing processing executed by the information linkage system according to the embodiment.
Description of the symbols:
1: an information linkage system; 100: a terminal device; 104: a display unit; 154: a list receiving unit; 150: a start receiving section; 152: a first display control unit; 155: a second display control unit; 156: a selection receiving unit; 157: a transmission unit; 158: a receiving section; 159: a third display control unit; 160: a fourth display control unit; 200: a receiving device; 202: an input terminal; 251: a viewing history transmitting section; 300: a viewing history management server; 352: a viewing history receiving section; 353: an interest information receiving unit; 354: a start receiving section; 355: a list transmission unit; 361: determining an information management database; 364: a scene information management database; 400: providing an information management server; 451: a transmission request receiving unit; 452: a page information transmitting section; 600: and (4) information list.
Detailed Description
The following describes the embodiments in detail with reference to the drawings.
(information linkage system 1)
Fig. 1 is a diagram illustrating an example of the configuration of an information linkage system 1 according to the embodiment. As shown in fig. 1, an information linkage system 1 of the embodiment includes a terminal device 100, a receiving device 200, a viewing history management server 300, and a plurality of provided information management servers 400. The viewing history management server 300 is an example of a server and a first server. The provided information management server 400 is an example of a second server and an external server.
The terminal device 100 is held by a user, for example. The receiving apparatus 200 is installed in, for example, a house of a user. The viewing history management server 300 is provided, for example, to an operator who provides a linkage application. The plurality of providing information management servers 400 include a providing information management server 400A and a providing information management server 400B. The provision information management server 400A is provided to a first mail order dealer that provides an electronic commerce service for selling goods and the like using the internet. The provision information management server 400B is provided in a second mail order dealer that provides a mail order sales program that can be viewed on the receiving apparatus 200 and an electronic commerce service that uses the internet to sell commodities and the like introduced in the mail order sales program.
The terminal device 100, the receiving device 200, the viewing history management server 300, and the provided information management server 400 each have a function of connecting to a network. The network refers to all information communication networks using telecommunication technology, including wireless/wired LAN, internet, telephone communication line network, etc. The reception device 200, the viewing history management server 300, and the provided information management server 400 may not have a function of connecting to a telephone communication network.
The terminal device 100 is, for example, a portable terminal device such as a smartphone or a tablet terminal, or a Computer such as a notebook PC (Personal Computer). The terminal device 100 can display information to a user who can view the broadcast content displayed on the receiving device 200. The terminal device 100 is not limited to the above example, and may be another electronic device as long as it has a function of connecting to a network. Broadcast content is an example of content.
The receiving apparatus 200 can view broadcast contents such as various programs and advertisements by receiving broadcast waves (broadcast signals) from a broadcasting station, for example. The receiving apparatus 200 is a television apparatus. The receiving apparatus 200 has a function of recording received broadcast content and a function of playing recorded broadcast content. In addition, the reception apparatus 200 has a function of transmitting the viewing history of the broadcast content. Viewing includes viewing of broadcast content currently being broadcast and viewing of recorded broadcast content during playback. The reception apparatus 200 can communicate with the viewing history management server 300 and the provided information management server 400 via a network. In the present embodiment, the broadcast content includes a program broadcast in real time, content displayed in a time-shift view of a recorded program, and advance information of a broadcast schedule. The broadcast content may also be a program based on any broadcast wave such as terrestrial digital, BS, and CS.
The viewing history management server 300 has a so-called pairing function of associating the terminal device 100 and the receiving device 200. The viewing history management server 300 has the following functions: an information list representing information on the viewed broadcast content as a list of selectable items is generated from the viewing history transmitted by the reception apparatus 200 and transmitted to the terminal apparatus 100.
The provided information management server 400 has a function of transmitting a web page, which is associated with an item of the information list selected in the terminal device 100, to the terminal device 100. The web page is displayed on the terminal device 100.
(terminal device 100)
Next, the terminal device 100 of the embodiment will be explained. Fig. 2 is a block diagram showing an example of the configuration of the terminal device 100 according to the embodiment.
As shown in fig. 2, the terminal device 100 includes a communication I/F (interface) 101, an audio input unit 102, a display unit 104, a Graphic Controller (Graphic Controller)105, a Touch Panel Controller (Touch Panel Controller)106, a cpu (central Processing unit)107, a Memory (Memory)108, and a camera 109. The terminal device 100 may also have a speaker or the like.
The communication I/F101 is used for communication with other devices such as the viewing history management server 300 and the provided information management server 400. The audio input unit 102 is an audio input device such as a microphone, and receives a user's voice input. The audio input unit 102 may not be provided.
The display unit 104 is, for example, a touch panel device in which a display panel 104a and a touch panel 104b are combined. The Display panel 104a is, for example, an LCD (Liquid Crystal Display) or an OLED (Organic Light-Emitting Diode). The touch panel 104b is used to detect a touch position touched by a finger of a user, a stylus pen, or the like on the display screen of the display screen 104 a.
The graphic controller 105 controls the display screen 104a of the display part 104. The touch panel controller 106 controls the touch panel 104b of the display unit 104, and acquires coordinate data indicating a touch position touched by the user on the display screen from the touch panel 104 b.
The camera 109 is a digital camera incorporating an Image pickup Device such as a CCD (Charge Coupled Device) or a CIS (CMOS Image Sensor), for example. The camera 19 outputs, as captured image data, data including a video or still image of a plurality of frames of images generated by the imaging unit 14 at a predetermined frame rate.
The CPU107 controls each part of the terminal apparatus 100 by executing various computer programs. The Memory 108 includes a ROM (read only Memory), a RAM (Random Access Memory), an SSD (Solid State Drive), and the like, and stores various computer programs and various data used for various arithmetic processes of the CPU 107. The various computer programs include a linkage application.
Fig. 3 is a block diagram showing an example of the functional configuration of the terminal device 100 according to the embodiment. As shown in fig. 3, the terminal device 100 has the following functional sections: a startup receiving unit 150, an image acquiring unit 151, a first display control unit 152, an information transmitting unit 153, a list receiving unit 154, a second display control unit 155, a selection receiving unit 156, a transmitting unit 157, a receiving unit 158, a third display control unit 159, and a fourth display control unit 160. These functional units are realized by the CPU107 reading and executing a program stored in a storage device such as a ROM. In addition, a part or all of the functional units may be configured by dedicated hardware. The functions of these functional units will be described later.
Receiving apparatus
Next, the reception device 200 of the embodiment will be explained. Fig. 4 is a block diagram showing an example of the configuration of the receiving apparatus 200 according to the embodiment.
As shown in fig. 4, the receiving apparatus 200 includes an input terminal 202, tuners 203a to 203g, a signal processing section 207, a graphics processing section 208, an audio processing section 209, an OSD (On Screen Display) signal generating section 210, and an image processing section 211.
A terrestrial digital broadcast wave received by the terrestrial broadcast receiving antenna 213 is input to the input terminal 202. That is, the input terminal 202 receives broadcast content through a broadcast wave. Terrestrial digital broadcast waves are supplied to the tuners 203a to 203g through the input terminal 202. The input terminal 202 is an example of a receiving unit.
The tuners 203a to 203g are tuners for terrestrial digital broadcasting, and select a broadcast wave of a channel instructed by a control unit 216, which will be described later, from among the terrestrial digital broadcast waves supplied from the input terminal 202.
In addition, the receiving apparatus 200 may also have an input terminal to which satellite digital broadcast waves received by the BS/CS digital broadcast receiving antenna are input. The satellite digital broadcast wave is supplied to a tuner for satellite digital broadcast through the input terminal.
The signal processing section 207 demodulates a broadcast wave including a digital image signal and an audio signal from the broadcast waves supplied from the tuners 203a to 203 g. The signal processing unit 207 selectively performs predetermined digital signal processing on an image signal including a digital broadcast wave, and outputs the image signal to the graphic processing unit 208. The signal processing unit 207 selectively performs predetermined digital signal processing on an audio signal including a digital broadcast wave, and outputs the audio signal to the audio processing unit 209.
The signal processing unit 207 is connected to a plurality of external input terminals 214a to 214 d. The external input terminals 214a to 214d can input analog image signals and audio signals from a DVD (Digital Versatile disc) recorder or the like as an example of an external device. The signal processing unit 207 digitizes the analog image signal and the audio signal input from the external input terminal 214a to the external input terminal 214 d. The signal processing unit 207 performs predetermined digital signal processing on the digitized image signal and outputs the processed image signal to the graphics processing unit 208. The signal processing unit 207 performs predetermined digital signal processing on the digitized audio signal and outputs the processed signal to the audio processing unit 209.
The graphics processing section 208 superimposes the digital image signal supplied from the signal processing section 207 and the OSD signal generated by the OSD signal generating section 210 and outputs the superimposed signal to the image processing section 211. The graphics processing section 208 can also output any one of the digital image signal supplied from the signal processing section 207 and the OSD signal generated by the OSD signal generating section 210 to the image processing section 211.
The image processing unit 211 converts the digital image signal or the OSD signal input from the graphic processing unit 208 into an analog image signal or an OSD signal in a format displayable on the image display unit 233, and outputs the converted signal to the image display unit 233. The image display unit 233 is, for example, an LCD or an organic EL display panel.
The audio processing unit 209 converts the digital audio signal input from the signal processing unit 207 into an analog audio signal in a format playable by the speaker 215, and outputs the converted signal to the speaker 215.
The receiving apparatus 200 further has a control section 216, a card holder 217, various interfaces 218, 219, 221, and a luminance sensor 230. The control unit 216 includes a CPU216a, a ROM216b, a RAM216c, and a nonvolatile memory 216 d.
The control section 216 generally controls various operations of the receiving apparatus 200, for example, an operation of receiving broadcast waves such as terrestrial digital broadcast waves and satellite digital broadcast waves, and the like. The control unit 216 controls each unit of the reception apparatus 200 in accordance with the operation information from the operation unit 222 or the operation information input from the remote controller 224 via the reception unit 223.
The CPU216a controls the overall operation of the reception apparatus 200 by executing programs stored in the ROM216 b. The ROM216b mainly stores programs executed by the CPU216 a. The RAM216c provides a work area when the CPU216a executes programs. The nonvolatile memory 216d stores various setting information, control information, and the like of the reception apparatus 200.
The control section 216 is connected to a card holder 217 which removably loads the memory card 234 through a card I/F225. Accordingly, the control section 216 can transmit and receive various information to and from the memory card 234 mounted on the card holder 217 through the card I/F225.
The control unit 216 is connected to the LAN terminal 226 through the communication I/F218. Accordingly, the control unit 216 can transmit and receive various information to and from an external device such as a relay device (not shown) connected to the LAN terminal 226 or a Hard Disk Drive (HDD) of the LAN through the communication I/F218. The communication I/F218 may be configured to be wirelessly connectable to an external device.
The control unit 216 is connected to an HDMI terminal 227 via an HDMI (High-Definition Multimedia Interface) I/F221. Accordingly, the control section 216 can transmit and receive various information to and from the external device connected to the HDMI terminal 227 through the HDMI I/F221.
The control unit 216 is connected to a USB terminal 228 via a USB (Universal Serial Bus) I/F219. Accordingly, the control unit 216 can transmit and receive various information to and from the storage device 200a such as a USB HDD having the USB terminal 228 connected thereto via the USB I/F219.
The storage device 200a is configured to have, for example, an HDD, an SSD (Solid State Drive), or the like, and is configured to store the digital signal received by the reception device 200 as video data. In addition, the storage device 200a may be built in the reception device 200.
Thus, the receiving apparatus 200 including the storage apparatus 200a is configured as a video recording apparatus. The recording device is not limited to the receiving device 200, and may be configured as another storage device as long as it has a broadcast wave receiving function and a broadcast content recording function.
Fig. 5 is a block diagram showing an example of the functional configuration of the receiving apparatus 200 according to the embodiment. As shown in fig. 5, the receiving apparatus 200 has a viewing history transmitting section 251 and a code symbol display control section 22 as functional sections. These functional units are realized by the CPU216a reading and executing programs stored in a storage device such as the ROM216 b. In addition, a part or all of the functional units may be configured by dedicated hardware. The functions of these functional units will be described later.
Viewing history management server 300
Next, the viewing history management server 300 according to the embodiment will be described. Fig. 6 is a block diagram showing an example of the configuration of the viewing history management server 300 according to the embodiment.
As shown in fig. 6, the viewing history management server 300 has a communication I/F301, an operation section 302, a CPU303, a memory 304, and a storage device 305.
The communication I/F301 is used for communication with other devices such as the terminal device 100, the reception device 200, and the provided information management server 400. The operation unit 302 includes an input device such as a keyboard and a mouse, and a display device such as a display screen.
The storage device 305 has, for example, an HDD, an SSD, or the like, and stores various information.
The CPU303 controls each part of the viewing history management server 300 by executing various computer programs. The memory 304 has a ROM, a RAM, and the like, and stores various computer programs and various data used for the CPU303 to perform various arithmetic processes.
Fig. 7 is a block diagram showing an example of a functional configuration of the viewing history management server 300 according to the embodiment. As shown in fig. 7, the viewing history management server 300 includes a correlation unit 351, a viewing history receiving unit 352, an interest information receiving unit 353, a startup receiving unit 354, a list generating unit 355, and a list transmitting unit 356 as functional units. These functional units are realized by the CPU303 reading and executing a program stored in a storage device such as a ROM. In addition, a part or all of the functional units may be configured by dedicated hardware. The functions of these functional units will be described in various processes described later.
In addition, the viewing history management server 300 has a determination information management database 361 (determination information management DB in fig. 7), a viewing history management database 362 (viewing history management DB in fig. 7), an interest information management database 363 (interest information management DB in fig. 7), a scene information management database 364 (scene information management DB in fig. 7), and a program information management database 365 (program information management DB in fig. 7) as storage parts. These storage units are provided in storage device 305. The specific information management database 361 is an example of a specific information storage unit, the viewing history management database 362 is an example of a viewing history storage unit, the interest information management database 363 is an example of an interest information storage unit, the scene information management database 364 is an example of a scene information management storage unit, and the program information management database 365 is an example of a program information storage unit.
Fig. 8 is a diagram showing an example of information stored in the identification information management database 361 according to the embodiment. As shown in fig. 8, the determination information management database 361 associates and stores the reception device ID for determining the reception device 200 and the terminal device ID for determining the terminal device 100. Here, the reception apparatus ID is issued by the viewing history management server 300, for example. The terminal device ID is, for example, a manufacturing number or a unique address of the terminal device 100. Further, the reception device ID and the terminal device ID are not limited to the above. For example, the terminal apparatus ID may also be an ID set by a determined mail order distributor, for example. In addition, the terminal device ID may also be an advertisement ID set by the terminal device 100. The advertisement ID may also be used across a plurality of applications installed in the terminal device 100. Further, the same IP address as that of the receiving apparatus 200 may be transmitted to the terminal apparatus 100 via the network, and the terminal apparatus 100 may be linked to the IP address. In this case, there may be a case where the permission to send the IP address is obtained on the receiving apparatus 200 side and a case where the permission is obtained on the partner side such as a mail order dealer. The receiving device ID is an example of receiving device identification information, and the terminal device ID is an example of terminal device identification information.
Fig. 9 is a diagram showing an example of information stored in the viewing history management database 362 according to the embodiment. As shown in fig. 9, the viewing history management database 362 stores viewing history information in the reception apparatus ID. The viewing history information stores, for each receiving apparatus ID, a starting point and an ending point of a viewing channel, a viewing time (time slot), a program name, and a broadcast position (time information of the elapsed time in the program of second accuracy from the start of the program or information of the date, time, minute-second at the time of broadcast). Here, a plurality of playback positions may exist, and in this case, the recording of the playback positions may exist in discontinuous sections.
Fig. 10 is a diagram showing an example of information stored in the interest information management database 363 according to the embodiment. As shown in fig. 10, the time and the device state related information at which the interest key 224a (fig. 1) of the remote controller 224 or the interest key 502 (fig. 20) of the terminal device 100 is pressed (operated) are stored for each receiving device ID. The device state related information refers to information for determining broadcast content displayed when pressed. The device state related information includes, for example, channel and input information. The input information is, for example, information indicating an HDMI number, BS, CS, digital terrestrial radio waves, and the like selected when broadcasting the broadcast content. Also, the device state related information may also store a program name or a device connected with HDMI, or the like. When the user is interested in an item or the like displayed in the broadcast content while viewing the broadcast content, the interest key 224a or the interest key 502 is pressed, and the pressed time, channel, and input information as the pressed information are stored in the interest information management database 363. The interest key 224a, the interest key 502 are keys for notifying that the broadcast content displayed on the receiving apparatus 200 is interested. The interest information management database 363 may store a time from a point of pressing (operating) the interest key 502 (fig. 20) to a predetermined time. The interest key 502 is an example of a selection section.
Fig. 11 is a diagram showing an example of information stored in the scene information management database 364 according to the embodiment. As shown in fig. 11, the scene information management database 364 stores information indicating an object or a place displayed as a scene of broadcast content for each viewing time (time period) of each channel. In other words, the scene information management database 364 stores the time information and the information indicating the object or the place to be displayed as the scene of the broadcast content at the time indicated by the time information in association with each other. In the example of fig. 11, the example of the package is illustrated as the information indicating the object or the place displayed as the scene of the broadcast content, but the present invention is not limited to this. For example, when the information indicates an object or a place to be displayed as a scene of broadcast content, the information may be a place name or the like or a name of a building or the like. These pieces of scene information can be input by, for example, an input job of an operator.
Returning to fig. 7, the program information management database 365 stores the program name, broadcast time (broadcast time), performer, and the like of each program as information related to the program.
Providing information management server 400
Next, the provided information management server 400 according to the embodiment will be described. Fig. 12 is a block diagram showing an example of the configuration of the provided information management server 400 according to the embodiment.
As shown in fig. 12, the provided information management server 400 includes a communication I/F401, an operation unit 402, a CPU403, a memory 404, and a storage device 405.
The communication I/F401 is used for communication with other devices such as the terminal apparatus 100 and the viewing history management server 300. The operation unit 402 includes an input device such as a keyboard and a mouse, and a display device such as a display screen.
The storage device 405 has, for example, an HDD, an SSD, or the like, and stores various information.
The CPU403 controls each part of the provided information management server 400 by executing various computer programs. The memory 404 includes a ROM, a RAM, and the like, and stores various computer programs and various data used by the CPU403 to perform various arithmetic processes.
Fig. 13 is a block diagram showing an example of a functional configuration of the provided information management server 400 according to the embodiment. As shown in fig. 13, the provided information management server 400 includes a transmission request receiving unit 451 and a web page information transmitting unit 452 as functional units. These functional units are realized by the CPU403 reading and executing a program stored in a storage device such as a ROM. In addition, a part or all of the functional units may be configured by dedicated hardware. The functions of these functional units will be described later.
The provided information management server 400 includes a product management database 461 (product management DB in fig. 13) as a storage unit. The storage unit is provided in the storage device 405. The article management database 461 stores information on articles for each article. The product management database 461 of the present embodiment may also store information for migrating to a page where a product is purchased to the user, such as a URL indicating a page where the product is purchased. In addition, the combination of page information indicating a product purchase site and parameter information for searching for the product on the product purchase site may be used. In addition, as long as the present embodiment can provide information prompting the user to purchase a product, for example, the information relating to the product may be a product name, a product ID (product specifying information), a price, or the like. In addition, the article management database 461 stores page information representing pages of a sales site of articles.
The information provided to the user by the provided information management server 400 is not limited to information on the goods sold but may be information that attracts the interest of the user and results in purchase. For example, the provision information management server 400 may be information related to a recipe of food displayed when the interest key is pressed, or a restaurant introduction and an appointment website of the restaurant displayed when the interest key is pressed. Also, the provision information management server 400 may also be a vacation introduction, a travel guide, a hotel reservation, a reservation of a vehicle, a reservation of a golf course, or the like, associated with a screen displayed when the interest key is pressed. When displaying such information, a database for managing information for displaying such information (e.g., URL) should be provided instead of the goods management database 461. The steps before displaying these pieces of information are the same as those before displaying the product, and therefore, the description thereof is omitted.
Various treatments
Next, various processes executed by the information linkage system 1 according to the embodiment will be described.
Association processing
First, a description will be given of a correlation process executed by the information linkage system 1 according to the embodiment. Fig. 14 is a flowchart showing an example of the association process executed by the information linkage system 1 according to the embodiment. Fig. 15 is a diagram showing an example of the terminal device 100 and the receiving device 200 in the association processing according to the embodiment.
The association process is started by performing a predetermined operation on the receiving apparatus 200.
As shown in fig. 14, the reception apparatus 200 transmits reception apparatus ID inquiry information to the viewing history management server 300 (S11). The reception apparatus ID inquiry information includes the manufacturing number, the unique address, and the like of the reception apparatus 200.
Upon receiving the receiving device ID query information (S21), the viewing history management server 300 transmits the receiving device ID to the receiving device 200 (S22). The receiving apparatus ID may be generated upon receiving the receiving apparatus ID inquiry information, or may be assigned to each receiving apparatus 200 in advance.
When the receiving apparatus 200 receives the receiving apparatus ID (S12), the code symbol display control section 252 displays the code symbol 500 (fig. 15) including the receiving apparatus ID on the image display section 233 (S13). As shown in fig. 15, the code symbol 500 is, for example, a QR code (registered trademark). The code symbol 500 includes, for example, information for making a connection with the viewing history management server 300.
The user uses the camera 109 of the terminal device 100 to take an image of the code symbol 500 displayed on the receiving device 200. Accordingly, as shown in fig. 14, the acquiring unit 151 of the terminal device 100 acquires code symbol information, which is information indicated by a code symbol (S31). In the terminal device 100, the first display control unit 152 displays the code symbol 500 and the receiving device ID on the display unit 104 (fig. 15). The reception apparatus ID is displayed in the display area 501 of the display unit 104.
Next, the information transmitting unit 15 of the terminal device 100 transmits the acquired receiving device ID and the terminal device ID of the terminal device 100 to the viewing history management server 300.
When the viewing history management server 300 receives the reception device ID and the terminal device ID from the terminal device 100 (S23), the association unit 351 associates the received reception device ID and the terminal device ID and stores them in the identification information management DB (S24).
By the interlocking processing using the code symbol 500, for example, even when the terminal device 100 and the receiving device 200 are not connected to each other on the same network, the terminal device 100 and the receiving device 200 can be interlocked very easily. In this case, the viewing history management server 300 can obtain information of the terminal device 100 from a mobile phone company that provides a communication service to the terminal device 100.
After the terminal device 100 and the receiving device 200 are associated with each other by the above-described processing, when the linkage application is started in the terminal device 100, images as shown in fig. 16 to 20 are displayed on the terminal device 100. These images will be explained below. When the user presses the start key 503 displayed on the display unit 104 of the terminal device 100 by the start reception unit 150, the linked application is started. That is, the start receiving unit 150 receives a start request of the linked application.
Fig. 16 is a diagram illustrating an example of image switching of the terminal device 100 according to the embodiment. Fig. 16 shows an example of a screen displayed when a program currently being broadcast by the receiving apparatus 200 or a recorded program is being played. The example of fig. 16 is an example of a screen in a case where scene information of a program under observation is registered in the scene information management database 364. In fig. 16, the user is a member of the electronic commerce service provided by the first mail order dealer, and an example of a case where the terminal device 100 of the user is registered in the first mail order dealer is shown.
As shown in fig. 16 (a), when the linkage application is started, the information list 600A is displayed on the display unit 104 of the terminal device 100. Specifically, the display unit 102 displays elements of the information list 600A related to the content displayed on the screen of the receiving apparatus 200 that has been linked with the terminal apparatus 100. The information list 600A is generated based on viewing history information indicating a viewing history of broadcast content received by the receiving device 200, and the receiving device 200 receives broadcast content by broadcast waves in conjunction with the terminal device 100. The production method will be described later. The information list 600A represents information on viewed broadcast content as a selectable item list. The selection of each item is performed by the user pressing (operating) the touch panel 104 b.
Specifically, the information list 600A includes a calendar area 601, a program information area 602, a performer information area 603, a shop area 604, a first goods area 605, a second goods area 606, a location area 607, and an advertisement area 608. These display elements can be displayed in any combination or arrangement according to the use history of the user or the intention of the mail order dealer, and the same category is sometimes added or subtracted as the items C and D, for example. The program information area 602, the performer information area 603, the store area 604, the first product area 605, the second product area 606, the location area 607, and the advertisement area 608 are each provided with a link to a predetermined page. That is, a link to a predetermined external service or a link prepared inside the terminal device 100 is provided according to the content.
The calendar area 601 displays the current time. The time of the calendar area 601 can be changed by a predetermined operation.
The program information area 602 displays program information. When the program information area 602 is selected, a page indicating a recommended program is displayed as shown in fig. 16 (b).
The store area 604 displays information on stores displayed in the program. When the store area 604 is selected, an image (not shown) of a page showing detailed information of the store is displayed. The shop is registered as scene information in the scene information management database 364.
The first product area 605 and the second product area 606 display information on products displayed in the program, respectively. Information (for example, a name) of the product "a" is displayed in the first product area 605, and information (for example, a name) of the product "B" is displayed in the second product area 606. The article a is, for example, a bag. When any one of the first product area 605 and the second product area 606 is selected, an image of a page showing details of the product in the selected area is displayed. At this time, there are two cases: a case where a structure within the linkage application has a link to an internal page that receives and displays only metadata and a photo from the provision information management server 400; and a function of displaying by transmitting the URL of the link destination in the embedded browser or the browser application in the linked application. In fig. 16 (c), an image of a page in the case where the first product region 605 is selected is displayed. This page represents details of item "a" in the e-commerce service provided by the first mail order distributor. In the case where the user purchases the article "a", the article "a" can be purchased by jumping from the page to a purchase page of the article. The switching of the image in the case where the second product region 606 is selected is also the same as the case where the first product region 605 is selected, and when the second product region 606 is selected, an image of a page showing details of the product "B" in the electronic commerce service provided by the second mail order dealer is displayed, and the product "B" can be purchased by a predetermined operation. The product "a" and the product "B" are registered as scene information in the scene information management database 364.
Further, in the case where the program under viewing is a mail order program provided by the second mail order distributor, the page displayed when the first article area 605 or the second article area is selected represents details of an article in the electronic commerce service provided by the second mail order distributor. The user may purchase the item "A" from the second mail-order distributor by jumping from the page to a purchase page for the item.
Information on the location displayed in the program is displayed in the location area 607. When the position area 607 is selected, as shown in fig. 16 (d), an image of a page showing the search result of the place displayed in the position area 607 is displayed. The page is, for example, a search result of accommodation facilities of the place. In the case where the user subscribes to a certain accommodation facility in the search result, the accommodation facility can be subscribed to by jumping from the page to a predetermined page. The location is registered as scene information in the scene information management database 364.
An advertisement is displayed in the advertisement area 608. An advertisement is for example an advertisement related to a program under viewing. When the advertisement area 608 is selected, an image (not shown) of a page showing detailed information of the advertisement is displayed.
Fig. 17 is a diagram illustrating another example of image switching of the terminal device 100 according to the embodiment. Fig. 17 shows an example of a screen displayed when a program currently being broadcast by the reception apparatus 200 or a recorded program is being played back, as in fig. 16. In addition, similarly to fig. 16, fig. 17 shows an example of a case where the user is a member of the electronic commerce service provided by the first mail order dealer, and the terminal device 100 of the user is registered in the information processing device of the first mail order dealer. However, the example of fig. 17 is different from the example of fig. 16 in that scene information of a program under viewing is not registered in the scene information management database 364.
As shown in fig. 17 (a), when the linkage application is started, the information list 600B is displayed on the display unit 104 of the terminal device 100.
Specifically, the information list 600B includes a calendar area 601, a program information area 602, a performer information area 603, recommendation areas 609 to 612, and an advertisement area 608. The calendar area 601, the program information area 602, the performer information area 603, and the advertisement area 608 are the same as in the example of fig. 16. Therefore, when the program information area 602 is selected, as shown in (b) in fig. 17, a page indicating a recommended program is displayed.
The recommendation areas 609 to 612 display recommended information, respectively. Recommendation "a", recommendation "b", recommendation "c", and recommendation "d" are displayed in recommendation area 609 to recommendation area 612, respectively. For example, recommendations "a" to "c" are products, and recommendation "d" is a location. When any of the recommendation areas 609 to 612 is selected, an image of a page showing details of recommendation of the selected area is displayed. Fig. 17 (c) shows an image of a page in the case where the recommendation region 610 is selected. This page represents the details of "b" in the e-commerce service provided by the first mail order distributor. In the case where the user purchases the item "b", the item "b" can be purchased by jumping from the page to a purchase page of the item. The other recommendation areas 609 and 611 can purchase the recommendation "a" or the recommendation "c" by a predetermined operation. In fig. 17, (d) shows an image of a page in the case where the recommendation region 612 is selected. This page is, for example, a search result of accommodation facilities in a place where "d" is recommended. In the case where the user subscribes to a certain accommodation facility in the search result, the accommodation facility can be subscribed to by jumping from the page to a subscription page.
Fig. 18 is a diagram illustrating another example of image switching of the terminal device 100 according to the embodiment. Fig. 18 shows an example of a screen displayed when a program currently being broadcast by the reception apparatus 200 or a recorded program is being played back, as in fig. 16. However, fig. 18 is different from the example of fig. 16 in that the user is not a member of the electronic commerce service provided by the first mail order dealer, and the terminal device 100 of the user is not registered in the information processing device of the first mail order dealer.
As shown in fig. 18 (a), when the linkage application is started, the information list 600C is displayed on the display unit 104 of the terminal device 100.
Specifically, the information list 600C includes a calendar area 601, a program information area 602, a performer information area 603, a linkage notification area 613, a linkage notification area 614, and an advertisement area 608. The calendar area 601, the program information area 602, the performer information area 603, and the advertisement area 608 are the same as in the example of fig. 16.
The interlock notification area 613 and the interlock notification area 614 display notifications related to the interlock of the terminal device 100 with a predetermined service, respectively. When the linkage notification area 613 is selected, as shown in fig. 18 (b), an image of a linkage page for linking a predetermined service with the terminal device 100 is displayed. Similarly, when the linkage notification area 614 is selected, an image of a linkage page for linking another service with the terminal device 100 is displayed. Here, the other service may be an e-commerce service provided by the first mail order distributor.
Fig. 19 is a diagram illustrating an example of image switching of the terminal device 100 according to the embodiment. The example of fig. 19 differs from the example of fig. 16 in that the terminal device 100 is used outdoors, for example, and the receiving device 200 is not used for viewing. In the present embodiment, as described above, the viewing history management server 300 manages information on viewing by the reception apparatus 200. Therefore, the terminal device 100 can display various information according to the information on viewing based on the reception device 200 managed by the viewing history management server 300. For example, as described later, the information list 600D can be displayed.
As shown in fig. 19 (a), the display of the information list 600D on the display unit 104 of the terminal device 100 is triggered by the activation of the linkage application.
Specifically, as in the example of fig. 16, the information list 600D includes a calendar area 601, a program information area 602, a performer information area 603, a shop area 604, a first goods area 605, a second goods area 606, a location area 607, and an advertisement area 608. However, the information indicated by the calendar area 601, the program information area 602, the performer information area 603, the shop area 604, the first product area 605, the second product area 606, the location area 607, and the advertisement area 608 is information related to the last program, that is, the program that was viewed most recently, and a link related to the information is provided in each area. Therefore, when the program information area 602 is selected, as shown in (b) in fig. 19, a page indicating a recommended program is displayed. When the first product region 605 is selected, as shown in fig. 19 (c), an image of a page showing details of the product shown in the first product region 605 is displayed. When the position area 607 is selected, as shown in fig. 19 (d), an image of a page showing the search result of the location displayed in the position area 607 is displayed.
In the example of fig. 19, as shown in the example of fig. 17, when the scene information of the program being viewed is not registered in the scene information management database 364, the display content of the information list 600D may be made the same as the content of the information list 600B of fig. 17. Information list 600 is sometimes used hereinafter to collectively refer to information lists 600A-600D.
Fig. 20 is a diagram showing an example of displaying an interest key 502 on the terminal device 100 according to the embodiment. As shown in fig. 20, in the terminal device 100, when a predetermined operation is performed on the image on which the information list 600 is displayed, the fourth display control unit 160 displays the interest key 502 on the display unit 104. In addition, the interest key 502 may be displayed together with the information list 600.
Viewing history information storage processing
Next, the viewing history information storage processing will be described. Fig. 21 is a diagram showing an example of the information list generation process executed by the information linkage system 1 according to the embodiment.
In the example of fig. 21, after viewing of broadcast content is disclosed at a certain time, the channel is changed at a certain time, the interest key 224a of the remote controller 224 is pressed at a certain time, the interest key 502 is pressed at a certain time in the terminal device 100, and viewing is ended at a certain time in the receiving device 200.
As shown in fig. 21, in the reception apparatus 200, when viewing is started, the viewing history transmission part 251 transmits viewing start information to the viewing history management server 300 (S111). The viewing start information includes the receiving apparatus ID, information indicating start of viewing, the channel on which viewing is started, and the viewing start time.
In the viewing history management server 300, the viewing history receiving part 352 receives the viewing start information from the receiving apparatus 200, and registers the viewing start information in the viewing history management database 362 (S121).
Next, in the reception device 200, when the channel is changed, the viewing history transmission unit 251 transmits the channel change information to the viewing history management server 300 (S112). The channel change information includes a receiving apparatus ID, a changed channel, and a change time.
In the viewing history management server 300, the viewing history receiving unit 352 receives the channel change information from the receiving apparatus 200, and registers the channel change information in the viewing history management database 362 (S122).
Next, at the reception apparatus 200, when the interest key 224a is pressed, the viewing history transmission part 251 transmits the interest information to the viewing history management server 300 (S113). The interest information includes a receiving apparatus ID, information indicating that the interest key 224a is pressed, and a pressing time.
In the viewing history management server 300, the interest information receiving unit 353 receives the interest information from the receiving apparatus 200, and registers the interest information in the interest information management database 363 (S123).
Next, in the terminal device 100, when the interest key 502 is pressed, that is, when the interest key 502 is selected, the transmission unit 157 transmits interest information indicating interest in the broadcast content to the viewing history management server 300. The interest information includes a terminal apparatus ID, information indicating that the interest key 502 is pressed, i.e., information indicating interest in broadcast content, and a pressing time.
In the viewing history management server 300, the interest information receiving unit 353 receives the interest information from the terminal device 100 (S124), and converts the terminal device ID included in the interest information into a receiving device ID (S125). Specifically, the interest information receiving unit 353 converts the terminal device ID into a receiving device ID associated with the terminal device ID in the identification information management database 361. Then, the interest information receiving unit 353 registers the interest information received in S124 in the interest information management database 363 using the converted receiving apparatus ID.
Next, in the reception apparatus 200, when the viewing ends, the viewing history transmission part 251 transmits viewing end information to the viewing history management server 300 (S114). The viewing end information includes a receiving apparatus ID, information indicating the end of viewing, and a viewing end time.
In the viewing history management server 300, the viewing history receiving part 352 receives viewing end information from the receiving apparatus 200, and registers the viewing end information in the viewing history management database 362.
In the above processing steps, the case where the viewer views in real time is explained. However, the present embodiment is not limited to the case of live viewing, and can provide the same service as the service shown in fig. 21 even when the reception device 200 plays recorded program information.
For example, in a case where the reception apparatus 200 plays program information in response to an operation from the remote controller 224, the viewing history management server 300 receives interest information indicating that the interest key 502 has been pressed from the terminal apparatus 100. In this case, the viewing history management server 300 transmits an inquiry about the currently played program information to the receiving device 200 indicated by the receiving device ID linked with the terminal device ID of the terminal device 100.
Then, in response to the inquiry, the viewing history transmitting part 251 of the reception apparatus 200 transmits information for specifying the scene in which the interest key 502 has been pressed to the viewing history management server 300, based on the information on the currently played program and the information on the elapsed time after the playing of the program.
For example, the reception apparatus 200 stores attribute information about a currently played program. The attribute information includes a channel, a recording start time, a recording end time, a program name, and the like. Therefore, the reception apparatus 200 can determine the time of playing the scene in which the interest key 502 is pressed from the elapsed time and the recording start time after playing the program. Then, the reception apparatus 200 sets the determined timing as the pressing time, and thereafter transmits the pressing time, the channel, and the like to the viewing history management server 300.
This process is shown as an example, but is not limited to the method of querying the viewing history management server 300. For example, when the reception apparatus 200 starts playing a recorded program, the reception apparatus 200 may transmit attribute information about the played program to the viewing history management server 300. Then, the determination of the pressing time may be made on the viewing history management server 300 side.
Information providing process
Next, the information providing process will be described. Fig. 22 is a flowchart showing an example of information providing processing executed by the information linkage system 1 according to the embodiment. In the example of fig. 22, in the terminal device 100, after pressing the start key 503 of the linked application, the user selects any item in the information list 600 displayed on the terminal device 100.
As shown in fig. 22, when the start receiving unit 150 of the terminal device 100 receives the start request of the linked application (S211), the linked application is started and the start notification of the linked application including the terminal ID and the start information is transmitted to the viewing history management server 300 (S212).
In the viewing history management server 300, the activation receiving unit 354 receives the notification of the activation of the linked application from the terminal device 100 (S221).
When the activation receiving unit 354 receives the activation notification, the list generating unit 355 converts the terminal ID included in the activation notification into the receiving apparatus ID. The conversion method is the same as the above method. Then, the list generation unit 355 creates the information list 600 based on the viewing history information received from the reception device 200 by the viewing history reception unit 352 (S223), and the reception device 200 is specified by the converted reception device ID, that is, the reception device ID linked with the terminal device ID for specifying the terminal device 100 in the specification information management database 361. The information list 600 represents information related to viewed broadcast content as a selectable item list. The information list 600 includes items of information that can select broadcast content that is of interest to the user according to the viewing history information and the time at which the broadcast content is of interest to the user indicated in the interest information. In addition, the information list 600 includes items of information that can select an object or place displayed as a scene of the broadcast content at the time when the user shows an interest, based on the viewing history information, the time when the user is interested in the broadcast content indicated in the interest information, and the scene information management database 364. The information list 600 includes, for example, items indicating information on objects shown in scenes of broadcast content displayed on the receiving apparatus 200 near the time when the interest key 502 is selected based on the interest information transmitted by the transmitting unit 157. Specifically, the object is a commodity such as a bag. The list transmission unit 356 transmits the generated information list to the terminal device 100 (S224).
In the terminal device 100, the list receiving part 154 receives the information list 600 from the viewing history management server 300 (S213). The list receiving unit 154 is an example of a receiving unit.
The second display control unit 155 of the terminal device 100 displays the information list 600 received by the list receiving unit 154 on the display unit 104 (S214: for example, as shown in fig. 16 (a)). That is, when the activation receiving unit 150 receives the activation of the linked application, the second display control unit 155 displays the information list 600 received by the list receiving unit 154 on the display unit 104. The second display control unit 155 can selectively display information of an object (for example, a package) displayed in the broadcast content as an item included in the information list 600. The second display control unit 155 displays information on an object (product) of a scene in the vicinity of the time when the interest key 502 is selected, which is included in the information list 600. The second display control unit 155 is an example of a display control unit.
The selection receiving unit 156 of the terminal device 100 receives selection of an item included in the information list 600, for example, product information (S215). The transmitting unit 157 transmits, for example, a product page information request as a transmission request of information associated with the item (product information) for which the selection receiving unit 156 received the selection to the provided information management server 400 (S216). Here, the product page information is, for example, information indicating a product page shown in fig. 16 (c), i.e., page information indicating a product (object) to be purchased.
In the provided information management server 400, the transmission request receiving unit 451 receives a product page information request, i.e., a transmission request for page information that enables purchase of the product (object), from the terminal device 100 (S231), and the terminal device 100 receives selection of information indicating the product (object). When the transmission request receiving unit 451 receives the product page information request, the page information transmitting unit 452 transmits page information on the purchasable object to the terminal device 100.
The receiving unit 158 of the terminal device 100 receives the product page information as the information associated with the item for which the selection receiving unit 156 has received the selection from the provision information management server 400 (S217). The third display control unit 159 causes the display unit 104 to display the product page indicated in the product page information received by the receiving unit 158 (S218: for example, as shown in fig. 16 (c)).
As described above, in the embodiment, the information linkage system 1 is configured by the reception device 200 and the viewing history management server 300 (server). The reception device 200 has an input terminal 202 (reception section) and a viewing history transmission section 251 (transmission section). The input terminal 202 receives broadcast content through broadcast waves. The viewing history transmitting part 251 transmits viewing history information indicating a viewing history of the broadcast content to the viewing history management server 300. The viewing history management server 300 has a specific information management database 361 (specific information storage section), a viewing history receiving section 352, a startup receiving section 354, and a list transmitting section 355. The identification information management database 361 associates and stores a reception device ID (reception device identification information) for identifying the reception device 200 and a terminal device ID (terminal device identification information) for identifying the terminal device 100 capable of displaying information to a user who can view broadcast content at the reception device 200. The viewing history receiving section 352 receives viewing history information from the receiving apparatus 200. When the activation receiving unit 354 receives the activation notification, the list transmitting unit 355 transmits the information list 600 to the terminal device 100, the information list 600 being generated based on the viewing history information received by the viewing history receiving unit 352 from the receiving device 200, and showing the information on the viewed broadcast content as a selectable item list. The reception apparatus 200 is determined by the reception apparatus ID associated with the terminal apparatus ID for determining the terminal apparatus 100 in the determination information management database 361.
With this configuration, the terminal device 100 can provide the user with the information related to the broadcast content, and therefore, the time and effort required for the user to acquire the broadcast content can be reduced.
Here, the image displayed on the receiving apparatus 200 cannot be provided with a link to a page on which a website is displayed by a touch operation, that is, cannot be provided with an item from which information on broadcast content can be selected. In contrast, in the present embodiment, the information list 600 is transmitted to the terminal device 100, the information list 600 is displayed by the terminal device 100, and the information list 600 represents information on broadcast content displayed on the receiving device 200 as a selectable item list. Accordingly, information related to the broadcast content can be selected.
In the present embodiment, the viewing history management server 300 (server) further includes an interest information receiving unit 353, and the interest information receiving unit 353 receives interest information indicating that the broadcast content is interested from the receiving apparatus 200 or the terminal apparatus 100. The list transmitting part 355 transmits an information list 600 to the terminal device 100, the information list 600 including information about the broadcast content in which the user is interested as a selectable item, according to the viewing history information and the time at which the user is interested in the broadcast content shown by the interest information.
According to such a structure, information on broadcast content in which the user is interested can be provided as selectable items to the user.
In the present embodiment, the viewing history management server 300 (server) further includes a scene information management database 364 (scene information storage unit) that stores the time information and information indicating the object or location of the scene as the broadcast content displayed at the time indicated by the time information in association with each other in the scene information management database 364. The list transmitting part 355 transmits, at the time of interest of the user, an information list 600 including information about an object or a place displayed as a scene of the broadcast content as a selectable item to the terminal device 100, based on the viewing history information, the time of interest of the broadcast content by the user indicated by the interest information, and the scene information management data database 364.
According to such a configuration, it is possible to provide information on an object or a place displayed as a scene of broadcast content in which the user is interested to the user as a selectable item.
In addition, the information linkage system 1 has a provision information management server 400 (second server). The provided information management server 400 includes a transmission request receiving unit 451 (receiving unit) and a page information transmitting unit 452 (transmitting unit), wherein the transmission request receiving unit 451 receives a transmission request for page information that allows a purchase of an object from a terminal device 100 that has received a selection of information indicating the object; when the transmission request receiving unit 451 receives the transmission request, the page information transmitting unit 452 transmits page information on the purchasable object to the terminal device 100.
According to such a configuration, it is possible to purchase an object related to the broadcast content in which the user is interested relatively easily.
In the present embodiment, the terminal device 100 includes a display unit 104, a first display control unit 152, a list receiving unit 154 (receiving unit), and a second display control unit 155. The first display control unit 152 causes the display unit 104 to display a reception device ID (reception device identification information) for identifying the reception device 200. The list receiving unit 154 receives the information list 600, and the second display control unit 155 causes the display unit 104 to display the information list 600 received by the list receiving unit 154, the information list 600 being generated based on the viewing history information indicating the viewing history of the broadcast content received by the receiving apparatus 200, and indicating the information on the viewed broadcast content as a selectable item list.
With this configuration, the terminal device 100 can provide the user with the information related to the broadcast content, and therefore, the time and effort required for the user to acquire the broadcast content can be reduced.
In the present embodiment, the terminal device 100 further includes: a selection receiving unit 156 that receives selection of an item included in the information list 600; a transmitting unit 157 that transmits a transmission request of information associated with the item selected by the selection receiving unit 156 to the provided information management server 400 (external server); a receiving unit 158 that receives the information from the provided information management server 400; and a third display control unit 159 that causes the display unit 104 to display the information received by the receiving unit 158.
With such a configuration, the terminal device 100 can display the information transmitted from the provided information management server 400.
In the present embodiment, in the terminal device 100, the second display control unit 155 can selectively display information to be displayed in the broadcast content included in the item of the information list 600. When the selection receiving unit 156 has received the selection of the information indicating the object, the transmitting unit 157 transmits a transmission request for page information on which the object can be purchased to the provided information management server 400. The transmission request receiving section 451 receives page information on purchasable objects from the provided information management server 400. The third display control section 159 displays page information on which the object can be purchased.
With this structure, the user can purchase the object relatively easily.
In the present embodiment, the terminal device 100 further includes a fourth display control unit 160 that displays an interest key 502 (selection unit), and the interest key 502 notifies that the broadcast content displayed on the receiving device 200 is interested in the interest. In the case where the interest key 502 is selected, the viewing history transmitting part 251 transmits interest information indicating interest in the broadcast content to the viewing history management server 300.
With this configuration, the object of interest of the user can be specified with high accuracy.
In the present embodiment, the list receiving unit 154 receives the information list 600, and the information list 600 includes the following items: near the time when the interest key 502 is selected based on the interest information transmitted by the transmission unit 157, items of information relating to objects in the scene of the broadcast content displayed on the reception device 200 are indicated. The second display control unit 155 displays information on an object included in the scene played near the time when the interest key 502 is selected, the object being included in the information list 600.
With this configuration, information on an object played in a scene near the time when the interest key 502 is selected can be provided to the user.
Further, the programs (including the linkage application) executed by the terminal device 100, the reception device 200, the viewing history management server 300, and the provided information management server 400 are provided as computer program products in an installable format or an executable format. That is, the program is provided in a state of being included in a computer program product having a nonvolatile computer-readable storage medium such as a CD-ROM, a Flexible Disk (FD), or a CD-R, DVD.
The program may be provided or distributed via a network in a state stored in a computer connected to the network such as the internet. The program may also be provided in a state of being preloaded in a ROM or the like.
The information list 600 can select an object or a place from the category, the product category, and the purpose. In addition, the information list 600 may display the bonus lottery in which the user wins the bonus points in a selectable manner.
Further, it is also possible to display a product purchased by a user viewing a program on the information list 600 of the terminal device 100 of another user viewing the same program. In addition, when a product whose number of searches is larger than usual (standard value) is matched when a program is viewed, the product may be displayed on the information list 600. In addition, items associated with a particular program that were introduced by the first mail order distributor may also be displayed in the information list 600. Further, information may be displayed on the information list based on broadcast data obtained by text-converting the broadcast data. In addition, information based on the index may be displayed on the information list. The indexing is performed by another server different from the viewing history management server 300 and the providing information management server 400, i.e., an index server. The index server has a function of parsing a broadcast signal (at least one of an image, audio, and subtitle), identifying a signal similar to the broadcast signal from previously stored feature information, and storing a candidate result. By the reception apparatus 200 and the terminal apparatus 100 making a query to the index server, if the viewing channel and the viewing time are known, candidates of content shown in scenes according to the viewing channel and the viewing time are listed. Then, by searching these candidates at the providing information management server 400, it is possible to introduce a similar shop, a shop, or a vacation place. The above is an index service. Here, sometimes there is some delay between the point in time when the information of interest to the user is displayed and the pressing (reaction) of the interest key 224a, 502 by the user. In such a case, by the index service, it is possible to estimate a candidate in advance assuming the above-described offset of delay (error), or to display the associated information on the terminal apparatus 100 based on the candidate.
In addition, in the case where the program is a baseball program, the information list may display items for linking the ticket reservation page. Where the program is a live program, the list of information may display items for linking to a concert ticket reservation page. In this case, items of the genre and artist of the live broadcast based on the preference of the user may be displayed. In the case where the program is a music program, the information list may display a music distribution page for linking broadcasted musical compositions. In this case, items of the genre and artist of music based on the preference of the user may be displayed. In the case where the program is a television show or an animation program, the information list may display items for linking an original text, a theme tune, an acoustic music product, a video distribution, and the like. In this case, a television series or an animation program broadcasted in other seasons, a related work, information of the same performer may be displayed. In the case where the program is a pull-up thematic program, the information list may display items for linking recommended pull mail orders or pages of stores. In the case where the program is a movie program, the information list may display items for linking guide information, text, theme tune, and acoustic music items pointing to VOD (Video on Demand). In the case where the program is a mail order program, the information list may display items for guiding download of an application program of a mail order operator that provides the program.
In the above-described embodiment, the example in which the content is broadcast content is shown, but the present invention is not limited to this. The content may also be video content provided by a video distribution service, for example. In this case, the video content is distributed from the video distribution server via a network, for example. The video content may also be, for example, non-broadcast content or software packages of partners of the operator providing the collaborative application. Here, in order to determine what the distribution content is, for example, an operator who provides the linkage application and an operator of the video distribution service enter into a business contract. Then, by matching the combination information of the interest information of the carrier side providing the linked application, the ID (specifying information) of the receiving apparatus 200, and the operation time information with the combination information of the video content and the time information of the carrier side of the video distribution service, it is determined what the distribution content is. In addition, as another method of determining what the distribution content is, the distribution content is determined in the same method as the method of determining the broadcast content by implementing a mechanism for image recognition such as ACR on the receiving apparatus 200 side.
In addition, the interest key 224a, the interest key 502 may be used as follows. In the event that the scene at which the interest key 224a, 502 is pressed is an advertisement, then the advertisement may be identified, rather than the bag or travel destination. In the case where the advertisement is a target of a campaign conducted with an advertiser or the like, the user may be given an advantage of obtaining an equivalent having a monetary value such as a coupon, an automatic accumulation, or the like. Accordingly, the operator of the linked application can promote sales by: as the operation of the linked application, the operator of the linked application cooperates with other operators to transmit an advertisement mail to the terminal device 100 such as a mobile phone or a PC of a person interested in the advertisement, to provide a discount coupon to the advertisement mail, to recommend a registered member, or the like. In addition, in addition to the method of advertising mail, coupon, automatic accumulation of points by the system, and the like as described above, an associated advertisement popup, a notification sub-screen (which can be switched to a full screen accordingly), a video advertisement, and the like can be displayed on the reception apparatus 200. That is, the advertisement area 608 displayed on the terminal device 100 is displayed on the receiving device 200.
Some embodiments of the present application have been described above, but these embodiments are merely examples and are not intended to limit the scope of the present application. The innovative embodiments can be implemented in other various forms, and various omissions, substitutions, and changes can be made without departing from the spirit of the present application. These embodiments and modifications thereof are included in the scope and gist of the present application, and are included in the invention of the scope described in the claims and the equivalent scope thereof.

Claims (5)

  1. An information linkage system comprising a receiving device and a server, wherein the receiving device has a receiving unit and a transmitting unit,
    the receiving part is used for receiving content;
    the transmission section that transmits viewing history information indicating a viewing history of the content to the server;
    the server has a determination information storage section, a viewing history receiving section, a start receiving section, and a list transmitting section, wherein,
    a determination information storage unit configured to store reception device determination information for determining the reception device and terminal device determination information for determining a terminal device capable of displaying information to a user who can view the content on the reception device, in association with each other;
    the viewing history receiving section receiving the viewing history information from the receiving apparatus;
    a start receiving unit configured to receive a start notification of a predetermined program from the terminal device;
    the list transmitting unit transmits, to the terminal device, an information list generated based on viewing history information received by the viewing history receiving unit from a receiving device specified by the receiving device specifying information associated with terminal device specifying information for specifying a terminal device in the specifying information storage unit and representing information related to the viewed content as a selectable item list, when the activation receiving unit receives the activation notification.
  2. The information linkage system according to claim 1,
    the server further has an interest information receiving unit that receives interest information indicating interest in the content from the receiving apparatus or the terminal apparatus,
    the list transmitting unit transmits the information list including information about the content in which the user is interested as a selectable item to the terminal device, based on the viewing history information and the time at which the user is interested in the content indicated by the interest information.
  3. The information linkage system of claim 2, wherein
    The server further includes a scene information storage unit that stores time information in association with information indicating an object or a place of a scene as the content displayed at the time indicated by the time information,
    the list transmitting section transmits the information list including information on an object or a place displayed as a scene of the content as a selectable item to the terminal apparatus at the time of the user's interest, based on the viewing history information, the time of the user's interest in the content indicated by the interest information, and the scene information storing section.
  4. The information linkage system according to any one of claims 1 to 3,
    the content includes at least one of broadcast content and video content provided by a video distribution service.
  5. A server having a determination information storage section, a viewing history receiving section, a startup receiving section, and a list transmitting section, wherein,
    a determination information storage unit that stores reception device determination information for determining a reception device that receives a content, the reception device determination information being used to determine a terminal device that can display information to a user who can view the content on the reception device, in association with the terminal device determination information;
    the viewing history receiving section receiving, from the receiving apparatus, viewing history information indicating a viewing history of the content;
    a start receiving unit configured to receive a start notification of a predetermined program from the terminal device;
    the list transmitting unit transmits, to the terminal device, an information list generated based on viewing history information received by the viewing history receiving unit from a receiving device specified by the receiving device specifying information associated with terminal device specifying information for specifying a terminal device in the specifying information storage unit and representing information related to the viewed content as a selectable item list, when the activation receiving unit receives the activation notification.
CN202080006661.9A 2020-05-28 2020-12-23 Information linkage device and system Active CN114009057B (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
JP2020093745A JP7321975B2 (en) 2020-05-28 2020-05-28 Information linkage system
JP2020-093745 2020-05-28
JP2020093744A JP7229200B2 (en) 2020-05-28 2020-05-28 Information linkage system and server
JP2020-093641 2020-05-28
JP2020093641A JP7229199B2 (en) 2020-05-28 2020-05-28 Terminals and programs
JP2020-093744 2020-05-28
PCT/CN2020/138540 WO2021238187A1 (en) 2020-05-28 2020-12-23 Information linkage system and server

Publications (2)

Publication Number Publication Date
CN114009057A true CN114009057A (en) 2022-02-01
CN114009057B CN114009057B (en) 2023-04-07

Family

ID=78745560

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080006661.9A Active CN114009057B (en) 2020-05-28 2020-12-23 Information linkage device and system

Country Status (2)

Country Link
CN (1) CN114009057B (en)
WO (1) WO2021238187A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102572541A (en) * 2011-12-29 2012-07-11 Tcl集团股份有限公司 Television subscriber interaction method and system
CN102790907A (en) * 2012-07-13 2012-11-21 李映红 Interactive system and method aiming at television program
CN102802029A (en) * 2012-07-13 2012-11-28 李映红 Interactive system and method for television program
CN102802028A (en) * 2012-07-13 2012-11-28 李映红 Interactive system and method in allusion to television programs
CN105208449A (en) * 2015-09-22 2015-12-30 李世平 Method and system for synchronously browsing relevant information related to broadcasted television programs
WO2016000394A1 (en) * 2014-06-30 2016-01-07 中兴通讯股份有限公司 Information acquisition method and device
CN107277571A (en) * 2017-06-28 2017-10-20 百视通网络电视技术发展有限责任公司 A kind of displaying predetermined programme system and method based on wechat small routine

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8863165B2 (en) * 2010-11-01 2014-10-14 Gracenote, Inc. Method and system for presenting additional content at a media system
KR20160134355A (en) * 2015-05-15 2016-11-23 삼성전자주식회사 Display apparatus and Method for controlling display apparatus thereof
CN105847882A (en) * 2016-03-30 2016-08-10 乐视控股(北京)有限公司 Method, mobile terminal and system for pushing related commodity information of television program
CN106231355B (en) * 2016-08-03 2019-04-23 深圳Tcl新技术有限公司 The interactive approach and system of TV and mobile terminal

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102572541A (en) * 2011-12-29 2012-07-11 Tcl集团股份有限公司 Television subscriber interaction method and system
CN102790907A (en) * 2012-07-13 2012-11-21 李映红 Interactive system and method aiming at television program
CN102802029A (en) * 2012-07-13 2012-11-28 李映红 Interactive system and method for television program
CN102802028A (en) * 2012-07-13 2012-11-28 李映红 Interactive system and method in allusion to television programs
WO2016000394A1 (en) * 2014-06-30 2016-01-07 中兴通讯股份有限公司 Information acquisition method and device
CN105208449A (en) * 2015-09-22 2015-12-30 李世平 Method and system for synchronously browsing relevant information related to broadcasted television programs
CN107277571A (en) * 2017-06-28 2017-10-20 百视通网络电视技术发展有限责任公司 A kind of displaying predetermined programme system and method based on wechat small routine

Also Published As

Publication number Publication date
CN114009057B (en) 2023-04-07
WO2021238187A1 (en) 2021-12-02

Similar Documents

Publication Publication Date Title
US20220382801A1 (en) Universally interactive request for information
US10511894B2 (en) Apparatus and method for tagging media content and managing marketing
US10368141B2 (en) System and method for engagement and distribution of media content
CN101578862B (en) Media systems with integrated content searching
US20080109851A1 (en) Method and system for providing interactive video
US20080109841A1 (en) Product information display and product linking
US9654721B2 (en) System and method for providing personal content recommendations
US8805729B2 (en) Multi-platform network for providing ordering services
US20080052750A1 (en) Direct-point on-demand information exchanges
US20100023405A1 (en) Advertising by tagging predefined keywords or phrases onto content or media
WO2014142301A1 (en) Information supply system, server device, video display device, information supply method, and program
US20100175091A1 (en) System and Method of Providing a Source for Ordering a Plurality of Products from a Plurality of Media
US20110107219A1 (en) Service providing apparatus and method for recommending service thereof
JP6799655B1 (en) User interface methods, terminal programs, terminal devices, and advertising systems
KR101708152B1 (en) Method for providing selective watching at home shopping data broadcasting
TW201322740A (en) Digitalized TV commercial product display system, method, and recording medium thereof
KR101232818B1 (en) A method for classifing goods by category of the home shopping data broadcasting
CN114009057B (en) Information linkage device and system
JP7229199B2 (en) Terminals and programs
JP7229200B2 (en) Information linkage system and server
JP7321975B2 (en) Information linkage system
US20130262200A1 (en) Method and Apparatus for the identification of products displayed in media programs
WO2008147149A2 (en) Method and system for providing advertisement
JP2006074801A (en) Digital television broadcasting system, transmitting apparatus, receiving apparatus, mobile data terminal and shop terminal
JP2010233020A (en) Information providing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant