US7756916B2 - Display method - Google Patents

Display method Download PDF

Info

Publication number
US7756916B2
US7756916B2 US11/447,112 US44711206A US7756916B2 US 7756916 B2 US7756916 B2 US 7756916B2 US 44711206 A US44711206 A US 44711206A US 7756916 B2 US7756916 B2 US 7756916B2
Authority
US
United States
Prior art keywords
program
name
information
viewing
programs
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US11/447,112
Other languages
English (en)
Other versions
US20060282407A1 (en
Inventor
Yasushi Shikata
Kazuna Maruyama
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Canon Inc
Original Assignee
Canon Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Inc filed Critical Canon Inc
Assigned to CANON KABUSHIKI KAISHA reassignment CANON KABUSHIKI KAISHA ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: MARUYAMA, KAZUNA, SHIKATA, YASUSHI
Publication of US20060282407A1 publication Critical patent/US20060282407A1/en
Application granted granted Critical
Publication of US7756916B2 publication Critical patent/US7756916B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/248—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9038—Presentation of query results
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/912—Applications of a database
    • Y10S707/913—Multimedia
    • Y10S707/915—Image
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y10S707/99933—Query processing, i.e. searching

Definitions

  • the present invention relates to a display method.
  • Japanese Patent Application Laid-Open No. 11-261908 describes a method (means) of searching a program using information (keyword) related to the program in a program and/or information selection support apparatus. Specifically, a technique is disclosed in which with pictures of a plurality of user's favorite performers being displayed the user selects his/her most favorite performer from the performers and then presses a search start button to start a search. In addition, there is disclosed a technique of displaying on a screen character strings in different colors which serve as keyword candidates.
  • An object of the present invention is to provide a novel configuration capable of suitably displaying information on a program related to a selected program.
  • a display method is configured as follows.
  • a display method comprising the steps of:
  • the databases including: a database in which information indicating a name of person can be identified; a database in which information indicating an attribute name of person can be identified; a database in which information indicating a name of thing can be identified; a database in which information indicating an attribute name of thing can be identified; a database in which information indicating a name of place can be identified; a database in which information indicating an attribute name of place can be identified; a database in which information indicating an attribute name of event can be identified; a database in which information indicating an attribute name of event can be identified; and a database into which a part or all of the databases is integrated, the plurality of pieces of information including: information indicating a name of person; information indicating an attribute name of person;
  • examples of the name of person include the real name, pseudonym, common name, and the like of a person.
  • Examples of the attribute name of person include a “president”, a “committee member”, a “minister”, a “pattern maker”, a “billionaire”, a “group leader”, and the like.
  • Examples of the name of thing include a “bat”, a “hot-air balloon”, and the like.
  • Examples of the attribute name of thing include a “tool”, “peripheral equipment”, and the like.
  • Examples of the name of place include “Kyoto”, “Madrid”, and the like.
  • Examples of the attribute name of place include an “amusement park”, a “ranch”, and the like.
  • Examples of the name of event include “Big Bang”, “Great Kanto Earthquake”, “World Cup”, and the like.
  • Examples of the attribute name of event include a “fraud case”, a “festival”, and the like.
  • the object to be extracted includes the types of names such as the name of person, the attribute name of person, the name of thing, the attribute name of thing, the name of place, the attribute name of place, the name of event, and the attribute name of event. Extraction of information indicating these names does not require that a certain name belongs only to a single type. Depending on the contents of a database, for example, a “fraud case” may be extracted as the attribute name of event or may be extracted as the name of event.
  • Information indicating “Superman” may be stored in a database as information indicating the name of person or may be stored as information indicating the attribute name of person. Alternatively, information indicating “Superman” may be stored as information indicating the name of thing or may be stored as information indicating the name of event.
  • the database indicates a set of a plurality of data units which serve as the object to be compared for extraction. Therefore, for example, a database in which information indicating the name of person can be identified has a plurality of data units on names as data indicating the name of person. The name of person does not need to be the name recorded in the registry books; a pseudonym, an abbreviation, and the like can also be used.
  • a display method is configured as follows.
  • a display method comprising the steps of:
  • searching from a group of information including information associated with a plurality of programs, information corresponding to information obtained by extracting information indicating a name of person from a group of information associated with a selected program;
  • the group of information associated with the selected program has a structure in which a first area having described therein information indicating a performer's name and a second area different from the first area are specified, and the information obtained by extraction is information obtained by extracting the information indicating the name of person with at least a group of information described in the second area being an extraction population.
  • the information corresponding to extracted information is the same information as the extracted information or information having the same or nearly the same meaning as the extracted information can be suitably adopted.
  • the information associated with a program includes information specified as attribute information on the program and information specified as attribute information on a scene of the program.
  • attribute information a program name, a summary description, a performer's name, and the like which are provided by the sending side of the program (the distributor (broadcasting station) of the program or the producer of the program) or the creator of a program table other than the sender of the program, so as to be associated with the program can be suitably adopted.
  • a data structure of section format defined in the MPEG-2 Systems corresponds to such a structure.
  • EIT Event Information Table
  • Section format data is variable length and predetermined data types (an identifier, time information, and descriptor information) are stored in a predetermined order. Among them, in a descriptor area of the EIT, details of the information associated with the program are stored. Specific examples of descriptors are provided below.
  • Component descriptor describes the type of component (video, audio, or the like) and also a video format and the like.
  • Content descriptor describes genre information.
  • Short event descriptor describes a program name, a program outline, and the like.
  • Extended event descriptor describes (1) a detailed description of a program; and (2) a performer's name, program details, announcement from the program, and the like.
  • an area in which information indicating a performer's name is described is provided as an extended event descriptor.
  • extended event descriptor are described data that specifies the size of an area in which the name of an item is described, followed by text data (e.g., “performer”) of the name of the item. Subsequent to that, data that specifies the size of an area in which specific contents of the item are described is described followed by text data (e.g., Taro Suzuki and Jiro Yamamoto) of the specific contents of the item.
  • Descriptors other than an extended event descriptor can also be used.
  • a short event descriptor is defined in the “program lineup information (ARIB STD-B10) used in digital broadcasting”, and in the short event descriptor a program name and a program outline can be described.
  • the structure in which a first area having described therein information indicating a performer's name is specified indicates a structure configured such that the information described in the area being information for identifying a performer can be identified by an apparatus that processes the information. Therefore, it is not always necessary to indicate, in text data, that a performer is described as the name of an item such as “performer”. For example, a data structure can also be adopted in which information for identification such as 111 is described and thereafter the actual performer's name is described. If an apparatus that processes this information is configured to be able to determine that information following the identification information of 111 is information that identifies a performer, it is not necessary to describe text data “performer” as the name of an item.
  • the data structure in which a first area having described therein information indicating a performer's name and a second area different from the first area are specified is a data structure in which an area other than the first area is specified.
  • For the second area at least one of an area in which detailed contents of a program are described, an area in which a program outline is described, and an area in which a program name is described can be suitably employed.
  • a structure in which an area can be identified by information that identifies the name of an item such as “program details”, “program outline”, or “program name”
  • a structure in which an area can be identified by information that identifies the contents of information described in the area, a structure in which a fixed area is assigned, or the like can be suitably employed.
  • the information indicating the name of person is extracted using a database in which the name of person can be identified.
  • a configuration can be suitably adopted in which the information obtained by extraction from the group of information associated with the selected program is information obtained by extraction before the selected program is selected by a user of an apparatus that performs the display method.
  • a configuration can be suitably adopted in which the extraction is performed in advance on a plurality of programs that are likely to be selected by the user.
  • a configuration can be suitably adopted in which the searching step is performed without receiving, after the selected program is selected, an instruction for a search from a user of an apparatus that performs the display method.
  • the searching step includes, when there are a plurality of pieces of the information which is extracted from the group of information associated with the selected program, a step of selecting from the pieces of extracted information a piece of information based on a predetermined selection condition.
  • a configuration can be suitably adopted in which information for allowing user's preference to be reflected in the selection is configured to be outputable and using the information for allowing user's preference to be reflected a piece of information is selected from the plurality of pieces of extracted information.
  • a configuration can be suitably adopted in which in the displaying step, pieces of information on a plurality of programs which are respectively associated with the pieces of information searched in the searching step are displayed on a same screen.
  • the following operation is suitably performed. Specifically, different directions are instructed using direction instruction keys on an operation device which is operated by the user, so as to obtain a state in which among a plurality of programs whose information is displayed each of different programs is selected.
  • the state in which a program is selected indicates either a state in which the position where information on a program is displayed is focused or a state in which the channel of a program is selected and the program is being played.
  • the direction instruction keys are not limited to buttons, and various input devices that allow the user to specify a direction can be employed.
  • the direction instruction keys may be a set of independent keys for different directions or a single key, such as a stick-type key, that allows the user to select one of a plurality of directions.
  • FIG. 1 is an overall processing flowchart of a related program search
  • FIG. 2 is a diagram showing an internal configuration of a digital television apparatus 100 according to an embodiment of the present invention
  • FIG. 3 is a diagram showing an exemplary configuration of remote control keys on a remote control 200 ;
  • FIGS. 4A and 4B are diagrams each showing a user interface according to the embodiment of the present invention.
  • FIG. 5 is a presentation flowchart of a related program search using the user interface
  • FIG. 6 is a diagram showing an exemplary presentation for setting a category type
  • FIG. 7 is a diagram showing a system configuration according to the embodiment of the present invention.
  • FIG. 8 is a processing flowchart of category information extracting processing
  • FIG. 9 is a processing flowchart of search condition determination and search execution processing
  • FIG. 10 is a flowchart of extracting category information from program related information 902 ;
  • FIG. 11 is a diagram showing exemplary category priority 907 classified by genre
  • FIG. 12 is a diagram showing exemplary category priority 906 .
  • FIG. 13 is a diagram showing a determination method of the category priority 906 .
  • a display method of the present invention includes a display (and selection) method in an apparatus having a display, such as a computer or a digital television apparatus.
  • a digital television apparatus is a preferred embodiment in which the present invention is implemented, in terms of its capability of easily obtaining information related to contents (particularly a program) from a broadcasting station or the Internet.
  • the embodiment of the present invention will be described in detail below using a digital television apparatus as an example.
  • FIG. 7 is a diagram showing an exemplary system configuration according to the embodiment of the present invention.
  • a digital television apparatus 100 is capable of receiving, via cable or radio, BS (Broadcast satellite), CS (Communication Satellite), and terrestrial digital broadcasting or analog broadcasting transmitted from a broadcasting station 300 .
  • the digital television apparatus 100 is connected to the Internet and thus is capable of performing interactive communication with the broadcasting station 300 .
  • a televiewer can operate the digital television apparatus 100 using a remote control 200 .
  • FIG. 3 is a diagram showing an exemplary configuration of remote control keys on the remote control 200 .
  • the remote control 200 has at least normal up/down keys 205 , numeric keypad 204 , power key 206 , up, down, left, and right arrow keys 201 , determination key 202 , and search key 203 used to search a related program.
  • the remote control 200 has a “program table” key used to display an EPG and a “contents of program” key used to display the contents of a program.
  • FIG. 2 is a diagram showing an internal configuration of the digital television apparatus 100 necessary to implement the present invention.
  • the digital television apparatus 100 receives, through a receive unit 102 , digital or analog broadcasting. Broadcast data received by the receive unit 102 is demodulated and separated and then divided into AV streams (hereinafter referred to as “program contents 901 ”) such as video and audio that compose a program and information about the program (hereinafter referred to as “program related information 902 ”).
  • program contents 901 such as video and audio that compose a program and information about the program
  • the program related information 902 has the same contents as program information included in SI (Service Information) which is currently sent via BS digital broadcasting or terrestrial digital broadcasting. Alternatively, the program related information 902 has the same contents as program information (meta data) used in server-type broadcasting which is expected to come into service in the future.
  • SI Service Information
  • the program related information 902 has the same contents as program information (meta data) used in server-type broadcasting which is expected to come into service in the future.
  • the program information (corresponding to a “group of information associated with a program” of the present invention) specifically includes not only a program name and a summary description (program outline) but also a start time, a duration, a genre, a sub-genre, video and audio format information, copy control information, performers' names, a detailed description of the contents of the program, and the like. Normally, information about programs for up to about a week ahead is sent at a time.
  • the image and audio decoding unit 110 decodes the program contents 901 separated by the receive unit 102 and passes video data to a screen synthesis unit 111 . Similarly, the image and audio decoding unit 110 passes audio information contained in the program contents 901 to an audio output unit (not shown).
  • the image synthesis unit 111 synthesizes the program contents 901 received from the receive unit 102 through the image and audio decoding unit 110 , and a graphic image, such as a background, a character, or a diagram, received from a screen generation unit 109 . In the case of performing normal television viewing, the screen synthesis unit 111 passes moving image information included in the program contents 901 received from the image and audio decoding unit 110 , to a display unit 112 .
  • the screen synthesis unit 109 generates a graphic image from background or character and diagram information including the program related information 902 which is obtained from an accumulation unit 107 , and then passes the graphic image to the screen synthesis unit 111 .
  • the screen synthesis unit 111 When the screen synthesis unit 111 obtains the graphic image from the screen generation unit 109 , the screen synthesis unit 111 synthesizes the graphic image on the moving image information and passes a synthesis result to the display unit 112 .
  • the display unit 112 outputs the synthesis result from the screen synthesis unit 111 on a screen and presents it to the televiewer.
  • the audio output unit also outputs the obtained audio information in synchronization with the synthesis result.
  • the category information extraction unit 104 extracts information including character strings from the program related information 902 obtained through the receive unit 102 , and then extracts information on the basis of category.
  • the information including character strings is character string information which can be described by the sending side; for example, “program name” and “program summary description” correspond to such information.
  • SI Service Information
  • information having a program outline described therein which is included in a short event descriptor and information, such as “performer”, “announcement”, and “program details”, which is included in an extended event descriptor also correspond to such information.
  • the category represents information set by a receiving apparatus to obtain unique program related information. For example, “name of person”, “name of place”, “track name”, “car's name”, “sport name”, and the like serve as categories (unique categories on the receiving apparatus side).
  • the category information extraction unit 104 accumulates in the accumulation unit 107 results (hereinafter referred to as “category information extracted program related information 905 ”) obtained by extracting information on the basis of category.
  • a data accumulation unit for analysis 105 accumulates information necessary when the category information extraction unit 104 extracts information on the basis of category. Examples of such information include dictionaries of person names and place names.
  • the dictionaries are databases which store information.
  • the person name dictionary stores information indicating the names of a plurality of persons.
  • a category it is also possible to set a category called “attribute name of person”.
  • a person attribute name dictionary may be used.
  • the place name dictionary stores information indicating the names of a plurality of places.
  • a category it is also possible to set a category called “resort”. Information belonging to this category can be extracted using a database storing the attribute names of places, such as hot springs, amusement parks, and beaches.
  • a track name dictionary stores information indicating the names of a plurality of pieces of music.
  • a car's name dictionary stores information indicating the names of a plurality of cars.
  • track names and cars' names may be integrated and stored in a database indicating the names of things.
  • a database can be used in which, for example, information indicating the name “earth song” is stored to be associated with information indicating that that name is a track name and information indicating the name “S 200 ” is stored to be associated with information indicating that that name is a car's name.
  • a sport name dictionary stores information indicating the names of a plurality of sports.
  • an event name dictionary may be used.
  • the event name dictionary stores information indicating the names of a plurality of events. Note that databases covering a plurality of categories may be provided individually or may be integrated into a single database.
  • Program related information 902 may exist on a particular site on the Internet.
  • the digital television apparatus 100 can download the program related information 902 by establishing a connection to the Internet through a modem 103 .
  • the category information extraction unit 104 extracts from the program related information 902 obtained through the modem 103 information on the basis of category of the receiving apparatus and accumulates extraction results in the accumulation unit 107 .
  • the information extraction is performed on currently broadcasted programs and programs that are expected to be broadcasted.
  • the accumulation unit 107 accumulates the program related information 905 extracted as information belonging to the aforementioned categories from the category information extraction unit 104 .
  • information extracting processing on the basis of category by the category information extraction unit 104 can also be performed on information temporarily accumulated in the accumulation unit 107 .
  • the accumulation unit 107 directly obtains and accumulates program related information 902 from the receive unit 102 or through the modem 103 and then processing by the category information extraction unit 104 is performed at a predetermined timing.
  • a remote control input unit 101 receives remote control information 903 from the remote control 200 and passes the remote control information 903 to a control unit 108 .
  • the remote control information 903 includes information on the type of remote control key and information on an action (press, release, or continuously press) made on the remote control.
  • the control unit 108 performs control according to the remote control information 903 .
  • the control unit 108 obtains remote control information 903 from the remote control input unit 101 and recognizes that it is a request to display a user interface
  • the control unit 108 requests a search unit 106 to perform related program search processing based on information extracted from program information on a currently viewed program.
  • the control unit 108 requests the screen generation unit 109 to generate a graphic image based on search results obtained by the search unit 106 .
  • control unit 108 determines from remote control information 903 that it is a request to select a channel
  • the control unit 108 requests the receive unit 102 to select a channel and requests the screen generation unit 109 to abandon the graphic image being displayed.
  • the control unit 108 passes a history for channel selection to a profile management unit 113 .
  • the search unit 106 performs, based on the category information extracted program related information 905 accumulated in the accumulation unit 107 , a related program search based on information extracted from information associated with a newly selected program and then notifies results to the screen generation unit 109 .
  • the profile management unit 113 receives the history of channel selection from the control unit 108 and collects logs of the viewing history of the televiewer and also accesses the accumulation unit 107 and obtains category information extracted program related information 905 on viewed programs. Then, the profile management unit 113 generates, at a predetermined timing, televiewer's preferred program information 904 based on the viewing logs and the category information extracted program related information 905 .
  • the preferred program information 904 is information indicating: (1) the priorities of categories; and (2) the priorities of value in a category (hereinafter referred to as “category value 908 ”). For example, when there are categories of “name of person”, “name of place”, and “track name”, (1) the priorities of categories are priorities of categories set in order of televiewer's preference, such as No. 1 “name of person”, No. 2 “name of place”, and No. 3 “track name”.
  • the priorities of the category value 908 are, when “name of person” is taken as an example, priorities of specific values in the same category in order of televiewer's preference, such as No. 1 “performer A”, No. 2 “performer B”, and No. 3 “performer C”. Note that while (1) the priorities of categories and (2) the priorities of the category value 908 in a category are held as information common for all program genres, they are also held individually for each genre and sub-genre.
  • FIG. 4A is a diagram showing an exemplary presentation of a user interface (UI) according to the embodiment of the present invention.
  • UI user interface
  • the televiewer searches other programs related to a program (selected program) currently being viewed by the televiewer, by pressing the search key 203 on the remote control 200 with the channel of that program being selected, the user interface shown in FIG. 4A is presented on the display unit 112 .
  • An exemplary presentation is provided in FIG. 4B .
  • a presentation is provided such that the user interface shown in FIG. 4A is synthesized on the viewing program (moving image).
  • Information displayed at the center of the user interface is information on a program (hereinafter referred to as a “main program 301 ”) which serves as a search source.
  • the main program 301 shows the name of the program (“program name A”) being viewed by the televiewer.
  • Information displayed in areas in four directions, up, down, left, and right, from the main program 301 is information on programs (hereinafter referred, clockwise from right, to as “related programs 302 , 303 , 304 , and 305 ”) related to the main program 301 .
  • the related programs represent programs having information common with program related information 902 on the main program. For example, a program having the same performer, supervisor, genre, music, or the like as the main program corresponds to a related program. Related programs are automatically searched by preset logical processing (described later) and up to four related programs are presented in the aforementioned peripheral areas. As information on a related program, related information 307 indicating the relation with the main program is presented as well as a program name 306 . In addition to these, as information on the related program, genre information on the program or the like may be added. In FIG. 4A , a state is shown in which a focus for operation is placed on the main program 301 . The focus is caused to move using the up, down, left, or right arrow key 201 on the remote control 200 .
  • the timing at which the user interface is presented is when the televiewer is viewing the TV, the timing is not limited thereto.
  • the search key may be pressed while an EPG is being run, and in order to search programs related to a focus program (selected program) on the EPG the user interface may be presented.
  • the exemplary presentation of UI shown in FIG. 4A is merely an example and thus the user interface can be any as long as it fulfills the same functions as those of FIG. 4A .
  • FIG. 5 is a presentation flowchart of a related program search using the user interface.
  • the user interface is displayed (at step S 401 the program name 301 of the main program in FIG. 4A is displayed, and at step S 402 information on the related programs 302 to 305 are displayed), going into a state of waiting for the televiewer to make input to a remote control key.
  • the selected program serves as a main program 301 and thus moves to the center position of the user interface (steps S 403 and S 404 ).
  • programs 302 , 303 , 304 , and 305 related to the new main program 301 are displayed (step S 402 ). Specifically, after one of the related programs (e.g., program B shown in FIG. 4 ) is selected, the selected program (program B) serves as the main program. Then, information corresponding to information extracted from information associated with the program B is newly searched. Then, information on programs associated with the information found by the search is displayed. After the program B is selected, the user does not need to provide any special instruction for the new search. Specifically, in the state shown in FIG. 4 , an instruction to select the program B is triggered to perform a new search based on information extracted from information associated with the program B.
  • the related programs e.g., program B shown in FIG. 4
  • steps S 402 to S 404 are repeated.
  • the televiewer can follow the links of the related programs with the program being viewed as a base point.
  • the televiewer wants to select the channel of the main program 301 or to record the main program 301 , by pressing the determination key 202 on the remote control 200 during a remote control key input wait state, processing necessary for channel selection or recording is performed and thereafter the user interface is no longer displayed (steps S 405 , S 406 , and S 407 ).
  • FIG. 1 is an overall processing flowchart of a related program search performed by the digital television apparatus 100 .
  • the digital television apparatus 100 obtains, at a predetermined timing, program related information 902 through the receive unit 102 or the modem 103 (step S 501 ), and then extracts, by the category information extraction unit 104 , information about categories which are set on the receiving apparatus from the program related information 902 (step S 502 ).
  • the predetermined timing is one in which information is obtained periodically at certain intervals (e.g., every one hour) or one in which information is obtained when the digital television apparatus 100 is turned on.
  • step S 503 The steps after step S 503 are processing triggered by an operation performed on the remote control by the televiewer viewing the program.
  • the digital television apparatus 100 determines a search condition based on category information extracted program related information 905 on the viewing program (step S 503 ) and searches related programs (step S 504 ). Then, when the related programs are determined, the digital television apparatus 100 generates a graphic image and presents the graphic image on the display unit 112 (step S 505 ), going into a televiewer's input state.
  • the digital television apparatus 100 performs again search condition determination processing with the selected related program being as a base point (step S 506 ). If the televiewer presses the determination key 202 on the remote control 200 to perform a channel selection (or recording), the digital television apparatus 100 performs predetermined channel selection processing (or recording processing) and the graphic image being displayed is no longer displayed (steps S 507 and S 508 ).
  • FIG. 8 is a detailed flowchart of the category information extracting processing of step S 502 in FIG. 1 .
  • category an extraction is performed is preset before performing extracting processing (step S 601 ).
  • a category setup can be performed by a method in which the setup is performed manually by the televiewer or a method in which the setup is performed automatically by the digital television apparatus 100 .
  • FIG. 6 is a diagram showing exemplary category priority 906 .
  • top three categories, “name of person”, “track name”, and “name of place”, are set as categories used in extracting processing.
  • FIG. 13 is a diagram showing an exemplary flow of determining the category priority 906 by the profile management unit 113 .
  • the profile management unit 113 uses viewing logs and category information extracted program related information 905 . Specifically, the profile management unit 113 identifies, from the viewing logs, programs having been viewed by the televiewer and then determines category value 908 for each category from character string information included in program related information 902 on the identified programs (corresponding to program related information 905 obtained by extracting information belonging to a category).
  • An “example of program related information 905 ” in FIG. 13 is exemplary category information extracted program related information 905 on the programs identified by the viewing logs.
  • the category value 908 includes a performer's name and a supervisor's name.
  • the profile management unit 113 records the number of accumulations (accumulation value) of the same category value 908 from the category information extracted program related information 905 .
  • the profile management unit 113 records accumulation values such that: (1) the accumulation value of “performer A” which is the name of person is “4”; (2) the accumulation value of “classic music C” which is a track name is “3”; and (3) the accumulation value of “place B” which is the name of place is “2”. Then, a category that includes category value 908 having a high accumulation value is set to high priority.
  • the profile management unit 113 records the category priority 906 such that No. 1 is “name of person”, No. 2 is “track name”, and No. 3 is “name of place”.
  • the category information extraction unit 104 obtains or updates a dictionary (corresponding to the “database” of the present invention) necessary for extraction (step S 602 ). For example, if, at step S 601 , “name of person”, “name of place”, and “track name” are set as categories, the category information extraction unit 104 of FIG. 2 checks if dictionaries of “name of person”, “name of place”, and “track name” are accumulated in the data accumulation unit for analysis 105 . If any of the dictionaries of “name of person”, “name of place”, and “track name” is lacking, the category information extraction unit 104 obtains data from an outside source through the modem 103 and accumulates the obtained data in the data accumulation unit for analysis 105 . The dictionaries of “name of person”, “name of place”, and “track name” are used in extracting processing.
  • a dictionary corresponding to the “database” of the present invention
  • step S 602 is performed when the category setup at step S 601 is manually performed; when the category setup is automatically performed, step S 602 is performed prior to step S 601 .
  • a free format portion (a portion in which a program name, a summary description (program outline), and detailed contents of a program are described) is extracted from program related information 902 (see FIG. 2 ) obtained through the receive unit 102 or the modem 103 (step S 603 ), and words and the parts of speech of the words are identified from character strings by morphological analysis (step S 604 ).
  • step S 603 uses the dictionaries held in the data accumulation unit for analysis 105 , processing up to the point where “name of person” and “name of place” are identified (extracted) is performed.
  • FIG. 10 is a diagram showing the flow of the aforementioned steps S 603 and S 604 using “name of person” and “name of place” as an example.
  • Information 801 corresponds to program related information 902 (see FIG. 2 ) on “program A” and is information (categorized information) which is already categorized by the broadcasting station 300 .
  • the categorized information includes “program name”, “broadcasting date”, “start time”, “duration”, “genre”, “program outline”, “program details”, and “performer”.
  • the categorized information is the same information as SI (Service Information) which is implemented in digital broadcasting.
  • SI Service Information
  • a performer can be extracted.
  • the name of person is described in areas other than the area in which performers are described.
  • extraction is performed on areas other than that area as an extraction object (the area of performers may also be an extraction object), whereby extraction failure can be reduced.
  • Information 802 is obtained by extracting from the information 801 only information including character strings that can be used as a search condition.
  • “program name”, “program outline”, “program details”, and “performer” correspond to the information including character strings.
  • “genre” is also sent as character string information, the “genre” is included in the information 802 .
  • Information 803 is obtained by extracting from the information 802 only information about “name of person”.
  • the information 802 includes “name of person” in the categories as follows: (1) “Mr. MS” in the program name; (2) “Miss NS” and “Mr. ST” in the program outline; (3) “Mr. T” and “Mr. G” in the program details; and (4) “Miss TY” and “Mr. HS” in the performer.
  • the information 803 is information obtained by extracting “name of person” from a plurality of categories in the information 802 .
  • character strings are cut out at word level and only nouns (proper nouns) are extracted, and then, matching is performed with the person name dictionary, whereby person's name nouns are identified.
  • Information 804 is obtained by extracting from the information 802 only information about “name of place”.
  • the information 802 includes the name of place in the categories as follows: “Shinjuku” and “Kabuki-cho” in the program outline and “K country” in the program details.
  • the information 804 is information obtained by extracting “name of place” from a plurality of categories in the information 802 .
  • character strings are cut out at word level and only nouns (proper nouns) are extracted, and then, matching is performed with the place name dictionary, whereby place's name nouns are identified.
  • dictionaries data for analysis
  • the category information extraction unit 104 extracts information 803 and information 804 for each program and then adds the extracted information as additional information to the related program information 902 (corresponding to the category information extracted program related information 905 ) and accumulates the information in the accumulation unit 107 (step S 605 ).
  • the aforementioned processing is performed on all programs (step S 606 ). Note that although the present embodiment employs a configuration in which this extracting processing is performed in advance on a plurality of programs, the present invention is not limited thereto. For example, when a program is selected, information may be extracted from a group of information which is associated with the selected program.
  • the digital television apparatus 100 performs unique categorization which is independent of the data structure of program related information 902 sent from the broadcasting station 300 .
  • information 803 and information 804 may be directly extracted from information 801 .
  • FIG. 9 is a detailed flowchart of search processing of steps S 503 and S 504 in FIG. 1 .
  • the steps of determining a search condition are steps S 701 and S 702 .
  • the control unit 108 obtains a category priority 907 classified by genre of a viewing program (which is a selected program and a program being viewed) from the profile management unit 113 , according to a search request received through the remote control 200 (step S 701 ).
  • the category priority 907 classified by genre is obtained by setting priorities for genres in the same manner as the aforementioned priorities set to determine the category priority 906 .
  • the profile management unit 113 generates and holds category priority 907 classified by genre based on (1) the viewing logs of the televiewer and (2) the category information extracted program related information 905 (see FIG. 2 ) (corresponding to the preferred program information 904 and the “step of obtaining a category priority” of the present invention).
  • FIG. 11 is a diagram showing exemplary category priority 907 classified by genre.
  • the categories shown in FIG. 11 are (1) categories manually selected by the televiewer or (2) categories automatically selected at step S 601 of FIG. 8 .
  • “name of person”, “track name”, “name of place”, “sport name”, “store name”, and “car's name” are selected.
  • priorities such as (1) the name of person, (2) track name, and (3) the name of place are obtained.
  • the profile management unit 113 may extract information about genres from the information 801 .
  • buttons which are assigned with genres may be provided on the remote control 200 and the profile management unit 113 may obtain information about genres according to a signal sent in response to an operation performed on any of the buttons by the user.
  • the control unit 108 obtains from the profile management unit 113 a maximum of each category of the viewing program (step S 702 ).
  • the maximum of each category represents the maximum number of programs that can be displayed with the same category when a related program search is performed. For example, when a search is performed for the category “name of person”, if the “maximum is two”, the search for the name of person ends at a stage where two programs having the same name of person have been searched, and processing follows a next category search.
  • step S 703 shows a detailed flowchart of the search processing step S 504 .
  • the control unit 108 requests the search unit 106 for a search based on the category priority 907 and the maximums of the categories which are obtained at steps S 701 and S 702 .
  • the search unit 106 obtains from the accumulation unit 107 information about a category with highest priority among the category priority 907 obtained at step S 701 . For example, when the category with highest priority is “name of person”, the search unit 106 obtains from the accumulation unit 107 the category value 908 of the category information extracted program related information 905 on the viewing program.
  • the category value 908 belonging to the category of “name of person” corresponds to information on the name of person extracted from a group of information which is associated with a selected program, and it is likely that “performer's name” or “voice artist's name” appearing on the selected program corresponds to the category value 908 .
  • the obtained category value 908 is “performer A”, “performer B”, and “performer C”. Then, a determination is made as to whether the obtained category value 908 is plural (step S 703 ).
  • step S 703 If, at step S 703 , the obtained category value 908 is singular, information having that value is searched from information accumulated in the accumulation unit 107 (step S 705 ). Specifically, if the category value 908 belonging to the category of “name of person” which is extracted from a group of information associated with the viewing program is singular, a search is performed for the “name of person (category value)”. Note that when a search is performed for a certain category value, it is desirable to also search a synonym or near-synonym of that category value. For example, a certain category value may be included, with an abbreviation or another name, in a group of information associated with other programs. Thus, it is ideal to perform a search for information (the same one, the one having the same meaning, or the one having nearly the same meaning) corresponding to extracted information.
  • the search unit 106 requests the profile management unit 113 to set priorities for the obtained category value 908 .
  • the profile management unit 113 having received a request sets priorities for the category value 908 and returns results to the search unit 106 (step S 704 ).
  • the search unit 106 performs a search using category value 908 with highest priority among the priorities obtained at step S 704 (step S 705 ).
  • the search unit 106 requests, at step S 704 , the profile management unit 113 to set priorities for the “performer A”, “performer B”, and “performer C”.
  • the profile management unit 113 returns the search unit 106 priority results such as, for example, 1. “performer A”, 2. “performer B”, and 3. “performer C”.
  • the search unit 106 performs a search for the “performer A” which has highest priority.
  • step S 705 A determination is made as to the number of programs hit as the result of search at step S 705 (step S 706 ). If a single program is hit, that program is determined to be a related program. If there is no hit program, processing once again returns to step S 705 and a search is performed again for category value 908 with the second highest priority. On the other hand, as the result of search, if a plurality of programs are hit, the search unit 106 requests the profile management unit 113 to set priorities for the programs.
  • the profile management unit 113 having received a request sets priorities for the obtained programs and returns results to the search unit 106 (step S 707 ). For example, if a plurality of search results are obtained at step S 705 such as “program X”, “program Y”, and “program Z”, the search unit 106 once again requests the profile management unit 113 to set priorities for the programs. Here, at step S 707 , the profile management unit 113 returns the search unit 106 priority results such as, for example, 1. “program X”, 2. “program Y”, and 3. “program Z”.
  • the search unit 106 determines the number of programs that matches the maximum obtained at step S 702 to be related programs (step S 708 ). Specifically, the search unit 106 determines the “program X” with highest priority to be a related program. Then, the search unit 106 compares the number of displayable related programs with the number of the related programs determined as the result of search. If the number does not reach the number of displayable related programs, processing follows a next category and a search for a related program is performed again (step S 709 ).
  • the search is performed simply using a plurality of pieces of information included in program related information, and thus, a method capable of searching a variety of related programs can be provided.
  • operability is improved.
  • the digital television apparatus 100 a means of extracting not only category information included in program related information 902 sent from the broadcasting station 300 but also information, from the program related information 902 , which is oriented to category information in which the televiewer has an interest, it is possible to search related programs independent of the sending side and to be more oriented to televiewer's preferences.
  • the present embodiment is not limited to the digital television apparatus 100 and any apparatus can be used as long as the apparatus has the same functions as the digital television apparatus 100 .
  • the contents are not limited to programs; for example, the present invention can also be applied to the case in which a search is performed for a scene of a program.
  • information on programs related to a selected program can be suitably displayed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
US11/447,112 2005-06-10 2006-06-06 Display method Expired - Fee Related US7756916B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2005170880A JP4455415B2 (ja) 2005-06-10 2005-06-10 表示方法及び表示制御装置
JP2005-170880 2005-06-10

Publications (2)

Publication Number Publication Date
US20060282407A1 US20060282407A1 (en) 2006-12-14
US7756916B2 true US7756916B2 (en) 2010-07-13

Family

ID=37525257

Family Applications (1)

Application Number Title Priority Date Filing Date
US11/447,112 Expired - Fee Related US7756916B2 (en) 2005-06-10 2006-06-06 Display method

Country Status (2)

Country Link
US (1) US7756916B2 (enrdf_load_stackoverflow)
JP (1) JP4455415B2 (enrdf_load_stackoverflow)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080235188A1 (en) * 2007-03-20 2008-09-25 John Kelly King Universal media guide
US20120099025A1 (en) * 2010-10-21 2012-04-26 Tomohiro Kanda Television Apparatus, Display Control Device, and Display Control Method
US20140258909A1 (en) * 2008-10-23 2014-09-11 Samsung Electronics Co., Ltd. Remote control device and method of controlling other devices using the same

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100757232B1 (ko) * 2006-06-28 2007-09-10 삼성전자주식회사 키패드가 형성된 배터리 팩, 이종 키패드 배터리 팩을장착할 수 있는 휴대 단말기, 및 배터리 팩 교체를 통한휴대 단말기의 키패드 변경 방법
JP4919879B2 (ja) 2007-06-07 2012-04-18 ソニー株式会社 情報処理装置および方法、並びにプログラム
JP5458636B2 (ja) * 2009-04-07 2014-04-02 ソニー株式会社 情報処理装置、情報処理方法、プログラム、情報提供装置、情報提供方法および情報処理システム
JP2011114777A (ja) * 2009-11-30 2011-06-09 Nec Casio Mobile Communications Ltd 放送受信装置、放送受信装置の番組情報取得方法及びプログラム
WO2011067808A1 (ja) * 2009-12-02 2011-06-09 株式会社 東芝 番組推薦装置および番組推薦方法
KR20110067268A (ko) * 2009-12-14 2011-06-22 삼성전자주식회사 디스플레이장치 및 그 정합영상의 생성방법
JP5415369B2 (ja) * 2010-07-09 2014-02-12 日本放送協会 番組検索装置および番組検索プログラム
JP2013065950A (ja) * 2011-09-15 2013-04-11 I-O Data Device Inc 番組有効表示システム、番組有効表示装置および番組有効表示方法
WO2014188593A1 (ja) * 2013-05-24 2014-11-27 株式会社 東芝 方法、シーンリスト出力装置、プログラム、及びサーバ
JP7403112B2 (ja) * 2021-04-06 2023-12-22 株式会社インフォシティ 情報通信端末装置及び該装置における表示制御方法

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5850218A (en) * 1997-02-19 1998-12-15 Time Warner Entertainment Company L.P. Inter-active program guide with default selection control
JPH11261908A (ja) 1998-03-06 1999-09-24 Toshiba Corp 番組及び又は情報の選択支援装置
US6100884A (en) * 1996-05-27 2000-08-08 Fujitsu Limited Device for delivering listings of broadcast programs via network
JP2001148813A (ja) 1999-11-19 2001-05-29 Toyota Motor Corp 放送受信装置
US20010024565A1 (en) * 1999-12-03 2001-09-27 Hideaki Yui Television receiver
US20020044144A1 (en) * 2000-10-18 2002-04-18 Pioneer Corporation Program guiding apparatus and method
JP2003051753A (ja) 2001-08-06 2003-02-21 Alpine Electronics Inc デジタル放送受信機
US20030050855A1 (en) * 2001-08-22 2003-03-13 Jaffe Stephen E. Method and apparatus for facilitating organization of packages and bundles for sale via eletronic commerce
US20030105853A1 (en) * 2001-11-30 2003-06-05 Hajime Morito Handling support method and handling support system
US20030195877A1 (en) * 1999-12-08 2003-10-16 Ford James L. Search query processing to provide category-ranked presentation of search results
US20040123319A1 (en) * 2002-12-13 2004-06-24 Samsung Electronics Co., Ltd. Broadcast program information search system and method
US20050033747A1 (en) * 2003-05-25 2005-02-10 Erland Wittkotter Apparatus and method for the server-sided linking of information
US20050044037A1 (en) * 2001-01-30 2005-02-24 David Lawrence Systems and methods for automated political risk management
US6865746B1 (en) * 1998-12-03 2005-03-08 United Video Properties, Inc. Electronic program guide with related-program search feature
WO2005048587A1 (ja) 2003-11-13 2005-05-26 Matsushita Electric Industrial Co.,Ltd. 番組推薦装置及び番組推薦装置の番組推薦方法並びにプログラム

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6100884A (en) * 1996-05-27 2000-08-08 Fujitsu Limited Device for delivering listings of broadcast programs via network
US5850218A (en) * 1997-02-19 1998-12-15 Time Warner Entertainment Company L.P. Inter-active program guide with default selection control
JPH11261908A (ja) 1998-03-06 1999-09-24 Toshiba Corp 番組及び又は情報の選択支援装置
US6865746B1 (en) * 1998-12-03 2005-03-08 United Video Properties, Inc. Electronic program guide with related-program search feature
JP2001148813A (ja) 1999-11-19 2001-05-29 Toyota Motor Corp 放送受信装置
US6928262B1 (en) * 1999-11-19 2005-08-09 Toyota Jidosha Kabushiki Kaisha Broadcast receiving device
US20010024565A1 (en) * 1999-12-03 2001-09-27 Hideaki Yui Television receiver
US20030195877A1 (en) * 1999-12-08 2003-10-16 Ford James L. Search query processing to provide category-ranked presentation of search results
US20020044144A1 (en) * 2000-10-18 2002-04-18 Pioneer Corporation Program guiding apparatus and method
US20050044037A1 (en) * 2001-01-30 2005-02-24 David Lawrence Systems and methods for automated political risk management
JP2003051753A (ja) 2001-08-06 2003-02-21 Alpine Electronics Inc デジタル放送受信機
US20030050855A1 (en) * 2001-08-22 2003-03-13 Jaffe Stephen E. Method and apparatus for facilitating organization of packages and bundles for sale via eletronic commerce
US20030105853A1 (en) * 2001-11-30 2003-06-05 Hajime Morito Handling support method and handling support system
US20040123319A1 (en) * 2002-12-13 2004-06-24 Samsung Electronics Co., Ltd. Broadcast program information search system and method
US20050033747A1 (en) * 2003-05-25 2005-02-10 Erland Wittkotter Apparatus and method for the server-sided linking of information
WO2005048587A1 (ja) 2003-11-13 2005-05-26 Matsushita Electric Industrial Co.,Ltd. 番組推薦装置及び番組推薦装置の番組推薦方法並びにプログラム
US20080295132A1 (en) 2003-11-13 2008-11-27 Keiji Icho Program Recommendation Apparatus, Method and Program Used In the Program Recommendation Apparatus

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080235188A1 (en) * 2007-03-20 2008-09-25 John Kelly King Universal media guide
US20140258909A1 (en) * 2008-10-23 2014-09-11 Samsung Electronics Co., Ltd. Remote control device and method of controlling other devices using the same
US9940011B2 (en) * 2008-10-23 2018-04-10 Samsung Electronics Co., Ltd. Remote control device and method of controlling other devices using the same
US10423324B2 (en) 2008-10-23 2019-09-24 Samsung Electronics Co., Ltd. Remote control device and method of controlling other devices using the same
US10845986B2 (en) 2008-10-23 2020-11-24 Samsung Electronics Co., Ltd. Remote control device and method of controlling other devices using the same
US20120099025A1 (en) * 2010-10-21 2012-04-26 Tomohiro Kanda Television Apparatus, Display Control Device, and Display Control Method
US8495706B2 (en) * 2010-10-21 2013-07-23 Kabushiki Kaisha Toshiba Television apparatus, display control device, and display control method

Also Published As

Publication number Publication date
JP2006345376A (ja) 2006-12-21
JP4455415B2 (ja) 2010-04-21
US20060282407A1 (en) 2006-12-14

Similar Documents

Publication Publication Date Title
US7756916B2 (en) Display method
US6928262B1 (en) Broadcast receiving device
US7096486B1 (en) TV program selection support system
EP0794670B1 (en) Context-based recognition system for interactive tv and telephony
KR100350787B1 (ko) 멀티미디어 객체의 사용자 프로파일 생성방법과 사용자 프로파일을 이용한 멀티미디어 검색 및 브라우징 방법
CN100433810C (zh) 处理节目信息的系统
US8402487B2 (en) Program selection support device
KR100718606B1 (ko) 프로그램의 추출방법 및 프로그램의 추출장치
US8374845B2 (en) Retrieving apparatus, retrieving method, and computer program product
KR101419937B1 (ko) 기호 추출 장치, 기호 추출 방법 및 기호 추출 프로그램이 기록된 컴퓨터 판독가능한 기록 매체
US20070150273A1 (en) Information retrieval apparatus and method
JPH11134345A (ja) 嗜好情報選択装置
US20040083490A1 (en) Program recommendation system, program recommendation method and program for realizing the same
US20050289599A1 (en) Information processor, method thereof, program thereof, recording medium storing the program and information retrieving device
US20100083314A1 (en) Information processing apparatus, information acquisition method, recording medium recording information acquisition program, and information retrieval system
EP1679716A1 (en) Information processing device, method of processing information, and program
JPH11252477A (ja) 受信機
JP2005522113A (ja) パーソナル化されたニュースを提供するための方法及びシステム
US20080016068A1 (en) Media-personality information search system, media-personality information acquiring apparatus, media-personality information search apparatus, and method and program therefor
JP2001028717A (ja) 情報表示装置及び情報受信装置並びにそれらの方法
JP2012084966A (ja) 動画情報視聴装置及び動画情報視聴方法
JP6029530B2 (ja) 情報処理装置及び情報処理方法
JP2008027186A (ja) 情報検索装置および情報検索方法
JP2004312627A (ja) テレビジョン受像装置およびその番組情報検索方法
JP2007199315A (ja) コンテンツ提供装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: CANON KABUSHIKI KAISHA, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SHIKATA, YASUSHI;MARUYAMA, KAZUNA;REEL/FRAME:017976/0341

Effective date: 20060602

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

FPAY Fee payment

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.)

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.)

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20180713