WO2017216953A1

WO2017216953A1 - Content display device, content display system, content display method, and content display program

Info

Publication number: WO2017216953A1
Application number: PCT/JP2016/068087
Authority: WO
Inventors: 幸典遠藤
Original assignee: 三菱電機株式会社
Priority date: 2016-06-17
Filing date: 2016-06-17
Publication date: 2017-12-21
Also published as: JPWO2017216953A1; JP6109443B1

Abstract

A content display device (10) has a communication unit, a display unit, an input unit, a storage unit that stores software programs including a distributed browser (11), and a processing unit that executes software programs. The processing unit acquires (11) content via the communication unit, expands the document structure of the content into a tree structure to generate (11, 12) tree structure data (120), searches the tree structure data (120) using tags or properties as keywords and analyzes division points in the content to generate (13) a plurality of divided groups, generates divided group list information (140) and displays the same on the display unit, makes selectable (14, 15) one of a plurality of partial content items, and transmits (11), to a linked display device (20) via the communication unit, the partial content item selected from among the plurality of partial content items by the input unit.

Description

Content display device, content display system, content display method, and content display program

The present invention relates to a content display device and a content display method for transmitting partial content generated by dividing digital content to a cooperative display device, a content display system including the content display device and the cooperative display device, and a content display program About.

Conventionally, partial content is generated by dividing a single digital content including a script (hereinafter also referred to as “content” or “content data”), and the partial content (hereinafter also referred to as “partial tree data” or “partial tree data”). ) Is transmitted to a cooperative display device (display device using a child browser) (for example, see FIG. 1 of Patent Document 1). The content acquisition unit of the content display device downloads and acquires content from a Web server, expands the acquired content into tree structure data (hereinafter also referred to as “tree structure” or “tree structure”), and stores it in the DOM storage unit. A unique or unique attribute value is assigned to each element in order to store and identify the elements constituting the tree structure in the DOM storage unit. Thereafter, the child browser determination unit of the content display device determines a partial tree that is a partial content displayed by the child browser of the cooperative display device, and transmits the partial tree to the cooperative display device. As a method for determining that a sub-tree is a transmission target in the child browser determination unit of the content display device, for example, an attribute value (type name of the display device) is described in the sub-tree in the content in advance, and this attribute value There is a method for determining whether or not a sub-tree is a transmission target by using as a mark.

On the other hand, the cooperative display device receives the partial content transmitted from the content display device at the receiving unit, expands the received partial content into a tree structure, stores it in the DOM storage unit, and then displays an image based on the partial content Displayed in the section.

Japanese Patent No. 5841260 (Claim 1, paragraphs 0021 to 0026, FIG. 1)

However, since the conventional content display device uniquely determines the partial tree corresponding to the partial content to be displayed on the cooperative display device and transmits the determined partial content to the cooperative display device, the user of the cooperative display device is the user There is a problem that it is not possible to select a partial content displayed on the cooperative display device by its own operation.

The present invention relates to a content display device and a content display method capable of displaying a partial content selected by a user of the cooperative display device on a display unit of the cooperative display device, a content display system including the content display device and the cooperative display device, It is another object of the present invention to provide a computer display program.

A content display device according to an aspect of the present invention is a content display device that is cooperatively connected to a cooperative display device, and includes a communication unit, a display unit that displays information, an input unit that receives user input, and a distributed browser. A storage unit that stores a software program; and a processing unit that executes the software program. The processing unit expands the document structure of the content acquired through the communication unit into a tree structure and stores the tree structure data Generating a plurality of divided groups by searching the tree structure data using tags or attribute values as keywords, analyzing the division points of the content, and generating divided group list information from the plurality of divided groups; The plurality of partial contents that are presented to the user and represented as the plurality of divided groups can be selected, and the plurality From the partial contents, the partial contents selected by the input unit or the linkage display device is intended to be transmitted to the cooperative display device via the communication unit.

A content display system according to another aspect of the present invention is a content display system including a content display device and a cooperative display device that is cooperatively connected to the content display device, the content display device including a communication unit, information A display unit that displays user information, an input unit that receives user input, a storage unit that stores a software program including a distributed browser, and a processing unit that executes the software program, and the processing unit includes the communication unit The document structure of the content acquired via the tree is expanded into a tree structure to generate tree structure data, the tree structure data is searched using a tag or attribute value as a keyword, and the content division point is analyzed to obtain a plurality of divisions Generate a group, generate a divided group list information from the plurality of divided groups and present it to the user, One of a plurality of partial contents represented as a plurality of divided groups can be selected, and the partial content selected by the input unit or the cooperative display device is selected from the plurality of partial contents. Via the link display device.

A content display method according to another aspect of the present invention is a content display method for displaying content on a content display device that executes a software program including a distributed browser and a cooperative display device that is cooperatively connected to the content display device. Expanding the document structure of the content acquired by the content display device into a tree structure to generate tree structure data, and the content display device searching the tree structure data using a tag or attribute value as a keyword. Analyzing the division points of the content to generate a plurality of divided groups; and the content display device generates divided group list information from the plurality of divided groups and presents it to a user, and the plurality of divided groups Select one of multiple partial contents represented as That a step, from among the plurality of partial contents, the partial contents selected by the content display device or the cooperation display device, in which a step of transmitting from the content display device to the linkage display device.

A content display program according to another aspect of the present invention is a tree structure in which a document structure of acquired content is expanded into a tree structure on a content display apparatus as a computer that is linked and connected to the cooperative display apparatus by a software program including a distributed browser. A process for generating data, a process for searching the tree structure data using a tag or attribute value as a keyword, analyzing a division point of the content to generate a plurality of divided groups, and a list of divided groups from the plurality of divided groups A process of generating information and presenting it to a user so that any one of the plurality of partial contents represented as the plurality of divided groups can be selected; The partial content selected by the cooperative display device is transferred to the content display device. Is a program for executing a process of transmitting to the cooperation display device from.

According to the present invention, the partial content selected by the user of the cooperative display device from the divided group list information can be displayed on the display unit of the cooperative display device.

It is a figure which shows an example of the functional block structure of the content display system (including a content display apparatus and a cooperation display apparatus) which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the hardware constitutions of the content display system (a content display apparatus and a cooperation display apparatus) which concern on Embodiment 1. FIG. 6 is a diagram illustrating a display example of content (three partial contents) on the display device of the content display apparatus according to Embodiment 1. FIG. 6 is a diagram illustrating a structure example of a DOM tree of content acquired by the content display device according to Embodiment 1. FIG. 6 is a diagram illustrating an example of content division group list information acquired by the content display device according to Embodiment 1. FIG. 6 is a diagram showing a display example of partial content on the display device of the content display device according to Embodiment 1. FIG. 5 is a flowchart showing a divided group generation process in the content display device according to the first embodiment. 6 is a flowchart showing a divided group selection process in the content display device according to the first embodiment. It is a figure which shows an example of the functional block structure of the content display system (a content display apparatus and a cooperation display apparatus are included) which concern on Embodiment 2 of this invention. It is a figure which shows an example of the hardware constitutions of the content display system (including a content display apparatus and a cooperation display apparatus) which concerns on Embodiment 2. FIG. It is a figure which shows the example of the division group selection information of the content which the content display apparatus which concerns on Embodiment 2 acquires. It is a figure which shows the example of a display of the partial content in the content display apparatus which concerns on Embodiment 2, and a cooperation display apparatus. 10 is a flowchart showing a divided group selection process in the content display device according to the second embodiment. 10 is a flowchart showing a divided group selection process in the cooperative display device of the content display system according to the second embodiment. It is a figure which shows an example of the functional block structure of the content display system (including a content display apparatus and a cooperation display apparatus) which concerns on Embodiment 3 of this invention. 10 is a flowchart showing a divided group selection process in the content display device according to the third embodiment. 12 is a flowchart showing a divided group selection process in the cooperative display device of the content display system according to the third embodiment.

<< 1 >> Embodiment 1
<< 1-1 >> Configuration FIG. 1 is a diagram showing an example of a functional block configuration of a content display system according to Embodiment 1 of the present invention. The content display system according to Embodiment 1 includes a content display device 10 and a cooperative display device 20 (also referred to as 20A and 20B) as another display device (display terminal). The content display device 10 is a device capable of executing the content display method according to the first embodiment, and is a device capable of executing the content display program according to the first embodiment. However, the number of linked display devices 20 may be any number as long as it is one or more. Examples of the content display device 10 include a personal computer (PC), a mobile communication terminal (for example, a smartphone, a tablet terminal, etc.), a digital television, a car navigation system, and various displays for industrial use. Examples of the other display device 20 include a PC and a mobile communication terminal (for example, a smartphone, a tablet terminal, etc.).

As shown in FIG. 1, the content display device 10 according to the first embodiment includes a distributed browser 11 that displays a content browsing screen on a display device (display unit) by executing content browsing (browsing) software. . The distributed browser 11 expands the document structure of the acquired content into a DOM (Document Object Model) tree 120 as a tree structure and stores it in the storage unit 12. In addition, the content display apparatus 10 includes a divided group analysis unit 13, a storage unit 14 that stores the divided group list information 140, a divided group information management unit 15 that updates and records the divided group list information 140, and a divided group selection. Part 16. The memory | storage part 12 and the memory | storage part 14 are memory | storage devices, such as a semiconductor memory and a magnetic disc apparatus, for example, The kind of memory | storage device is not limited. The storage unit 12 and the storage unit 14 may be separate storage devices, or may be different recording areas of the same storage device.

Further, as shown in FIG. 1, the cooperative display device 20 is a distribution in which the content display device 10 according to the first embodiment displays a content browsing screen on a display device by executing content browsing (browsing) software. A browser 21, a divided group selection unit 23, and a storage unit 22 that stores a DOM tree (DOM Tree).

The distributed browser 11 is content browsing (browsing) software, and in particular, provides a content linkage and synchronization function between a plurality of browsers. The content browsed by the distributed browser 11 is “HTML (Hyper Text Markup Language)” or “XHTML (Extensible Hyper Text Language Description) data”, which is an international standard specification of Web (World Wide Web) technology. A document body described in a language, a CSS style sheet described in a document layout definition specification called “CSS (Cascading Style Sheets)”, and a script program written in a programming language called “JavaScript” (registered trademark) Etc. The content browsed by the distributed browser 11 can include various types of files such as images, videos, and music to be displayed or reproduced. An example of the distributed browser 11 is a general-purpose browser that supports “Presentation API (Application Programming Interface)” standardized by W3C (World Wide Web Consortium) which is an international standardization organization of Web technology. An example of the distributed browser 11 is described in Patent Document 1 as a component of a content display device.

The distributed browser 11 of the content display apparatus 10 analyzes the HTML document structure of the content acquired from the Web server, expands it into a tree structure (DOM tree 120) called DOM, and stores the DOM tree 120 in the storage unit 12.

The division group analysis unit 13 of the content display device 10 searches and analyzes the DOM tree 120 using a specific HTML tag or attribute value as a keyword, and determines a content division point, that is, a division group.

The division group list information 140 of the content display device 10 is partial tree list information representing a plurality of determined division groups, and is stored in the storage unit 14.

The division group information management unit 15 of the content display device 10 stores, reads, and updates the division group list information 140 in the storage unit 14.

The divided group selection unit 16 of the content display device 10 presents the contents of the divided group list information 140 to the user of the cooperative display device 20 and accepts the selection result of the divided group by the user of the cooperative display device 20.

FIG. 2 is a diagram illustrating an example of a hardware configuration of the content display system (including the content display device 10 and the cooperative display device 20) according to the first embodiment. In FIG. 2, the content display apparatus 10 includes a CPU (Central Processing Unit) 30 as a processor as an information processing unit, a main memory 31, a storage device (storage unit) 32 such as a flash memory or a hard disk, and Ethernet (registration). Trademark) or wireless LAN (Local Area Network) or a mobile phone network or other communication standard (communication unit) 33, an input device (input unit) 34, a display device (display unit) 35, and these And a bus 36 interconnecting the components 30 to 35 to each other. The main memory 31 is an operating system (OS) 31A as a software for the content display device 10, a browser 31B (distributed browser 11 in FIG. 1) that is a content display program, and an application for the content display device 10. The content 31C is stored. These are stored in advance in the storage device 32 and transferred to the main memory 31 at the start of program execution. The distributed browser 11, the divided group analysis unit 13, the divided group information management unit 15, and the divided group selection unit 16 in the content display device 10 of FIG. 1 are stored in the storage device 32 in FIG. Can be realized by the CPU 30 that executes the software program (OS 31A, distributed browser 31B, content 31C, etc.) stored in the computer.

In FIG. 2, the cooperative display device 20 includes a CPU 40 as a processor as an information processing unit, a main memory 41, a storage device (terminal storage unit) 42, an Ethernet (registered trademark), a wireless LAN, or a mobile phone network. A communication device (terminal communication unit) 43, an input device (terminal input unit) 44, a display device (terminal display unit) 45, and these components 40 to 45 compliant with communication standards such as And a bus 46. The main memory 41 stores, as software, an OS 41A, a browser 41B that is a content display program, and a content 41C that is an application for the cooperative display device 20. These are stored in advance in the storage device 42 and transferred to the main memory 41 at the start of program execution. 1, the distributed browser 21 is a CPU 40 that executes a stored software program (OS 41A, distributed browser 41B, content 41C, etc.) stored in the storage device 42 in FIG. 2 and transferred to the main memory 41. And can be realized.

FIG. 3 is a diagram showing a browser display example of content on the display device 35 of the content display apparatus 10 according to the first embodiment. In FIG. 3, the content displayed by the browser on the display device 35 includes video content 39B such as a broadcast program and video, and related information content 39A such as text, graphics, and images related to the video content 39B. It consists of three parts (three display areas) including a selection button 39C. As described above, the content display device 10 is configured from a plurality of display areas, and can display various combinations of content such as graphics, moving images, and selection buttons.

FIG. 4 is a diagram illustrating a structure example of a DOM tree 120 of content acquired by the content display device 10 according to the first embodiment. FIG. 4 is a conceptual diagram showing a tree structure with a part of the content omitted. In FIG. 4, the document structure of a single content acquired from a Web server is analyzed to form a tree structure (DOM tree) having HTML tags or attribute values and the content content itself (text, etc.) as nodes. . Here, the DOM tree (body) of the main body portion of the content is assumed to represent the entities of the three display areas (partial content) in FIG. 3 in different forms, and corresponding three

subtrees

391, 392, 393, respectively. It is composed of

FIG. 5 is a diagram showing an example of the divided group list information 140 of the content display device 10 according to the first embodiment. In FIG. 5, a divided group name 141 is a unique name of a divided group whose classification type is known, and an ID attribute value 142 is an identifier for specifying a subtree of the divided group. A set of the divided group name 141 and the ID attribute value 142 is set as one entry of the divided group list information 140, and an entry (14A, 14B, 14C) is generated for each determined divided group. This divided group list information 140 is created for each acquired content.

FIG. 6 is a diagram illustrating a display example of content on the display device 35 of the content display apparatus 10 according to the first embodiment. 6, one of the three

display areas

39A, 39B, and 39C shown in FIG. 3 is visually designated by highlighting, for example, a frame line or the inside of the frame. The area designated for focus moves (focus shift) to an adjacent display area triggered by an input operation by the user. Further, when the input operation is repeated continuously, the focus state of the first display area is surely returned, and the focus state circulates thereafter (for example, the

display areas

39A, 39C, and 39B are circulated in this order). In addition, the display area, that is, the partial content is selected in response to another input operation (selection of the display area for which focus is designated) by the user in a state where the focus is currently designated.

<< 1-2 >> Operation FIG. 7 is a flowchart showing divided group generation processing in the content display apparatus 10 according to the first embodiment. The division group generation process is a process for generating a division point for dividing the content into a plurality of partial contents.

In step S10 of FIG. 7, the distributed browser 11 of the content display device 10 analyzes the HTML document structure as the document structure of the content downloaded and acquired from the Web server, expands it into the DOM tree 120, and stores it in the storage unit 12. Let At this time, the distributed browser 11 actually creates a DOM tree and a render tree (Render Tree) separately from the HTML document and the CSS style sheet in the content.

In the next step S11, the distributed browser 11 establishes a cooperative connection (cooperative connection) with a cooperative display device that is another display device. The cooperative connection refers to a connection state in which the distributed browser 11 of the content display device 10 can operate in synchronization with the distributed browser 21 of the cooperative display device. Here, the processing after the next step S12 is started upon completion of the processing at step S11.

In the next step S12, the divided group analysis unit 13 searches the DOM tree 120 using a specific HTML tag or attribute value as a keyword, and analyzes a division point of the content, that is, a divided group. A divided group refers to a partial content divided in units meaningful to the viewing user. The division group is, for example,
A division group (GA) "first division group indicating partial content related to user operation";
A division group (GB) "second division group indicating a partial content related to stream video";
Divided group (GC) “third group indicating partial content related to audio”;
Divided group (GD) “fourth group indicating partial content related to any of text, still image, and image”;
Divided group (GE) “fifth group indicating partial contents not corresponding to specification of cooperative display device”,
Can be obtained by dividing the content in units of this group type. The group type is not limited to such group types (GA), (GB), (GC), (GD), and (GE), but the application field of the content display device 10 and the content that can be displayed. An appropriate group type may be defined according to at least one of the contents. Specific examples of the divided groups (GA), (GB), (GC), (GD), and (GE) are as follows.

The divided group (GA) “interactive group” is a partial content with an event notification accompanying a user operation such as focus designation, button press or character input. The search keyword for the partial content of “interactive group” is a tag such as <button>, <input>, <select>, or the like.

The division group (GB) “video group” is a partial content including display of a stream video. The search keyword of “video group” is a tag such as <video>, <track>, etc., for example.

The division group (GC) “voice group” is a partial content with only voice presentation and no screen display. The search keyword is a tag such as <audio>, for example.

The division group (GD) “other group” is partial content including display of text, still images, images, and the like. The search keyword for the group (GD) is a tag such as <iframe>, <img>, <canvas>, for example. The partial contents other than the group (GA), (GB), and (GC) are all groups (GD).

The division group (GE) “non-selectable group” is a partial content that cannot be selected because the display specifications such as resolution are not supported or the peripheral interface to be controlled is not equipped. The search keyword is, for example, a tag or attribute value such as <geolocation> (used for description of the location information acquisition function).

Subsequently, in step S13, when the division point of the content is determined, the division group analysis unit 13 assigns an ID attribute value that is a unique identifier in the DOM tree 120 in order to mark the division point.

In the next step S14, the divided group information management unit 15 stores a set of the divided group name 141 and the ID attribute value 142 of the divided group determined by the group type in the storage unit 14 as one entry of the divided group list information 140. Remember me.

In the next step S15, if the group type is the last group type, the process ends. In step S15, if the group type is not the last group type, the process returns to step S12, and the divided group analysis unit 13 searches the DOM tree 120 for the next group type and continues to generate divided groups. To do.

Here, a specific example of the divided group generation processing flow will be described with reference to FIGS. First, a search is performed using the <h1> tag representing a text heading and the <figure> tag representing a chart as keywords, in the DOM tree (body) of the main body of the content (step S12 in FIG. 7). As a result, a group type “(GD) other group” is determined below the <div> tag on the left side of the DOM tree to determine one divided group 391, and a unique ID identifier is assigned to the first <div> tag. (Step S13 in FIG. 7). Then, the entry 14A (FIG. 5) of the divided group “other / group 1” is stored in the divided group list information 140 (step S14 in FIG. 7).

Next, a search is performed using a <video> tag representing a moving image as a keyword (step S12 in FIG. 7), and the portion below the <div> tag in the center of the DOM tree is determined as a group type “(GB) video group”. One divided group 392 is determined, and a unique ID attribute value is assigned to the leading <div> tag (step S13 in FIG. 7). Then, the entry 14B (FIG. 5) of the divided group “video group 1” is stored in the divided group list information 140 (step S14 in FIG. 7).

Next, a search is performed using a <button> tag representing a push button as a keyword, and a group type “(GA) interactive group” is determined below the <div> tag on the right side of the DOM tree to determine one divided group 393. Then, a unique ID attribute value is assigned to the leading <div> tag (step S13 in FIG. 7). Then, the entry 14C (FIG. 5) of the divided group “interactive group 1” is stored in the divided group list information 140 (step S14 in FIG. 7).

In the above example, after the search keyword is found, the partial tree is traced back to the <div> tag representing a general area specification having no specific meaning, and the divided group is determined at that point. The div> tag is not assigned. When the <div> tag is not added to the content, the content display apparatus 10 newly adds a <div> tag and a unique ID attribute value. Note that the <div> tag does not affect the display of the content, so adding the <div> tag does not affect the display of the content.

In the above example, a simple search method is shown. However, a plurality of divided groups may be determined by combining a representative tag name and an attribute value in combination and performing a more efficient search.

FIG. 8 is a flowchart showing a divided group selection process in the content display device 10. The divided group selection process is a process for causing the user of the cooperative display device 20 to select a partial content to be displayed on the display device of the cooperative display device 20 from the divided group list information 140 using the input device of the content display device 10. It is.

First, in step S20 of FIG. 8, the division group information management unit 15 reads the division group list information 140 from the storage unit 14.

In the next step S21, the divided group selection unit 16 acquires the ID attribute value 142 of the first entry 14A in the divided group list information 140.

In the next step S22, the divided group selection unit 16 accesses the DOM tree 120 and identifies the subtree to which the ID attribute value 142 is assigned.

In the next step S23, the divided group selection unit 16 changes the DOM tree 120 and highlights the frame line of the partial content corresponding to the specified partial tree.

In the next step S24, the divided group selection unit 16 waits for a user input operation via the distributed browser 11.

In the next step S25, when the distributed browser 11 receives the user input operation and is an event input of “focus movement” (YES in step S25), the process returns to step S21, and the divided group selection unit 16 The ID attribute value 142 of the next entry 14B in the divided group list information 140 is acquired. In step S23, the border lines of adjacent partial contents are highlighted and moved.

On the other hand, if the determination in step S25 is NO and the result of the user input operation is not “selection decision” event input in step S26 (NO in step S26), the process returns to step S24, and the user input again. Wait for operation. If it is determined in step S26 that the event is a “selection decision” event (YES in step S26), the process proceeds to step S27.

In step S <b> 27, the divided group selection unit 16 cuts out the partial tree specified by the ID attribute value 142 from the DOM tree 120, generates a partial content that is completed independently, and transmits this to the cooperative display device 20. . As a result, as shown in the example of content selection and display shown in FIG. 6, in response to a user input operation, the cyclic focus is moved between the divided groups.

<< 1-3 >> Effect As described above, according to the content display device 10, the content display method, and the content display system according to Embodiment 1, the classification type of the divided group is defined, and a tag is assigned to each type. Alternatively, the content division point is analyzed using the attribute value as a keyword. Therefore, even if the identification information as the division point is not provided in the content in advance, the content is displayed in units of areas that are meaningful to the user. Can be divided.

Further, since the display area is cyclically moved on the display device 35 of the content display apparatus 10 according to the first embodiment, the divided group is visually presented to the user and can be selected by a simple operation. Can do.

In addition, the content display device 10 according to the first embodiment accepts partial content selection operations with only two types of inputs (focus movement and determination), thereby simplifying the implementation of the cooperative display device 20. It is possible to cope with a wider variety of cooperative display devices.

<< 2 >> Embodiment 2
<< 2-1 >> Configuration In the content display system according to the first embodiment, the divided group is focus-displayed on the display device 35 of the content display apparatus 10 (for example, cyclic focus movement display in FIG. 6), and the cooperative display apparatus 20 The user selects the partial content to be displayed on the display unit (for example, the display device 45 in FIG. 2) of the cooperative display device 20 by using the input unit (for example, the input device 34 in FIG. 2) of the content display device 10. .
In contrast, in the content display system according to Embodiment 2 of the present invention, the divided group list information is displayed on the display unit (for example, the display device 45 in FIG. 2) of the cooperative display device 50, and the user of the cooperative display device 50 However, from the divided group list information displayed on the display unit of the cooperative display device 50, using the input unit of the cooperative display device 50 (for example, the input device 44 in FIG. 2), the display unit of the cooperative display device 50 (for example, The partial content to be displayed on the display device 45) in FIG. 2 is selected.

FIG. 9 is a diagram illustrating an example of a functional block configuration of the content display system (including the content display device 10A and the cooperative display device 50) according to the second embodiment. 9, components that are the same as or correspond to the components shown in FIG. 1 are given the same reference numerals as those shown in FIG. The content display system according to the second embodiment is the content display system according to the first embodiment in that the content display device 10A includes the storage unit 17 that stores the divided group selection information 170 and the processing content of the distributed browser 11A. And different. In the content display system according to Embodiment 2, the content display device 10A and one or more cooperative display devices 50 (for example, 50A and 50B) are connected in a state where the cooperative connection is established. The content display device 10A is a device capable of executing the content display method according to the second embodiment, and is a device capable of executing the content display program according to the second embodiment.

FIG. 10 is a diagram illustrating an example of a hardware configuration of the content display system (including the content display device 10A and the cooperative display device 50) according to the second embodiment. 10, components that are the same as or correspond to the components shown in FIG. 2 are assigned the same reference numerals as those shown in FIG.

The distributed browser 51 of the cooperative display device 50 is the same content browsing (browsing) software as the content display device 10A, and has the same functions as the distributed browser 11. The DOM tree stored in the storage unit 52 stores partial content having the structure of the DOM tree 120 received from the content display device 10A. The divided group selection unit 53 processes the divided group list information 140 received from the content display device 10A, presents it to the user, and displays the partial content determined by the user selection operation from the input unit of the cooperative display device 50 as a content display. Receive from device 10A.

FIG. 11 is a diagram showing an example of the divided group selection information 170 of the content display device 10A shown in FIG. In FIG. 11, the terminal identifier 171 is an ID value for uniquely identifying the cooperative display device 50. The content identifier 172 is a content name or ID value for uniquely specifying a single content. The ID attribute value 173 is an identifier for specifying the subtree of the divided group. A set (set) of three pieces of information of the terminal identifier 171, the content identifier 172, and the ID attribute value 173 is set as one entry (for example, the entry 17A, the entry 17B, and the entry 17C) of the divided group selection information 170. 10 A of content display apparatuses preserve | save the ID attribute value 173 of the division group selection information 170 corresponding to the partial content selected last in the memory | storage part 17, when the cooperation connection with the cooperation display apparatus 50 is cancelled | released.

FIG. 12 is a diagram showing an example of split display of a single content by the content display system according to the second embodiment. Pattern 1 in FIG. 12 is an example in which a divided group (GA) is selected in the cooperative display device 50, and only the related information 39A related to the video content 39B is displayed on the content display device 10A and the cooperative display device 50.

In pattern 2 in FIG. 12, a divided group (GB) is selected in the cooperative display device 50, and only the audio of the video content 39B is separated and viewed on the cooperative display device 50 at hand of the user (listening to the audio). It is an example.

In pattern 3 in FIG. 12, a divided group (GC) is selected in each of the cooperative display device 50A and the other cooperative display device 50B, and the selection button 39C is shared by the cooperative display device 50A and the other cooperative display device 50B. In this example, the remote control operation is enabled using the

cooperative display devices

50A and 50B.

In the pattern 4 in FIG. 12, related information 39A related to the video content 39B is displayed on the cooperative display device 50A, a selection button 39C is displayed on the other cooperative display device 50B, and only the video content 39B is displayed on the content display device 10A. In this example, each of the plurality of divided groups is displayed on a different display device (that is, the content display device 10A, the cooperative display device 50A, and the cooperative display device 50B). In this way, taking into account the user's will (request) and convenience, display contents and display timing for each application field of the display device (that is, the content display device 10A, the cooperative display device 50A, and the cooperative display device 50B) are determined. Considering this, various other divided display patterns can be considered.

<< 2-2 >> Operation FIG. 13 is a flowchart showing divided group selection processing of the content display apparatus 10A according to the second embodiment. In step S30 of FIG. 13, the distributed browser 11A of the content display apparatus 10A analyzes the HTML document structure of the content acquired from the Web server, expands the DOM tree 120, and stores it in the storage unit 12.

In the next step S31, the distributed browser 11A establishes a cooperative connection with the cooperative display device 50. Here, the processing after the next step S32 is started upon completion of the processing at step S31.

In the next step S32, the divided group selection unit 16 transmits the divided group list information 140 to the cooperative display device 50.

In the next step S33, the divided group selection unit 16 waits to receive a divided group selection result.

In the next step S34, the divided group selection unit 16 receives the divided group selection result from the cooperative display device 50 via the distributed browser 11.

In the next step S35, the division group selection unit 16 requests the division group analysis unit 13 to cut out the partial tree specified by the selected ID attribute value 142 from the DOM tree 120, and to obtain a partial content that is completed independently. Generate.

In the next step S36, the divided group selection unit 16 transmits the generated partial content (partial tree) to the cooperative display device 50.

FIG. 14 is a flowchart showing a divided group selection process of the cooperative display device 50 of the content display system according to the second embodiment. In step S40 of FIG. 14, the distributed browser 51 of the cooperative display device 50 establishes a cooperative connection with the content display device 10A. Here, the processing after the next step S41 is started upon completion of the processing at step S40.

In the next step S41, the divided group selection unit 53 of the cooperative display device 50 receives the divided group list information 140 from the content display device 10A.

In the next step S42, the division group selection unit 53 processes the received division group list information 140, displays a partial content selection screen on the display unit of the cooperative display device 50, and presents it to the user.

In the next step S43, the divided group selection unit 53 waits for a user input operation for selecting a partial content.

In the next step S44, the divided group selection unit 53 transmits the selection result of the selected group (for example, the divided group name 141 or the ID attribute value 142 shown in FIG. 5) to the content display device 10A.

In the next step S45, the divided group selection unit 53 receives the partial content (partial tree) from the content display device 10A via the distributed browser 11A and stores it in the storage unit 52.

In the next step S46, the divided group selection unit 53 presents the partial content to the user of the cooperative display device 50 by displaying the received partial content on the display unit of the cooperative display device 50.

Note that the execution timing of the divided group analysis processing in the divided group analysis unit 13 of the content display device 10A is, for example, immediately after the cooperation connection is established in step S31, or in step S30, the content is acquired from the Web server and stored in the DOM tree. It can be the timing immediately after deployment.

<< 2-3 >> Effect As described above, in the content display device 10A, the content display method, and the content display system according to Embodiment 2, the divided group list information 140 is transmitted to the cooperative display device 50. Since the partial content selection screen is displayed on the browser screen of the cooperative display device 50, the user selects a division group on the browser screen of the cooperative display device 50 at hand, and displays it on the display unit of the cooperative display device 50. Partial content can be displayed.

Further, in the content display device 10A, the content display method, and the content display system according to Embodiment 2, the screen of the display device of the content display device 10A is not used for the partial content selection operation. The user of the display device 50 can change the selection and display of the partial content by simply operating the cooperative display device 50 without limitation on the number of times.

<< 3 >> Embodiment 3
<< 3-1 >> Configuration In the content display system according to the second embodiment, the content display device 10A transmits the divided group list information 140 to the cooperative display device 50, and the cooperative display device 50 displays the divided group list on the browser screen. The partial content selection screen based on the information 140 is displayed, and the user of the cooperative display device 50 performs an operation of selecting the partial content from the partial content selection screen every time the partial content selection screen is displayed.
On the other hand, in the content display system according to Embodiment 3 of the present invention, the content selection information 170 is stored in the storage unit 17 of the content display device 10B, so that the display unit of the cooperative display device 50 after the establishment of the cooperative connection. Partial content is displayed.

FIG. 15 is a diagram illustrating an example of a functional block configuration of the content display system (including the content display device 10B and the cooperative display device 50) according to the third embodiment. 15, components that are the same as or correspond to the components shown in FIG. 9 are given the same reference numerals as those shown in FIG. The content display system according to the third embodiment is different from the content display system according to the second embodiment in the processing contents of the distributed browser 11B of the content display device 10B. In the content display system according to Embodiment 3, the content display device 10B and one or more cooperative display devices 50 (for example, 50A and 50B) are connected in a state where a cooperative connection is established. Note that the hardware configuration of the content display system according to Embodiment 3 is the same as that shown in FIG. The content display device 10B is a device that can execute the content display method according to the third embodiment, and is a device that can execute the content display program according to the third embodiment.

<< 3-2 >> Operation FIG. 16 is a flowchart showing a divided group selection process of the content display apparatus 10B according to the third embodiment. In step S30 of FIG. 16, the distributed browser 11B of the content display apparatus 10B analyzes the HTML document structure of the content acquired from the Web server, expands it into the DOM tree 120, and stores it in the storage unit 12.

In the next step S31, the distributed browser 11B establishes a cooperative connection with the cooperative display device 50. Here, the processing after the next step S37 is started upon completion of the processing at step S31.

In the next step S37, the divided group selection unit 16 determines that the terminal identifier 171 and the content identifier 172 in the divided group selection information 170 when the cooperative display device 50 with which the cooperative connection has been established has previously established a cooperative connection. The previously stored ID attribute value 173 is acquired from the entry with the same set.

In the next step S35, the division group selection unit 16 requests the division group analysis unit 13 to cut out the partial tree specified by the acquired ID attribute value 173 from the DOM tree 120 and generate a partial content that is completed independently. To do.

Thereafter, in step S38, when the distributed browser 11B cancels the cooperative connection with the cooperative display device 50, in step S39, the divided group selection unit 16 determines the ID corresponding to the currently selected partial content. A combination of the attribute value 173, the terminal identifier 171 and the content identifier 172 is stored in the storage unit 17 as the divided group selection information 170.

FIG. 17 is a flowchart showing a divided group selection process in the cooperative display device 50 according to the third embodiment. In step S40 of FIG. 17, the distributed browser 51 establishes a cooperative connection with the content display device 10B. Here, the processing after the next step S45 is started upon completion of the processing at step S40.

In the next step S45, the divided group selection unit 53 receives the partial content (partial tree) from the content display device 10B via the distributed browser 51 and stores it in the storage unit 52 as a DOM tree.

In the next step S46, the divided group selection unit 53 displays the received partial content on the display unit of the cooperative display device 50.

<< 3-3 >> Effect As described above, in the content display device 10B, the content display method, and the content display system according to Embodiment 3, the division group selection information is stored when the cooperative connection is released, and then Since the same partial content as that of the previous time is automatically displayed when the cooperative connection with the same cooperative display device is established, it is possible to save the user from performing a selection operation.

<< 4 >> Modifications.
Various modifications can be made to the devices, systems, methods, and programs of the first to third embodiments by appropriately combining the configurations included in the first to third embodiments. For example, the division group selection information 170 and its storage unit 17 described in the second embodiment can be applied to the first embodiment.

10, 10A, 10B content display device, 11, 11A, 11B distributed browser, 12 storage unit, 120 DOM tree (tree structure data), 13 split group analysis unit, 14 storage unit, 140 split group list information, 15 split group information Management unit, 16 division group selection unit, 17 storage unit, 170 division group selection information, 20, 20A, 20B, 50, 50A, 50B linkage display device (display terminal), 21, 51 distributed browser, 22 storage unit, 23 division Group selection unit, 30 CPU (processing unit), 31 main memory (storage unit), 31A OS, 31B distributed browser, 31C content, 32 storage device (storage unit), 33 communication device (communication unit), 34 input device Input unit), 35 display device (display unit), 36 bus, 40 CPU (terminal processing unit), 41 main memory (terminal storage unit), 41A OS, 41B distributed browser, 41C content, 42 storage device (terminal storage unit) , 43 communication device (terminal communication unit), 44 input device (terminal input unit), 45 display device (terminal display unit).

Claims

A content display device linked to a linked display device,
A communication department;
A display for displaying information;
An input unit that accepts user input;
A storage unit for storing a software program including a distributed browser;
A processing unit for executing the software program;
Have
The processor is
Expanding the document structure of the content acquired via the communication unit into a tree structure to generate tree structure data,
Search the tree structure data using a tag or attribute value as a keyword, analyze the content division points, and generate a plurality of division groups,
Generate divided group list information from the plurality of divided groups and present it to the user, enabling selection of any of a plurality of partial contents represented as the plurality of divided groups,
A content display device that transmits partial content selected from the plurality of partial contents by the input unit or the cooperative display device to the cooperative display device via the communication unit.
The content display device according to claim 1, wherein the division group list information is presented by display on the display unit or display on a terminal display unit of the cooperative display device.
The plurality of divided groups are:
A first divided group indicating partial content related to a user operation;
A second divided group indicating partial content related to the stream video;
A third group showing partial content related to audio;
A fourth group showing partial content for either text, still images, or images;
The content display device according to claim 1, further comprising: a fifth group indicating partial content that does not correspond to a specification of the cooperative display device.
When the processing unit displays the divided group list information on the display unit, the processing unit highlights any one of the plurality of partial content areas and cyclically moves the highlighted area to an adjacent area. The content display device according to claim 2, wherein
5. The content display device according to claim 4, wherein the processing unit receives an input of an instruction for moving an area highlighted during the cyclic movement and an input of selection of the highlighted area by the input unit.
When displaying the divided group list information on the terminal display unit of the cooperative display device, the terminal processing unit of the cooperative display device highlights and highlights one of the plurality of partial content areas. The content display device according to claim 2, wherein the area is cyclically moved to an adjacent area.
The processor is
When the cooperative connection with the cooperative display device is canceled, the divided group selection information is stored in the storage unit,
The partial content based on the division group selection information stored in the storage unit at the start of the cooperative connection with the cooperative display device is transmitted to the cooperative display device. The content display device described.
A content display device;
A content display system having a cooperative display device linked to the content display device,
The content display device includes:
A communication department;
A display for displaying information;
An input unit that accepts user input;
A storage unit for storing a software program including a distributed browser;
A processing unit for executing the software program;
Have
The processor is
Expanding the document structure of the content acquired via the communication unit into a tree structure to generate tree structure data,
Search the tree structure data using a tag or attribute value as a keyword, analyze the content division points, and generate a plurality of division groups,
Generate divided group list information from the plurality of divided groups and present it to the user, enabling selection of any of a plurality of partial contents represented as the plurality of divided groups,
The content display system which transmits the partial content selected by the said input part or the said cooperation display apparatus from the said some partial content to the said cooperation display apparatus via the said communication part.
A content display method for displaying content on a content display device that executes a software program including a distributed browser and a cooperative display device that is cooperatively connected to the content display device,
Expanding the document structure of the content acquired by the content display device into a tree structure to generate tree structure data;
The content display device searches the tree structure data using a tag or an attribute value as a keyword, analyzes a division point of the content, and generates a plurality of divided groups;
The content display device generates division group list information from the plurality of division groups and presents it to the user, enabling any one of a plurality of partial contents represented as the plurality of division groups;
Transmitting the partial content selected by the content display device or the cooperative display device from the plurality of partial contents from the content display device to the cooperative display device.
In a content display device as a computer that is linked to a cooperative display device by a software program including a distributed browser,
Processing to expand the document structure of the acquired content into a tree structure and generate tree structure data;
A process of searching the tree structure data using a tag or an attribute value as a keyword, analyzing a division point of the content, and generating a plurality of divided groups;
A process of generating division group list information from the plurality of division groups and presenting it to a user, and enabling selection of any of a plurality of partial contents represented as the plurality of division groups;
The content display program for performing the process which transmits the partial content selected by the said content display apparatus or the said cooperation display apparatus from the said some content content to the said cooperation display apparatus from the said content display apparatus.