JP6575965B2 - Information display device, information display method, and program - Google Patents

Description

  The present disclosure relates to an information display device, an information display method, and a program that allow a plurality of display terminals to function as a single display terminal.

1. Background of the Invention 1.1 Information on Prior Art In addition to conventional desktops and laptops, portable devices such as smartphones and tablets reach public terminals such as digital signage, and content (text, An environment for utilizing images, videos, and applications) is in place. The current method of using content is the content automatically displayed on each display terminal (push), or the user himself / herself requests content from the display terminal (request). Will be used.

  In such a usage method, in order to utilize the necessary content, the content that is accidentally displayed on the surrounding display terminals can be used, or the user can request and display the necessary contents on the display terminal. After that, you need to use the content. The use of content is premised on the use within one display terminal, and therefore the current use of content is intermittent between display terminals.

  For example, when two display terminals are connected to a desktop or laptop to use the content as a dual display, various contents can be freely selected between the two display terminals so that the user can easily use them. It can be used in.

Patent 5282080 Japanese Patent No. 5089583 Patent 5183283

  However, in the case of the current content presentation and usage method, the usage method is limited. In the case of digital signage, there are cases where only a desired advertisement is displayed or a user's content is displayed by performing a specific operation like a KIOSK terminal. It is difficult with the existing technology to display the content required by the user on the street display terminal by the push method and freely use the content presented between the display terminals.

  If the user can link the display terminal on the street or the display terminal owned by the user and present the content appropriately to the user and use them freely between the display terminals, the display terminals can Content can be used. Thereby, the user can use not only the display terminals owned by the user but also the display terminals around the user, and the use opportunities of the display terminals can be increased. In addition, the use of various contents can be increased by a mechanism in which contents given to each user are displayed on appropriate display terminals on display terminals around the user. And if it can be freely operated between display terminals, it can be used according to the user's preference, and the content usage method with others is not limited to one display terminal, so the content usage method should be expanded. Can do.

  The above-described system, that is, an environment in which content can be freely used by linking a user and each display terminal is not realized by a conventional method of using a display terminal for using content.

In the present invention, in order to solve the presented problem,
(1) A mechanism for grouping display terminals installed in a real space such as a street corner so as to become one display terminal at each position is realized.
Until now, a method of grouping and utilizing surrounding display terminals is a mechanism in which a plurality of display terminals are bonded together as one tile using a conventional technique. In the prior art, it is possible to dynamically group digital signage installed at each position and display terminals of users who visit the place, which must be grouped in advance. Such a basic mechanism for grouping has already been released by itself. For example, there is Patent Document 1.

  On the other hand, it is unlikely that content necessary for the user is displayed at an appropriate position on the nearest display terminal on a display terminal such as a digital signage installed at each position. Although the method of presenting the content given to the user with respect to the display terminal in front as in Patent Documents 2 and 3 is realized by the prior art, the method is the closest to the surrounding display terminals. No mechanism has been devised to display content of an appropriate size at an appropriate position on the screen.

Therefore, in the present invention,
(2) A mechanism for presenting content of an appropriate size to an appropriate screen position of a nearby display terminal at each position is realized,
(3) The mechanism of (1) and (2) above is linked to realize a mechanism that allows the display terminals to cooperate with each other to freely operate content.

  That is, in the present invention, (1) a mechanism for grouping display terminals at each position is realized, and digital signage installed at each position and display terminals owned by the user are grouped and made available. Furthermore, (2) a mechanism is provided that displays content of an appropriate size at an appropriate position on the screen that is the closest among the display terminals in the vicinity of the user at each position. In other words, it is a mechanism for associating a user with a content display terminal. Accordingly, it is possible to present content of a size that is easy to use and view from the distance between the user and the display terminal on the screen of the display terminal nearest to the user. Furthermore, (3) based on the above mechanisms (1) and (2), a mechanism for freely utilizing contents displayed at appropriate positions on the grouped display terminals is realized. The present invention proposes a method capable of constructing an environment in which a user and a display terminal can cooperate to freely operate content. That is, the present invention relates to an invention of a function that extends use of content by a user so that display terminals can be used in cooperation with each other.

1.2 Problems of the prior art and problems to be solved by the invention The mechanism for enabling the user and the display terminal to cooperate with each other and freely operate the content is largely divided into the following three elements. It is necessary to realize.

(1) Mechanism for grouping display terminals at each position (2) Mechanism for connecting users and content via display terminals (3) Mechanism for freely using content on grouped display terminals

  Only the display terminals that are basically used utilize the contents by utilizing conventional digital signage and user display terminals. The display terminals in the vicinity of the user are basically the same. In the request method, the display terminals in the vicinity can be utilized, but the use method is still only the display terminals that are close to each other due to the request. For this reason, a method of extending the content usage method by the user, such as using the content by linking neighboring display terminals with the push method, has not been realized.

<Problem 1: Mechanism for grouping display terminals at each location>
Originally, the use of content on a display terminal is basically a single use regardless of the type of display terminal. Display terminals vary from personal terminals such as laptops, smartphones, and tablets to public terminals such as digital signage. Each of these devices presents content, and it is difficult to display content such that the display terminals are linked together to form a single screen.

  There are mainly the following methods as a mechanism for using a plurality of display terminals like a single display terminal by linking display terminals with each other in the prior art.

a) There are cases where tiled display terminals and shared workspace display terminals are bonded together like tiles and handled like a single display terminal. Similarly, there is a case where a plurality of display terminals are connected in a room such as a conference room and handled as one common work space. These are mechanisms that enable a plurality of display terminals to handle each display terminal like a single display terminal or a multi-display.

  The problem with this method is that the grouping for linking display terminals is static. A mechanism for outputting one display terminal as a server for grouping on each display terminal so that other display terminals can access the server from the network and display results are linked with each other. It is that.

  In other words, in the prior art, from digital signage to personal terminals, grouping at each position requires a setting for each display terminal, or shows specific types of display terminals that can be grouped in advance. It is also necessary to keep it.

  For this reason, the grouping that links the display terminals is not made dynamically. A mechanism for grouping and using display terminals at each position has not been invented.

b) Distributed Operating System Method A distributed operating system method can be used for a mechanism that links display terminals together. By installing a distributed operating system on each display terminal, the user can use each display terminal as his / her own display terminal. When each display terminal is connected to the network and logged into each display terminal, it can be used as its own workspace.

  Coordination between display terminals by a distributed operating system is a method of reading and using the user's own information from each display terminal over the network. This does not realize a mechanism for pushing content to digital signage or personal terminals, and is difficult to use as an information display device.

  That is, although display terminals around the user are grouped via a network, they are not grouped so as to display the display terminals in cooperation with each other.

  The first problem to be solved by the present invention is to provide a mechanism for grouping public display terminals such as digital signage installed at each position and enabling display of content in cooperation with each other. is there. This is performed dynamically so that the grouped display terminals can be utilized while being reorganized. It is a problem to organize each display terminal so that it becomes one display terminal in consideration of the resolution of each display terminal and the installed position.

<Problem 2: Mechanism for connecting user and content via display terminal>
There is no guarantee that a display terminal in the vicinity where the user can easily use is selected from the display terminals installed like digital signage, and the content is displayed at the position of the screen that is easy for the user to use. In order to utilize peripheral display terminals in the prior art, it is necessary to approach the display terminal, input user information and the like by some communication means, and take steps to present the content. For this reason, it is difficult to select a display terminal to be used from among display terminals in the vicinity of the user and provide the content in consideration of the display position on the screen and the size of the content.

  In the existing technology, a display terminal is connected to a user at each position, and contents are provided to the user on the screen as follows.

c) Conventional methods using near field communication functions such as NFC, Bluetooth (registered trademark), RFID, etc. Touching a smartphone or IC card having a near field communication function on a digital signage display terminal to a specific location In this mechanism, user information is provided and content is provided based on information input to the digital signage. The problem with this method is that, in order to determine the display terminal to be used, the user himself / herself must move to a predetermined position and provide information using the communication terminal.

  That is, it is not realized that the user appropriately assigns peripheral display terminals and appropriately presents the content, and a predetermined operation is required until the display terminal to be used is determined and the content is presented. .

d) Information providing service based on big data such as location information service A mechanism for presenting information using location information and various sensor data using a personal terminal such as digital signage or a smartphone has been invented. This is a method of pushing content to a display terminal based on position information and information detected from sensor data. The problems with this method are that content can be selected and provided as appropriate, but the user's appropriate position cannot be taken into account, and the display terminal to be used is fixed in advance.

  That is, it is not realized to select a display terminal suitable for the user from the vicinity and display the content at a position and size on the screen suitable for the user, and it is necessary to determine the display terminal to be used in advance. is there.

  The second problem to be solved by the present invention is the content given to the user by selecting a display terminal around the user, or a display terminal group when cooperating with the mechanism of (1) above, which is suitable for the user. And providing a mechanism for presenting content in a position that can be used by the user on the screen or in a size that is easy to view.

  In order to solve the above problems, an information display device according to the present invention provides each display terminal connected to a certain access point (AP) with each address, resolution, The display terminal entry means assigns the same group ID to the display terminals connected to the same AP, and associates the information notified from each display terminal with the group ID. Registered in the display terminal registry means, the display terminal group linker means refers to the resolution of each display terminal registered in the display terminal registry means for each group ID, and based on the resolution of all display terminals of the same group ID Generate a screen figure to be one screen, and send the image of the part corresponding to the position information of each display terminal from the screen figure to the address of the display terminal It decided to.

Specifically, the information display device according to the present invention is:
For each display terminal to be accessed, display terminal information indicating the display capability of content, network information, and display terminal entry in which entry information of real space information indicating location is input,
For each group formed by the access unit of the display terminal, a display terminal registry that holds the entry information input to the display terminal entry;
One display image to be displayed on one joint screen formed using all display terminals included in the group formed with reference to the display terminal information is created, and the display is made with reference to the real space information A display terminal group linker that divides a video for each display terminal included in the group and transmits the display video divided by referring to the network information to each display terminal included in the group;
Is provided.

The information display method according to the present invention includes:
For each display terminal to be accessed, a display terminal entry procedure in which entry information of display space information indicating the display capability of the content, network information, and real space information indicating the location is input,
For each group formed by the access unit of the display terminal, an entry information holding procedure for holding the entry information input in the display terminal entry procedure in a display terminal registry;
One display image to be displayed on one joint screen formed using all display terminals included in the group formed with reference to the display terminal information is created, and the display is made with reference to the real space information A display terminal group link procedure for dividing a video for each display terminal included in the group and transmitting the display video divided by referring to the network information to each display terminal included in the group;
I do.

  Since the information display apparatus and the information display method according to the present invention have a mechanism for grouping display terminals to form a group of display terminals and create an image according to the capabilities of the terminals belonging to the group, It is possible to provide a mechanism for grouping public display terminals such as digital signage installed in the network so that the display terminals can display contents in cooperation with each other. That is, the first problem can be solved.

  The information display device according to the present invention collects information on the communication state of the display terminal to be accessed and information on the change of the entry information, corrects the entry information held in the display terminal registry, and displays the display terminal group. A display terminal information management unit to be reflected in the display video created by the linker is further provided.

  This information display device can reorganize groups and increase / decrease the amount of image data in accordance with whether a terminal joins or leaves a group or network congestion.

An information display device according to the present invention is
A feature information dispatcher that provides feature information that is an event that appears in the real space stored in advance in the feature information registry based on the real space information of the display terminal of the user;
Based on the real space information of the display terminal of the user, a first link unit that detects the group available to the user from the group stored in the display terminal registry, and links the group and the user;
Based on the feature information provided by the feature information dispatcher, the content is selected from the content registry, and the content is selected from any of the joint screens based on the display terminal information and the real space information of the user's display terminal. A second link part for displaying at a position or determining display position information;
A content dispatcher that transmits the content and the display position information from the second link unit to the display terminal group linker and displays the content at a desired position on the joint screen;
Is further provided.

And the information display method according to the present invention includes:
Based on the real space information of the user's display terminal, a feature information dispatch procedure that provides feature information that is an event that appears in the real space stored in advance in the feature information registry;
A first link procedure for detecting a group available to the user from the groups stored in the display terminal registry based on the real space information of the display terminal of the user and linking the group and the user;
Based on the feature information provided in the feature information dispatch procedure, the content is selected from a content registry, and the content is selected from any of the joint screens based on the display terminal information of the display terminal of the user and the real space information. A second link procedure for determining display position information or display position information;
A content dispatch procedure for providing the content in the second link procedure and the display position information during the display terminal group link procedure and displaying the content at a desired position on the joint screen;
Do further.

  The information display device and the information display method according to the present invention provide a user and a content display terminal that generate a joint screen using content selected based on position information and sensor information input from the user's mobile terminal. It has a tie mechanism. For this reason, display devices around the user, or display device groups when working with the above mechanism, select the appropriate one for the user from the display terminal group, select the content tailored to the user, and use it for the user on the screen It is possible to provide a mechanism for presenting content in a possible position or in a size that is easy to view. That is, the second problem can be solved.

An information display device according to the present invention is
An event handler that acquires, as operation information, predetermined processing performed by the user for the content displayed by the content dispatcher at a desired position on the joint screen;
Based on the operation information acquired by the event handler, an event client that performs display change processing of the content;
A content window manager that, based on the processing of the event client, transmits a display change of the content according to the predetermined processing performed by a user to the display terminal group linker, and changes the content of the joint screen;
Is further provided.

And the information display method according to the present invention includes:
An event handle procedure for acquiring predetermined processing performed by a user as operation information for the content displayed at a desired position on the joint screen in the content dispatch procedure;
Based on the operation information acquired in the event handle procedure, an event client procedure for processing the display change of the content,
A content window management procedure for providing a display change of the content according to the predetermined process performed by a user during the display terminal group link procedure based on the process performed in the event client procedure, and changing the content of the joint screen; ,
Do further.

  The information display apparatus and the information display method according to the present invention can freely use contents on display terminals grouped by these mechanisms.

  The program according to the present invention is a program for causing a computer to execute the information display method. The information display apparatus according to the present invention can be realized by a computer and a program, and the program can be recorded on a recording medium or provided through a network.

  The present invention can provide a mechanism in which public display terminals such as digital signage installed at each position are grouped and contents can be displayed in cooperation with each other. Furthermore, the present invention selects a display suitable for the user from among display terminals around the user, or a display terminal group in the case of cooperation with the above mechanism, selects content tailored to the user, and It is possible to provide a mechanism for presenting content in a position that can be used by the user or in a size that is easy to view.

  The information display device according to the present invention can dynamically group a plurality of adjacent display terminals to function as one display device. And the information display apparatus which concerns on this invention can display the content according to the user on this display apparatus.

It is a figure explaining the information display apparatus which concerns on this invention. It is a figure explaining the mechanism which groups each display terminal of the information display device concerning the present invention. It is a figure explaining the mechanism of the connection through the display terminal of the user of the information display apparatus which concerns on this invention, and a content. It is a figure explaining the mechanism which utilizes a content freely on the display terminal grouped by the information display device concerning the present invention. It is a figure explaining the operation example of the information display apparatus which concerns on this invention. It is a figure explaining the information display method concerning the present invention. It is a figure explaining the information display method concerning the present invention. It is a figure explaining the information display method concerning the present invention.

  Embodiments of the present invention will be described with reference to the accompanying drawings. The embodiments described below are examples of the present invention, and the present invention is not limited to the following embodiments. In the present specification and drawings, the same reference numerals denote the same components.

2. 2. Contents of the Invention 2.1 Definition of Terms Here, terms used in the description of the present invention are defined.

User:
It refers to a person who watches, listens to, or operates content displayed on a signage or an information display device including his / her mobile terminal.
Information display device:
A device that can display content on an information display screen, such as digital signage and smartphones, regardless of whether it is permanent or mobile.
content:
Information composed of characters, images, videos, etc., such as announcements and advertisements.
Digital signage:
A device that displays content on a permanently installed screen.
mobile computer:
Portable terminal. This refers to a terminal having a sensor and a communication function from a portable device such as a smartphone phone or a tablet.
Network stats:
It refers to general information such as network traffic, packet loss status, and display terminal information (computer resource information (for example, remaining battery level, memory status, CPU operating rate, etc.)).
Display image:
It means still image or moving image content displayed on the display terminal.

2.2 Technical Means of the Invention and Their Functions The information display device according to the present invention dynamically groups digital signage and personal display terminals at each position, and groups information displays in the vicinity. This is a system that allows a user to freely operate a content by presenting the content at a position on the screen that can be used by a user and allowing display terminals to cooperate with each other. The technical means and operation will be described below.

2.2.1 Technical Means and Actions The information display device according to the present invention includes (1) a mechanism for grouping display terminals at each position, (2) a mechanism for connecting users and content via a display terminal, (3) It is composed of a mechanism for freely using content on grouped display terminals. Hereinafter, each means and operation will be described.

  FIG. 1 is a configuration diagram of the entire information display apparatus according to the present embodiment, including mechanisms (A) and (B) and a mechanism (C) that provides a GUI based on the mechanisms (A) and (B).

(A) Mechanism for grouping each display terminal The information display device of this embodiment
For each display terminal to be accessed, a display terminal entry 11 into which entry information of display terminal information indicating the display capability of content, network information, and real space information indicating the location is input;
A display terminal registry 12 that holds the entry information input to the display terminal entry 11 for each group formed by the access unit of the display terminal;
One display image to be displayed on one joint screen formed using all display terminals included in the group formed with reference to the display terminal information is created, and the display is made with reference to the real space information A display terminal group linker 13 that divides a video for each display terminal included in the group, and transmits the display video divided by referring to the network information to each display terminal included in the group;
Is provided.
The information display device according to the present embodiment collects information on the communication state of the display terminal to be accessed and information on the change of the entry information, corrects the entry information held in the display terminal registry, and displays the display terminal group. A display terminal information management unit 14 to be reflected in the display image created by the linker is further provided.
Hereinafter, each functional block will be described.

<Display terminal entry>
In the display terminal entry 11, in order for the display terminal to actually participate in the display terminal group at each position, display terminal information such as resolution, network information such as an IP address, and real space information such as position information (outdoor or indoor). Is entered over the network. In the grouping, each display terminal is grouped into one group in units of the accessed network. As a result, the display terminals can be grouped and a communication session can be established.

<Display terminal registry>
The display terminal registry 12 holds the received information on each display terminal. The holding method uses a table structure such as a database. Each display terminal information is held for each display terminal group, and the information is transmitted to the display terminal group linker 13. The display terminal registry 12 makes it possible to collectively manage information grouped with each display terminal.

<Display Terminal Information Management Department>
When the status of each display terminal is changed, the display terminal information management unit 14 changes the status information in the display terminal registry 12 and the display terminal group linker 13 or the information collected in the display terminal entry 11 to display each display. Provides information received from the session with the terminal.

<Display terminal group linker>
The display terminal group linker 13 uses the information of each display terminal of the display terminal group to generate a screen of the display terminal group, and sends the output portion of the screen assigned to each display terminal to the display terminal via the network. Send and display. Accordingly, one screen formed by each display terminal is displayed, and one information display device is generated by cooperation between the display terminals.

(B) Mechanism of association between user and content display terminal The information display apparatus of the present embodiment
A feature information dispatcher 21 that provides feature information that is an event that appears in the real space stored in advance in the feature information registry based on the real space information of the display terminal of the user;
A first link unit 22 for detecting a group that can be used by the user from groups stored in the display terminal registry based on the real space information of the display terminal of the user, and linking the group and the user;
Based on the feature information provided by the feature information dispatcher 21, the content is selected from the content registry, and based on the display terminal information and the real space information of the user's display terminal, the content is displayed on any of the joint screens. A second link unit 23 for displaying the position or determining the display position information;
A content dispatcher 24 that transmits the content and the display position information from the second link unit 23 to the display terminal group linker 13 and displays the content at a desired position on the joint screen;
Is further provided.
Hereinafter, each functional block will be described.

<Input user information>
A mechanism for presenting content to the user by using the real space information of the user as a trigger is operated. The user installs an information input application as a client in the mobile terminal, and inputs real space information (for example, position information) collected from the application. Thereby, a series of processes of a mechanism for presenting content to the user is executed.

<Content dispatcher>
The content dispatcher 24 obtains information about which display terminal group is to be used from the display terminal group and user link (first link unit) 22 based on the input real space information from the user, and features information Based on the real space information, the dispatcher 21 detects feature information representing the user's state and surroundings, and displays the display position on the display terminal group so that the content and the user are linked. It is specified from a link (second link unit) 23 on the terminal. Then, a content drawing request is transmitted to the display terminal group linker 13 of (1) above. Thereby, a nearby display terminal group is selected so as to connect the user and the content, and the content is presented at an appropriate position on the screen. Specifically, the content dispatcher 24 calculates the distance between the user (the display terminal held by the user) and another display terminal from the position information, and connects the user and the content.

<Link between display terminal group and user (first link part)>
The display terminal group and user link (first link unit) 22 obtains information on the display terminal group appropriate for the user's position from the display terminal registry 12 of (1) above from the real space information, and which display terminal group Decide what to use. Thereby, a display terminal that can be used by the user can be dynamically used at each position.

<Feature information dispatcher>
The feature information dispatcher 21 prepares a registration application called a feature information register for registering conditions of real space information in advance, and registers and holds the feature information conditioned by the real space information in the feature information registry. When the content dispatcher 24 inputs and inquires about real space information, the content dispatcher 24 refers to the conditions held by the table structure in the registry and returns the feature information. As a result, it is possible to detect feature information representing the user's state and information around the user.

<Link on content and user display terminal (second link part)>
In the content and the link (second link unit) 23 on the display terminal of the user, the content is selected from the content registry with reference to the feature information. The content can be registered in advance in association with the feature information from the content registration application, whereby the content is registered in association with the feature information. An ID is assigned to each content, and access information for each content can be registered. Therefore, when the content is selected, in order to link the content and the user with a link between the content and the target person (user), the display terminal information and the user's actual information are displayed on the screen on the display terminal group to be used. The display position is determined with reference to the spatial information. As a result, the content can be displayed on the screen on the display terminal group at a position where the user can use it.

(C) Mechanism for freely utilizing content on grouped display terminals The information display device of this embodiment is
An event handler 31 that acquires, as operation information, predetermined processing performed by the user for the content displayed by the content dispatcher 24 at a desired position on the joint screen;
An event client 32 that performs display change processing of the content based on the operation information acquired by the event handler 31;
Based on the processing of the event client 32, a content window manager 33 that transmits the display change of the content according to the predetermined processing performed by the user to the display terminal group linker 13 and changes the content of the joint screen;
Is further provided.
This information display device prepares a server having the following functions, and provides means for operating content in the environments (A) and (B), for example, a GUI (Graphical User Interface) for content operation. provide.

<Event handler>
It has a function of serving as a server that receives and processes operation information (H / W) that the user has operated on the screen on the display terminal group. The event handler 31 provides a server function for receiving operation information on the screen of each display terminal. Then, the display state of the content is reported to the display terminal group linker 13 and a drawing request is made.

<Event client>
The event client 32 detects information such as what operation has been performed based on the operation information received from the server of the event handler 31, content moved, enlarged, copied, etc. , Processing the operation information so that the size can be adjusted. As a result, the content window manager 33 can take action to change the display of the content.

<Content window manager>
The content window manager 33 is a means for managing the display position of each content on the display terminal group screen. Based on the information of the event client 32, the position where each content is displayed on the screen, the size, etc. are processed and stored. When changing the size of the content, the content having an appropriate resolution is selected, and the content is appropriately selected from the content registry (B) so that it can be used. The contents to be redisplayed and the information on the position to be displayed are passed to the event handler 31, and a request for drawing is made. Thereby, the effect | action which can change the display of each content based on operation information is provided.

2.3 Embodiments of the Invention An embodiment of the information display apparatus will be described with specific means and actions.

2.3.1 Mechanism for grouping display terminals at each position (A)
An embodiment of a mechanism for grouping display terminals at respective positions will be described. A mechanism for grouping display terminals by the process corresponding to (A) in the information display apparatus model shown in FIG. 1 will be described. FIG. 2 shows an embodiment up to construction of a display terminal group which is a virtual environment.

The information display method according to the present embodiment includes, for each display terminal to be accessed, a display terminal entry procedure in which display terminal information representing content display capability, network information, and entry information of real space information representing a location are input, An entry information holding procedure for holding the entry information input in the display terminal entry procedure in the display terminal registry 12 is performed for each group formed by the access unit of the display terminal.
Each display terminal, as a client side, handles display terminals connected to the same AP as a group by accessing a wireless network such as IEEE 802.15.4 to an AP (Raspberry PI) installed at each position. Each display terminal uploads the IP address, resolution, and position information to the server-side receiving unit 11a through the accessed AP. This is the process (α) corresponding to the display terminal entry 11.

The information display method of the present embodiment creates one display video to be displayed on one joint screen formed using all display terminals included in the group formed with reference to the display terminal information, and A display terminal that divides the display video for each display terminal included in the group with reference to real space information, and transmits the display video divided with reference to the network information to each display terminal included in the group Perform the group link procedure.
The uploaded data is uploaded to the DB corresponding to the display terminal registry 12, and the data is passed to the processing of the display terminal group linker 13. The display terminal group linker 13 refers to the resolution information among the display terminal information of each display terminal group, creates a screen figure that becomes one screen from the resolution of the entire display terminal group, and the display terminal group linker 13 In the processing, the transmission unit refers to the IP address of each display terminal in the display terminal group, and the screen corresponding to each display terminal is transmitted in a streaming format from the generated screen diagrams. Group to be a screen (β).

  In the display image generation 13a, the display terminals are arranged with reference to the position information in order to group the display terminals on the basis of the position of the AP that is the entry point of the display terminal group. Then, the display terminals are grouped, and the screen image actually generated by the transmission unit 13b is transmitted in the streaming format (γ).

  The display terminal linker 13 refers to the network stats information of each display terminal of the display terminal group from the display terminal information management 14 while streaming the corresponding portion of the screen diagram to each display terminal, and displays each streaming process. The screen diagram transmission process is simultaneously performed (α ′, β, γ) so as to adjust the data transfer amount so as to match the state of the terminal.

2.3.2 Mechanism of connection between user and content display terminal (B)
FIG. 3 shows an embodiment relating to the display terminal group and the connection between the target user and the content on the display terminal group on the assumption that the processing shown in FIG. 2 has been performed.

  The position information and sensor information of the target user are input from the smartphone (a). This process serves as a trigger to link the content with the target user. The input position information and sensor information serve as a linker that receives data at the receiving unit in the processing of the content dispatcher 24 and performs each processing at the requesting unit.

The information display method of the present embodiment detects a group that can be used by the user from the groups stored in the display terminal registry based on the real space information of the display terminal of the user, and links the group and the user. Perform one link procedure.
As the first processing after input, processing is performed for the display terminal group and the user link (first link unit) 22 (b). The position information of the user is input to the DB of the display terminal registry 12 in the part (A) of FIG. 1, and the nearest display terminal group is determined. And the information (resolution, IP address) of each display terminal and the position information of AP which is the reference point of the display terminal group are acquired. The display terminal group to be used is determined by referring to the distance between the position information of the display terminal and the position information of the user.

Next, the information display method according to the present embodiment includes a feature information dispatch procedure for providing feature information that is an event that appears in the real space stored in advance in the feature information registry based on the real space information of the user's display terminal. Do.
Using the location information and sensor information as elements for determining the content to be presented, the feature information dispatcher 21 defines the features that appear in the real space as feature information (for example, hot, steep slopes, humps, etc.). Detect by setting (c, d). The detection unit of the feature information dispatcher 21 receives the user's position information and sensor information (speed, acceleration, temperature, time), and manages and refers to each condition of the feature information data called the feature information table based on the position information. Detection is performed by inputting position information and sensor information into a table. And the feature information of each position is detected.

The information display method of the present embodiment selects content from a content registry based on feature information provided in the feature information dispatch procedure, and based on the display terminal information and the real space information of a user's display terminal, A second link procedure for determining display position information as to which position in the joint screen the content is to be displayed is performed.
When the second link unit 23 detects the characteristic information, the second link unit 23 performs processing of the content and the link (second link) on the display terminal of the target user (e, f, g). The content to be displayed is selected from the feature registry from the feature information (f). The content registry is a DB, and each content (moving image, application, image, etc.) can be selected and acquired based on the tag information of the feature information. When the content is selected, the second link unit 23 determines the closest position on the screen from among the display terminals of the display terminal group arranged with the AP of the display terminal group as a reference point based on the position information of the user. The position is set as a display position for displaying the content. The size of the content to be displayed is increased in proportion to the distance between the user and the display position of the display terminal. When the display position is determined, the window manager 33 in part (C) holds which content on which position on the display terminal group is to be displayed and in what size (e). Then, the second link unit 23 notifies the content to be displayed and the display position to the request unit of the content dispatcher 24 (g).

  Finally, the information display method of the present embodiment provides the content and the display position information in the second link procedure during the display terminal group link procedure, and displays the content at a desired position on the joint screen. Perform the content dispatch procedure. (A) The display terminal group linker 13 generates a display image by reporting the content to be displayed and its position, reflecting the content in the screen diagram of the display terminal group, and transmitting it to each display of the display terminal group It is sent to the terminal and displayed (h). The above is the embodiment (B).

2.3.3 Mechanism for freely using content on grouped display terminals (C)
FIG. 4 shows an embodiment in which content is freely used on a grouped display terminal (in cooperation with the display terminal).

The information display method of this embodiment performs the event handle procedure which acquires the predetermined process which the user performed as operation information with respect to the said content displayed on the desired position of the said joint screen by the said content dispatch procedure.
In the mechanism of freely using content by linking display terminals in the process (C), it is necessary to handle operation information called an event (i). The operation information is operation information using content. The display terminals of the display terminal group are touch panels, and can directly sense input related to user operations. Such sensed operation information is input to the event handler 31 (server side) in real time (i).

The information display method according to the present embodiment performs an event client procedure that performs processing for changing the display of the content based on the operation information acquired in the event handle procedure.
The input operation information is detected by the event client 32 while referring to the H / W repository (table type list) (ii). There are events related to content such as expansion and reduction of the content and movement of the display position of the content. In addition, display terminal addition and detachment are also included in the operation information as events for organizing the display terminal group. By detecting such information, it is determined how much the content is moved and how much the size is changed with respect to the change of the content display position and the content size, and the information is passed to the event handler 31 as an event. The movement amount, change size, and the like are the values of operation information input in the H / W repository. For example, in the case of content enlargement / reduction, an event of content enlargement / reduction is determined based on the direction and amount of operation. Index from within the W repository. Regarding the movement of content, a movement event is determined from the H / W repository from the value of the movement amount. Processing is performed so as to return such information to the event handler 31 (ii).

The information display method of the present embodiment provides the display change of the content according to the predetermined process performed by the user based on the process performed in the event client procedure during the display terminal group link procedure, and A content window management procedure for changing content is performed.
Next, the content window manager 33 processes information regarding the display position, size, and group reorganization of the content of the detected event (iii). If it is necessary to change the size of the content, the ID of the same content and the changed size are passed to the DB of the content registry in (B), and the content is appropriately selected when the resolution of the content needs to be changed. When the size of the display terminal group is changed due to the reorganization of the display terminals (display terminal addition / detachment event), or when the content is enlarged or reduced, the resolution is changed. Then, the display position of the content is arranged and recorded on the content window manager 33 (iii).

  Finally, if a change in the content display position or size is updated for each display terminal group on the content window manager 33, the display terminal group linker 13 in FIG. Notification from the event handler 31 causes each display terminal to draw content so as to form a display terminal group (iv). At that time, the display content and the display position and size information are passed to the display image generation processing unit, and the image generated by the transmission unit is transmitted in a streaming format. It becomes a procedure.

  Note that the processing related to the addition and removal of the display terminal must be coordinated with (A), the operation information is passed to the event handler 31, and the processing of (A) is performed at the same time, and the reorganization of the display terminal group is performed as parallel processing. Made. In the case of addition, it is processed as α, β, γ in the procedure shown in FIG. 2, and when it is disconnected, the display terminal information management side detects the disconnection message or the disconnection of the session after the disconnection for α ′, The display terminal group is reorganized by processing β and γ. The processing related to the display of content is executed by the processing of (i), (ii), (iii), and (iv) in the same manner as other events.

2.3.4 Operation Example Next, a specific operation example of the information display apparatus will be described.

(Operation X1)
The contents presented at the available position on the nearest display terminal at the user's position can be utilized on the grouped display terminals by the environments (A) and (B). The procedure is shown in FIG. The display terminals are grouped in (Processing A), the distance between the display terminal group used in (Processing B) and the target user is calculated, and the content to be displayed to the target user in Steps S11 to S16 and the display of the content The process of determining the position and actually presenting it is performed.

(Operation X2)
The content displayed in a part of the display terminal group is expanded and utilized for the entire display terminal group. One content can be displayed on the entire display terminals constituting the display terminal group. FIG. 7 shows a processing procedure of processing C. In step S21, an event notification of content enlargement is received, an interrupt event is detected (content enlargement) in step S22, the display position is held in the content window in step S23, and the display terminal group linker 13 is received in step S24. Request reflection on the screen. The reduction process is the same as the enlargement process.

(Operation X3)
The content presented on the display terminal group can be displayed and used by freely moving the content between the display terminals constituting the display terminal group. The content can be displayed by utilizing one or a plurality of display terminals constituting the display terminal group. The processing procedure will be described with reference to FIG. In step S21, an interrupt event of content movement is detected, content movement is determined in step S22, the content movement destination is held in step S23, and the display position of the content is updated by the display terminal group linker 13 in step S24. Ask to do so.

(Operation X4)
One or more display terminals can be dynamically added to the display terminal group to expand the display terminal group itself. By repeating the operations X1 to X3 in the display terminal group in which the originally presented content is reorganized together with the added display terminal, it can be used in the same manner. FIG. 8 shows the processing procedure. The display terminal to be added is added in (Processing A) described with reference to FIG. 6, and the contents are enlarged, reduced, or moved as in operation X <b> 2 through the processes in Steps S <b> 21 to S <b> 24 described in FIG. 7. .

(Operation X5)
One or more of the display terminals forming the display terminal group can be used separately from the organized display terminal group. When separating from the display terminal group forming the display terminal, it is possible to take out the displayed content so as to be displayed on the separated display terminal. FIG. 8 shows the processing procedure. First, the content to be extracted in (Processing C) described with reference to FIG. Then, the separation process is performed from the process on the display terminal information management unit 14 side (process A) described in FIG. Next, processing is performed again from the display terminal entry 11 side so that the cut-out display terminal operates as one display terminal group.

  Through the processing as described above, it is possible to freely use content in which display terminals such as operations X1 to X5 are linked.

2.4 Other Embodiments In the information display apparatus described with reference to FIGS. 2 to 4, only one server is described. However, the number of servers is not limited to one, and a plurality of servers may exist. For example, the information display device includes a first server having the function of FIG. 2A, a second server having the function of FIG. 3B, and a third server having the function of FIG. Provided, and may be configured to transmit and receive information between the respective servers.

3. Prior Art Related to Invention 3.1 Content Usage Method Coordinating Conventional Display Terminals <Tile Display Device>
In the tile type display device, there is a prior art in which a display terminal is connected as one part of one panel and is handled as one information display device. In consideration of the resolution of each display terminal, a GUI screen to be output to be displayed on each display terminal is generated and displayed. It is not different from a huge information display device in that it cannot be dynamically grouped or is not managed for dynamic use by a user (Patent Document 1).
<Joint workspace display device>
In the display device of the collaborative workspace, the display terminals of each user are connected to each other via a network, and the contents can be utilized by linking the display terminals with a mechanism that allows the screens to be shared with each other. Since such a mechanism has a limited use environment such as a conference room, a free operation cannot be performed by dynamically utilizing a display terminal at a destination.
<Distributed operating system>
In the distributed operating system, each display terminal can be connected via a network, and each user can use it by sharing each terminal. Can be used. From the viewpoint of a mechanism as a device for displaying information, it is a request type, does not support a push type, and does not provide a free operation between display terminals.

3.2 Method for Presenting User Content to Digital Signage <Information Display Device Utilizing Proximity Communication Technology>
This is a mechanism for causing a display terminal to present content by bringing a nearby communication device closer. RFID, NFC, infrared rays, etc. are examples of the proximity communication device. Using these things, content can be presented based on personal information. In terms of available display terminals, operations such as touch using proximity communication are required, so the distance from the available display terminals is very narrow, and the user must act close to the display terminal. (Patent Document 2).
<Apparatus for displaying content on nearby display terminal>
When a user approaches the vicinity of the display terminal, a mechanism for detecting the height of the user's eyes, displaying the content at an appropriate position on the screen, and presenting the content to the user so as to make a push notification is invented. Yes. From the viewpoint of content use, although it can be displayed in an appropriate size or the like for the user, the content operation is limited within one display terminal, and is limited from the viewpoint of use (Patent Document 3).

11: Display terminal entry 12: Display terminal registry 13: Display terminal group linker 14: Display terminal information management 21: Feature information dispatcher 22: First link part (link between display terminal group and user)
23: Second link part (link on content and target person's display terminal)
24: Content dispatcher 31: Event handler 32: Event client 33: Content window manager

Claims (7)

Display terminal entry into which display terminal information indicating the display capability of content, network information, and entry information of real space information indicating the location are input for each display terminal that accesses one or more access points installed at each position When,
A display terminal registry that forms a group with one or more display terminals connected to the same access point, and holds the entry information input to the display terminal entry for each of the formed groups;
One display image to be displayed on one joint screen formed using all display terminals included in the group formed with reference to the display terminal information is created, and the display is made with reference to the real space information A display terminal group linker that divides a video for each display terminal included in the group and transmits the display video divided by referring to the network information to each display terminal included in the group;
Accompanying the change of the state of the display terminal, the information of the change of the entry information is collected, the entry information held by the display terminal registry is corrected, and reflected in the display video created by the display terminal group linker Display terminal information management department,
An information display device comprising: A feature information dispatcher that provides feature information that is an event that appears in the real space stored in advance in the feature information registry based on the real space information of the display terminal of the user;
Based on the real space information of the display terminal of the user, a first link unit that detects the group available to the user from the group stored in the display terminal registry, and links the group and the user;
Based on the feature information provided by the feature information dispatcher, the content is selected from the content registry, and the content is selected from any of the joint screens based on the display terminal information and the real space information of the user's display terminal. A second link part for displaying at a position or determining display position information;
A content dispatcher that transmits the content and the display position information from the second link unit to the display terminal group linker and displays the content at a desired position on the joint screen;
The information display device according to claim 1 , further comprising: An event handler that acquires, as operation information, predetermined processing performed by the user for the content displayed by the content dispatcher at a desired position on the joint screen;
Based on the operation information acquired by the event handler, an event client that performs display change processing of the content;
A content window manager that, based on the processing of the event client, transmits a display change of the content according to the predetermined processing performed by a user to the display terminal group linker, and changes the content of the joint screen;
The information display device according to claim 2 , further comprising: Display terminal entry into which display terminal information indicating the display capability of content, network information, and entry information of real space information indicating the location are input for each display terminal that accesses one or more access points installed at each position Procedure and
An entry that forms a group with one or more display terminals connected to the same access point and holds the entry information input in the display terminal entry procedure in the display terminal registry for each of the formed groups. Information retention procedures;
One display image to be displayed on one joint screen formed using all display terminals included in the group formed with reference to the display terminal information is created, and the display is made with reference to the real space information A display terminal group link procedure for dividing a video for each display terminal included in the group and transmitting the display video divided by referring to the network information to each display terminal included in the group;
Accompanying the change of the state of the display terminal, information on the change of the entry information is collected, the entry information held in the display terminal registry is corrected, and reflected in the display video created by the display terminal group link procedure Display terminal information management procedure
How to display information. Based on the real space information of the user's display terminal, a feature information dispatch procedure that provides feature information that is an event that appears in the real space stored in advance in the feature information registry;
A first link procedure for detecting a group available to the user from the groups stored in the display terminal registry based on the real space information of the display terminal of the user and linking the group and the user;
Based on the feature information provided in the feature information dispatch procedure, the content is selected from a content registry, and the content is selected from any of the joint screens based on the display terminal information of the display terminal of the user and the real space information. A second link procedure for determining display position information or display position information;
A content dispatch procedure for providing the content in the second link procedure and the display position information during the display terminal group link procedure and displaying the content at a desired position on the joint screen;
5. The information display method according to claim 4 , further comprising: An event handle procedure for acquiring predetermined processing performed by a user as operation information for the content displayed at a desired position on the joint screen in the content dispatch procedure;
Based on the operation information acquired in the event handle procedure, an event client procedure for processing the display change of the content,
A content window management procedure for providing a display change of the content according to the predetermined process performed by a user during the display terminal group link procedure based on the process performed in the event client procedure, and changing the content of the joint screen; ,
The information display method according to claim 5 , further comprising: A program for causing a computer to execute the information display method according to claim 4 .

Images