JP2004164069A - Information control system, information control method, program for the same, recording medium recording that program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To expand a digital space in a computer to a real space, and to provide an intuitive and easy interaction between both the spaces. <P>SOLUTION: Interface environment using physical objects as mediation between two spaces is structured. Display surfaces 11 and 12 arranged in the environment to display various information, a camera 17 for photographing the display surfaces, transportable physical objects 16 to be placed on the display surfaces to display various information, and a computer 15 embedded in the environment and connected to the display surfaces, the camera and the physical objects are provided. The computer is provided with a processing for discriminating each of the physical objects and for recognizing position thereof on the basis of an image input from the camera, a processing for selecting a task to be carried out, and a processing for renewing the information displayed in the display surfaces and the physical objects on the basis of a result of carrying out of the selected task. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention mediates these two spaces in the construction of an interface environment that is intuitive and easy for a user to understand to a computer, particularly in an environment where a digital space (virtual space) on a computer is extended to a real world space. Constructing an interface environment.
[0002]
[Prior art]
Recently, a real-world oriented user interface has been attracting attention as a new technique related to a computer interface. This is a technology for extending a digital space originally limited on a computer display to a real world space. According to this real-world oriented interface, not only the display but also the table on which the computer is installed, the wall of the room, etc. function as an extended display, and the digital space is extended to the entire room where the computer is installed.
[0003]
As a technique for realizing these real-world oriented interfaces, for example, there is a technique called Pick-and-Drop (see Non-Patent Document 1). This is an extension of "drag and drop" used in a graphical user interface (GUI) environment, and maps the movement of data, etc. between multiple computers to intuitive operations in the real world. Technique. However, this approach requires picking the object on the computer and then dropping it on the target, which must be a very intuitive but spatially and temporally continuous operation.
[0004]
In order to eliminate such restrictions, a method has been proposed in which an object on a computer is linked to a physical object and the physical object is used. For example, MediaBlocks (see Non-Patent Document 2) uses a physical block to associate an object on a computer with an ID of the block, temporarily store the object in the block, and store the object in another computer. And so on.
[0005]
Further, there is an information input / output system and an information input / output method which are extended so that all objects used everyday can be used by attaching visual markers to physical objects (see Patent Document 3).
[0006]
[Non-patent document 1]
J. Rekimoto, Pick-and-Drop, Direct Manipulation Technology for Multiple Computer Environments, UIST '97, p. 31-39, 1997
[0007]
[Non-patent document 2]
B. Ullmer, H .; Ishii and D.S. Glas, MediaBocks, Physical containers, transports and controls for online media, SIGGRAPH'98, P.S. 379-386.1998
[0008]
[Patent Document 3]
JP-A-2001-175374
[0009]
[Problems to be solved by the invention]
In the conventional method described above, the information linked to the physical object cannot be confirmed without displaying or outputting the information to a connection destination, for example, a display, a printer, a mail, or the like. Therefore, it is necessary to describe information such as a title that can be confirmed in the physical object. Moreover, such an index is not effective for time-series information such as a certain block of video and audio.
[0010]
An object of the present invention is to provide an intuitive and easy interface environment that can expand a digital space on a computer into a real world space.
[0011]
It is a further object of the present invention to provide an excellent interface environment that allows intuitive and easy interaction between the digital space and the real world space.
[0012]
[Means for Solving the Problems]
The present invention has been made in view of the above-described problems, and is for constructing an interface environment using a physical object serving as a medium between two spaces in an environment where a digital space on a computer is extended to a real world space. Information control system,
One or more display surfaces capable of displaying various information arranged in an environment, one or more image input means capable of photographing the display surface, and one or more mounted on the display surface and capable of displaying various information Comprising a portable physical object, a display surface, an image input means, and an environment-embedded computer connected to the physical object,
The computer, based on the input image by the image input means, a process of recognizing the identification and position of each physical object, a process of selecting a task to be executed, and a display surface based on an execution result of the selected task, And a process of updating information displayed on the physical object.
[0013]
The computer can execute the following processing.
[0014]
(A) A process of recognizing the identification and position of each physical object by using the content of information instructed to be displayed on each physical object from the computer.
[0015]
(B) A process of recognizing the identification and position of each physical object using the content of the information instructed to be displayed on each display surface from the computer.
[0016]
(C) Identification information and position information of each continuous physical object, information displayed at a position on each display surface corresponding to the current position of each physical object, and information displayed on each physical object. The process of selecting a task to execute using it.
[0017]
(D) When updating the information displayed on each display surface, a process of generating information to be displayed avoiding a portion corresponding to the current position of each physical object and presenting the information to the display surface .
[0018]
(E) When updating the information displayed on each physical object, if the information to be displayed is time-series information such as video information, information that summarizes the information is generated, and the information is transmitted to the physical object. The process to be presented.
[0019]
Further, the physical object may have a unique ID, be connected to the computer via a network, and have a process of displaying information instructed to be displayed by the computer.
[0020]
Another aspect of the present invention is an information control method for constructing an interface environment using a physical object serving as a medium between two spaces in an environment where a digital space on a computer is expanded into a real world space. The environment includes at least one display surface capable of displaying various information, at least one image input unit capable of photographing the display surface, and capable of displaying various information placed on the display surface. Comprising one or more portable physical objects, an environment-embedded computer connected to the display surface, the image input means, and the physical objects,
(1) a step of recognizing identification information and position information of each physical object based on an image input by the image input means, (2) a step of selecting a processing to be executed, and (3) the selected processing. Updating the information displayed on the display surface and the physical object based on the result of (1).
[0021]
In the step (1), the identification and position of each physical object may be recognized using the content of the information instructed to be displayed on each physical object from the computer, and the display instruction may be given from the computer on each display surface. The identification and position of each physical object may be recognized using the content of the information thus obtained.
[0022]
In the step (2), identification information and position information of each continuous physical object, information displayed at a position on each display surface corresponding to the current position of each physical object, and displayed at each physical object The process to be executed may be selected by using the information that is stored.
[0023]
In the step (3), when updating the information displayed on each display surface, information to be displayed is generated by avoiding a portion corresponding to the current position of each physical object, and the information is displayed on the display surface. May be presented, and when updating the information displayed on each physical object, if the information to be displayed is time-series information such as video information, information that summarizes the information is generated. Then, the information may be presented to the physical object.
[0024]
According to the information control system and method as described above, the present invention uses a physical object in the real world as a medium between two spaces, a digital space and a real world space, so that the digital space on the computer becomes the real world space. Provides a preferred environment to be extended.
[0025]
In addition, by controlling the interaction between the spaces by operating the physical object according to the present invention, an intuitive and easy interface environment is constructed.
[0026]
Further, according to the present invention, since each physical object has means for displaying visual information, it is possible to immediately understand what kind of information is the information to be processed, and to have an intuitive and easy interface environment. To build.
[0027]
Furthermore, since it is possible to associate each piece of digital information with each physical object, effective management of digital information that tends to be buried in the logical space of a computer is realized.
[0028]
As described above, the present invention is characterized by the following information control system, information control method, program, and recording medium.
[0029]
(Invention of information control system)
(1) In an environment in which a digital space on a computer is extended to a real world space, an information control system for constructing an interface environment using a physical object serving as a medium between the two spaces,
One or more display surfaces capable of displaying various information arranged in the environment, one or more image input means capable of photographing the display surface, and capable of displaying various information placed on the display surface Comprising one or more portable physical objects, an environment-embedded computer connected to the display surface, the image input means, and the physical objects,
The computer, based on an image input by the image input unit, a process of recognizing the identification and position of each physical object, a process of selecting a task to be executed, and based on an execution result of the selected task, It is characterized by including each unit for processing for updating information displayed on the display surface and the physical object.
[0030]
(2) The computer recognizes the identification and position of each physical object by using the content of the information instructed to be displayed on each physical object from the computer.
[0031]
(3) The computer recognizes the identification and the position of each physical object by using the content of the information instructed to be displayed on each display surface from the computer.
[0032]
(4) In an environment in which a digital space on a computer is extended to a real world space, an information control system for constructing an interface environment using a physical object serving as a medium between the two spaces,
One or more display surfaces capable of displaying various information arranged in the environment, one or more portable physical objects mounted on the display surface and capable of displaying various information, and sensing the physical object And one or more sensing means, and an environment-embedded computer connected to the display surface, the physical object, and the sensing means.
The computer performs a process of recognizing an identification and a position of each physical object based on a sensing result of the sensing unit, a process of selecting a task to be executed, and the display based on an execution result of the selected task. It is characterized by comprising means for updating information displayed on the surface and the physical object.
[0033]
(5) The computer displays identification information and position information of each continuous physical object, information displayed at a position on each display surface corresponding to the current position of each physical object, and displayed on each physical object. Means for selecting a task to be executed by utilizing the information stored in the memory.
[0034]
(6) When updating the information displayed on each display surface, the computer generates information to be displayed while avoiding a portion corresponding to the current position of each physical object, and outputs the information to the display surface. Is presented.
[0035]
(7) When updating information displayed on each physical object, if the information to be displayed is time-series information such as video information, the computer generates information summarizing the information, It is characterized by presenting information to an object.
[0036]
(8) The physical object has a unique ID, is connected to the computer via a network, and has means for displaying information instructed to be displayed by the computer.
[0037]
(Invention of information control method)
(9) In an environment in which a digital space on a computer is extended to a real world space, an information control method for constructing an interface environment using a physical object serving as a medium between the two spaces,
The environment includes at least one display surface capable of displaying various information, at least one image input unit capable of photographing the display surface, and at least one image input device mounted on the display surface and capable of displaying various information. The portable physical object and the display surface, the image input means, comprising an environment embedded computer connected to the physical object,
The computer is
(1) recognizing the identification and the position of each physical object based on the image input by the image input means;
(2) selecting a task to be performed;
(3) updating information displayed on the display surface and the physical object based on the execution result of the selected task.
[0038]
(10) In the step (1), the identification and the position of each physical object are recognized using the content of information instructed to be displayed on each physical object from the computer.
[0039]
(11) In the step (1), the identification and the position of each physical object are recognized by using the content of the information instructed to be displayed on each display surface from the computer.
[0040]
(12) An information control method for constructing an interface environment using a physical object serving as a medium between the two spaces in an environment where a digital space on a computer is extended to a real world space,
The environment includes one or more display surfaces capable of displaying various information, one or more portable physical objects mounted on the display surface and capable of displaying various information, and sensing 1 of the physical object. Comprising one or more sensing means, an environment-embedded computer connected to the display surface, the physical object, and the sensing means,
The computer is
(1) recognizing the identification and position of each physical object based on the sensing result of the sensing means;
(2) selecting a task to be performed;
(3) updating information displayed on the display surface and the physical object based on the execution result of the selected task.
[0041]
(13) In the step (2), identification information and position information of each continuous physical object, information displayed at a position on each display surface corresponding to the current position of each physical object, and each physical object A task to be executed is selected by using the information displayed in (1).
[0042]
(14) In the step (3), when updating the information displayed on each display surface, information to be displayed is generated while avoiding a portion corresponding to the current position of each physical object, and the information is displayed. Presenting information on the surface.
[0043]
(15) In the step (3), when information displayed on each physical object is updated, if information to be displayed is time-series information such as video information, information that summarizes the information is generated. And presenting information to a physical object.
[0044]
(Invention of program)
(16) The information control method according to any one of claims 9 to 15 is configured to be executable by a computer.
[0045]
(Invention of recording medium)
(17) A computer-executable program for recording the information control method according to any one of claims 9 to 15 on a computer.
[0046]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 schematically shows an example of construction of an environment according to the present invention.
[0047]
As shown in FIG. 1, at least one LCD (Liquid Crystal Display) projector 13 or an embedded display (preferably a flat type such as a plasma display) is installed to display digital information on the table 11 and the wall surface 12. Have been. The contents displayed by each LCD projector 13 and the display are controlled by computers 15 interconnected by a network 14.
[0048]
A camera 17 is installed to capture display contents of digital information on the table 11 and the wall surface 12 and a physical object 16 operated on the table 11. The camera 17 may be, for example, a CCD (Charge Coupled Device) camera, may be fixed, or may be a controllable camera such as pan / tilt / zoom. Images captured by the camera 17 are processed by a computer 15 interconnected by a network 14.
[0049]
In addition, the physical object 16 may be any portable physical object as long as the display means is provided, and the content displayed by each physical object is controlled by the computer 15 connected by the network 14. . This network may be a normal cable connection, or may be connected by other means such as a wireless LAN (Local Area Network) in order to realize a more flexible operation.
[0050]
Further, the environment-embedded computer 15 connected thereto may be, for example, a PC / AT (Personal Computer / Advanced Technology) compatible machine manufactured by IBM Corporation in the United States. In the example shown in FIG. 1, the computer 15 is configured as one computer. However, the computer 15 may be configured as a plurality of network-connected computer systems. At this time, the computers may be interconnected to the network 14 via a NIC (Network Interface Card), or may be connected by other means such as a wireless LAN.
[0051]
FIG. 2 shows a software configuration for information control mounted on the computer 15. The image input unit 15A acquires a current or time-series image captured by the camera 17, and the display instruction receiving unit 15B receives display instruction information for an image projected on the display surface by the LCD projector 13 and the projected image. The physical object identification / position recognition unit 15C recognizes the identification and position of each physical object using the content of the information received from the display instruction. The two-dimensional position is recognized at the time of the identification, and the position is recognized three-dimensionally, such as the inclination of the physical object at this position.
[0052]
Based on the current position information of each physical object recognized by the recognizing unit 15C, the execution task selecting unit 15D compares the information displayed at the position on each display surface corresponding to the current position of each physical object with each physical object. The information displayed on the object is associated, and a task to be executed is selected according to three types of patterns A, B, and C using the movement of the physical object.
[0053]
The information updating unit 15E updates information displayed on the display surface based on the execution result of the selected task. For this, display information is generated, information to be displayed next is mapped on a display surface, and output is performed, and summary information of time-series information is output to a physical object.
[0054]
Next, various processes realized by the computer according to the present invention will be described in detail below with reference to the process flow shown in FIG.
[0055]
First, the identification and position of each physical object 16 are recognized by inputting a camera image (S1), inputting a display surface image, and receiving a display image instruction (S2) (S3, S4). This mechanism is as follows.
[0056]
The camera 17 is installed so that the field of view covers the entire surface of the table 11, and recognizes the position of each physical object 16 on the table 11 and its identifier from the image thus captured. At this time, since the information displayed on the physical object is controlled by the computer, processing is performed using this control and the input image, but these have two aspects.
[0057]
One is to use where the appearance of the information that should be displayed is the same as the image obtained via the image input means. That is, the physical object is identified by catching the coincidence of the color information and the coincidence of the time-series information. When the color information is used, a related portion in the obtained image is searched for the pattern and graphic pattern indicated for display and the individual color information. When time-series information is used, a related portion in the obtained image is searched for the on / off or color change pattern of each dot designated for display. Thus, each physical object is identified by searching for a location where a match is found (S3). By this identification, the two-dimensional position on the display surface is also recognized.
[0058]
Following this, in order to recognize the three-dimensional position of each physical object, such as tilting or rotating, or being placed on the display surface or being lifted into space, Another aspect, that is, how the appearance of information that should be displayed is different from the image obtained via the image input means is used. That is, the three-dimensional position of the display surface of the physical object and the inclination thereof are calculated by capturing the change in the shape. With respect to the shape or pattern designated for display, a corresponding shape or pattern in the obtained image is searched. Then, it is determined how different these shapes and patterns are, and a three-dimensional position and its inclination are calculated (S4).
[0059]
When such image processing is performed, the information displayed on the display surface may adversely affect the processing. For example, when the same color is used or when the luminance greatly changes, stable and robust image processing becomes difficult. Therefore, in the present embodiment, the identification and position of each physical object are recognized using the content of the information instructed to be displayed on each display surface from the computer. Actually, the correction processing of the image to be used is performed by using the difference between the current and past captured images, or by using the difference between the current captured image and the image displayed on the display surface.
[0060]
Next, a mechanism for selecting a task to be executed will be described. In the present embodiment, identification information and position information of each continuous physical object, information displayed at a position on each display surface corresponding to the current position of each physical object, and displayed on each physical object Use the information to select a task to perform.
[0061]
Based on the current position information of each physical object, information displayed at a position on each display surface corresponding to the current position of each physical object is associated with information displayed on each physical object. The digital information displayed thereon is control information and content information, and has the following three types of patterns.
[0062]
(A) Physical object: control information, display surface: content information, (B) physical object: content information, display surface: control information, (C) physical object: content information, display surface: content information.
[0063]
In the case of the above pattern (A), a task is determined by selecting from the control information displayed on the physical object using the movement of the physical object. In the case of the pattern (B), a task is determined by selecting from the control information displayed on the display surface using the movement of the physical object. In the case of the pattern (C), the direction of the control is determined by using the movement of the physical object.
[0064]
A task to be executed on the digital information associated with the information is selected (S5). At this time, the movement of the physical object is determined from the position information of each continuous physical object. A motion such as placing, lifting, tilting, and rotating the physical object is determined, and an operation assigned to the motion is performed.
[0065]
Finally, a mechanism for updating the information displayed on the display surface and the physical object based on the execution result of the selected task will be described.
[0066]
In the present embodiment, when updating the information displayed on each display surface, information to be displayed is generated avoiding a portion corresponding to the current position of the physical object (S6), and the information is displayed on the display surface. Is output (S7). This information output uses, in the process of selecting a task to be executed, the position information of each of the acquired physical objects, and information to be displayed next in an area excluding a portion corresponding to the position. Is mapped and output to the display surface.
[0067]
Further, when updating the information displayed on each physical object, information generated by summarizing time-series information such as video information is output to the physical object (S8). This summarization process is performed based on a change in content or a change in camera work.
[0068]
Hereinafter, an example of the processing described above will be described. Now, as shown in FIG. 4A, it is assumed that “Menu” 24 is displayed on the display surface 21 as digital information, and that the physical object 23 is placed on the display surface 21. At this time, by performing an operation of tilting the physical object 23, “Select” that is control information is displayed. Further, as shown in FIG. 4B, the physical object 23 is superimposed on “TV Program” which is one of “Menu” 24. Thereby, “TV Program” is “Selected” on the display surface 22.
[0069]
In accordance with this, the information displayed on the display surface is updated, and “TV Program” 34 is displayed on the display surface 31 as digital information, as shown in FIG. Subsequently, by performing an operation of tilting the physical object 33, “Record” which is control information is displayed. Further, as shown in FIG. 5B, the physical object 33 is overlaid on “drama” which is one of “TV Program” 34. As a result, on the display surface 32, the “drama” is “Recorded” by the physical object 33.
[0070]
When “Record” is completed in this way, this video is summarized and displayed on the physical object 43 on the display surface 41 as shown in FIG. Subsequently, assuming that the user wants to copy this video to another device, the user can select a menu and perform an operation such as selecting a menu on the display surface 42, as shown in FIG. 46 is displayed. At this time, by tilting the physical object 43 and superimposing it on the device 45, the control from the physical object 43 to the device 45 is determined, and the video “Recorded” on the physical object 43 is copied to the device 45. .
[0071]
In addition, assuming that the user wants to search for a scene similar to a certain scene in the video, an operation such as selecting a menu causes the control information “similarity search” to be displayed on the display surface 51 as shown in FIG. 54 is displayed, and the physical object 53 in a state where the corresponding scene is displayed is matched with this. As a result, a scene similar to this scene is searched for in the video “Recorded” on the physical object 53. At the same time, as shown in FIG. 7B, the information displayed on the display surface 52 is updated, and the search result 55 is displayed.
[0072]
FIG. 8 shows another example of construction of the environment according to the present invention. As shown in the figure, one or more LCD projectors 62 are installed to display digital information on the sensing table 61. The content displayed by each LCD projector is controlled by computers 64 interconnected by a network 63.
[0073]
The sensing table 61 is a device for sensing the physical object 65 thereon, and may use, for example, an RFID (Radio Frequency Identification) system. At this time, the physical object 65 includes a chip including an IC memory and a communication circuit, a micro antenna, and the like. The sensing table 61 is composed of an RF module and a control module, and writes data from the connected environment-embedded computer 64 to the physical object 65, and writes data from the physical object 65 to the environment-embedded computer 64. I send it. The environment-embedded computer 64 is the same as the configuration example described above.
[0074]
It is needless to say that some or all of the processing functions described above can be realized using a computer, or that each processing procedure can be executed by a computer. Or a program for causing a computer to execute the processing procedure on a computer-readable recording medium such as a flexible disk, an MO, a ROM, a memory card, a CD, a DVD, and a removable disk. It can be recorded and stored or provided, and can be distributed through a communication network such as the Internet.
[0075]
Although the present invention has been described above in detail with reference to a specific embodiment, the present invention is not limited to the above-described embodiment, and various modifications may be made without departing from the scope of the invention. It goes without saying that it is possible. That is, the present invention has been disclosed by way of example, and should not be construed as limiting.
[0076]
【The invention's effect】
As described above, according to the present invention, a digital space on a computer is extended to a real world space by using a physical object in the real world as a medium between two spaces, a digital space and a real world space. A suitable environment can be provided.
[0077]
In addition, by controlling the interaction between the spaces by operating the physical object according to the present invention, an intuitive and easy interface environment can be constructed.
[0078]
Further, according to the present invention, since each physical object has means for displaying visual information, it is possible to immediately understand what kind of information is the information to be processed, and to have an intuitive and easy interface environment. Can be constructed.
[0079]
Furthermore, since individual digital information can be associated with each physical object, effective management of digital information that tends to be buried in the logical space of a computer can be realized.
[Brief description of the drawings]
FIG. 1 is a diagram schematically showing a configuration example of an environment according to the present invention.
FIG. 2 is a software configuration diagram of a computer for information control according to the present invention.
FIG. 3 is a processing flow of information control according to the present invention.
FIG. 4 is a diagram for explaining an example of a process according to the present invention.
FIG. 5 is a diagram illustrating an example of a process according to the present invention.
FIG. 6 is a diagram illustrating an example of a process according to the present invention.
FIG. 7 is a diagram illustrating an example of a process according to the present invention.
FIG. 8 is a diagram illustrating an example of a process according to the present invention.
[Explanation of symbols]
11 ... Table (display surface)
12 ... wall surface (display surface)
13 LCD projector
14. Network
15 ... Computer
16 ... Physical object
17… Camera
21, 22 ... display surface
23 ... Physical object
24 ... Menu
31, 32 ... display surface
33 ... Physical object
34… TV Program
41, 42 ... display surface
43 ... Physical object
44, 45, 46 ... Equipment
51, 52 ... display surface
53 ... Physical object
54… Similar search
55… Search results
61 ... Sensing table (display surface)
62 ... LCD projector
63… Network
64 ... Computer
65 ... Physical object

Claims (17)

An information control system for constructing an interface environment using a physical object serving as a medium between the two spaces in an environment where a digital space on a computer is extended to a real world space,
One or more display surfaces capable of displaying various information arranged in the environment, one or more image input means capable of photographing the display surface, and capable of displaying various information placed on the display surface Comprising one or more portable physical objects, an environment-embedded computer connected to the display surface, the image input means, and the physical objects,
The computer, based on an image input by the image input unit, a process of recognizing the identification and position of each physical object, a process of selecting a task to be executed, and based on an execution result of the selected task, An information control system, comprising: means for updating information displayed on a display surface and a physical object. The information control system according to claim 1, wherein the computer recognizes the identification and the position of each physical object by using the content of information instructed to be displayed on each physical object from the computer. The information control system according to claim 1, wherein the computer recognizes the identification and the position of each physical object by using the content of information instructed to be displayed on each display surface from the computer. An information control system for constructing an interface environment using a physical object serving as a medium between the two spaces in an environment where a digital space on a computer is extended to a real world space,
One or more display surfaces capable of displaying various information arranged in the environment, one or more portable physical objects mounted on the display surface and capable of displaying various information, and sensing the physical object And one or more sensing means, and an environment-embedded computer connected to the display surface, the physical object, and the sensing means.
The computer performs a process of recognizing an identification and a position of each physical object based on a sensing result of the sensing unit, a process of selecting a task to be executed, and the display based on an execution result of the selected task. An information control system comprising: means for updating information displayed on a surface and a physical object. The computer calculates identification information and position information of each successive physical object, information displayed at a position on each display surface corresponding to the current position of each physical object, and information displayed on each physical object. 5. The information control system according to claim 1, further comprising: means for selecting a task to be executed by using the information control system. The computer, when updating the information displayed on each display surface, avoids a location corresponding to the current position of each physical object, generates information for display, and presents the information to the display surface. The information control system according to claim 1 or 4, wherein: When updating the information displayed on each physical object, if the information to be displayed is time-series information such as video information, the computer generates information that summarizes the information and sends the information to the physical object. The information control system according to claim 1, wherein the information control system presents the information. 5. The physical object according to claim 1, wherein the physical object has a unique ID, is connected to the computer via a network, and has a unit that displays information for which a display instruction is given from the computer. 6. Information control system. An information control method for constructing an interface environment using a physical object serving as a medium between the two spaces in an environment where a digital space on a computer is extended to a real world space,
The environment includes at least one display surface capable of displaying various information, at least one image input unit capable of photographing the display surface, and at least one image input device mounted on the display surface and capable of displaying various information. The portable physical object and the display surface, the image input means, comprising an environment embedded computer connected to the physical object,
The computer is
(1) recognizing the identification and the position of each physical object based on the image input by the image input means;
(2) selecting a task to be performed;
(3) updating information displayed on the display surface and the physical object based on an execution result of the selected task;
An information control method, comprising: 10. The information control method according to claim 9, wherein in the step (1), the identification and the position of each physical object are recognized using the content of information instructed to be displayed on each physical object from the computer. 10. The information control method according to claim 9, wherein in the step (1), the identification and the position of each physical object are recognized by using contents of information instructed to be displayed on each display surface from the computer. An information control method for constructing an interface environment using a physical object serving as a medium between the two spaces in an environment where a digital space on a computer is extended to a real world space,
The environment includes one or more display surfaces capable of displaying various information, one or more portable physical objects mounted on the display surface and capable of displaying various information, and sensing 1 of the physical object. Comprising one or more sensing means, an environment-embedded computer connected to the display surface, the physical object, and the sensing means,
The computer is
(1) recognizing the identification and position of each physical object based on the sensing result of the sensing means;
(2) selecting a task to be performed;
(3) updating information displayed on the display surface and the physical object based on the execution result of the selected task;
An information control method, comprising: In the step (2), identification information and position information of each continuous physical object, information displayed at a position on each display surface corresponding to the current position of each physical object, and displayed at each physical object 13. The information control method according to claim 9, wherein a task to be executed is selected by using the information. In the step (3), when updating the information displayed on each display surface, information to be displayed is generated by avoiding a portion corresponding to the current position of each physical object, and the information is displayed on the display surface. The information control method according to claim 9, wherein the information is presented. In the step (3), when information displayed on each physical object is updated, if information to be displayed is time-series information such as video information, information that summarizes the information is generated. The information control method according to claim 9, wherein information is presented to an object. A program for an information control method, wherein the information control method according to any one of claims 9 to 15 is configured to be executable by a computer. A recording medium on which is recorded a program configured to execute the information control method according to any one of claims 9 to 15 on a computer.

Images