JPH08335158A - Information processing system - Google Patents

Abstract

PURPOSE: To automatically decide an information processor to be relationally operated by providing a layout detecting means for detecting the arrangement information of respective information processors and a relational operation deciding means for deciding the device to be relationally operated. CONSTITUTION: The respective information processors such as sheets (SHEET) 1-4 which are information processors formed in the shape of thin sheets like paper and especially provided with display parts, a pen 10, a mouse 20 and a keyboard 30 are set at arbitrary positions on a disk space 40. This disk space 40 manages the entire system. Under the working environment in which various kinds of information processors are suitably arranged, this disk space 40 detects the layout information such as the existing positions or directions of respective information processors, further performs the relation (resource allocation) of devices to be relationally operated according to previously decided rules while referring to this layout information and functions to provide the optimum working environment for a user.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a system for automatically constructing an environment in which information processing apparatuses are associated with each other and operated when performing business using a plurality of information processing apparatuses. , Referring to the placement information of each information processing device,
The present invention relates to a system for automatically determining an input information processing device and a display information processing device as devices to operate in association with each other and constructing a business environment.

[0002]

2. Description of the Related Art As an example of the prior art, Japanese Patent Laid-Open No. 61-45318
As described in Japanese Patent Publication No. JP-A-2003-242242, in order to efficiently use a plurality of input devices, a system for assigning one information processing device while switching a plurality of input devices (keyboard, etc.) and constructing a work environment is disclosed. Proposed.

On the other hand, a system has been proposed in which one information processing device controls display image information of two divided screens.

In this system, one information processing device
A system in which two display devices are connected. The two displays are logically controlled as one display screen, and the display screen can be freely pointed by one mouse. ing.

In such a system, assuming that the size of the display screen of one display is "A4 size", two display devices display the screen information of "A3 size" which is twice as large. it can. That is, one display screen information can be divided and displayed on two displays, and a display screen having a double size can be provided.

Further, in order to reduce the trouble of performing a control operation using a remote control device (also referred to as a "remote control device") corresponding to each device such as a television or a video device, one remote controller is provided. In addition, a device having a function of controlling various devices has already been proposed. It can be said that such a multifunctional remote control device is a device capable of controlling and operating a plurality of devices.

[0007]

By the way, the above-mentioned conventional technique has a system configuration in which a plurality of input / output devices and a plurality of information processing devices are appropriately switched and used, but they are independent. No consideration was given to efficient operation by associating a plurality of information processing devices with each other.

For example, when a plurality of information processing apparatuses are arranged close to each other, the information processing apparatuses arranged close to each other are operated in association with each other in order to logically operate in one operating environment. In such a case, or when the directions in which the information processing devices exist are the same, the information processing devices cannot be associated with each other and operated.

However, from the user's point of view, when a large number of information processing devices are present in the surroundings, which device is adopted as the input device and which device has a display function is used. It is cumbersome to think and decide each time to decide the system configuration. There is also an empirical fact that the adoption of the information processing device corresponding to the input device selected by the user is usually performed by selecting the information processing device arranged closest to the input device. To do.

A plurality of devices can be controlled by operating the multi-functional remote control device using infrared rays. In this control, the multi-functional remote control device is directed toward the direction in which the control target device exists. , But it is realized by performing a command sending operation, and considering that the target device is controlled by operating the remote control in a specific direction (if the device is not operated in a specific direction, It is impossible to transmit a command to the device) and the arrangement information such as the existing position and the existing direction of the devices are not considered at all.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to consider the arrangement information such as the existence positions and the direction of existence of a plurality of information processing devices, and to operate in association with the information. It is to provide a system for constructing a user-friendly operating environment by automatically determining a processing device.

[0012]

[Means for Solving the Problems] In order to achieve the above object, the following means can be considered.

That is, it has a plurality of information processing devices,
An information processing system for deciding a device to be operated in association, wherein a layout detecting means for detecting arrangement information of each of the information processing devices, and an apparatus to be operated in association with reference to the arrangement position are decided. And a related operation determining means.

The layout detecting means has a function of detecting, as the arrangement information, either the existing position of each information processing apparatus or the existing direction indicating the direction in which each information processing apparatus is arranged. Also, the related operation determining means is a system for determining an apparatus to be related to operate according to a predetermined rule with reference to the arrangement information.

Further, specifically, the following modes can be considered.

First, of the plurality of information processing devices,
An input information processing apparatus that receives input information and wirelessly outputs it, and a display information processing apparatus that performs processing corresponding to the information wirelessly output from the input information processing apparatus and displays the processing result, respectively. Provide one or more.

Then, the related operation determining means refers to the arrangement information and determines that one input information processing apparatus and at least one display information processing apparatus are to be operated in association with each other. It is a system to decide.

Further, as a system in which the existence position and the existence direction are used as the arrangement information, the following modes can be considered.

That is, the layout detecting means has a function of detecting the existing position of each of the information processing devices as arrangement information, and the related operation determining means is the input information processing device and the display information processing device having the closest existing positions. It is a system that determines an information processing device as a device that should operate in association with the information processing device.

Further, the layout detecting means has a function of detecting, as arrangement information, an existence direction indicating an arrangement direction of each of the information processing devices, and the related operation determining means is closest to the existence direction. A system is also conceivable in which the input information processing apparatus and the display information processing apparatus are determined as devices that should operate in association with each other.

[0021]

The information processing system has a plurality of information processing devices and determines the devices to operate in association with each other.

First, the layout detecting means detects the arrangement information of each of the information processing devices, and the related operation determining means refers to the arrangement position to determine the device to operate in association therewith.

At this time, the layout detecting means detects, as the arrangement information, either the existing position of each of the information processing devices or the existing direction indicating the direction in which each of the information processing devices is arranged.

Then, the related operation determining means refers to the arrangement information and determines a device to be related to operate according to a predetermined rule.

More specifically, among the plurality of information processing devices, it corresponds to an input information processing device that receives input information and wirelessly outputs it, and information wirelessly output from the input information processing device. One or more display information processing apparatuses that perform the processing and display the processing results are provided.

At this time, the related operation determining means refers to the arrangement information and operates one input information processing apparatus and at least one display information processing apparatus in association with each other. To decide.

When the existing position of the information processing device is used as the layout information, the layout detecting means detects the existing position of each of the information processing devices as the layout information, and the related operation determining means further determines the most existing position. The input information processing device and the display information processing device that are close to each other are determined as devices that should operate in association with each other.

When the direction of existence of the information processing device is used as the arrangement information, the layout detecting means detects the existence direction indicating the direction in which the information processing device is arranged as the arrangement information, and further, The related operation determining means determines the input information processing apparatus and the display information processing apparatus that are closest to each other in the direction of existence as the apparatuses that should operate in association.

As described above, the layout detecting unit obtains the arrangement information of each information processing apparatus, determines the information processing apparatus to be associated and operates based on the obtained arrangement information, and associates the information processing apparatuses with each other. Operate in relation to each other. For example, by determining the input information processing apparatus and the display information processing apparatus that are closest to each other in position as the apparatuses that should operate in association with each other, both apparatuses operate as if they were one information processing apparatus. The usage environment of the information processing apparatus can be automatically constructed, which is convenient for the user.

[0030]

Embodiments of the present invention will be described below with reference to the drawings.

FIG. 1 is an external view of an information processing system according to an embodiment of the present invention.

As shown in FIG. 1, various information processing devices are arranged in the desk space 40.

Of course, each information processing device can be arranged at an arbitrary position on the desk space (DESK_SPACE) 40. As shown in FIG. 1, the information processing device has a thin sheet shape like paper. In particular, an information processing device (sheets (SHEET) 1 to 4) including a display unit, and a keyboard (KB) 30 having a function of transmitting and inputting information input by a user to one of the information processing devices (SHEET 1 to 4) , A mouse (MS) 20 having a function of transmitting and outputting the information given by the user by a moving operation or a click operation to any of the information processing devices (SHEET1 to 4), and the information given by the user by the operation of the user Information processing device (SHEET1 ~
4) shows a pen (PEN) 10 having a function of transmitting and outputting.

Here, a pen (also referred to as "PEN" as appropriate)
Each of a mouse 10, a mouse (also appropriately referred to as “MS”) 20, a keyboard (also appropriately referred to as “KB”) 30, and a desk space (also appropriately referred to as “DESK_SPACE”) 40 is considered as an independent information processing device. ing.

The information processing devices of "SHEET1-4" are
At least a processing unit that receives the sent information and performs a predetermined process corresponding to the received information, and a display unit (display) that displays the processing result are provided. Here, the sheet (SHEET) is referred to as a notebook type mainstream personal computer due to technological innovation in recent years, but due to further technological development, it will be an ultra thin type in the future. It is assumed that a sheet-shaped personal computer will appear. Of course, in the present invention, the size of the information processing device is not restricted. That is, it may be a notebook type or desktop type information processing apparatus.

Further, as described above, the desk space 4
0 is also one information processing device, and in the present invention, the desk space 40 has a function of detecting the layout information (layout information) of each information processing device, and a device that should operate in association with the layout information. It has at least a function of making a decision of, and has a management function of the entire system. Such a function will be described later.

In the embodiment of the present invention, it is assumed that a user performs a predetermined work by using each of the information processing devices described above.

Further, each information processing apparatus is of a built-in power source type, or is configured to receive power from the desk space 40 in a cordless manner.

Furthermore, the information processing devices are configured to be cordless and capable of communicating necessary information. Such a communication function can be easily realized by the recent wireless LAN technology.

In this way, the microprocessor and communication I
As electronic devices such as C and special LSIs become cheaper, smaller, and higher in performance, various electronic devices are built in the device to realize more intelligent information processing devices. You can

In FIG. 1, sheets (SHEET1 to SHEET4),
The information processing devices such as the pen 10, the mouse 20, and the keyboard 30 are placed at arbitrary positions on the desk space 40. The desk space 40 manages the entire system as described above. Details of this management method will be described later.

As shown in FIG. 1, under the working environment in which various information processing devices are appropriately arranged, the desk space 4
0 detects layout information such as the existence position and the direction of existence of each information processing device, and further refers to the layout information to associate devices that should operate in association with each other according to a predetermined rule. Also referred to as “resource allocation”), and functions to automatically provide an optimal work environment to the user. Hereinafter, the association of such operations will be described in detail, but before that, an example of a system configuration for realizing the system described above will be outlined with reference to FIG. 2.

In the system configuration shown in FIG. 2, each information processing apparatus has a wireless network interface (RLAN I
/ F) to configure a wireless network (RLAN). Information transmission by a wireless network is performed in the same manner as a wired network using an optical fiber or the like.

Each information processing device is configured with an RLAN I / F, and necessary information is transmitted between arbitrary devices.

For example, in order that information can be transmitted between the sheets (SHEET1 to SHEET4), and output from the keyboard 30 which is one of the input devices (information processing device used by the user for information input). The assigned information is resource-assigned so that it can be transmitted to any sheet.

Information transmission between the pen 10, the mouse 20, and the keyboard 30, which are input devices, is meaningless. Therefore, the RLAN is configured so that information transmission between these input devices cannot be performed. You can leave it. Usually, the most information is transmitted between the input device such as the pen 10, the mouse 20 and the keyboard 30 and each sheet having a processing function and a display function.

For operation using the pen 10, the desk space 40 may be handled as if it were paper.

That is, the desk 10 is constructed so that information can be easily input with the pen 10 as if writing characters, symbols, figures, etc. with a pencil. For this purpose, a recognition unit that recognizes information input by a pen operation in the desk space 40 and an information processing device in which the recognized input information is resource-allocated through the RLAN I / F of the desk space 40. A pen input information processing unit for performing the process of transmitting to the device may be provided. For the method of recognizing the information input by pen operation,
Since this is a known technique and is not a main part of the present invention, the description thereof will be omitted.

Furthermore, personal identification information (ID unique to the individual
Etc.) is input using the pen 10 and the desk space 40 is provided with the collation function of the input recognition information, thereby providing a function equivalent to identifying a user using a seal stamp. The desk space 40 is further provided with a function of allocating resources or allocating resources so that a user-specific work environment is defined in advance and a corresponding work environment is immediately constructed when the user is recognized. It is also possible to keep it.

Mouse 2 which is another input device
It is needless to say that even if the 0 or the keyboard 30 is used, it is possible to provide the same function as the pen 10 and to access any sheet.

A plurality of transmission lines are arranged on the desk space 40, and each information processing device has a communication section connectable to any one of the transmission lines so that information communication between specific information processing devices can be performed. The desk space 40 may have a function.

The operation of the embodiment according to the present invention will be described with reference to FIGS.

Here, how to allocate resources to each information processing apparatus becomes a problem of how the desk space 40 operates by associating each resource of the input device and the sheet having the display with each other. As a resource allocation criterion, the distances between the devices are calculated using the information on the existing positions of the information processing devices, and the devices that form the shortest combination of the distances (for example, the distance to the input device used by the user, Is the shortest combination)
And a method of associating devices that form a combination in which the directions of presence are closest to each other (for example, the direction of presence of the input device used by the user and the sheet having the closest direction of presence) by using the directions of presence. To be Here, the presence direction is a direction of one specific side forming the outer shape of the sheet or the keyboard 30, a direction indicated by the housing of the pen 10, a direction indicated by a virtual straight line connecting the front and rear ends of the mouse, and the like. Conceivable.

Both the distance information and the direction information are detected, and the priority of which information is prioritized is determined in advance, and the information with the higher priority is referred to, and the distance information and the direction information are respectively referred to. On the other hand, it is conceivable that a weighting coefficient is determined and resource allocation is performed such that the value obtained by multiplying the obtained information by the coefficient and obtaining the sum is the largest.

It can be said that the standard using the distance information is a standard determined in consideration of the empirical fact that the devices close to each other are working in some relation with each other.
Further, the reference using the direction information is that when a person calls out, it is possible to make the devices existing in the same direction relevant to each other, as you can imagine that the face turns in that direction, It can be said that it is a standard determined in consideration of building an environment with excellent workability from an ergonomic point of view.

Now, with reference to FIG. 7, the principle of detecting the presence position and the presence direction of each information processing apparatus will be described.

To simplify the description, it is assumed that only the seat 1 (SHEET1) is placed on the desk space 40. For other sheets and input devices,
The detection principle is the same.

First, markers P1 and P2 capable of detecting coordinate positions are attached to two corners of the sheet 1 (SHEET1). Then, the desk space 40 detects the position coordinates of this marker.

The marker is formed by connecting a coil and a capacitor in parallel so as to have a specific resonance frequency.

The position coordinates of the marker are detected by a tablet device which is a known technique as follows.

Although not shown, the tablet device is a device which is constructed by arranging electric wires in a matrix in the desk space 40 and sequentially applying an alternating current between the two electric wires in both the x and y directions. Then, when the frequency of the alternating current is scanned as the specific resonance frequency, impedance change occurs due to the resonance action at the position where the marker exists, and the current value becomes the resonance value.

Utilizing this, the position coordinates of the markers P1 and P2 are detected. Note that a plurality of positions may be detected by changing the type of marker (for example, changing the capacitance of the capacitor).

Now, if the position coordinates of the markers P1 and P2 can be detected, the inclination θ can be easily calculated by the following equation 1.

[0064]

[Mathematical formula-see original document] θ = tan-1 (ly / lx) (Formula 1) where lx is the difference between the x-coordinates of the two markers P1 and P2, and ly is the y-coordinate of the two markers P1 and P2. Is the difference. Also, tan-1 is an arctangent function.

In this way, a marker may be attached in advance to each information processing device so that a predetermined direction of existence can be obtained. Further, by determining the existence position of the information processing device as the coordinate of the midpoint of the position coordinates indicated by the two markers P1 and P2, the coordinates of the existence position of each information processing device can be grasped. Of course, in order to accurately set the coordinates of the central position of each information processing device to the existing position, a value considering the size of the device is added to the coordinates of the midpoint of the position coordinates indicated by the two markers P1 and P2. You may do it.

Now, an example of resource allocation based on distance information between devices will be specifically described with reference to FIGS. 3 and 4. For ease of explanation, the case where the number of sheets is two will be described.

In FIG. 3, the desk space 40 is provided with the keyboard 30 which is an input device, and which is one of SHEET1 and SHEET2 which is an information processing device having a display.
It is explanatory drawing which assumed the case where it allocates automatically. FIG.
In, the distances l1 and l2 are calculated from the position coordinates between each information processing.

Here, since the relationship of l1 <l2 exists, it is determined that the sheet closest to the keyboard 30 which is the input device is SHEET1. Therefore, the desk space 40 includes the keyboard 30 and SHEET1.
Processes so that they operate in association with each other.

For example, using the above-mentioned RLAN, the information output from the keyboard 30 is temporarily stored in the desk space 40.
Further, the desk space 40 can control the transmission information so that the received information is sent only to SHEET1, so that the keyboard 30 and SHEET1 can perform related operations. In addition, if each information processing apparatus is provided with a starting unit that starts its own apparatus only when a specific start command is received, in addition to being operated, the desk space 40 is required. It suffices to send the activation command only to the device.

For example, in the example shown in FIG. 3, first, since the keyboard 30 is activated by the user's operation, the desk space 40 may send the activation command only to SHEET 1. At this time, for the user,
A sheet to show that the device association has been made
SHEET1 may be configured to display a reaction when it becomes a resource allocation target. As an example of the reaction display, as shown in FIG. 3, a liquid crystal device provided along the edge of the sheet may be driven. As a result, the reaction display is performed as shown in FIG.

As another method of resource allocation based on the distance information, for example, all resources existing within a predetermined distance range from the input device can be allocated. For example, with respect to the keyboard 30, a predetermined distance range
Assuming that resources within l2 are allocated, sheet 1 (SHEET1) and sheet 2 (SHEET2) are associated with the keyboard 30, and three information processing devices are determined as devices that should operate in association with each other. It will work in the same work environment.

As described above, the resource allocation based on the distance information can be performed for the sheets.

FIG. 4 is a drawing for explaining the concept of resource allocation between the sheets. In this figure, SHEET1 and SHEET2 having a short inter-sheet distance ls are automatically allocated. Reaction display at this time
(ACTION) drives the liquid crystal device provided at the edge of each sheet so that the contact portions facing each other are not framed.
This reaction display may be performed in the same way even when two or more sheets are displayed.

The operation will be described below.

First, the desk space 40 grasps the existing position of each sheet and associates the sheets existing within a predetermined distance. In the example shown in FIG. 4, the distance between SHEET1 and SHEET2 is ls, and SHEET1 and SHEET2 are grasped as sheets existing within a predetermined distance. Then, it is decided to operate SHEET1 and SHEET2 in association with each other.

An example of this operation will be described below.

First, the desk space 40 uses RLAN to send relevant information to SHEET1 and SHEET2 indicating that they have been associated with each other. SHEET1 and SHEET2 are
By the related information, it is possible to know that they are related to each other. Then, when the sheets are associated with each other, it is determined in advance which one will be the main device and the processing will be performed.
I know this. Now, SHEET1 is the main device.

The information input by the user operating the keyboard 30 is temporarily received by the desk space 40 using the above-mentioned RLAN. And the desk space 40
Controls the transmission information so that the received information is sent to SHEET1, which is the main device. Then, the processing result executed in SHEET1 is such that the sum of the display contents of SHEET1 and SHEET2 becomes a display content having one meaning. For this purpose, SHEET1 sends the display information that SHEET2 should display to SHEET2 using RLAN. Since the related information has already been obtained in SHEET2, the display software which is predetermined corresponding to the related information is activated, and the display processing using the display information sent from SHEET2 is performed. Note that SHEET1 has already obtained relevant information, so
A predetermined display software corresponding to the information is activated to generate display information for SHEET1 to display, and display processing is performed.

By such operation, SHEET1 and SH
The combination of the display contents of EET2 is the display contents having one meaning.

As described above, it is possible to logically display one sheet by combining two display contents of the display section of each sheet (for example,
When the size of the display screen of each sheet is A4 size, it is possible to display A3 size by associating and operating two sheets.) Furthermore, there is display information to be displayed on multiple display screens. At this time, it is also possible to display each display information on the display unit of each sheet one after another so that the display is performed as if the page is being turned.

In the example shown in FIG. 4, two sheets are used for the sake of simplification of description, but three or more sheets can be obtained by changing the display software stored in each sheet. The same operation can be performed by using the sheet.

Next, with reference to FIG. 5, an embodiment in which resource allocation is performed based on direction information will be described.

As shown in FIG. 5, the arrangement state of the keyboard (KB) 30 which is an input device is changed from the arrangement state shown by "KB '".

The desk space 40 is a keyboard (KB)
The presence direction of 30 and each sheet (SHEET1, SHEET2) is detected. Then, it is determined which sheet the direction of presence of the keyboard (KB) 30 is closest to, and resource allocation is performed.

In the example shown in FIG. 5, the desk space 40
Performs processing so that the keyboard (KB) 30 and the seat 2 (SHEET2) operate in association with each other.

For example, using the RLAN described above, the information output from the keyboard 30 is temporarily stored in the desk space 40.
Further, the desk space 40 can control the transmission information so that the received information is sent only to SHEET2, so that the keyboard 30 and SHEET2 can perform related operations.

Note that SHEET2 displays the reaction display as described above. Therefore, by changing the direction of the keyboard 30, it is possible to operate the keyboard 30 and other sheets in association with each other.
According to this method, resource allocation can be performed relatively easily without using distance information. As another resource allocation method using direction information, a method of allocating all the resources whose existence direction is within the direction indicated by a predetermined angle range with respect to the existence direction of a certain input device is also considered. .

As described above, the resource allocation may be performed by combining the distance information and the direction information. For example, within a predetermined distance from the input device, and
A method of allocating a resource only in a certain existence direction to the input device, a method of allocating a resource existing in a predetermined existence direction range to the input device and having the shortest distance to the input device, and the like. Can be mentioned.

The automatic resource allocation method described above may result in allocation not desired by the user. In this case, the desk space 40 may be configured so as to have a function capable of forcibly changing the resource allocation by manual operation.

FIG. 6 shows a manner in which the allocation is forcibly changed by operating the mouse 20 which is an input device to give a pointing instruction. In this case, the cursor is initially positioned at the cursor b, is changed to the cursor a, and the mouse 20 is clicked to instruct the change. That is, the resources are allocated so that the keyboard 30 and SHEET1 operate in association with each other, but the mouse 20
By the operation of, the resource allocation is changed so that the keyboard 30 and the sheet SHEET2 operate in association with each other. Similarly,
It is also possible to change the resource allocation by operating the pen or the keyboard 30.

The desk space 40 is configured to have a function of detecting mouse movement information and calculating the position of the cursor. At this time, the maximum area where the cursor can exist is within the area of the desk space 40. Since the display means does not exist except when the position of the cursor is on the display of the sheet, the cursor is not actually displayed as indicated by the cursor b. It should be noted that the desk space 40 grasps the existing position of the display of each sheet from the existing position of each sheet based on the sheet shape information given in advance. Then, when the position where the cursor is present is present on the display of the seat by operating the mouse 20, the desk space 40 uses RLAN to give information indicating that the cursor is to be displayed, and A seat with a display, keyboard 3
It operates in relation to 0. It should be noted that the sheet to which the information indicating that the cursor is displayed is subjected to the processing for displaying the cursor. Also, the newly associated SHEE
At this time, T2 displays an action.

The related operations performed by the keyboard 30 and SHEET 2 are managed by the desk space 40 as described above.

Now, FIG. 8 shows a resource allocation management table for managing the resource allocation performed by the desk space 40. Such a resource allocation management table is available at desk space 4
0 prepares and manages.

FIG. 8A shows the resource allocation example shown in FIG.
FIG. 8B shows the state of the resource allocation example shown in FIG. In this way, for the resource determined to operate in a related manner, a "○" mark is added to the corresponding column, and the desk space 40 refers to this table to grasp the resource allocation state, to manage. The "○" mark for the related resource that has changed its resource allocation and is no longer operating is deleted from the management table. Actually, the desk space 40 is provided with a memory and stores such a management table in the memory, and the mark “◯” is processed as the digital information “1”.

Next, the desk space 4 described above
An overview of the overall processing performed by 0 will be described with reference to FIGS.

FIG. 9 shows an outline of the whole process for easy understanding.

First, the pen / mouse coordinate detection process 100.
Detects the coordinates of a pen, mouse, etc.

On the other hand, the marker coordinate detection processing 200 detects the coordinates of another information processing device such as a sheet or a keyboard. The separation into 100 and 200 has no particular meaning. This is for easier understanding.

When the detection of these coordinates is completed, the layout detection processing 300 calculates the distance information between the devices and the information of the direction of existence of each device. When this calculation is completed, the resource management processing 400 determines a device to be associated and operates based on the distance information and the direction information according to a predetermined rule, and constructs a work environment rich in workability of the user. After determining the devices to be associated with each other, the desk space performs information transmission between the devices using the RLAN so that the desk space performs the associated operations.

The detailed contents of the processing blocks 300 and 400 will be described below with a flowchart.

FIG. 10 is a flowchart showing the processing contents of the layout detection processing.

First, the position coordinates (Pci) of the center of each device are calculated from the coordinates (P1i, P2i) of the two markers (step 310). The center coordinates of each processing device can be easily calculated by obtaining the coordinates of the marker and taking into consideration predetermined shape information such as the depth unique to each device. For example, in a rectangular sheet, when the markers are attached to both ends of the short side, the center coordinates of the two markers are obtained, and from the center coordinates, the long side is parallel to the long side (perpendicular to the straight line passing through both markers). When the coordinates of a point separated by a distance of half the length are obtained, these become the center coordinates of the sheet, and the center position can be similarly obtained in other devices.

Next, from the marker coordinates (P1i, P2i) of the two points,
The tilt angle (θPi), which is a parameter indicating the direction in which the information processing device exists, is calculated by the above-described equation 1 (step 32).
0). Then, it is determined whether or not the calculation is completed for all information processing devices except the desk space (step 330), and if not completed, the same calculation is performed for other information processing devices. Therefore, the Sahux “i” at the marker coordinates (P1i, P2i) indicates a variable that means loop processing is performed by the number of information processing devices. That is, it is sufficient to set i = 1 first and terminate the process shown in FIG. 10 when the value of i reaches a predetermined number.

FIG. 11 is a flowchart showing the processing contents of the resource management processing performed by the desk space.

In this resource management process, the arrangement state of each device is grasped based on the center coordinates and inclination angles (Pci, θPi) of each information processing device obtained by the process shown in FIG. This is a process of deciding whether to operate the devices in association with each other, and is a process of creating the management table shown in FIG. It should be noted that this processing is roughly divided into two. In steps 410 to 440 in the first half, resource allocation is automatically performed based on the layout information. Steps 450 to 460 in the latter half show processing for an exception of so-called automatic allocation, in which the user allocates resources by a compulsory operation.

It should be noted that here, there is shown a flowchart of the processing for resource allocation based only on the distance information.

First, the distance li is obtained from the center position coordinates Pci of each device, which is the layout information (step 410). Then, in this step, all the distances li are obtained by changing the suffix i that can be combined.

Next, of the obtained distances li, a search is made for which device combination is the smallest (step 420). In addition, as an aspect of this combination,
"Sheet with input device and display",
"Sheets equipped with displays (for example, in the case shown in FIG. 4)" and the like are considered. Here, it is assumed that “combination of only input devices” is meaningless, and if the distance between the devices for such a combination is the minimum, the process ends.

Then, a flag (corresponding to a circle) is set in the resource allocation management table so as to correspond to the combination of devices for which the obtained distance li is the minimum (step 430). Then, until the combination of all the information processing devices is completed,
The above process is repeated (step 440).

The next step 450 is a step for performing a kind of interrupt processing with respect to normal processing.

That is, this is a process for monitoring whether or not the user has instructed to forcibly perform resource allocation. It is judged whether or not there is an exceptional condition (forced designation by operation of mouse, keyboard, etc.) (step 450), and if forced, clear the corresponding flag in the management table once and force designated. A flag is set in the column of the resource allocation management table corresponding to (step 460).

Finally, resource allocation is performed by referring to the flag set in the resource allocation management table (step 47).
0). Then, a process for causing the devices, which are determined to operate in association with each other, to operate in association with each other (step
480).

In FIG. 11, based on the distance information,
Although the resource allocation has been described, it goes without saying that the resource allocation may be performed based on the direction information.

By the way, according to the embodiments described so far,
The layout information was detected using the marker attached to each device, but each device is equipped with a distance measuring device such as an ultrasonic sensor, and each device automatically measures the distance to another device, It is also conceivable to identify the partner device that should be associated with the device, and to perform the associated operation with the identified device with reference to. In this case, for example, one of the devices serves as the main device, manages information indicating the related state of each device, and controls communication of the information using the RLAN to perform the related operation. Embodiments are possible.

In order to detect layout information,
It is also possible to perform image processing.

In the example shown in FIG. 12, the camera 500 detects the image information of each device, and the image processing unit (not shown) performs the image processing based on the detected image information to detect the layout information. is there.

The image processing performed here is a known technique and will not be described in detail, but the processing for realizing the system according to the present invention will be outlined.

First, a process for extracting a contour from image information is performed. Then, the position of the center of gravity is obtained for each closed contour line. This center of gravity position corresponds to the center position of each device. Further, the distance between each device is calculated by the length of a straight line connecting the positions of the centers of gravity. As a result, the distance information between the respective devices is obtained and transmitted to the desk space 40 via the cable.

Further, from the image information, the angle of the specific line obtained by performing the contour extraction with respect to the specific one side of the desk space 40 is obtained, so that the information on the direction in which the device exists is detected.

For example, in a rectangular sheet, the long side may be treated as the specific line.

In the case of a mouse, it can be dealt with by forming the shape of the mouse into a shape having a straight line in part. Further, even if the mouse does not have a special shape, the direction in which the mouse exists can be detected by determining the angle formed by the straight line connecting the center of gravity of the mouse and the head position of the mouse with one specific side of the desk space 40. You may do it.

In this way, the layout information is detected by performing the image processing based on the image information obtained by the camera.

In addition, high precision GPS (Global Positioning)
System) and the like are provided in the apparatus, and by sending the position information to the desk space, the desk space can detect the layout information.

In the embodiment of the present invention, the information processing apparatus has been described as a thin and light sheet like paper, that is, a sheet in view of the future office. The present invention can be applied to an electronic notebook and a desktop information processing device.

The present invention can also be configured as a system assuming a plurality of users.

Further, in the embodiment of the present invention, the system using the two-dimensional plane desk space has been described as shown in FIG. 1. However, another desk space is provided on the front side and the side of the desk space. A system configuration is also conceivable in which seats and the like are arranged vertically, and sheets and the like can be arranged in a vertically arranged desk space. In this case, the vertically arranged desk space may be provided with the tablet function so that the existence position and the existence direction of each information processing device can be detected.

In this case, the presence position and the presence direction of each information processing device must be treated and calculated as three-dimensional information as a matter of course.

After the system is started, the user can change the status from the state in which there is no information processing device on the desk space.
It is also conceivable that one set of the input information processing apparatus and the display information processing apparatus is arranged on the desk space, and at the same time, a process of operating the two apparatuses in association with each other is performed.

As described above, a plurality of information processing devices are used, the positional relationship of the plurality of information processing devices is detected, and the devices to be operated are determined in association with each other. A system capable of constructing an environment can be realized.

[0130]

As described above, according to the present invention, in a device using a plurality of information processing devices, the information processing device which detects the arrangement relationship information of the plurality of information processing devices and operates in association therewith. It is possible to realize a system capable of determining

Therefore, it is possible to provide a good working environment by associating a plurality of information processing devices with the information on the arrangement relationship.

Specifically, based on the information on the arrangement relationship,
In order to automatically operate one input device in association with an information processing apparatus having a display function,
The user can immediately perform desired processing using the system. In addition, when the angle is detected as the layout relationship information, the input device is only directed in a predetermined direction and the information processing apparatus having the display function is automatically operated in association with the information processing apparatus. Can be built and is excellent in usability.

Further, only by arranging a plurality of information processing devices having a display function close to each other, the display functions of the devices can be activated in association with each other to display a large screen of a document or the like.

[Brief description of drawings]

FIG. 1 is an overall external view of an example of an information processing system according to the present invention.

FIG. 2 is a configuration diagram of an example of an information processing system according to the present invention.

FIG. 3 is an explanatory diagram of automatic allocation of input devices.

FIG. 4 is an explanatory diagram of automatic allocation of sheets.

FIG. 5 is an explanatory diagram of automatic allocation of input devices.

FIG. 6 is an explanatory diagram of allocation change by an input device.

FIG. 7 is an explanatory diagram of a principle of detecting a sheet position and an inclination, which is an embodiment according to the present invention.

FIG. 8 is an explanatory diagram of a resource allocation management table.

FIG. 9 is an explanatory diagram of a processing outline according to the present invention.

FIG. 10 is a flowchart illustrating an example of layout detection processing.

FIG. 11 is a flowchart showing an example of resource management processing.

FIG. 12 is an explanatory diagram of another layout detection example.

[Explanation of symbols]

10 ... Pen (PEN), 20 ... Mouse (MS), 30 ... Keyboard (KB), 40 ... Desk space

 ─────────────────────────────────────────────────── ─── Continuation of front page (72) Inventor Toshimi Yokota 7-1, 1-1 Omika-cho, Hitachi City, Ibaraki Hitachi Ltd. Hitachi Research Laboratory (72) Inventor Masaki Miura 7-chome, Omika-cho, Hitachi City, Ibaraki Prefecture No. 1 Hitachi Ltd., Hitachi Research Laboratory (72) Inventor Keiko Gunji 7-1-1 Omika-cho, Hitachi City, Ibaraki Prefecture Hitachi Ltd. Hitachi Research Laboratory

Claims (7)

[Claims] 1. An information processing system having a plurality of information processing devices and deciding devices to be associated with each other, the layout detecting means detecting layout information of the information processing devices, and the layout. An information processing system, comprising: a related operation determining means that determines a device to be operated in association with the position. 2. The layout detection means according to claim 1, wherein the layout detection unit detects, as arrangement information, one of an existing position of each information processing apparatus and an existing direction indicating a direction in which each information processing apparatus is arranged. An information processing system, wherein the related operation determining means determines an apparatus to be related to operate according to a predetermined rule with reference to the arrangement information. 3. The input information processing apparatus, which receives the input information and wirelessly outputs it, among the plurality of information processing apparatuses, and the information output by communication from the input information processing apparatus according to claim 1. One or more display information processing apparatuses that perform corresponding processing and display processing results are provided, and the related operation determining unit refers to the arrangement information and
An information processing system, characterized in that one input information processing device and at least one display information processing device are determined as devices to be associated and operate. 4. The layout detecting means according to claim 3, wherein the layout detecting means has a function of detecting the existing position of each of the information processing devices as arrangement information, and the related operation determining means is for inputting, which has the closest existing position. An information processing system characterized in that an information processing device and a display information processing device are determined as devices to operate in association with each other. 5. The layout detecting means according to claim 3, wherein the layout detecting means has a function of detecting an existence direction indicating an arrangement direction of each of the information processing devices as arrangement information, and the related operation determining means is the most existing. An information processing system, characterized in that an input information processing apparatus and a display information processing apparatus, which are close to each other in direction, are determined as apparatuses to be associated with each other. 6. The related operation determining means according to claim 3, wherein the related operation determining means includes a set of display information processing devices closest to the existing position and the set of display information processing devices. The closest information processing device for input is determined as a device that should operate in association, and the processing result of any one of the information processing devices for display corresponding to the information wirelessly output from the information processing device for input, An information processing system, characterized by performing a process of displaying a set of divided information devices for display. 7. The layout detecting means according to claim 1, wherein the layout detecting means processes the image information by capturing an image of each information processing device and obtaining image information. And an image processing unit for obtaining the arrangement information.