JPH0981475A - Information terminal equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information terminal equipment in which the comparison between pages is easily performed and the edition for every page becomes easy. SOLUTION: The liquid crystal boards 1 to 3 of a portable type information terminal 14 have at least one of means displaying the information file composed of at least one of character information, graphic information and image information and means inputting and editing the information file. The boards are provided with communi-cation means transmitting and receiving the information file and control information and means for cooperating with other information terminal equipments by using this communication terminal. At least one information file is displayed by dividing the file between other cooperative information terminal equipments.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information terminal device having a display function such as a liquid crystal board such as a portable information terminal.

[0002]

2. Description of the Related Art In a conventional wireless terminal system, when an information file is transmitted from one terminal to another terminal to display this information, since there is only one display device for the terminal, for example, a plurality of windows are displayed on the screen. Information was displayed by using the page for each page or scrolling the screen. Further, in such a system, there is no function of displaying a plurality of pages, scrolling a page, or performing partial display of a large screen by solidifying the plurality of display devices.

In such a system, when a plurality of pages are displayed on one screen when comparing the contents over a plurality of pages, there is a problem that the display is compressed small when the number of pages is large and the comparison is difficult to perform. . Further, there is a problem that a large display that does not fit on one screen is compressed into a small size and is difficult to be compressed.

Further, a video conference system is widely known, which is intended to hold a conference on an individual desk and connect multiple points with a communication line. In such a video conference system, a face image of a conference participant is generally displayed on the display screen, and the face and sound of the participant are collected by a TV camera and a microphone, converted into video data and audio data, and the communication line is displayed. And is displayed as a face image on another device. In addition, the voice is added together with the voices of other conference participants, and the same voice is output from the speakers of all the devices to simulate the atmosphere of the actual conference. Also,
As for the distributed materials to the conference participants, each person takes in the original material from the scanner, converts it into image data, sends it out to the communication line, and is displayed on the screen of each conference system. And
All materials distributed by all participants will be commonly displayed on the participant's system.

However, in the conventional video conference system, since it is necessary to display both the images of the conference participants and the distribution material on the display screen, the area for displaying the distribution material is limited. For this reason, the minimum necessary materials for displaying multiple handouts in a limited area are displayed, reduced, or displayed in a multi-window format, but the screen becomes difficult to see. Will end up. In addition, it is necessary to enlarge the desired material or send it to the front of the multi-window screen, which has a drawback that the operation becomes troublesome.

[0006]

SUMMARY OF THE INVENTION It is an object of the present invention to provide an information terminal device which facilitates comparison between pages and facilitates page-by-page editing.

Another object of the present invention is to provide an information terminal device capable of displaying a large information file partially but in a very easy-to-read form.

Still another object of the present invention is to provide an information terminal device capable of freely dividing and displaying a material, a face image or the like in a video conference system or the like and further holding the information by hand. Especially.

[0009]

In order to solve such a problem, the invention according to claim 1 is a means for displaying an information file including at least one of character information, graphic information and image information, or the information file. In an information terminal device having at least one of means for inputting and editing, for cooperating between a communication means for transmitting and receiving the information file and control information and another information terminal device using this communication terminal. And at least 1
It is characterized in that one of the information files is divided and displayed with another associated information terminal device.

According to a second aspect of the present invention, in the information terminal device according to the first aspect, there is provided means for recognizing a cooperation state in a plurality of information terminal devices with which each information terminal device cooperates,
Each of the information terminal devices determines which part of at least one information file should be displayed.

According to a third aspect of the invention, in the information terminal device according to the first aspect, the communication means includes means for establishing a wireless link with another information terminal device. .

According to a fourth aspect of the invention, in the information terminal device according to the first aspect, there is provided means for regulating information transfer from another information terminal device.

According to a fifth aspect of the present invention, in the information terminal device according to the first aspect, there is provided means for judging the capacity of the information file which can be displayed in the information terminal device, and the information to be transferred or being transferred. When the file exceeds the displayable capacity in the information terminal device, the information file is reduced and displayed, or a part of the information file is not displayed.

According to a sixth aspect of the present invention, in the information terminal device according to the first aspect, there is provided means for adding another information terminal device to the cooperation while the information terminal device is in cooperation with each other, It is characterized in that the capacity of an information file that can be displayed in a plurality of linked information terminal devices after addition is re-determined, and the display method in the information terminal device is changed based on the re-determination.

According to a seventh aspect of the present invention, in the information terminal device according to the first aspect, there is provided means for changing a cooperation state between the information terminal devices when the information terminal devices are in cooperation with each other,
When the cooperation state is changed, the cooperation state is judged again, and the contents displayed in each information terminal device are changed.

The invention according to claim 8 is the information terminal device according to claim 1, which comprises an input buffer and an output buffer, and in the state in which the information terminal devices cooperate with each other, an information file is stored using the input buffer and the output buffer. The feature is that the contents can be scrolled.

According to a ninth aspect of the present invention, in the information terminal device according to the first aspect, means for selecting an information file handled in the information terminal device or a part of the information file and transmitting the selected information file to another information terminal device. And a means for editing an information file or a part of the information file received from another information terminal device, the information being transferred in arbitrary units and being editable in arbitrary units.

According to a tenth aspect of the present invention, in the information terminal device according to the first aspect, means for detecting that the user is using each information terminal device, and an information display function and an information editing function are activated. And / or means for deactivating,
It is characterized in that only the information terminal device used by the user can display and edit information.

According to the eleventh aspect of the present invention, in the information terminal device according to the first aspect, when an information file is created or edited in the information terminal device, the identifier of the information terminal device or the creator or the editor of the information file is added to the information file. It is characterized in that it is provided with means for assigning an identifier of the person, and when the information file is changed, the identifier is deleted or changed.

According to the twelfth aspect of the present invention, in the information terminal device according to the first aspect, when the information file can be correctly transmitted from the information terminal device to another information terminal device, the information terminal device which receives the information file It is characterized by comprising means for leaving the terminal attribute information as a history in the transmitting side information terminal device.

According to a thirteenth aspect of the present invention, in the information terminal device according to the first aspect, when the information file transferred from the information terminal device to another information terminal device is changed, the information terminal device on the transmitting side again It is characterized in that it is provided with means for transferring the updated information file to the receiving side information terminal device and can update the information in the receiving side information terminal device. According to a fourteenth aspect of the present invention, in the information terminal device according to the first aspect, when an information file is created or edited in the information terminal device, a screen managed by the information file is set as a virtual display screen. A means for displaying the contents of the information file corresponding to the arrangement coordinates on the display screen of at least one linked information terminal device arranged on the display screen on the linked information terminal device. To do.

According to a fifteenth aspect of the present invention, in the information terminal device according to the first aspect, at least one information terminal device arranged in the virtual display screen enables / disables the coordinate detection function of the virtual display screen. Means for changing the relative coordinates of the virtual display screen and the information terminal device when the information terminal device moves within the virtual display screen.

According to a sixteenth aspect of the present invention, in the information terminal device according to the first aspect, the information file created or edited in the first information terminal device is provided to the second information terminal device with the arrangement information of the information terminal device. It is characterized in that it includes means for displaying in cooperation with each other, and displaying the arrangement relationship as the contents of each information file.

According to a seventeenth aspect of the present invention, in the information terminal device according to the first aspect, when the side face of the first information terminal device and the side face of the second information terminal device are arranged in close contact with each other,
The information file is transmitted from the first information terminal device to the second information terminal device through these aspects, and means for displaying a continuous figure across the first and second information terminal devices is provided. To do.

The invention described in claim 18 is the information terminal device according to claim 1, wherein each information terminal device is provided with an optical communication means for designating a group forming a wireless link. .

According to a nineteenth aspect of the present invention, in the information terminal device according to the first aspect, the first information terminal device is photographed by a television camera, and the photographed video is image-processed to arrange the information terminal device. And a means for classifying the arrangement relationship into a plurality of groups, and a link is established between the second information terminal device and at least one of the plurality of groups wirelessly. And

According to a twentieth aspect of the invention, in the information terminal device according to the first aspect, the information terminal device comprises means for generating magnetism from the bottom surface of the information terminal device and means for detecting the magnetism. It is characterized by measuring the coordinates that are drawn.

According to a twenty-first aspect of the invention, in the information terminal device according to the first aspect, means for detecting a moving distance and a moving direction in the information terminal device, and coordinates of the information terminal device arranged in the virtual screen. And means for measuring.

According to a twenty-second aspect of the present invention, in the information terminal device according to the first aspect, the distance from the television camera and the distance from the television camera by performing image processing on the image captured by the television camera to extract the mark points Means for measuring the direction, and measures the installation position of the information terminal device.

According to a twenty-third aspect of the present invention, in the information terminal device according to the first aspect, at least two or more information terminal devices are provided with a laser transmitting mechanism and a receiving mechanism, and the transmitting mechanism and the receiving mechanism are used. It is characterized by comprising means for measuring relative coordinates by communicating with each other, and measuring arrangement coordinates of the information terminal device in the virtual screen.

According to a twenty-fourth aspect of the present invention, in the information terminal device according to the first aspect, when the information terminal device is placed on the display screen of another second information terminal device, the display screen of the information terminal device is displayed. Is provided to the second information terminal device. The invention according to claim 25,
The information terminal device according to claim 1, characterized in that the plurality of information terminal devices are provided with means for dividing and assigning and executing for each application or data attribute.

According to a twenty-sixth aspect of the present invention, in the information terminal device according to the first aspect, a means for displaying a face image of the user or an icon and material for identifying the user on the information terminal device, and outputting the voice of the user The information terminal device and the user are associated with each other.

According to a twenty-seventh aspect of the present invention, in the information terminal device according to the first aspect, a television camera for photographing a flatly arranged document, a means for converting the photographed document into image data, and the image data. Means for removing the background portion by performing image processing on the document data to extract individual document data, and adding a spatial correction to the document data using known dimensions of the document to convert the document data to the document data. And means for reproducing.

According to a twenty-eighth aspect of the present invention, in the information terminal device according to the first aspect, a scanner, means for converting a document read from the scanner into an information file, and an image representing a transfer destination of the information file are provided. It is characterized by comprising means for displaying and means for transferring the information file to another information terminal device corresponding to the transfer destination by designating the video on the screen of the information terminal device.

According to a twenty-ninth aspect of the present invention, in the information terminal device according to the first aspect, a means for designating a point area for the information file, a face image for identifying the information file, the point area and the point designator or A means for sharing and displaying an icon to the association information terminal device, and a display style of the point region and the face image or icon are modified / corresponding to the point designator.
And means for changing.

According to a thirtieth aspect of the present invention, in the information terminal device according to the first aspect, a part of the information file displayed on the first information terminal device is designated from the screen of the first information terminal device. Means for transferring or copying to the second information terminal device to transfer and displaying, and the original information in the first information terminal device from the second information terminal device to the first information terminal device. And a means for displaying the file in the order of the files.

According to a thirty-first aspect of the invention, in the information terminal device according to the first aspect, the display content of the displayed information file and the style of the display content of the information file written and input directly on the screen are modified / changed. It is characterized by comprising means.

According to a thirty-second aspect of the invention, in the information terminal device according to the first aspect, the television camera, a means for displaying a face image or an icon for identifying the person, and the face of the operator of the information terminal device are displayed. It is provided with means for detecting the eyeball direction by shooting with a television camera, and means for displaying the face image or icon focused on by the eyeball direction by modifying / changing the style from the other face image or icon. It is characterized by

According to a thirty-third aspect of the invention, in the information terminal device according to the first aspect, when there is a point instruction on the display by the information terminal device, the entire screen of the information terminal device or the information file pointed to by the point is displayed. It is characterized by comprising means for emphasizing.

According to a thirty-fourth aspect of the present invention, in the information terminal device according to the first aspect, a means for holding a conference by sharing the voice input from a plurality of information terminal devices and outputting the voice to the information terminal devices. , 2 of the information terminal devices
When performing a conference by sharing two first information terminal devices and a second information terminal device other than the first information terminal device by outputting audio, the sharing is performed for the first information terminal device. A means for outputting a voice by attenuating or inhibiting the voice, performing a conversation only with the first information terminal device, and outputting the conversation voice to the first information terminal device, and the conversation voice output by the first information terminal device. Is added to the shared voice of the second information terminal device and output or prohibited.

According to a thirty-fifth aspect of the present invention, in the information terminal device according to the first aspect, the emergency importance level is set prior to communication from the first information terminal device to another second information terminal device. A means for inputting the set class from the first information terminal device and a display for expressing the communication request are displayed on the second information terminal device by providing a plurality of classes, and the display style is modified / changed according to the classification. And a means for causing it.

According to a thirty-sixth aspect of the present invention, in the information terminal device according to the first aspect, a conference is held by using the first information terminal device that convenes the conference and the second information terminal device that is convened. The means for performing and the second information terminal device include a convocationer and priority class determination table, and make a conference participation decision / notification based on the convenee schedule table, the determination table, or the attendance determination table based on a combination of both. It is characterized by comprising means.

According to a thirty-seventh aspect of the present invention, in the information terminal device according to the thirty-sixth aspect, the decision table for determining / notifying the conference participants comprises a multi-delivery level classification table for defining the distribution contents. It is characterized in that the contents of shared information distribution to the second information terminal device are controlled based on the above.

In the present invention, by transferring the information file of the portable information terminal to the plurality of linked liquid crystal boards,
Each liquid crystal board can display the contents of the information file page by page, facilitating comparison between pages and files, and facilitating work such as editing.

Even for a large graphic that cannot be displayed on one liquid crystal board, the graphic is virtually arranged and the liquid crystal board is arranged in the virtual graphic to display a partial graphic on the liquid crystal board. You can

Further, a portable information terminal and a plurality of liquid crystal boards are combined to form a video conference system, and face images of conference participants are displayed on the portable information terminal. Then, by displaying only the materials used in the meeting on the LCD board, the materials can be divided into multiple LCD boards for display, and the LCD board can be held by hand to see the actual materials. The same effect as the conference used can be expected.

[0047]

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, details of embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a diagram showing the configuration of an information terminal device according to an embodiment of the present invention.

As shown in the figure, this information terminal device is
It is composed of the portable information terminal 4 and a plurality (three in this embodiment) of liquid crystal boards 1, 2, 3. The portable information terminal 4 and the liquid crystal boards 1, 2, and 3 have at least means for displaying an information file including at least one of character information, graphic information, and image information, or means for inputting and editing the information file. At least one piece of information is provided, which has one and also includes communication means for transmitting and receiving the information file and control information, and means for cooperating with another information terminal device by using this communication terminal. The file is divided and displayed between other information terminal devices that cooperate with each other.

Each of the liquid crystal boards 1, 2, and 3 has a terminal address a to c. Here, by operating the liquid crystal boards 1, 2, and 3 by stacking them or by instructing the user to use the liquid crystal boards 1, 2, and 3 and their order,
The liquid crystal boards 1, 2, and 3 start cooperation with each other to generate a group address g.

When the cooperation of the liquid crystal boards 1, 2, and 3 is started, a wireless link is formed between the liquid crystal boards 1, 2, and 3 at the same time. Even if 2, 3 are physically separated, each liquid crystal board 1,
The cooperation between the two and three can be continued.

In this state, when the portable information terminal 4 designates the information file in the portable information terminal to be transferred and transmits the broadcast or destination designation, the liquid crystal board 1,
Two and three receive this information file and display the contents. Here, the contents displayed on each liquid crystal board 1, 2, and 3 are
For example, the liquid crystal boards 1, 2, and 3 respectively display the first to third pages of the received information file. At this time, for example, pages in ascending order are displayed from the upper side of the stacked liquid crystal boards 1, 2, and 3.

As shown in FIG. 2, each liquid crystal board 1, 2,
When information is transferred from the mobile information terminal 3 to the mobile information terminal 4, the liquid crystal boards 1, 2, and 3 are in contact with the mobile information terminal 4,
Alternatively, information transfer is performed by operating the liquid crystal boards 1, 2, and 3 with the portable information terminal 4 in the file receiving mode. However, when an information file having the same name as the information name to be transferred already exists in the portable information terminal 4, the user of the portable information terminals 1, 2, 3 is asked to confirm the overwrite. The information transmitted at this time may be new information, additional information, or edit information.

When the number of pages that can be displayed by the linked liquid crystal boards 1, 2, and 3 is smaller than the number of pages of the information file transferred from the portable information terminal 4, as shown in FIG. It is displayed in a reduced size on the screen, or some pages of the information file are not displayed as shown in FIG. In the latter case, the information that is not displayed is retained without being displayed in the liquid crystal board 2 in which the last page is stored as shown in FIG. 4 or in the other liquid crystal boards.

When a plurality of pages are reduced to one screen, they are returned to one screen one page by adding a liquid crystal board as shown in FIG. When the latter half page of the information file is not displayed, the latter half page is displayed by adding the liquid crystal board as shown in FIG. 5, or the state where the respective liquid crystal boards are overlapped as shown in FIG. In the case of, the liquid crystal board located on the upper side is moved to the lower side to display the page which should be on the lower side. In the latter case, the information of the page displayed by the liquid crystal board 1 moving to the lower side may be held by the liquid crystal board 1 as shown in FIG. 6, or may be transferred to the second liquid crystal board 2 located from the upper side. You may transfer.

Since each of the liquid crystal boards 1, 2 and 3 has an information input buffer and an information output buffer separately, as shown in FIG. 7, the liquid crystal boards 1, 2 and 3 are stacked or in a linked state. Thus, page scrolling between the liquid crystal boards 1, 2, and 3 is possible. Further, as a result, even if the number of pages is increased or decreased by editing the information of each liquid crystal board 1, 2, or 3, page-to-page editing can be performed by editing the page break symbol while scrolling the page. You can also change the page to be reduced.

From the portable information terminal 4 to the liquid crystal boards 1, 2,
3 or when transferring information from the liquid crystal boards 1, 2, 3 to the portable information terminal 4, it is possible to transfer in units of file or page as a unit of information transfer. As a result, as shown in FIG. Each page edited on each of the liquid crystal boards 1, 2, and 3 can be returned to the portable information terminal 4.
When the associated liquid crystal boards 1, 2, and 3 are stacked, the liquid crystal board 1 located on the uppermost side as shown in FIG.
Only the information is displayed, and the remaining liquid crystal boards 2 and 3 located on the lower side do not display the information. Thereby, power consumption can be saved. Also, the liquid crystal board 1,
The information may be displayed only when a few hands are held.

From the portable information terminal 4 to the liquid crystal boards 1, 2,
3 to transfer the information file to the information file, the ID (identifier) of the portable information terminal 4 is added to the information file as shown in FIG.
It is given and transferred to each liquid crystal board 1, 2, 3. In each of the liquid crystal boards 1, 2, and 3, handwritten characters can be input and edited, and when the information transferred from the portable information terminal 4 is edited, the information of the transmission source portable information terminal which is the attribute of the transferred information is displayed. The ID is deleted. Instead, the corrected IDs of the liquid crystal boards 1, 2, and 3 may be attached to the information. This allows the source information to be protected.

In the portable information terminal 4, a transfer destination history information table of information files as shown in FIG. 11 is constructed. When the information transferred from the portable information terminal 4 does not fit in the memory in the liquid crystal boards 1, 2, and 3, the information is transferred from the beginning of the information to the position where it enters the liquid crystal boards 1, 2, and 3. At this time, the liquid crystal boards 1, 2, and 3 to which the information has been transferred to the portable information terminal is recorded as a status, and when the information is requested again, the information can be transferred from the continuation.

When the liquid crystal boards 1, 2, and 3 are used for a telephone directory, an address book, or the like, a nonvolatile memory is used as a memory in the liquid crystal boards 1, 2, and 3, for example. Here, as shown in FIG. 12, when the source information in the portable information terminal 4 is changed, the automatically updated information can be transmitted from the portable information terminal 4 to the liquid crystal boards 1, 2, and 3. it can. Another embodiment of the present invention will be described.

As shown in FIG. 13, the portable information terminal 4 manages a large virtual screen 5 which cannot be displayed by one sheet, a figure 6 virtually existing in the virtual screen 5 and coordinates for arranging the figure name. are doing. When the liquid crystal boards 1 and 2 which are in wireless link with the portable information terminal 4 are arranged in the virtual screen 5, the arrangement coordinates of the liquid crystal boards 1 and 2 with the virtual screen 5 as a reference are measured. The portable information terminal 4 returns the partial graphic corresponding to the coordinates to the liquid crystal boards 1 and 2 and displays it. When the liquid crystal boards 1 and 2 move within the virtual screen 5, the figures displayed on the liquid crystal boards 1 and 2 also change. There may be a plurality of liquid crystal boards 1 and 2 existing in the virtual screen 5.

FIG. 14A shows three liquid crystal boards 1, 2,
3 is an example in which discrete figures 6 are displayed on each of the liquid crystal boards 1, 2 and 3.

Further, as shown in FIG. 14B, the portable information terminal 4 for managing the original figure of the virtual screen 5 is arranged in the virtual screen 5, and the portable information terminal 4 itself is provided with the figure 6. It is also possible to display a part and distribute the graphic information to other liquid crystal boards 1.

As described above, by moving the liquid crystal board existing in the virtual screen 5, the displayed graphic 6 also moves. FIG. 15 shows an example in which a switch (SW) 7 for fixing the figure as it is is attached to the liquid crystal board 1 even if the liquid crystal board is moved. When SW7 is turned off, the display graphic 6 is fixed even when the liquid crystal board 1 is moved, and when it is turned on, the graphic 6 is moved when the liquid crystal board 1 is moved. For example, assuming that the graphic 6 is arranged in the virtual screen 5 as shown in FIG. 16, the graphic 6 of FIG. 16A is displayed on the liquid crystal board 1 in FIG. 15A. Then, when the liquid crystal board 1 is moved to the right while the SW 7 is on, the graphic 6 of FIG. 16B is displayed on the liquid crystal board 1 (FIG. 15B). When the SW7 is turned off in this state, the display of the figure 6 in FIG. 16B is fixed, and the display does not change even if the liquid crystal board 1 moves to the left. After returning the liquid crystal board 1 to the same state as the position shown in FIG.
W7 is turned on (FIG. 15 (3)). Then, when the liquid crystal board 1 is moved to the right side, the liquid crystal board is shown in FIG.
The figure 6 of (c) is displayed. As described above, the SW 7 can enable or disable the function of detecting the moving state (moving distance) of the liquid crystal board 1 when the liquid crystal board 1 is moved. LCD board 1 when on
If the liquid crystal board 1 is moved in a desired direction and is returned when it is off, the same effect can be obtained even if the liquid crystal board 1 is moved within a small range at hand, when the liquid crystal board 1 is largely moved in one direction in the virtual screen.

FIG. 17 shows a case where a plurality of liquid crystal boards 1, 2 and 3 on which the graphic 6 is displayed are stacked. In this case, the graphic 6 displayed on each of the liquid crystal boards 1, 2 and 3 may be displayed on the portable information terminal 4 as shown in FIG. The operation detects the coordinates on the virtual screen 5 on which the liquid crystal boards 1, 2, and 3 are placed, and at the same time, the graphic 6 and the coordinates displayed on the liquid crystal boards 1, 2, and 3 are used for the portable information terminal. 4, the portable information terminal 4 calculates the overlapping state of the graphic 6 from the coordinates and the graphic information and displays the graphic 6 as shown in FIG. In the portable information terminal 4, the liquid crystal boards 1, 2,
The frame 3 may be displayed, or the graphic 6 may be displayed so that the upper and lower overlapping states can be seen. Also, figure 6
If it is not known what the lower figure looks like when overlapping, it is possible to display only the outline of the figure 6 so that the state of the entire overlapping figure can be understood. Also,
In the above description, the liquid crystal boards 1, 2, and 3 are in the overlapping state, but the liquid crystal boards 1, 2, and 3 are arranged in a discrete manner.
The portable information terminal 4 may display the graphics 6 of the plurality of liquid crystal boards 1, 2, and 3.

FIG. 19 shows a plurality of liquid crystal boards 1 and 2 which are arranged with their side surfaces in contact with each other.
This is an example in which a large figure 6 that spans between is displayed. In the method of FIG. 13 or FIG. 14B, since the liquid crystal boards 1 and 2 arranged in the virtual screen 5 are coordinate-managed, if the side surfaces of the liquid crystal boards 1 and 2 are brought into close contact with each other, the liquid crystal boards 1 and 2 shown in FIG. The display format of can be realized. However, as another method, for example, when the liquid crystal board 1 is used as a master device and the liquid crystal board 2 is used as a slave device and closely attached to the liquid crystal board 1, the liquid crystal board 2
Coordinates are managed by the LCD board 1 and extended display data
Data is also sent from the liquid crystal board 1 to the liquid crystal board 2, and FIG.
Can be displayed as. In order to realize this method, if any of the four side surfaces of the liquid crystal boards 1 and 2 comes into contact with the side surfaces of the other liquid crystal boards 1 and 2, data can be exchanged between them as shown in FIG. A sensor 8 composed of a light emitting element 8a and a light receiving element 8b is attached to and the data is transmitted and received by light. The light emitting element 8a and the light receiving element 8b are attached so that there is no gap in the side surface and they are staggered. When the side surfaces come into contact with each other, data is transmitted through the light emitting element 8a and the light receiving element 8b, and communication is performed. If the light emitted from the light emitting element 8a attached to the side surface is made into a code signal that can be identified for each light emitting element,
When the side surfaces of the two liquid crystal boards 1 and 2 are in contact with each other, it is possible to determine how the side surfaces of adjacent ones are displaced and in contact with each other by examining the signal received by the light receiving element 8b.

When a plurality of liquid crystal boards 1 and 2 are brought into contact with each other to display a large graphic 6, one liquid crystal board 1 is used as a master device, the master device manages the entire graphic data, and touches the master device. A graphic is given to another liquid crystal board 2 to expand the graphic. In this case, when the parent device is removed from the group of liquid crystal boards, the same processing as above can be performed by changing another liquid crystal board to the parent device.

Next, an embodiment for establishing a wireless link will be described. As described above, a plurality of liquid crystal boards that need to establish a wireless link are piled up, or each liquid crystal board starts to cooperate with each other by an operation such as a user instructing the liquid crystal board to be used and the order thereof, A wireless link is formed between each liquid crystal board. Here, as shown in FIG. 21, the liquid crystal board 1 for which a wireless link is to be taken is first attached to the portable information terminal device 4 by making the portable information terminal 4 the main device and bringing the liquid crystal board 1 to establish a wireless link. By emitting light from the light emitting element 9a and receiving it by the light receiving element 9b attached to the liquid crystal board 1, the portable terminal 4 and the liquid crystal board 1 are designated as a group.

By wirelessly linking thereafter, a wireless link is constructed between the portable information terminal 4 and the liquid crystal board 1. The liquid crystal board for which a wireless link is desired may be repeated by the same operation as described above. Here, if the light emitted from the light emitting element 9a is weakened so that the data cannot be received unless the light receiving element 9b is brought very close to the light emitting element, the liquid crystal board placed near the portable information terminal 4 will be erroneously detected. It never works. By the way, when the liquid crystal board is arranged on the virtual screen, it is an important element of the present invention to detect the coordinates where the liquid crystal board is placed. FIG. 22 shows an example of a method of detecting the position where the liquid crystal board is placed. LEDs 10 are attached to the four corners of each of the liquid crystal boards 1, 2, and 3 arranged in the virtual screen. First, after starting the system, a link instruction is given by an input operation on the screens of the liquid crystal boards 1, 2, and 3. At this time, among the plurality of liquid crystal boards 1, 2 and 3, which of the liquid crystal boards 1, 2 and 3 is to be in the same group is also instructed by a cooperative group. The reason why there are a plurality of cooperative groups is that there is an advantage that even one mobile information terminal 4 can simultaneously display separate virtual screens in each cooperative group. For example, a liquid crystal board placed on an adjacent desk wirelessly returns a response signal to the liquid crystal boards of the same emphasis group. Response signals are sequentially sent from the control unit to the liquid crystal boards of the same emphasis group. The liquid crystal board that received the response signal is the LED1 in the four corners.
Blink 0 in order. TV camera has LED1
The lighting state of 0 is monitored, and the captured image is sent to the portable information terminal 4. By extracting the lighting position of the LED 10 from the transmitted image, the portable information terminal 4 can know which liquid crystal board the target is currently, which liquid crystal board of the cooperation group. In addition, LED1 of four corners
If the order in which 0s are blinked is determined, the direction in which the liquid crystal board is placed can also be known from the portable information terminal 4. Here, since the television camera 11 overlooks the entire virtual screen from an oblique direction, the liquid crystal boards 1, 2, and 3 are viewed not from the upper surface but from the rotated oblique direction. Therefore, the liquid crystal boards 1, 2, and 3 are set in the virtual screen by using the dimensions of the LEDs 10 attached to the four corners of the liquid crystal boards 1, 2, and 3 as viewed from the upper surface of the liquid crystal boards 1, 2, and 3. Correct the coordinates as seen from the top. Similarly, when the liquid crystal boards 1, 2 and 3 move in the virtual screen thereafter, the portable information terminal 4 manages which coordinate of which liquid crystal board in which cooperation group is located. You can

Next, when a special sheet is laid on the desk on which the liquid crystal board is placed and the liquid crystal board is placed on the sheet,
An example of detecting the coordinates of the placed liquid crystal board will be described. In FIG. 23, a wire-shaped magnetic detection grating 12 having a size corresponding to a virtual screen is stretched in the X-axis and Y-axis directions. The magnetic detection grid 12 can be attached to a soft sheet-like material such as cloth and laid on a desk or the like.
When the liquid crystal board 1 is placed on the magnetic detection grating 12, the magnetism generating element 13 attached to the bottom of the liquid crystal board 1 generates magnetism. The magnetism is converted into an electric signal by the magnetic detection grid 12, an electric signal is generated at the corresponding X coordinate position of the X coordinate detection circuit 14 and the corresponding Y coordinate position of the Y coordinate detection circuit 15, and the coordinate calculation device 16 coordinates. Code data is output as data. The magnetism generated from the magnetism generating element 13 can be differentiated between the liquid crystal boards by forming a code for each liquid crystal board or changing the interval. Further, by attaching two magnetic field generating elements to the bottom of the liquid crystal board, it is possible to detect the orientation of the liquid crystal board with respect to the magnetic detection grid.

FIG. 24 shows an embodiment in which the magnetic detection grating 12 is embedded in a large desk 17 such as a conference desk. In this embodiment, no matter where the liquid crystal board 1 is placed on the desk 17, communication can be performed between the desk 17 and the liquid crystal board 1, and the desk 17 is connected to the portable information terminal 14. Here, when a group meeting is assumed using the liquid crystal board 1, the liquid crystal board 1
There is no need to detect the position of the. It is sufficient to distinguish each liquid crystal board 1 as described above. For example, the same document can be sent from the portable information terminal 4 to all the liquid crystal boards, or the document can be sent to a specific liquid crystal board. Also, the liquid crystal boards can communicate with each other via the portable information terminal 4.

In FIG. 25, a sphere (moving position detecting mechanism 18) that can be driven by a mechanism equivalent to a mouse is attached to the bottom surface of the liquid crystal board 1, and when the liquid crystal board 1 is moved on a flat plate such as a desk, The moving distance can be detected from the rotation direction and rotation angle of the sphere. The moving position detecting mechanism 18 does not need to be attached to all four corners of the liquid crystal board 1. If attached at two points, the direction in which the liquid crystal board 1 is facing can be detected.

FIG. 26 shows an embodiment in which microminiature television cameras (eg CCD cameras) 19 are attached to the four corners of the liquid crystal board 1 to detect the position coordinates of the liquid crystal board 1. A plurality of reference points 20 are placed on a virtual screen or in the vicinity thereof, and a plurality of TV cameras 19 mounted on the liquid crystal board 1
The reference point 20 is photographed, and the reference point 20 is extracted from the video by image processing. The extraction method is
The top of the reference point 20 is lit at a constant cycle. In addition, the contour of the reference point 20 is easily extracted by filling it with a specific color and visually emphasizing it. Then, the coordinates where the liquid crystal board 1 is placed are calculated from the images of the reference points 20 extracted by the plurality of television cameras 19. As a method of calculation, as shown in FIG. 27, the sizes of a, b, and c are measured from a video image of the reference point 20. The liquid crystal board 1 has a table corresponding to the distance from the television camera 19 to the reference point 20 and the combination of a, b, and c corresponding to the angle deviated from the central axis of the television camera 19. Then, the above tables are associated with a, b, and c photographed and measured by the TV camera 19,
When the closest combination of a, b, and c is selected, the distance from the television camera 19 corresponding to the a, b, and c to the reference point 20 and the deviation from the central axis are known. Then, the same processing is performed on the other TV cameras 19 so that the distance from the TV camera 19 and the deviation from the central axis can be known. Here, if the distance from each of the two reference points 20 to each TV camera 19 and the deviation from the central axis of each TV camera 19 are known, the coordinates where the liquid crystal board 1 is placed are calculated from the two reference points 20. It is possible.

FIG. 28 is a block diagram showing a method for measuring the relative distance between two liquid crystal boards with a laser beam.
The transmitter 21a is a laser beam emitting part, and the laser beam is transmitted in the horizontal direction.
It has a structure that can rotate 0 degrees. The signal output from the transmitter 21a contains the digitized angle formed by the sides of the liquid crystal board and the laser beam currently radiated. Further, the receiver 21b has a structure capable of receiving the laser beam transmitted from the transmitter of another liquid crystal board. The receiving portion 21b has a structure in which a plurality of laser beam receiving elements are arranged so as to receive a laser beam coming from 360 degrees in the horizontal direction. Also, the liquid crystal boards 1, 2
Each has its own clock, and the portable information terminal 4
From the same time is set all at once.

When the laser beam is radiated from the transmitter 21a, if the angle information and the transmission start time are included in the signal, other liquid crystal boards that have received the laser beam by the receiver 21b From the time information, the distance between the liquid crystal boards 1 and 2 can be calculated from the difference from the current time, and the mutual coordinates can be calculated from the angle information.

FIG. 29 shows the case where two liquid crystal boards 1 and 2 are arranged so that their side surfaces are in contact with each other.
It describes a method of making 2 consecutive coordinates. In the method shown in the figure, first, the points are pointed on the liquid crystal board 1 near the surfaces contacting each other with a pen (point A). Next, a point (point B) near the side surface on the adjacent liquid crystal board 2 is pointed.
Care must be taken so that points A and B have the same vertical coordinates when pointing. Then, the coordinates of the points A and B are wirelessly sent to the portable information terminal 4. here,
When the distance between the point A and the lower side of the liquid crystal board 1 is A, and the distance between the point B and the lower side of the adjacent liquid crystal board 2 is b, the mutual vertical directions of the liquid crystal boards 1 and 2 are (a -B) It means that they are arranged deviated. If the portable information terminal 4 manages the value of this shift, when the figure is displayed across the two liquid crystal boards 1 and 2, the shift is taken into consideration and the two liquid crystal boards 1 and 2 are considered. Send figure data for coordinates,
It may be displayed on the liquid crystal boards 1 and 2.

FIG. 30 describes a method of detecting a displacement when two liquid crystal boards 1 and 2 are arranged as in the embodiment of FIG. In the method shown in the figure, an arrow is first displayed at a fixed position near the side surface of one liquid crystal board 1. On the adjacent liquid crystal board 2, point the horizontal direction of the arrow (point A). Thereafter, similarly to the above, the portable information terminal 4 sets the distance from the lower side of the liquid crystal board to the arrow as a and the distance to the point A as b, and shifts the two liquid crystal boards 1 and 2 in the vertical direction (a- By managing b) and transmitting the graphic data to the two liquid crystal boards 1 and 2, it is possible to display the graphic that extends between the liquid crystal boards 1 and 2.

Although the above embodiment assumes a system composed of one portable information terminal and a plurality of liquid crystal boards, the elements constituting this system include these portable information terminals and liquid crystal boards. Any combination may be used.

As a method of linking the liquid crystal boards, a method of designating the order relation between the liquid crystal boards by a pointing device can be considered in addition to the method described in the above embodiment.

Further, in the above-described embodiment, when a plurality of liquid crystal boards are linked, the link is realized by generating a group address. However, one of the liquid crystal boards in the linked liquid crystal boards is the master station. Then, a system that realizes cooperation may be used.

Further, in the above-mentioned embodiment, it is assumed that the display is in page units, but it is not necessary to be in page units.

Furthermore, the identifier for protecting the original information may remain as a history without being erased or rewritten during editing.

Furthermore, not only the case of an information file transferred from another information terminal device but also the case of a file created by itself may be handled in the same manner.

Next, another embodiment of the present invention will be described. FIG. 31 is a diagram showing the configuration of the video conference system according to this embodiment.

As shown in FIG. 31, a speaker 23, a microphone 24, and a television camera 25 are attached to the monitor 22, and only face images of conference participants are displayed. The plurality of liquid crystal boards 1, 2 and 3 are used for handouts or handouts needed for a conference and a freely writable white board. Further, the scanner 26 reads the contents of the handout materials and handout materials required for the conference from the paper state and converts them into data usable as a system. The liquid crystal boards 1, 2, 3 and the monitor 22 are wirelessly linked, and data can be exchanged bidirectionally between the liquid crystal boards 1, 2, 3 and the monitor 22.

FIG. 32 shows the monitor 22 as the liquid crystal board 1.
This is a configuration in which the portable information terminal 4 having the same structure as those of 2 and 3 is replaced. However, the portable information terminal 4 has a CCD camera 2
7, a microphone 28, and a speaker 29 are attached. When the user activates the system, the portable information terminal 4 and the plurality of liquid crystal boards 1, 2, and 3 are instructed by the user on the screen. Cooperation starts and a wireless link is configured.
After the wireless link is established, the cooperation can be continued even if the liquid crystal boards 1, 2, 3 are separated from the portable information terminal 4.

In FIG. 33, the area of the portable information terminal 4 is wide,
An example is shown in which when the liquid crystal boards 1, 2, 3, 3a are placed on the surface, the screens of the liquid crystal boards 1, 2, 3, 3a are directly transferred to the screen of the portable information terminal 4.

In this way, when the liquid crystal boards 1, 2, 3, 3a are placed on the portable information terminal 4, the liquid crystal boards 1, 2, 3,
FIG. 34 shows a method for detecting the coordinates where 3a is placed.

As shown in FIG. 34, projections 30 are attached to the back side of the liquid crystal board 1 at four corners. A micro switch 31 is attached to the tip of one protrusion 30. When the liquid crystal board 1 is placed on the portable information terminal 4, the protrusion 30 of the liquid crystal board 1 pushes the pressure detection sensor 32 of the portable information terminal 4. The pressure detection sensor 32 has X-axis and Y-axis.
Since they are spread in the axial direction, the coordinates are output to both the X-axis coordinate detecting device 33 and the Y-axis coordinate detecting device 34. On the other hand, when the micro switch 31 of the liquid crystal board 1 is pressed, the screen data of the liquid crystal board 1 is wirelessly sent to the portable information terminal 4. The portable information terminal 4 receives screen data from the liquid crystal board 1 and displays the data at the detected coordinates. As an application of this embodiment, when a group theme study meeting is conducted by the KJ method or the like, each person in charge is given the liquid crystal board 1, his or her own idea is entered on the liquid crystal board 1, and the liquid crystal board 1 When is applied to an appropriate place of the portable information terminal 4, the content is transferred to the portable information terminal 4. That is, the same effect as the method of sticking a memo paper on a large paper can be expected. The content pasted on the portable information terminal 4 can be selected later by enclosing the portion with a light pen or the like and moved to another portion, and can be organized by item. Also, if a classification number or the like is added to the above contents, it is possible to search later and automatically rearrange the items. In FIG. 35, the portable information terminal 4 is used as a parent computer, a plurality of liquid crystal boards 1, 2 and 3 are used as child computers, and each liquid crystal board 1, 2 and 3 is independently executed for each application such as a computer, word processor and graphic. This is an example of the above. The execution results of the liquid crystal boards 1, 2, 3 can be sent to the portable information terminal 4, and the results sent from the portable information terminal 4 can be compiled to create a report document or the like. Generally, in such applications, a similar effect can be expected in a multi-window system. Since the multi-window system has only one screen, when a plurality of windows are displayed, they overlap each other and become difficult to see. In some cases, the screen may need to be shortened. On the other hand, in the present embodiment, one screen can be completely occupied by one application, and the liquid crystal boards 1, 2,
You can pick up 3 and see it, and the operability will be much better. If the desks are occupied by the liquid crystal boards 1, 2, and 3 when the plurality of liquid crystal boards 1, 2, and 3 are lined up on the desk, the plurality of liquid crystal boards 1, 2, and 3 are placed on top of each other. The required liquid crystal boards 1, 2, and 3 may be placed at the top.

FIG. 36 shows an example in which a plurality of liquid crystal boards 1, 2, and 3 are classified and stored for each information attribute. In a general multi-window system, it is difficult to understand because different kinds of information are mixedly displayed on one screen, but if they are displayed separately for each liquid crystal board as in this embodiment, they are displayed on the screen in a very easy-to-see manner. Corrections to information are easier to understand and fewer mistakes are made.

FIG. 37 shows the liquid crystal board 1 for each conference participant.
This is an example in which 2 and 3 are assigned. That is, the sound of each participant is output from the speaker 37 of the assigned liquid crystal boards 1, 2, and 3, and the face image or the icon for identifying the conference participant is displayed on the corresponding liquid crystal boards 1, 2, and 3. The materials distributed by the participant are also displayed on the corresponding liquid crystal boards 1, 2, and 3. In the present embodiment, the distribution materials and face images are mixedly displayed on one liquid crystal board 1, 2 and 3, and the voices of the conference participants are also added as a whole, so that who speaks at the ongoing conference. This has the effect of clarifying which material is being watched.

Further, when the speeches of the conference participants do not change swiftly and the speech of one person is relatively long, as shown in FIG. 38, one liquid crystal board 1 is substituted, and the screen changeover switch 38 is used to participate in each conference. The handouts such as the person's voice and facial image may be switched.

Conventionally, the distributed materials of the conference participants and their own materials are read by a scanner, converted into image data and displayed on a portable information terminal or the like. Generally, it is troublesome and troublesome to read the paper-based materials one by one with a scanner. Therefore, as shown in FIG. 39, the documents 40 arranged on the desk may be photographed by the television camera 39, and the content of each document may be extracted from the photographed image by image processing. However, if the data is read as it is, there is a spatial distortion as shown in FIG. Spatial distortion cannot be uniformly processed depending on the mounting direction of the TV camera and the distance between the document and the TV camera. Therefore, in this embodiment, as shown in FIG. 41, the size of the paper used as the distribution material is fixed. For example, all handouts will be A4. Then, the paper portion is cut out from the photographing data as shown in FIG. As a cutting method, the brightness of the surface of the desk and the blank portions at the top, bottom, left and right of the sheet shown in FIG. 41 are used for the cutting. That is, the boundary of the leading edge of the paper can be determined by extracting the difference between the brightness of the desk and the brightness of the blank portion. Since the image data of the extracted document has a spatial distortion, it is necessary to correct this distortion. Therefore, since the paper sizes are unified and the paper size is known in advance, linear correction is applied to the distorted data by using the vertical and horizontal dimensions of the paper. At the time of this correction, vertical and horizontal processing, rotation, etc. are performed to reproduce the actual data on the paper as shown in FIG. When the papers are placed on top of each other, the contents of the uppermost paper are read by the same process as described above. In addition, when a document is photographed, when new writing is added to the document, the contents of the writing, the writing instrument, the image of the hand are taken at any time, and the writing is finished and the image of the writing instrument and the hand is recorded. When it disappears, it will be registered as a new document content. By performing the above-described processing, the contents of the documents arranged on the desk can be sequentially read, and the contents can be read even if the documents are changed, so that the portable information terminal 4 in FIG. By displaying the video of the handouts read in the above, a conference using ordinary paper is realized.

FIG. 43 shows the face image of the relevant conference participant displayed on the portable information terminal 4 and the icon for identifying the conference participant when the distribution material read by the scanner 26 is distributed to the conference participants. An example is shown in which the light pen 41 is automatically distributed by clicking.

FIG. 44 shows the face image of the conference participant displayed on the portable information terminal or the icon for identifying the conference participant and the materials used for the conference, of the conference participant currently pointing to the material. An example is shown in which a face image or the like is displayed by being emphasized or changed in color so as to be distinguished from the face images or the like of other conference participants, and the participant and the point area are clearly associated. The information is also displayed on other portable information terminals 4 including the own portable information terminal 4. When the conference participant encloses the area pointed to the material with the light pen 41 or the like, the pointed area is emphasized in the same manner as the emphasizing method of the face image or the like.

Further, as shown in FIG. 45, the face image or the like may be moved close to the pointed area.

Further, as shown in FIG. 46, a plurality of conference participants may point the material at the same time. In this case, a plurality of emphasizing methods are applied in order to distinguish which position in the material is pointed out for each participant. For example, the material which points to the face image of the participant B is colored in red, and those of the participant D are colored in blue. Further, in the case where a plurality of participant points are given, it may be applied to the embodiment shown in FIG. That is, the face images and the like of the participants who have designated those regions may be displayed below the plurality of point designated regions in different colors from the other point regions and face images and the like.

FIG. 47 shows an example in which liquid crystal boards are assigned according to their uses. The folder board 1 is intended to store handouts or handouts. When the user points the necessary material in the folder board 1 and then points the screen of the display board 2, the corresponding material in the folder board 1 moves to the display board 2 and is displayed. The folder board 1 for storing documents can be placed on a desk, the display board 2 can be held by hand, and the contents can be watched in front of the eyes. The division of roles between the folder board 1 and the display board 2 is clear, and operability is improved. Then, when it is no longer necessary, the relevant material can be returned to the original position from the display board 2 to the folder board 1. Further, the relevant material can be left on the folder board 1 and a copy can be displayed on the display board 2. With the folder board 1 alone, the necessary materials can be moved to the front and viewed as in the case of a general multi-window system display. However, if the inner material is moved to the front, the order of the material may be lost later, and it is troublesome to return to the original order. If only the necessary materials are moved to the display board 2 as in this embodiment,
The order of the materials on the folder board 1 is less likely to change. Further, when another conference participant accesses a document on the folder board 1 during the conference, the document can be automatically moved from the folder board 1 to the display board 2. The white board 3 is used as a memo board at hand or a board in which conference participants can write in common. If the user does not want to show it to other participants as a memo of only his / her own, the written contents can be made invisible to other conference participants.

When each participant freely writes on the board commonly written by the conference participants, the content to be written gradually increases, and the content written by oneself cannot be distinguished from the content written by other participants. There is a possibility that it will end up. Therefore, as shown in FIG. 48, the user's own handwriting is emphasized, the color is changed, or the dotted line is used to distinguish it from the contents written by other participants.

By the way, in the video conference system shown in FIG. 32, when a conference participant sees the face image of another participant displayed on the portable information terminal 4 and an icon for identifying the participant, , If you automatically make the participant's face image etc. that you are gazing clearer than the other participants' face images (increasing the contrast or changing the color), the face image etc. will be displayed for a long time. Even if you look at it, it has the effect of reducing eye fatigue. FIG. 49 shows an embodiment in which the user is paying attention to the facial image of A or the like, and the facial image of A or the like is emphasized over the facial images B, C and D of the other participants. In order to realize this embodiment, it is necessary to detect which participant's face image or the like the user is gazing at. C as an implementation method
It suffices to take a picture of the face of the user with the CD camera 27 and detect from which image the direction of the eyeball of the user is facing.
The following techniques are known as detection methods.

(1) The horizontal rotation angle of the face is calculated from the left and right edges of the face and the center positions of the inner and outer canthus.

(2) From the angle formed by the line segment connecting the outer corners of the eyes (both inner canthus) and the line segment connecting the midpoints of both inner corners of the eyes and the midpoint of the lips, and the horizontal rotation angle of the face obtained in (1) , Find the tilt angle.

(3) The depth of the outer corner of the eye is obtained by setting the straight line connecting the midpoints of the straight lines connecting the outer corners of the eyes from the center of the ellipse of the face section to the front of the face.

(4) Find the center of the eyeball on the screen.

(5) The size of the eyeball is obtained from the position of the inner corner of the eye and the depth of the outer corner of the eye obtained in (3). At this time, it is assumed that the diameter of the eyeball is equal to the distance between the inner and outer corners of the eye.

(6) The center position of the eyeball is obtained from the fact that the horizontal section of the face and the section of the eyeball have the same distortion.

(7) The edge of the iris is found and the center direction of the iris is found by circle approximation.

Regarding the distance between the portable information terminal 4 and the user, the size of the image of the user is stored in advance on the portable information terminal 4 side when they are separated by the reference distance. Then, the size of the image of the user can be calculated from the captured image.
With such a procedure, the rotation angle of the face, the tilt angle, the rotation angle of the eyes, and the distance can be known. On the other hand, if compared with the split screen layout information such as the face image of the participant displayed on the portable information terminal 4, the user can Since it is possible to know which participant is paying attention, the image of the participant can be emphasized.

For details of the above technology, see, for example, the 40th National Information Processing Society of Japan (first half of 1990) National Convention "Gaze detection method from image of face on a slant" (Hiro Aoyama, Masahiro Kawagoe Electrotechnical Laboratory) ) Is disclosed.

In a conference system in which a set of portable information terminals and a plurality of liquid crystal boards are combined, when other participants point the handouts in the process of proceeding the conference,
The position of the pointed material is reflected on the liquid crystal board of the user. However, when the number of liquid crystal boards increases, it becomes difficult to know which liquid crystal board is being pointed to.
In particular, if the display portion pointed to is small, it becomes more difficult for the user to find the point position. Therefore, as shown in FIG. 50, the liquid crystal board (C) that is the target of the points
By blinking the entire display or changing the display color of the entire display, the user can immediately gaze at the target liquid crystal board. If you know the target LCD board, you can find the point position relatively easily.

Further, the pointed folder may be emphasized instead of emphasizing the entire screen as shown in FIG.

In the process of advancing the video conference, it becomes necessary to talk with other participants in secret. In addition, there are times when you do not want to tell the contents of the secret story to anyone other than yourself, and sometimes you want to consciously tell the other participants. Therefore, FIG.
As shown in 2, the secret information secret icon to the mobile information terminal 4 and the "secret information disclosure" icon to let other participants hear the secret information and participation It is composed of the face image of the person or an icon that can identify the participant. Here, since the meeting is performed by four people and the facial images of the user are omitted, the facial images of B, C, D (the user is A) are displayed on the portable information terminal 1 of the user. There is. Here, in the case of a normal conference, as shown in FIG. 53, the voice uttered by each participant is captured by the microphones MC-A to MC-D of each portable information terminal 4, added by the ADD circuit 42, and added to each portable. Speakers SP-A to SP of the type information terminal 4
Output simultaneously with -D. If the user wants to keep a secret during a meeting, the user first asks "private secret".
Light pen 4
Click with 1, and then click with the light pen 41 the face image or the like of the person you want to keep secret. In this embodiment, the other party is B. When the “secret information disclosure” icon is clicked, the SW of the circuit shown in FIG. 54 is connected to b. The voices of the user A and the secretive partner B are captured by MC-A and MC-B, added by ADD1, and input to OR1 and OR2. On the other hand, the voices of the participants C and D are added by ADD2 and O
Input to R2. Attenuator A is the output of ADD2
Input to OR1 through T1. The voice that passed through OR1 is S
It is output from the PA and SP-B speakers. Meanwhile OR
The sound passing through 2 is output from the SP-C and SP-D speakers. That is, the voice of the person other than the person who is secretly speaking is reduced by the attenuator of AT1 and output from the speakers A and B, or the voice of the person other than the person is prohibited. Then, the voices A and B are output to other participants including themselves without being attenuated. And the voice of the people who are secretly talking can be heard between the people at a normal volume,
Other participants' voices may be heard quietly or may be prohibited. Then, the sound of the secret story can be heard by participants other than the person concerned at a normal volume, so that the contents of the secret story can be understood.

On the other hand, when the "secret information is not disclosed" icon is clicked with the light pen 41, SW is connected to a in FIG. The operation in this case is almost the same as the above, but since the voices of the participants A and B pass through the AT2, the participant C
The sound is attenuated from the D speaker. That is, since the voices of the persons who are giving the secrets can be heard by other participants as a small voice, the contents cannot be discriminated and the secrets are not disclosed. When you start a video signal between remote places, you can't understand the busyness of the other party, so
There is a possibility that the communication may start and you may disturb the other party without considering the other party's convenience. Therefore, it is a good idea to get the other person's consent by telling the other person the strength of your will to talk to. In FIG. 55, the communication partner (A, B, C, D) is selected from the display screen of the person. Then, the strength of the will to speak is selected from "strong", "normal", and "weak". Further, in the above description, the face image is limited to identify the person. However, an icon or the like that can identify the person may be displayed. By the above operation, the face image of the person is displayed on the display screen of the other person. Depending on the strength of the person's willingness to talk, facial images etc.
The size changes, and the strength of one's will can be visually recognized.
From the displayed screen, the other party decides whether to communicate by judging from the will of the person concerned and his / her busyness. If the other party permits this communication, the other party's face image is displayed on the screen of the person and mutual image communication is started.

When the video conference spreads in general offices, there is a possibility that the conference will be called frequently.
Therefore, it becomes necessary to select whether to attend the conference based on my current work. However, it may not be possible to refuse to attend the meeting by the convener of the meeting. Therefore, the purpose of this embodiment is to automatically determine the attendance of a meeting and notify the convener when a meeting is called from the schedule table shown in FIG. 56 and the attendance judgment table shown in FIG. 57. To do. FIG.
The schedule table shown in 6 is an example in which a daily schedule is set in units of 2 hours. Enter the degree of work busyness every two hours before starting work in the morning. If you already have a meeting, enter the meeting invitees. In this case, 0 and a fixed value are input for the degree of busyness. In addition, if a video conference is called on this day, information to determine whether or not to send the handouts used in the conference and the meeting results after the conference to your mobile information terminal in advance every two hours. Enter in the schedule separated by. On the other hand, in the attendance determination table, regardless of the daily schedule, as shown in FIG. 57, the convener of the meeting is listed in advance, and a reference value for determining attendance is set for the other party. For example, if the criterion is 3, attend unconditionally. Remarks 1 and 2 are examples in which a meeting was convened by the manager and section manager of the boss. In addition, when the person is not a special convener, the judgment criterion is set to 2 and the judgment is made based on the degree of busyness in the schedule. In the example of FIG. 57, if the busyness is 3 or less, attendance,
If you are 4 or more, you are absent. If the criterion is 1, he / she is unconditionally absent. Further, when the judgment criterion is 0, the attendance is unconditional because the meeting was scheduled according to the schedule as described above. The attendance judgment table can add meeting conveners and can change the judgment criteria freely. When a meeting is convened irregularly, it is automatically displayed as a meeting invitation mail on the portable information terminal as shown in FIG. 58 using the schedule table and attendance determination table. Example 1
This is an example in which it was decided that the meeting was attended, but the result of the meeting with the handouts was not particularly necessary. Example 2 is an example in which it is determined that the distribution material and the meeting result should be sent. If the meeting is judged to be attended, the convener is immediately notified and the meeting is started. Further, when the distribution materials and the result of the meeting are input as “Judge each time” in the schedule table, after the conference convocation mail is displayed, whether or not those materials are necessary is input from the portable information terminal. If it is determined that you are absent from the meeting requested to convene, the absent meeting convocation mail will be displayed,
The collector will be notified of the absence.

[0115]

As described above, according to the present invention,
Since information files over a plurality of pages are displayed on a plurality of liquid crystal boards, comparison between pages is easy to perform. Basically, since the display is not reduced in units of one page, editing for each page is easy. Further, even for a large information file that cannot be displayed on one liquid crystal board, a virtual screen of the information file is set, and the contents of information corresponding to the arrangement position are partially displayed on the liquid crystal board arranged in the virtual screen. be able to.

Further, it is possible to freely divide and display materials or face images on a plurality of liquid crystal boards and view the contents by holding the liquid crystal boards by hand. The effect is similar to that of a conference using paper. Can be expected. In other words, the conventional video conference system displays the face images of the participants and the materials used in the conference on the same monitor, so the display area becomes insufficient, and some face images may be deleted or reduced in size. are doing. Further, when there are a plurality of materials, the materials are displayed in a multi-window method, so that there is a drawback that the materials overlap and the lower material is hidden and invisible. The present invention can eliminate these drawbacks.

[Brief description of drawings]

FIG. 1 is a diagram showing that each liquid crystal board according to an embodiment of the present invention cooperates to receive one information file for each page.

FIG. 2 is a diagram showing that information is transferred from a liquid crystal board to a portable information terminal according to an embodiment of the present invention.

FIG. 3 is a diagram showing an example of displaying a plurality of pages on a liquid crystal board according to an embodiment of the present invention.

FIG. 4 is a diagram showing an example in which only one page is displayed on a liquid crystal board according to an embodiment of the present invention.

FIG. 5 is a diagram showing an example in which a liquid crystal board according to an embodiment of the present invention is added and the display is returned to each page.

FIG. 6 is a diagram showing an example in which a liquid crystal board according to an embodiment of the present invention is moved to display an undisplayed page.

FIG. 7 is a diagram showing that page scrolling can be performed while a plurality of liquid crystal boards according to an embodiment of the present invention are stacked.

FIG. 8 is a diagram showing that an information file according to an embodiment of the present invention can be edited page by page.

FIG. 9 is a diagram illustrating that when a plurality of liquid crystal boards according to an embodiment of the present invention are stacked, display is not performed on the liquid crystal boards other than the uppermost liquid crystal board.

FIG. 10 is a diagram showing that an owner ID is added to an information file according to an embodiment of the present invention to protect original information.

FIG. 11 is a diagram showing an example of history information of an information file transfer destination according to an embodiment of the present invention.

FIG. 12 is a diagram showing an example in which information in a liquid crystal board according to an embodiment of the present invention is automatically updated.

FIG. 13 is a diagram showing that a graphic in a virtual screen according to an embodiment of the present invention is displayed on a plurality of liquid crystal boards arranged in the screen.

FIG. 14 is a view showing that discrete figures are arranged in a virtual screen and the figures are displayed on a liquid crystal board according to an embodiment of the present invention.

FIG. 15 is a diagram showing a change in a graphic displayed on a liquid crystal board when the liquid crystal board is moved within a virtual screen according to an embodiment of the present invention.

16 is a diagram showing a state in which the target graphic in FIG. 15 is actually arranged in the virtual screen.

FIG. 17 is a diagram showing a state in which liquid crystal boards according to an embodiment of the present invention are stacked and arranged.

FIG. 18 is a diagram showing a state in which the liquid crystal boards according to an embodiment of the present invention are displayed on the information terminal device in an overlapping state.

FIG. 19 is a diagram showing a state in which two liquid crystal boards according to an embodiment of the present invention are arranged in close contact with each other and graphics are continuously displayed over the two liquid crystal boards.

FIG. 20 is a diagram showing a state of a light emitting element and a light receiving element attached to a side surface of a liquid crystal board for the purpose of transmitting and receiving data through a plurality of liquid crystal boards according to an embodiment of the present invention.

FIG. 21 is a diagram showing a state in which a portable information terminal and a liquid crystal board according to an embodiment of the present invention are linked using light and radio waves.

FIG. 22 is a diagram showing a state in which a liquid crystal board arranged on a virtual screen according to an embodiment of the present invention is being photographed by a television camera.

FIG. 23 is a diagram showing a state in which a liquid crystal board having a magnetic field generating element attached is placed on an underlay in which a magnetic detection grating is formed into a sheet shape in the X-axis and Y-axis directions according to an embodiment of the present invention.

FIG. 24 is a diagram showing a state in which a magnetic detection grating according to an embodiment of the present invention is laid on the entire desk and a liquid crystal board is placed on the desk.

FIG. 25 is a diagram showing a structure in which a sphere is attached to the bottom of a liquid crystal board according to an embodiment of the present invention to detect a moving position of the liquid crystal board.

FIG. 26 is a diagram showing a state in which the positional relationship between the reference point and the liquid crystal board is measured using the television camera mounted on the liquid crystal board according to the embodiment of the present invention.

FIG. 27 is a diagram showing a distance relationship between a reference point photographed by a television camera and a photographing region according to an embodiment of the present invention.

FIG. 28 shows a state in which a laser beam transmitting unit and a laser beam receiving unit are attached to a liquid crystal board according to an embodiment of the present invention, and a laser beam is exchanged with another liquid crystal board to measure a mutual positional relationship. FIG.

FIG. 29 is a diagram showing positions of points where continuous graphics are displayed across a liquid crystal board in close contact with one another according to an embodiment of the present invention, and an instruction is given from the screen for continuous display.

FIG. 30 is a diagram showing a position of a point where continuous graphics are displayed across a liquid crystal board in close contact with one another according to one embodiment of the present invention and only one screen is used for continuous display.

FIG. 31 is a diagram showing a configuration example of a video conference system according to an embodiment of the present invention.

FIG. 32 is a diagram showing an example in which the monitor part of the video conference system in the above figure according to an embodiment of the present invention is changed to a portable information terminal.

FIG. 33 is a conceptual diagram illustrating a state in which the display content of the liquid crystal board is transferred to the portable information terminal by stacking the liquid crystal board on the large portable information terminal according to the embodiment of the present invention.

FIG. 34 is a diagram for explaining a mechanism for detecting the weighted coordinates of the liquid crystal board when the liquid crystal board is placed on the portable information terminal according to the embodiment of the present invention.

FIG. 35 is a diagram showing an example in which a plurality of liquid crystal boards according to an embodiment of the present invention are divided and stored for each application attribute.

FIG. 36 is a diagram showing an example in which a plurality of liquid crystal boards according to an embodiment of the present invention are divided and stored for each attribute of a database.

FIG. 37 is a diagram showing an example in which face image display, audio output, and material display are associated with one liquid crystal board for each conference participant according to an embodiment of the present invention.

38 is a diagram showing an example in which the liquid crystal board divided for each conference participant in FIG. 37 is used by being switched by one liquid crystal board with a changeover switch.

FIG. 39 is a diagram showing a configuration required for capturing a document randomly arranged on a desk according to an embodiment of the present invention with a television camera and taking image data into a portable information terminal.

FIG. 40 is a diagram showing a display example of image data taken in by the system of FIG. 39.

FIG. 41 is a diagram showing a display example of pixel data when a photographed document according to an embodiment of the present invention is not corrected.

FIG. 42 is a diagram showing an example in which the image data taken in FIG. 41 is corrected to be converted into regular image data.

FIG. 43 is a diagram showing an example of designating a distribution destination of image data of a document imported from a scanner according to an embodiment of the present invention from a face image of a portable information terminal.

FIG. 44 is a diagram showing an example in which the area displayed on the document displayed on the portable information terminal according to the embodiment of the present invention is highlighted and the face image of the person in charge who points is displayed.

FIG. 45 is a diagram showing a modification of the embodiment shown in FIG. 44.

FIG. 46 is a diagram showing a modification of the embodiment shown in FIG. 44.

FIG. 47 is a diagram showing an example in which a liquid crystal board according to an embodiment of the present invention is shared and used as a folder board, a display board, and a white board.

FIG. 48 is a diagram for distinguishing the information file displayed on the portable information terminal according to the embodiment of the present invention from the content written by the operator.

FIG. 49 is a diagram showing an example of emphasizing and displaying a face image focused on by the operator on the portable information terminal according to the embodiment of the present invention.

FIG. 50 is a diagram showing an example in which a liquid crystal board that has been accessed for point designation among a plurality of liquid crystal boards according to an embodiment of the present invention is displayed with the entire board highlighted prior to the access.

51 is a diagram showing a modification of the embodiment shown in FIG. 50.

FIG. 52 is a display example of a screen of a portable information terminal for realizing a secret talk between conference participants when a video conference is executed using the portable information terminal according to the embodiment of the present invention. Shows.

FIG. 53 is a diagram showing an example of a circuit for adding a voice input from a microphone when a conference participant has a normal conference according to an embodiment of the present invention.

FIG. 54 is a diagram showing an example of a circuit for adding voices input from microphones to realize a secret talk between conference participants according to an embodiment of the present invention.

[Fig. 55] Fig. 55 is a diagram illustrating a method of transmitting a person's will to speak to a partner when communication is performed using the portable information terminal according to the embodiment of the present invention.

FIG. 56 is a diagram showing a table for determining attendance for a conference according to the busyness of the conference and the convener of the conference according to the embodiment of the present invention.

FIG. 57 is a diagram showing a table for determining busyness of a video conference according to an embodiment of the present invention and attendance at the conference depending on a convener of the conference.

FIG. 58 is a diagram showing a table for determining busyness of a video conference according to an embodiment of the present invention and attendance at the conference depending on a convener of the conference.

[Explanation of symbols]

 1, 2, 3 ...... Liquid crystal board 4 ...... Portable information terminal

─────────────────────────────────────────────────── ─── Continuation of the front page (51) Int.Cl. ⁶ Identification code Internal reference number FI Technical display location H04L 12/18 H04N 7/15 H04N 7/15 9466-5K H04L 11/18

Claims (37)

[Claims] 1. An information terminal device having at least one of a means for displaying an information file consisting of at least one of character information, graphic information and image information, or a means for inputting and editing the information file, A communication means for transmitting and receiving an information file and control information, and means for cooperating with another information terminal device using this communication terminal are provided, and at least one of the information files is linked with another An information terminal device, wherein the information terminal device is divided and displayed with the information terminal device. 2. A unit for recognizing a cooperation state in a plurality of information terminal devices with which each information terminal device cooperates, which part of at least one information file should be displayed by each information terminal device. The information terminal device according to claim 1, wherein 3. The information terminal device according to claim 1, wherein the communication means comprises means for establishing a wireless link with another information terminal device. 4. The information terminal device according to claim 1, further comprising means for restricting information transfer from another information terminal device. 5. A means for determining the capacity of an information file displayable in the information terminal device, wherein the information file to be transferred or being transferred exceeds the displayable capacity in the information terminal device. The information terminal device according to claim 1, wherein the information file is reduced in size and displayed, or a part of the information file is not displayed. 6. Information that can be displayed in a plurality of linked information terminal devices after the addition, comprising means for adding another information terminal device to the cooperation while the information terminal devices are linked The information terminal device according to claim 1, wherein the capacity of the file is determined again, and the display method in the information terminal device is changed based on the determination. 7. The information terminal device comprises means for changing a cooperation state between the information terminal devices while the information terminal devices are in cooperation with each other, and when the cooperation state is changed, the cooperation state is judged again, and each information terminal device is re-determined. The information terminal device according to claim 1, wherein the contents displayed in the information terminal device are changed. 8. The content of the information file can be scrolled by using the input buffer and the output buffer in the state that the input terminal and the output buffer are provided and the information terminal device cooperates. Information terminal equipment. 9. An information file to be handled in the information terminal device or a means for selecting and transmitting a part of the information file to another information terminal device, and an information file or an information file received from another information terminal device. 2. The information terminal device according to claim 1, further comprising means for editing a section, wherein information is transferred in arbitrary units and can be edited in arbitrary units. 10. Each information terminal device is provided with means for detecting that the user is using it, and means for activating / deactivating the information display function and the information editing function, which are used by the user. The information terminal device according to claim 1, wherein information display and information editing are possible only for the existing information terminal device. 11. When an information file is created or edited in the information terminal device, the information file is provided with a means for giving an identifier of the information terminal device or an identifier of a creator or an editor to the information file. The information terminal device according to claim 1, wherein the identifier is erased or changed when is added. 12. A means for, when an information file is correctly transmitted from an information terminal device to another information terminal device, leaving terminal attribute information of the information terminal device that received the information file as a history in the transmitting side information terminal device. The information terminal device according to claim 1, further comprising: 13. A means for transferring the updated information file from the transmitting side information terminal device to the receiving side information terminal device again when the information file transferred from the information terminal device to another information terminal device is changed. The information terminal device according to claim 1, further comprising: and capable of updating information in the receiving side information terminal device. 14. When an information file is created or edited in an information terminal device, a screen managed by the information file is set as a virtual display screen, and at least one linked screen arranged in the display screen is set. 2. The information terminal device according to claim 1, further comprising means for displaying the contents of the information file corresponding to the arrangement coordinates on the display screen of the information terminal device on the linked information terminal device. 15. At least one information terminal device arranged in the virtual display screen comprises means for enabling / disabling the coordinate detection function of the virtual display screen, and the information terminal device is provided with the virtual display screen. The information terminal device according to claim 1, wherein the relative coordinates of the virtual display screen and the information terminal device are changed when moving inside. 16. A means for displaying the information file created or edited in the first information terminal device in cooperation with the second information terminal device including the arrangement information of the information terminal device,
The information terminal device according to claim 1, wherein a layout relationship is displayed as the content of each information file. 17. When the side surface of the first information terminal device and the side surface of the second information terminal device are arranged in close contact with each other, the first information terminal device to the second information terminal device passes through these side faces. 2. The information terminal device according to claim 1, further comprising means for transmitting an information file and displaying a continuous graphic across the first and second information terminal devices. 18. The information terminal device according to claim 1, further comprising optical communication means for designating a group forming a wireless link in each information terminal device. 19. A means for recognizing the arrangement relationship of the information terminal device by photographing the first information terminal device with a television camera and image-processing the photographed image, and classifying the arrangement relation into a plurality of groups. And at least one of a plurality of groups wirelessly with the second information terminal device.
The information terminal device according to claim 1, wherein a link is established with one group. 20. The information terminal device comprises means for generating magnetism from the bottom surface and means for detecting the magnetism, and measures the coordinates at which the information terminal device is placed. Information terminal equipment. 21. An information terminal device is provided with means for detecting a moving distance and a moving direction, and means for measuring coordinates of the information terminal device arranged in a virtual screen. Information terminal device described. 22. Installation of the information terminal device, comprising: a television camera; and means for measuring a distance and a direction from the television camera by performing image processing on a video image captured by the television camera and extracting a landmark point. The information terminal device according to claim 1, wherein the position is measured. 23. A laser transmitting mechanism and a laser receiving mechanism are provided in at least two or more information terminal devices, and means for measuring relative coordinates by communicating with each other using the laser transmitting mechanism and the laser receiving mechanism. The information terminal device according to claim 1, wherein the arrangement coordinates of the information terminal device in the virtual screen are measured. 24. When the information terminal device is placed on the display screen of another second information terminal device, a means for transferring the display screen of the information terminal device to the second information terminal device is provided. The information terminal device according to claim 1, which is characterized in that. 25. The information terminal device according to claim 1, further comprising means for dividing and executing and displaying for each of the plurality of information terminal devices for each attribute of application or data. 26. Correspondence between the information terminal device and the user by providing the information terminal device with means for displaying a face image of the user or an icon and material for identifying the user, and means for outputting the user's voice. The information terminal device according to claim 1, wherein the information terminal device is attached. 27. A television camera for photographing a flatly arranged document, a means for converting the photographed document into image data, and a background portion is deleted by performing image processing on the image data to individually remove the image data. 2. The apparatus according to claim 1, further comprising means for extracting the document data of the document and means for reproducing the document data by applying a spatial correction to the document data using a known dimension of the document. Information terminal equipment. 28. A scanner, a means for converting a document read from the scanner into an information file, a means for displaying an image representing a transfer destination of the information file, and the image on the screen of the information terminal device. The information terminal device according to claim 1, further comprising means for transferring the information file to another information terminal device corresponding to the transfer destination by designating. 29. A means for designating a point area for an information file, and a means for sharing and displaying an information file, a face area or an icon for identifying the point area and the point designator on an associated information terminal device. When,
The information terminal device according to claim 1, further comprising: a unit that modifies / changes a display style of the point area and the face image or the icon in accordance with the point designator. 30. A part of the information file to be displayed on the first information terminal device is designated or specified on the screen of the first information terminal device, and is transferred or copied and transferred to the second information terminal device. And a means for displaying the information file from the second information terminal device back to the first information terminal device in the original order of the information file in the first information terminal device. The information terminal device according to claim 1. 31. The information terminal according to claim 1, further comprising means for modifying / modifying the display content of the displayed information file and the style of the display content of the information file input by directly writing on the screen. apparatus. 32. A television camera, means for displaying a face image or an icon for identifying the person, means for photographing the face of the operator of the information terminal device with the television camera to detect the eyeball direction, and the eyeball. The information terminal device according to claim 1, further comprising means for displaying the face image or icon whose direction is focused on by modifying / changing a style from another face image or icon. 33. When the information terminal device gives a point instruction on the display, a means for emphasizing the entire screen of the information terminal device or the information file to which the point instruction is given is provided. Information terminal equipment. 34. Means for holding a conference by sharing and outputting voice input from a plurality of information terminal devices to the information terminal devices; and two first information terminal devices of the information terminal devices. When a conference is held by sharing voice output to a second information terminal device other than the first information terminal device, the shared voice is attenuated or prohibited and output to the first information terminal device. However, a means for performing conversation only with the first information terminal device and outputting the conversation voice to the first information terminal device, and a means for outputting the conversation voice output from the first information terminal device to the second information terminal device. The information terminal device according to claim 1, further comprising: a unit that adds to the shared voice and outputs or prohibits the shared voice. 35. A plurality of classes are provided for the urgency importance prior to communication from the first information terminal device to another second information terminal device, and the set class is set from the first information terminal device. 2. The apparatus according to claim 1, further comprising: an input unit; and a unit for displaying the communication request on a second information terminal device and modifying / changing the display style according to the classification. Information terminal equipment. 36. Means for holding a conference by using a first information terminal device for convening a conference and another second information terminal device for convening, and the second information terminal device is a convener and a priority. 2. The information terminal according to claim 1, further comprising: a class determination table, and a means for making a conference participation decision / notification based on the attendee schedule table, the determination table, or the attendance determination table based on a combination of both. apparatus. 37. The judgment table for determining / notifying the conference participants is
37. The information terminal device according to claim 36, further comprising: a plurality of distribution level classification tables that define distribution contents, and controlling shared information distribution contents to the second information terminal device based on the classification table.