JP2015232697A - Display system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display system that uses each portable type communication terminal as one display device to perform a display by combining a plurality of portable type communication terminals arrayed vertically and/or laterally.SOLUTION: A display system 1 comprises: a connection target terminal identification processing unit 10 that identifies a portable type communication terminal B serving as a communication opponent of a portable type communication terminal A; a location setting processing unit 11 that displays a combinable location upon combining with the identified portable type communication terminal B to thereby receive a selection of the location of the combination, and combines the portable type communication terminal A and the portable type communication terminal B having a corresponding combination location selected at the combination location where the selection is received; and an operation processing unit 13 that causes an operation performed in the portable type communication terminal A to be reflected in the combined portable type communication terminal B, and executes a display of an area corresponding to a location where the combination is implemented.

Description

  The present invention relates to a display system in which a plurality of portable communication terminals are combined vertically and / or horizontally to perform display using each portable communication terminal as one display device.

  In recent years, portable communication terminals such as mobile phones, PHS, and tablet computers have become widespread and are used in various situations such as school education and company training. Then, portable communication terminals are handed to students, students, students (hereinafter collectively referred to as “learners”), and between teachers and lecturers (hereinafter collectively referred to as “teachers”). In addition, classes and lectures using two-way communication (hereinafter collectively referred to as “classes”) are beginning to be implemented.

  In the class, a group may be formed by multiple learners, such as group learning. For example, an operation of creating one picture among a plurality of learners is an example. In such a case, work is performed using one portable communication terminal in the group.

  However, when a plurality of people form a group, the portable communication terminal is small because of its characteristics, and the display device is also small. Therefore, it is easy for a plurality of people to work. Therefore, a system that is used as one display device by combining a plurality of portable communication terminals is disclosed in Patent Document 1 and Non-Patent Document 1 below.

JP 2009-94775 A

Eiyuki Suzuki, Hideo Funyu, Yoshihiko Kubota, “Support for Collective Collaborative Learning Using Tablet Devices-XingBoard: Concept and Prototype of Crossing Board”, IEICE Tech. 113, no. 166, The Institute of Electronics, Information and Communication Engineers, July 2013, p. 41-p. 46

  In the case of the system disclosed in Patent Document 1, a plurality of portable terminals are combined vertically and horizontally to form a single display device and display a screen. Patent Document 1 proposes a method of combining each mobile terminal, a method of automatically assigning and setting in advance, attaching a plurality of non-contact ICs to the mobile terminal, and determining by arrangement thereof.

  In the case of the automatic assignment method, it is unclear which mobile terminal is assigned to which position. Therefore, as described in Patent Document 1, it is necessary to manually change the position of the mobile terminal after assignment. Sometimes it comes out. Moreover, in the case of the method of setting in advance, the above problem does not occur, but it is necessary to set in advance which mobile terminal is to be combined with which position. In addition, when a plurality of non-contact ICs are used, a special hardware configuration in which the non-contact ICs are provided on the top, bottom, left, and right of the portable terminal is required, and lacks versatility.

  Therefore, using the system of Patent Document 1 is not suitable for displaying as a single display device by combining a plurality of portable communication terminals in a class.

  The system of Non-Patent Document 1 has a client-server type configuration. Therefore, all operations at each portable communication terminal are once sent to the server, and after the processing for the operation is executed at the server, the processing result is returned to each portable communication terminal. And when determining the combination position of each portable communication terminal, the same process as described above is required. For this reason, each portable communication terminal cannot be used unless it can be connected to the server via a network.

  Furthermore, even if the network is connected, the learner needs to set the position of his portable communication terminal. However, setting it is not easy. That is, in the case of Non-Patent Document 1, each learner must appropriately set the combination position of his portable communication terminal, but it is not easy for a learner of an elementary school lower grade, for example, to perform the setting work. In some cases. In addition, a plurality of learners may set the same combination position.

  Specifically, when a group is formed in a school lesson, the teacher may decide the member composition for each group in advance, but in most cases, depending on the content and progress of the lesson, Membership is determined flexibly as needed. In particular, in the case of outdoor learning, experiments, etc., member composition is often determined according to the situation. In the group based on the determined member configuration, when combining the portable communication terminals used by each learner, there is no time for the teacher to set the combination position of the portable communication terminals in each group. It is necessary for individuals to make appropriate settings. Therefore, there is a need for an intuitive operation method and a system that prevents erroneous operations so that the learner can easily perform the setting by himself / herself. In particular, if the learner is an elementary school lower grader who is unfamiliar with the handling of portable communication terminals, it can be said that this intuitive operation and prevention of erroneous operations are further required.

  Also, in the field of school education, by letting learners carry out a collaborative activity called group learning, through that activity, "sharing awareness", "activating discussion", " It is demanded to bring out the learning effect of “interchange”. Furthermore, in order to create a natural collaboration, it is necessary for each learner to smoothly move through a series of flows that bring information, interact, and discuss.

  Therefore, even in the group learning scene using portable communication terminals such as tablet computers, it is easy to set the combination position of each portable communication terminal in order to bring out the above-mentioned cooperative learning effect. It can be said from the viewpoint in the field of school education that a system that can do this is desired.

  Therefore, a system that can easily set the combination position of each portable communication terminal is desired.

  The same is true for companies. In other words, when a meeting with a small number of people using a portable communication terminal is carried out in a company, if it takes time to set the combination position of the portable communication terminal, the main purpose of discussion will be smooth. It cannot be migrated, and time is wasted. Therefore, it is required that the combination position of the portable communication terminal can be set quickly with a simple operation.

  In view of the above problems, the present inventors have invented the display system of the present invention.

  A first invention is a display system that displays a single display device by combining a plurality of portable communication terminals, and specifies a connection target terminal that specifies a portable communication terminal that is a communication partner of the portable communication terminal. When the processing unit and the specified portable communication terminal are combined, the selection of the combination position is accepted by displaying the position that can be combined, and the portable communication terminal and the corresponding combination position are selected. A combination position setting processing unit that combines the performed portable communication terminal with the combination position that has received the selection, and an operation performed on the portable communication terminal are reflected in the combined portable communication terminal, and And an operation processing unit that executes display of an area corresponding to the combined position.

  With the display system of the present invention, a learner who uses a portable communication terminal can easily combine the portable communication terminal by simply selecting a combination position when combining the portable communication terminal. Thereby, the setting of the combination position of each portable communication terminal can be easily performed.

  In the above-described invention, when the combination position setting processing unit receives information on the combination position from the portable communication terminal, the combination position setting unit accepts selection of the combination position at the portable communication terminal and receives the combination position received by the portable communication terminal. By transmitting this information, it can be configured as a display system that is combined with the specified portable communication terminal at the combination position received by the portable communication terminal.

  In addition, the combination position setting processing unit transmits the combination position information received by the portable communication terminal to the portable communication terminal serving as the communication partner, and the transmitted combination position. And a combination position correspondence determination processing unit for determining a match or correspondence between the information on the combination position received from the portable communication terminal serving as the communication partner, and the portable communication terminal based on the determination result, The display system may include a position determination processing unit that combines the portable communication terminal serving as the communication partner with the received combination position.

  As in these inventions, when a combination position is selected in another portable communication terminal to be combined, the information is received and the combination or correspondence is determined to determine the combination. This makes it easy to set the combination position.

  In the above-described invention, the combination position setting processing unit transmits information on the combination position that has received the selection from the portable communication terminal that has received the selection of the combination position to the specified portable communication terminal. Thus, in the specified portable communication terminal, a combination position display control processing unit that performs display control processing of display of a position corresponding to the combination position or display of a position other than the position corresponding to the combination position, It can be configured like a display system.

  For example, when a learner who is unfamiliar with the operation of the portable communication terminal operates like a lower grade in an elementary school, there is a possibility that an incorrect position is selected when selecting a combination position. Therefore, selection of an incorrect position can be prevented by performing display control processing as in the present invention.

  In the above-described invention, the display system further includes a mount size setting processing unit that determines the size including the display range of the display device of the combined portable communication terminal as the mount size. Can be configured.

  When combining a plurality of portable communication terminals, it is necessary to set a mount for placing objects. Therefore, by using the present invention, the size of the mount can be automatically set.

  The above display system can be realized by reading the display program of the present invention into a portable communication terminal and executing it. That is, a display program that combines a plurality of portable communication terminals to display as a single display device, and the display program uses the portable communication terminal as a communication partner of the portable communication terminal. In the case of a combination with a connection target terminal identification processing unit for identifying a terminal and the identified portable communication terminal, a selection of a combination position is accepted by displaying a position that can be combined, and the portable communication terminal, A combination position setting processing unit for combining the portable communication terminal for which the corresponding combination position has been selected at the combination position that has received the selection, and the operation performed on the portable communication terminal for the combination communication. A display program that is reflected on the terminal and functions as an operation processing unit that displays the area corresponding to the combined position. It is.

The above display system can be realized by executing the display method of the present invention on a portable communication terminal. That is, a display method for performing display by combining a plurality of portable communication terminals as a single display device, wherein connection target terminal inquiry information for specifying a portable communication terminal that is a communication partner of the portable communication terminal is displayed. The step of transmitting, the step of receiving connection target terminal response information corresponding to the connection target terminal inquiry information from another portable communication terminal, and the connection target terminal inquiry information and the connection target terminal response information match or correspond Determining whether the communication partner is a portable communication terminal, transmitting the combination position inquiry information indicating a combination position to the specified portable communication terminal, Receiving combination position response information corresponding to combination position inquiry information; and combining position inquiry information and combination The portable communication terminal that has transmitted the combination position inquiry information and the combination position of the portable communication terminal that has transmitted the combination position response information at the combination position, The display method includes a step of reflecting an operation performed on the portable communication terminal on the combined portable communication terminal and a step of displaying an area corresponding to the combined position.
Further, the display system further selects the communication group setting in the portable communication terminal when the connection target terminal specifying process receives information of the communication group setting that enables communication connection from the portable communication terminal. A communication group can be set in the portable communication terminal by transmitting the received communication group setting information to the portable communication terminal.
Further, the display system further includes a connection target terminal specifying information processing unit for transmitting the communication group setting information received in the portable communication terminal to another portable communication terminal in the connection target terminal specifying process. A connection target terminal specific correspondence determination processing unit for determining a match or correspondence between the transmitted communication group setting information and the communication group setting information received from the other portable communication terminal, and the determination result Based on the above, it can be configured as a display system having the portable communication terminal, the other portable communication terminal, and a connection establishment processing unit for setting a communication group.

  By using the display system of the present invention, when a plurality of portable communication terminals are combined into a single display device, a display system that can easily set the combination position is possible.

It is a figure which shows typically an example of the conceptual diagram of the whole display system of this invention. It is a figure which shows typically the conceptual diagram of an example of the system configuration | structure of the display system of this invention. It is a figure which shows typically the conceptual diagram of an example of a structure of the connection object terminal specific process part in the display system of this invention. It is a figure which shows typically the conceptual diagram of an example of a structure of the combination position setting process part in the display system of this invention. It is a figure which shows an example of the hardware constitutions of a portable communication terminal. An example of a determination table for determining a correspondence relationship between connection target terminal inquiry information and connection target terminal response information for specifying a portable communication terminal to be connected in the connection target terminal specific correspondence determination processing unit FIG. It is a figure which shows typically an example of the determination table of the relationship between combination position inquiry information and combination position response information for determining the combination position of a portable communication terminal in a position determination process part. When determining a mount size in a mount size setting process part, it is a figure which shows typically the determination process of the mount size at the time of combining two portable communication terminals of B5 size in the horizontal direction and the vertical direction. When the mount size is determined by the mount size setting processing unit, a process for determining the mount size when a B5 size portable communication terminal is combined horizontally with two in the vertical direction and two in the horizontal direction is schematically shown. FIG. It is a figure which shows typically the relationship between a physical coordinate (absolute coordinate) and a client coordinate (relative coordinate) at the time of combining a portable communication terminal. It is a figure which shows typically the relationship of the physical coordinate at the time of combining 2 units | sets in a vertical direction, 2 units | sets in a horizontal direction, and the portable communication terminal A thru | or the portable communication terminal D, and a client coordinate. It is a figure which shows typically an example of the operation log information to produce | generate. It is a figure which shows typically an example at the time of transmitting operation log information with respect to the portable communication terminal B thru | or the portable communication terminal D from the portable communication terminal A. It is a figure which shows typically the process which converts a physical coordinate into a client coordinate in each portable communication terminal. It is a figure which shows typically an example at the time of transmitting operation log information with respect to the portable communication terminal A, the portable communication terminal C, and the portable communication terminal D from the portable communication terminal B. FIG. It is a figure which shows typically the process which converts a physical coordinate into a client coordinate in each portable communication terminal. It is a flowchart which shows an example of the process of a display system typically. It is a sequence diagram which shows typically an example of the process which specifies the portable communication terminal used as connection object. It is a sequence diagram which shows typically an example of the process of determining the combination position of a portable communication terminal. It is a figure which shows typically that a mutual communication is possible between portable communication terminals. It is a figure which shows the state by which the position of four portable communication terminals was determined. In Example 2, it is a figure which shows typically the conceptual diagram of a process in the case of performing a display control process in a position determination process part so that a learner may not select an incorrect combination position. In the second embodiment, when the portable communication terminal A to the portable communication terminal D are already combined, and “down” of the portable communication terminal B is further selected, the display control process for the portable communication terminal D is performed. FIG. In Example 3, it is a figure which shows typically the state which determined the combination position of the portable communication terminal A and the portable communication terminal B, and the temporary determination of mount size. In Example 3, it is a figure which shows typically the state which determined the combination position of the portable communication terminal A thru | or the portable communication terminal C, and the temporary determination of mount size. In Example 3, it is a figure which shows typically the state which determined the combination position of the portable communication terminal A thru | or the portable communication terminal D, and the temporary determination of mount size. In Example 3, it is a figure which shows typically the state which determined the combination position of the portable communication terminal A thru | or the portable communication terminal D, and the final determination of mount size. In Example 5, it is a figure which shows typically the conceptual diagram of the process which sets a communication group to the portable communication terminal A and the portable communication terminal B. FIG. In Example 5, the determination for determining the correspondence between the communication group inquiry information and the communication group response information for setting the communication group in the portable communication terminal that can be connected by the connection target terminal specific correspondence determination processing unit It is a figure which shows an example of a table typically. In Example 5, it is a figure which shows typically the conceptual diagram of the process which establishes communication connection between the portable communication terminal A and the portable communication terminal B. FIG. In Example 5, it is a figure which shows typically an example of the determination table of the relationship between combination position inquiry information and combination position response information for determining the combination position of a portable communication terminal in a position determination process part. In Example 5, it is a sequence diagram which shows typically an example of the process of setting a communication group to the portable communication terminal in which communication connection is possible. In Example 5, it is a figure which shows typically the state which established the communication connection between the portable communication terminal A and the portable communication terminal B. FIG.

  An example of an overall conceptual diagram of the display system 1 of the present invention is shown in FIG. A conceptual diagram of an example of the system configuration of the display system 1 is shown in FIG. In addition, FIG. 3 shows a conceptual diagram of an example of a configuration of a connection target terminal identification processing unit 10 to be described later, and FIG.

  The display system 1 is realized in a portable communication terminal used by each learner. The portable communication terminal in the display system 1 is preferably a portable communication terminal provided with a touch panel display device 72. FIG. 5 shows an example of the hardware configuration of the portable communication terminal. The portable communication terminal includes a calculation device 70 such as a CPU that executes calculation processing of a program, a storage device 71 such as a RAM and a hard disk that stores information, and a touch panel display device such as a touch panel display that can be input by a touch panel. 72 and a communication device 73 for directly communicating the processing results of the arithmetic device 70 and information stored in the storage device 71 between terminals. The communication device 73 may be capable of communicating over the Internet in addition to communicating directly between terminals.

  The touch panel display device 72 is a device in which the functions of the display device and the input device are integrated in that input can be performed directly on the display by a predetermined input device (such as a touch panel pen) or a finger.

  The display system 1 of the present invention is provided in a portable communication terminal used by each learner. The display system 1 includes a connection target terminal identification processing unit 10, a combination position setting processing unit 11, a mount size setting processing unit 12, and an operation processing unit 13. Each portable communication terminal preferably has the same function.

  Each means in the present invention is only logically distinguished in function, and may be physically or virtually the same area.

  The connection target terminal identification processing unit 10 executes a connection terminal identification process that identifies a portable communication terminal to be combined with the portable communication terminal. The connection target terminal identification processing unit 10 includes a connection target terminal identification information processing unit 100, a connection target terminal identification correspondence determination processing unit 101, and a connection establishment processing unit 102.

  The connection target terminal specific information processing unit 100 accepts an input to start processing of the display system 1 of the present invention. For example, an input indicating that a region displayed at a predetermined location of the touch panel display device 72 in the portable communication terminal has been selected is accepted. Then, as shown in FIG. 7 to be described later, in order to identify the portable communication terminal to be combined, whether or not it is a portable communication terminal to be connected to other portable communication terminals within a predetermined distance. Broadcast distribution of connection target terminal inquiry information (key) for specifying. Further, the connection target terminal specific information processing unit 100 receives connection target terminal response information (value) sent from another portable communication terminal.

  The connection target terminal specific correspondence determination processing unit 101, based on the connection target terminal response information (value) received by the connection target terminal specific information processing unit 100, the connection target terminal inquiry distributed by the connection target terminal specific information processing unit 100. It is determined whether the connection target terminal response information matches or corresponds to the information.

  The connection target terminal inquiry information indicates that a portable communication terminal that can be combined is within a communicable range (within a predetermined distance within which communication can be reached in the ad hoc mode, within a range in which network communication is possible in other communication modes). Information that is broadcast to inquire about whether or not it exists. Instead of broadcast distribution, multicast distribution or unicast distribution specifying a plurality of terminals that can be connected may be used.

  The connection target terminal response information is information returned from the portable communication terminal that has received the connection target terminal inquiry information to the connection target terminal inquiry information.

  The connection target terminal specific correspondence determination processing unit 101 determines the correspondence based on the determination table shown in FIG. 6 in order to determine the correspondence between the connection target terminal inquiry information and the connection target terminal response information. It is not limited to it. The connection target terminal inquiry information and the connection target terminal response information include affiliation class information, group identification information, the title of the mount data (referred to as “mount” in this specification), the cache of the mount, and the amount of data on the mount. The mount is displayed as the base (groundwork) when a plurality of portable communication terminals are combined. The learner can display various objects (image information, text information, etc.) on the mount. Can be arranged.

  When the connection establishment terminal specific correspondence determination processing unit 101 determines that the correspondence between the connection target terminal inquiry information and the connection target terminal response information matches or corresponds, the connection establishment processing unit 102 A connection is directly established between the portable communication terminal that sent the inquiry information and the portable communication terminal that returned the connection target terminal response information.

  In this case, the form of direct connection (generally called “Peer to Peer”, “P2P”) between portable communication terminals is a direct short-range wireless communication between portable communication terminals ( In general, the connection is based on a communication connection form called “ad hoc mode”. An environment that cannot be connected to a local area network (LAN) by communicating in the “ad hoc mode” (for example, if the display system 1 of the present invention is used in a school, observations and experiments performed outdoors) ), The display system 1 of the present invention can be realized. The form of direct connection is not limited to the ad hoc mode, and any form of communication connection may be used as long as the connection between portable communication terminals can be realized.

  The connection establishment processing unit 102 is preferably connected directly between portable communication terminals. However, the connection establishment processing unit 102 is not limited to this, and for example, a client / server type connection via a server may be used.

  In addition, when the connection establishment processing unit 102 establishes a connection between a plurality of portable communication terminals, the connection target terminal identification processing unit 10 preferably executes a process of synchronizing timing between the portable communication terminals. The date and time information is an example of the timing. However, the timing is not limited to this, and a timer that counts at a fixed timing may be used.

  As an example of specific processing, the timing (date / time information) of the portable communication terminal that delivered the connection target terminal inquiry information is sent to other portable communication terminals and aligned with the transmitted date / time information. There is a method for executing processing for synchronizing the timing (date information) of the portable communication terminal. In this case, regarding the timing synchronization processing, the portable communication terminal that has transmitted the connection target terminal inquiry information is a virtual “reference terminal” (terminal that is a timing reference), and the portable communication terminal that has transmitted the connection target terminal response information. The terminal is handled in the form of a virtual “correction target terminal” (terminal whose timing is corrected in accordance with the reference terminal). Note that any processing format may be used as long as the timing can be synchronized between the portable communication terminals with which the connection has been established.

  The combination position setting processing unit 11 executes processing for determining how to combine the portable communication terminals specified by the connection target terminal specifying processing unit 10 and determining the combination position. That is, information indicating the position to be combined is displayed on the display device of each portable communication terminal, and the selection is received by the combination position setting processing unit 11, so that the combination with the portable communication terminal for which the corresponding combination position is selected is performed. Is called. By performing the combination, it is possible to specify the positional relationship and coordinate relationship of each combined portable communication terminal.

  At this time, the portable communication terminal A specifies the combination position from the portable communication terminal A (for example, the portable communication terminal B to the portable communication terminal D) identified as the connection target terminal by the connection target terminal identification processing unit 10. The combination position inquiry information (key) indicating is multicast-distributed. When the selection of the combination position response information (value) corresponding to the portable communication terminal among the portable communication terminals that has received the combination position inquiry information is received by the combination position setting processing unit 11, it is transferred to the portable communication terminal. Return to terminal A. Thereby, the positional relationship of the combination can be set.

  The combination position setting processing unit 11 includes a combination position information processing unit 110, a combination position correspondence determination processing unit 111, and a position determination processing unit 112.

  The combination position information processing unit 110 receives input of information indicating the combination position displayed at a predetermined position of the touch panel display device 72 in the portable communication terminal. Then, the combination position inquiry information (key) that has received the input is multicast-distributed to the portable communication terminal specified by the connection target terminal specification processing unit 10. The combination position information processing unit 110 receives combination position response information (value) sent from any of the portable communication terminals specified above.

  Based on the combination position response information (value) received by the combination position information processing unit 110, the combination position correspondence determination processing unit 111 matches or corresponds to the combination position inquiry information distributed by the combination position information processing unit 110. It is determined whether it is response information. FIG. 7 schematically shows a determination table of the relationship between the combination position inquiry information and the combination position response information in this case.

  The combination position inquiry information refers to information for multicast distribution of information indicating the combination position to the portable communication terminal specified by the connection target terminal specification processing unit 10. The combination position response information is information indicating the combination position in the portable communication terminal that has received the combination position inquiry information. For example, when the combination position inquiry information is information indicating “right”, the combination position response information is information indicating “left”.

  When the combination position correspondence determination processing unit 111 determines that the combination position inquiry information and the combination position response information match or correspond, the position determination processing unit 112 combines the portable communication terminal with the combination position. decide.

  In the combination position information processing unit 110 of the combination position setting processing unit 11, for example, the portable communication terminal A accepts the selection on the right side as the combination position, and multicasts the combination position inquiry information indicating the selection. If the portable communication terminal B identified by the connection target terminal identification processing unit accepts the selection on the left side, the combination position information processing unit 110 of the portable communication terminal B indicates “left” as the combination position response information. Since the information is sent, the combination position information processing unit 110 of the portable communication terminal A accepts it. When the combination position inquiry information processing unit 111 determines that the combination position inquiry information and the combination position response information match or correspond to each other, the position determination processing unit 112 sets the portable communication terminal A to the left side. The portable communication terminal B is determined to be combined in the right combination position and positional relationship.

  Further, by the same process as described above, if the portable communication terminal A accepts the lower selection as the combination position and the portable communication terminal C accepts the upper selection, the portable communication terminal A is the upper, portable type. Communication terminals C are combined in a lower positional relationship. If the portable communication terminal B accepts the lower selection as the combination position and the portable communication terminal D accepts the upper selection, the positional relationship of the portable communication terminal B is the upper side and the portable communication terminal D is the lower position. Combined. As described above, the combination position setting processing unit 11 accepts the selection of the combination position of the portable communication terminal, so that the combination combination positional relationship can be set.

  In the above-described combination position setting processing unit 112, the case where the arrow symbol is used as the information indicating the combination position has been described, but any other symbol, character, number, symbol, character, or the like may be used. For example, different characters may be displayed in the up, down, left, and right directions, and the determination may be made based on the correspondence between the characters. Alternatively, the combination position may be determined by displaying the same symbol, character, number, symbol, or character at the corresponding position and determining whether they match.

  When the combination position setting processing unit 11 determines the combination position of each portable communication terminal, the mount size setting processing unit 12 executes processing for determining the size of the mount used in the combined portable communication terminal.

  Specifically, the mount size is determined by the size including the display range of the display devices of all the portable communication terminals according to the number of the portable communication terminals combined in the vertical and horizontal directions. Although it is preferable to determine the mount size with the smallest size including the display range of the display device of all portable communication terminals, the present invention is not limited to this.

  For example, as shown in FIG. 8, when two B5 size portable communication terminals are horizontally oriented and combined in the vertical direction, the mount size setting processing unit 12 determines the mount size as the B4 size. Also, as shown in FIG. 9, when two B5 size portable communication terminals are combined horizontally and two in the vertical direction and two in the horizontal direction are combined, the mount size setting processing unit 12 determines the mount size as the B3 size. .

  The operation processing unit 13 receives an operation input to the portable communication terminal between the combined portable communication terminals, transmits the operation log information to another portable communication terminal, and performs an operation corresponding to the operation log information. By performing the operation on the other portable communication terminal, the operation for one display device is executed and reflected.

  In addition, the operation processing unit 13 receives operation log information sent from another portable communication terminal, executes and reflects an operation corresponding to the operation log information, and among the execution results, the portable communication terminal The display corresponding to the display area in charge is performed on the display device of the portable communication terminal.

  By specifying the positional relationship of the combination of each portable communication terminal with the combination position setting processing unit 11, the operation processing unit 13 of each portable communication terminal displays as one display device based on the identified positional relationship. The positional relationship between the physical coordinates (absolute coordinates) and the client coordinates (relative coordinates) in the display device of each portable communication terminal is specified. In particular, the physical coordinate and the client coordinate conversion formula are generated by specifying the positional relationship between the physical coordinate origin and the relative coordinate origin in the display device of each portable communication terminal.

  A basic process for displaying in combination with a portable communication terminal will be described. In the display system 1 of the present invention, a physical coordinate that is an absolute coordinate indicating an editable region of content displayed on a screen and a client that is a relative coordinate indicating a range displayed on the touch panel display device 72 of each portable communication terminal. There are coordinates. As shown in FIG. 9, the relationship of coordinates when two portable communication terminals are combined in the vertical direction and two in the horizontal direction is shown in FIG. In the case of FIG. 10, the origin (cx, cy) of the client coordinates is the physical coordinates (X = 500, Y = 300). Therefore, coordinate conversion between physical coordinates and client coordinates can be performed by adding or subtracting the client coordinates or physical coordinates.

  In other words, the client coordinates can be calculated by subtracting the distance from the physical coordinate origin to the origin of the portable communication terminal from the physical coordinate value, and the absolute coordinate is calculated by subtracting the physical coordinate value from the physical coordinate value. What is necessary is just to calculate the value which added the distance from the origin to the origin in the portable communication terminal.

For example, in FIG. 10, the physical coordinates are (X, Y), the client coordinates of the portable communication terminal A are (cx1, cy1), the client coordinates of the portable communication terminal B are (cx2, cy2), and the portable communication terminal C Assume that the client coordinates are (cx3, cy3) and the client coordinates of the portable communication terminal D are (cx4, cy4). In this case, the conversion process from client coordinates to physical coordinates is:
In portable communication terminal A,
X = cx1, Y = cy1
In portable communication terminal B,
X = cx2 + 500, Y = cy2
In the portable communication terminal C,
X = cx3, Y = cy3 + 300
In the portable communication terminal D,
X = cx4 + 500, Y = cy4 + 300
It becomes.

The conversion process from physical coordinates to client coordinates is as follows:
In portable communication terminal A,
cx1 = X, cy1 = Y
In portable communication terminal B,
cx2 = X−500, cy2 = Y
In the portable communication terminal C,
cx3 = X, cy3 = Y-300
In the portable communication terminal D,
cx4 = X-500, cy4 = Y-300
It becomes.

  Therefore, for example, when the portable communication terminal A to the portable communication terminal D are combined as shown in FIG. 10, the physical coordinates and the client coordinates are as shown in FIG. That is, the physical coordinates (X, Y) are changed from (0, 0) to (999, 599). When the display area of each portable communication terminal on the physical coordinates is indicated by physical coordinates, the portable communication terminal A is (cx1 , Cy1) from physical coordinates (0,0) to (499,299), portable communication terminal B from (500,0) to (999,299) as (cx2, cy2), and portable communication terminal C (Cx3, cy3) is changed from (0, 300) to (499, 599), and the portable communication terminal D is changed from (500, 300) to (999, 599) as (cx4, cy4).

  Each portable communication terminal displays the range included in the physical coordinates on each touch panel display device 72. In that case, the physical coordinates must be changed to the client coordinates (relative coordinates) of each touch panel display device 72. For example, in the case of FIG. 11, client coordinates (cx1, cy1) = (X, Y) of portable communication terminal A, client coordinates (cx2, cy2) = (X-500, Y), portable type of portable communication terminal B By calculating the client coordinates (cx3, cy3) = (X, Y−300) of the communication terminal C and the client coordinates (cx4, cy4) = (X−500, Y−300) of the portable communication terminal D, The information given by the coordinates is changed to the client coordinates and displayed on the touch panel display device 72.

  An example of the process of reflecting and executing the operation using the operation log information in the operation processing unit 13 is shown in FIG. When the portable communication terminal A to the portable communication terminal D are combined as shown in FIG. 12, for example, when the operation “AAAA” is performed on the touch panel display device 72 of the portable communication terminal A, an operation process is performed. The unit 13 receives the operation “AAAA”. Then, the operation processing unit 13 converts the client coordinates on which the received operation “AAAA” is performed into absolute coordinates, and generates operation log information illustrated in FIG. 12. The operation processing unit 13 stores the generated operation log information in a predetermined storage area.

  Then, the operation processing unit 13 of the portable communication terminal A transmits the generated operation log information to the portable communication terminal B to the portable communication terminal D with which the connection is established. The sent operation log information is received by the operation processing unit 13 of the portable communication terminal B to the portable communication terminal D. This is schematically shown in FIG.

  When the operation log information is received, the operation log information is stored in predetermined storage areas of the portable communication terminal B to the portable communication terminal D, and the operation processing unit 13 executes the corresponding operation process. The operation process is executed on all connected terminals. And each operation processing part 13 of portable communication terminal B thru | or portable communication terminal D converts the physical coordinate in the received operation log information into each client coordinate. Since the portable communication terminal A originally accepts input in client coordinates, it can be used. This is schematically shown in FIG.

  Then, the operation “AAAA” is not within the display range of the respective touch panel type display devices 72 in the portable communication terminal B to the portable communication terminal D. However, since the operation “AAAA” is a process that does not depend on coordinates, each of the portable communication terminals A to D executes a display process corresponding to the operation “AAAAA”.

  Next, it is assumed that the operation “BBBB” is performed at the client coordinates (100, 200) of the touch panel type display device 72 of the portable communication terminal B. The operation processing unit 13 of the portable communication terminal B uses the client coordinates (cx2, cy2) = (100, 200) where the received operation “BBBB” is performed, and the physical coordinates (X, Y) = (600, 200). Change to, and generate operation log information including it. The operation processing unit 13 of the portable communication terminal B stores the generated operation log information in a predetermined storage area.

  Then, the operation processing unit 13 of the portable communication terminal B transmits the generated operation log information to the portable communication terminal A, the portable communication terminal C, and the portable communication terminal D with which connection is established. This is schematically shown in FIG. The sent operation log information is received by the operation processing unit 13 of the portable communication terminal A, the portable communication terminal C, and the portable communication terminal D.

  When the operation log information is received, the operation log information is stored in predetermined storage areas of the portable communication terminal A, the portable communication terminal C, and the portable communication terminal D, and the operation processing unit 13 executes the operation process corresponding to the operation log information. To do. The operation process is executed on all connected terminals. Then, each operation processing unit 13 of the portable communication terminal A, the portable communication terminal C, and the portable communication terminal D converts the physical coordinates in the received operation log information into respective client coordinates. For example, the portable communication terminal A converts to client coordinates (cx1, cy1) = (600, 200), and the portable communication terminal C converts to client coordinates (cx3, cy3) = (600, −100). The communication terminal D converts the client coordinates (cx4, cy4) = (100, −100). This is schematically shown in FIG.

  Then, the operation “BBBB” is not within the display range of the touch panel display device 72 of each of the portable communication terminal A, the portable communication terminal C, and the portable communication terminal D. However, since the operation “BBBB” is a process that does not depend on coordinates, each portable communication terminal A to portable communication terminal D executes a process corresponding to the operation “BBBB”.

  By repeating the process as described above a plurality of times, the operation log information matches in the portable communication terminal A to the portable communication terminal D. And since it displays on each portable communication terminal based on operation log information, each operation can be reflected quickly. In addition, since it does not depend on the server, there is no processing delay and no processing concentration on the server.

  In this manner, the operation processing unit 13 transmits the operations input from the combined portable communication terminals to the other portable communication terminals as operation log information, and mutually executes processes to reflect the operations. Display processing for displaying the combined portable communication terminal as one display device without using a server is possible.

  Next, an example of the processing process of the display system 1 of the present invention will be described with reference to the flowchart of FIG. 17 and the sequence diagrams of FIGS.

  In the following description, a case where date and time information is used as timing will be described. Moreover, it is group learning in a school lesson, Comprising: Four learners (students) (learners A thru | or learner D) connect each portable communication terminal (portable communication terminal A thru | or portable communication terminal D). The case of combining will be described.

  When the portable communication terminals used by each learner are combined, the communication is established between the portable communication terminals, and direct communication is performed, the process of identifying the portable communication terminal to be connected is first performed. It is executed by the processing unit 10 (S100).

  When a selection to start a process to be combined with another portable communication terminal is received by a connection target terminal specifying information processing unit 100 of a connection target terminal specifying processing unit 10 in a certain portable communication terminal, the connection target shown in FIG. The terminal identification process is started.

  For example, when learner A selects to start processing to be combined with another portable communication terminal in portable communication terminal A, it is accepted by connection target terminal specific information processing unit 100 of portable communication terminal A, and key Broadcast connection target terminal inquiry information. Here, since group learning processing is performed, for example, learner A distributes belonging class information (for example, “1-A”) as a key. It is preferable to use information associated with the learner when the learner logs in to the portable communication terminal as the connection target terminal inquiry information to be the key. However, the present invention is not limited to this, and connection establishment processing is started. You may accept input when you do.

  The portable communication terminal that has received the connection target inquiry information broadcast from the portable communication terminal A broadcasts a value (for example, “1-A”) corresponding to the key if there is matching or corresponding information. It is returned by distribution (in this embodiment, in particular, “ad hoc mode” is used).

  When receiving information from each portable communication terminal B to portable communication terminal D that is value corresponding to the information that is the key broadcasted from the portable communication terminal A, the connection target terminal of the portable communication terminal A is identified. The correspondence determination processing unit 101 refers to the determination table shown in FIG. 6 to determine whether the distributed connection target terminal inquiry information matches the received connection target terminal response information. If the connection target terminal inquiry information matches the connection target terminal response information, the portable communication terminal is specified as the connection partner.

  In addition, when belonging class information is transmitted as connection target terminal inquiry information as described above, it matches the portable communication terminal used by all learners in the classroom. Therefore, the connection target terminal specific information processing unit 100 further broadcasts another connection target terminal inquiry information (for example, group identification information “B group”).

  The portable communication terminal that has received the connection target terminal inquiry information broadcast from the portable communication terminal A broadcasts the value corresponding to the key (for example, “B group”) if there is matching or corresponding information. Return by delivery.

  When receiving information from each portable communication terminal B to portable communication terminal D that is value corresponding to the information that is the key broadcasted from the portable communication terminal A, the connection target terminal of the portable communication terminal A is identified. The correspondence determination processing unit 101 refers to the determination table shown in FIG. 6 to determine whether the distributed connection target terminal inquiry information matches the received connection target terminal response information. If the connection target terminal inquiry information matches the connection target terminal response information, the portable communication terminal is specified as the connection partner.

  As described above, the connection target terminal specific correspondence determination processing unit 101 executes the determination process of matching between the connection target terminal inquiry information and the connection target terminal response information a plurality of times until the unit to be combined. The portable communication terminal B to the portable communication terminal D are specified for the portable communication terminal, which is the portable communication terminal A here.

  In addition, it is possible to broadcast the group identification information as connection target terminal inquiry information from the beginning without specifying multiple times, and to identify the portable communication terminal to be combined. By distributing the connection target terminal inquiry information, it is possible to improve the specific accuracy of the portable communication terminal to be connected.

  When the value information corresponding to the key information broadcast from the portable communication terminal A is received from the portable communication terminal B to the portable communication terminal D as described above, the connection of the portable communication terminal A is established. The processing unit 102 sends information used for network connection, such as an IP address, between the portable communication terminal A and the portable communication terminal B to the portable communication terminal D to establish a communication connection. In addition, the portable communication terminal A sends information used for network connection of the portable communication terminal B to the portable communication terminal D, such as an IP address, to the portable communication terminal B to the portable communication terminal D. As a result, the portable communication terminal B to the portable communication terminal D establish a communication connection with another portable communication terminal other than the portable communication terminal A.

  When determining whether the key or value is portable communication terminals belonging to the same group, the class information of the learner using the portable communication terminal as the key (for example, “1 -A ") or group identification information (for example," B group "), and other portable communication terminals use the class information (for example," 1-A ") of the learner who uses it or group identification information (for example," B "). "B group") is returned as value. In the connection target terminal specific correspondence determination processing unit 11, if the key and value match or correspond to each other, the information is determined as a valid communication partner.

  Further, when the contents of the screens displayed between the portable communication terminals (for example, the size of the mount and the type of the page) match or correspond to each other, it may be determined as a valid communication partner. In this case, the title of the mount displayed on the portable communication terminal is sent as the key, and the portable communication terminal that opens the corresponding mount displays the title of the mount, the cache of the mount data, and the data amount of the mount data as the value. And so on. Then, in the connection target terminal specific correspondence determination processing unit 101, it is determined whether the key and value match or correspond to each other.

  The “ad hoc mode” is set so that the radio wave can reach only within a predetermined range, for example, within a range of several meters, so that broadcast distribution is not performed over a wide range.

  As described above, a direct communication connection can be established between portable communication terminals. That is, the portable communication terminal A to the portable communication terminal D can directly communicate with each other. This is schematically shown in FIG.

  If the connection target terminal specific information processing unit 100 of the portable communication terminal A does not receive the value information within a predetermined time after distributing the key information, the portable communication terminal , It is determined that the terminal is not a connection target.

  Next, in order to set the combination position of a portable communication terminal, the combination position is set by the combination position setting processing unit 11 of each portable communication terminal (S200). In this case, the combination position is displayed on the display device of the portable communication terminal, and the selection is received by the combination position information processing unit 110, whereby the combination with the portable communication terminal at the corresponding combination position is performed.

  At the time of this processing, the combination position information processing unit 110 of the portable communication terminal A is connected to the portable communication terminal B to the portable communication terminal D specified as the connection target terminal by the connection target terminal specifying processing unit 10. The combination position inquiry information (key) indicating the combination position is distributed by multicast. For example, in the portable communication terminal A, when the right side is selected as the combination position, the combination position information processing unit 110 of the combination position setting processing unit 11 accepts the information, and “right” is used as the combination position inquiry information. It transmits to the communication terminal B thru | or the portable communication terminal D.

  Then, the combination position information processing unit 110 of the combination position setting processing unit 11 of the portable communication terminal B to the portable communication terminal D that has received the “right” combination position inquiry information corresponds to the “right” combination position inquiry information. When the selection of the combination position response information “left” to be received is accepted (for example, portable communication terminal B), the combination position information processing unit 110 of the combination position setting processing unit 11 in the portable communication terminal (portable communication terminal B). Transmits “left” to the portable communication terminal A as combined position response information.

  The combination position information processing unit 110 of the combination position setting processing unit 11 of the portable communication terminal A that has received the “left” combination position response information is combined with the combination position inquiry information and the combination position response by the combination position correspondence determination processing unit 111. It is determined whether the information matches or corresponds. If it is determined that they match or correspond, the position determination processing unit 112 of the portable communication terminal A determines that the portable communication terminal B is combined on the right side of the portable communication terminal A. Then, the information is transmitted to the portable communication terminal B. The position determination processing unit 112 of the combination position setting processing unit 11 of the portable communication terminal B that has received this information determines that the portable communication terminal A is combined on the left side of the portable communication terminal B. Thereby, the combination position is determined between the portable communication terminal A and the portable communication terminal B.

  At this time, if there are two or more portable communication terminals that transmitted the combination position response information corresponding to the combination position inquiry information, the portable communication terminals that previously transmitted the combination position response information are combined. (The combination position response information transmitted earliest is determined to be a value corresponding to the key).

  More specifically, immediately after the portable communication terminal B transmits the “left” combination position response information to the “right” combination position inquiry information distributed by multicast from the portable communication terminal A, the portable communication terminal A performs the portable communication. In a scene where the terminal C also transmits “left” combination position response information, it is determined that the combination on the right side of the portable communication terminal A is the portable communication terminal B that previously transmitted the combination position response information.

  It is also possible to combine the portable communication terminal that transmitted the combination position response information received earliest instead of the portable communication terminal that transmitted the combination position response information first (in this case, the combination position response received earliest). The information is determined to be a value corresponding to the key).

  Similarly, the combination position is set in the vertical direction by performing the same processing as described above. FIG. 21 shows a state where the positions of the portable communication terminal A to the portable communication terminal D are set in this way.

  Note that the information in which the positional relationship is set is shared by transmitting and receiving information between each of the combined portable communication terminals A to D. Thereby, the positional relationship between the origin of its own portable communication terminal and the origin of physical coordinates can be specified.

  When the combination position of the portable communication terminal to be connected is set as described above, the mount size setting processing unit 12 sets the mount size based on the combined position (S300).

  Specifically, when a button indicating final determination of the combined position or the like is pressed by the combination position setting processing unit 11, the smallest size among the sizes including the display areas of the display devices of all the portable communication terminals. Is set as the mount size.

  As a result, the optimum mount size can be automatically determined based on the number of combined portable communication terminals and the combined position without setting information to be mounted.

  In the first embodiment, when a portable communication terminal is combined, the learner himself selects an appropriate combination position. Therefore, it is necessary to avoid the learner from operating it by mistake. Therefore, in this embodiment, a case will be described in which the combination position setting processing unit 11 further includes a combination position display control processing unit 113 so that the learner does not select an incorrect combination position. FIG. 22 schematically shows a conceptual diagram of processing in this embodiment.

  The combination position display control processing unit 113 can select only the combination position that matches or corresponds to the information indicating the combination in the combination position inquiry information in the portable communication terminal that has received the combination position inquiry information, or display control such as highlighting. I do. Alternatively, display control is performed such that a position other than the combination position that matches or corresponds to the information indicating the combination in the combination position inquiry information cannot be selected, the display is deleted, or the display is reduced.

  For example, when the portable communication terminal A to the portable communication terminal D are specified as the portable communication terminals to be connected, the combination position setting processing unit 11 of the portable communication terminal A performs the “right” combination position inquiry. Information is multicast distributed to the portable communication terminal B to the portable communication terminal D. The combination position setting processing unit 11 of the portable communication terminal B to the portable communication terminal D determines “left” as combination position response information corresponding to the “right” combination position inquiry information sent from the portable communication terminal A. In the display device, display control is performed such that a combination position other than “left” cannot be selected. As the non-selectable state, there are display control methods such as deleting the display of the arrow at the combination position other than “left”, reducing the display of the arrow, and making the arrow non-selectable.

  Further, the position of the combination position response information corresponding to the combination position inquiry information may be highlighted so that the occurrence of an erroneous operation is reduced without making the selection impossible state. For example, display control such as expanding the “left” arrow, which is combination position response information, reducing the arrows other than “left”, blinking the “left” arrow, and changing the color of the “left” arrow There is also a method.

  By executing the display control as described above, erroneous operations are less likely to occur.

  Therefore, for example, as shown in FIG. 23, when the portable communication terminal A to the portable communication terminal D are already combined, and “down” of the portable communication terminal B is further selected, the portable communication terminal D Display control processing is executed for.

  In the first and second embodiments described above, as the mount size determination process, the position of the portable communication terminal is determined, and when the position is determined, the mount size is determined based on the combination position of each portable communication terminal. Although set, the mount size may be set by the following processing. That is, when the position of the portable communication terminal is determined, the mount size is sequentially and tentatively determined. When the combined position of the portable communication terminal is finally determined, the mount size that has been provisionally determined at the end is determined. Determine and set.

  When combining the portable communication terminal A to the portable communication terminal D of the first embodiment, in the first embodiment, the combined position of the portable communication terminal A to the portable communication terminal D is set, and a predetermined value such as “final confirmation” is set. After the above operation is performed, the mount size setting processing unit 12 sets the mount size based on the combined position of the portable communication terminal A to the portable communication terminal D.

  In the present embodiment, when the portable communication terminal A to the portable communication terminal D are combined, first, the combined position of the portable communication terminal A and the portable communication terminal B is set as shown in FIG. The mount size setting processing unit 12 temporarily determines the mount size as “B4” size.

  Then, when the portable communication terminal C is combined with the portable communication terminal A and the portable communication terminal B, the mount size setting processing unit 12 at the stage where the combined position is determined as shown in FIG. The size is changed from “B4” to “B3” size, and the “B3” size is provisionally determined.

  Further, when the portable communication terminal D is combined with the portable communication terminal A to the portable communication terminal C, the mount size setting processing unit 12 at the stage where the combined position is determined as shown in FIG. Although the mount size setting process is performed, even when the portable communication terminal D is combined, the smallest size among the sizes including the display areas of the display devices of all the portable communication terminals is compared with the case of FIG. Since there is no change in the size, the mount size is maintained as it is.

  When the positions of the portable communication terminal A to the portable communication terminal D are finally confirmed by pressing a button such as “final confirmation”, the mount size “B3” provisionally determined at this time is Set as final mount size.

  The mount size setting process can also be performed by the process as described above.

  In the first to third embodiments, the mount size is finally set after the position where the portable communication terminal is combined is finally determined. Therefore, the learner needs to operate the final determination of the combined position.

  In the present embodiment, a case will be described in which it is possible to finally set the mount size without providing such final confirmation operation.

  First, since the connection target terminal identification processing unit 10 identifies portable communication terminals to be connected, the mount size setting processing unit 12 determines the number of portable communication terminals to be combined based on the identification. Remember. For example, assume that there are four.

  The mount size setting processing unit 12 counts the number of portable communication terminals combined so far when the position is set by the combination position setting processing unit 11 when the position is set. Remember. Then, the counted number is compared with the number specified by the connection target terminal specifying processing unit 10, and when they match, the mount size at that time is set.

  More specifically, for example, when the portable communication terminal A and the portable communication terminal B are combined in the state shown in FIG. 24, the number of combinations is determined as two. Then, the mount size setting processing unit 12 determines that the mount size is B4 from the combination position in FIG. Then, if it is determined whether the number “2” that is combined at this time matches the number “4” of the connection target terminal identification processing unit 10, they do not match. Therefore, it waits for the next portable communication terminal to be combined.

  Next, when the portable communication terminal C is further combined in the state of FIG. 25, the position is determined, and the number of combined units is added (incremented), and the number of combined units is 3 A stand. Then, the mount size setting processing unit 12 determines that the mount size is B3 from the combination position of FIG. Then, if it is determined whether the number “3” that is combined at this point matches the number “4” of the connection target terminal identification processing unit 10, they do not match. Therefore, it waits for the next portable communication terminal to be combined.

  Next, when the portable communication terminal D is combined with the portable communication terminal A to the portable communication terminal C, the state shown in FIG. 26 is obtained. Then, the number of combinations is added and the combination is performed. It is assumed that the number is four. Then, the mount size setting processing unit 12 determines that the mount size is B3 from the combination position of FIG. Then, when it is determined whether the number “4” that is combined at this time matches the number “4” of the connection target terminal identification processing unit 10 or not, they match. Therefore, the mount size setting processing unit 12 sets the mount size “B3” at this time as the final mount size. FIG. 27 shows this state.

  By performing the processing as in the present invention, the mount size can be determined without an operation of finally determining the portable communication terminal. In addition, it is possible to seamlessly realize a combination of portable communication terminals and a mount size determination process. Therefore, a smooth subsequent to group learning can be realized, and a high learning effect can be obtained without reducing the learner's concentration.

  In the first to fourth embodiments, the communication connection is established between the portable communication terminals in which the connection target terminal inquiry information and the connection target terminal response information match or correspond to each other. That is, if the connection target terminal inquiry information and the connection target terminal response information match or correspond to each other between portable communication terminals, a situation occurs where the communication connection is established even if the communication connection is not intended. On the other hand, a communication connection may not be established between portable communication terminals whose connection target terminal inquiry information and connection target terminal response information do not match or correspond to each other.

  Therefore, in the present embodiment, a case will be described in which it is possible to limit portable communication terminals that can be connected to each other before establishing communication connection between portable communication terminals. The description of the same or equivalent configurations and processes as those in the first to fourth embodiments will be omitted.

  The connection target terminal specific information processing unit 100 performs a communication group setting process for a portable communication terminal that desires a communication connection as a stage before establishing a communication connection between the portable communication terminals.

  For example, as a step before establishing communication connection between portable communication terminals, the connection target terminal specific information processing unit 100 of the portable communication terminal is displayed on the touch panel type display device 72 in the portable communication terminal (see FIG. An input indicating that “upper”, “lower”, “left”, and “right” positions shown in FIG. 28 are selected is received. Then, in order to perform a communication group setting process including portable communication terminals that desire communication connection, it is determined whether the portable communication terminal is a communication group target with respect to other portable communication terminals within a predetermined distance. Communication group inquiry information (key) for broadcast distribution. The connection target terminal specific information processing unit 100 receives communication group response information (value) sent from another portable communication terminal.

  Based on the communication group response information (value) received by the connection target terminal specific information processing unit 100, the connection target terminal specific correspondence determination processing unit 101 and the communication group query information distributed by the connection target terminal specific information processing unit 100 and It is determined whether the communication group response information matches or corresponds.

  The communication group inquiry information refers to information that is broadcasted to set a communication group that limits portable communication terminals that can be connected to each other. The communication group response information is information returned from the portable communication terminal that has received the communication group inquiry information in response to the communication group inquiry information.

  As communication group inquiry information and communication group response information, icon selection time information indicating time information when the connection target terminal specific information processing unit 100 receives an input indicating that an icon has been selected, and a connection target terminal specific information processing unit 100 There is icon position information indicating the position information of the icon that has received the input. For example, when learner A sets a communication group for portable communication terminal A and portable communication terminal B, learner A is displayed at the “right” position of portable communication terminal A as shown in FIG. And the icon displayed at the “left” position of the portable communication terminal B are tapped at the same timing. When such an operation is performed, the icon selection time information is “13:30:05” and the icon position information is “right” as communication group inquiry information. On the other hand, as the communication group response information, the icon selection time information is “13:30:05”, and the icon position information is “left”.

  The connection target terminal specific correspondence determination processing unit 101 determines the correspondence based on the determination table shown in FIG. 29 in order to determine the correspondence between the communication group inquiry information and the communication group response information, but is not limited thereto. . When the icon selection time information of the communication group inquiry information is “13:30:05”, if the icon selection time information of the communication group response information is “13:30:05”, it is determined that there is a correspondence relationship. Further, if the icon selection time information of the communication group response information is within a predetermined time (for example, about 1 to 2 seconds) from the icon selection time of the communication group inquiry information, it may be determined that there is a correspondence relationship. When the icon position information of the communication group inquiry information is information indicating “right”, if the icon position information of the communication group response information is information indicating “left”, it is determined that there is a correspondence relationship. In addition, communication group inquiry information and communication group response information include affiliation class information, group identification information, title of mounting data (referred to as “mounting” in this specification), mounting cache, and amount of mounting data. May be.

  When the connection establishment processing unit 102 determines that the correspondence relationship between the communication group inquiry information and the communication group response information matches or corresponds in the connection target terminal specific correspondence determination processing unit 141, A communication group is set up so that communication is possible with the portable communication terminal that has been sent and the portable communication terminal that has returned the communication group response information. As shown in FIG. 28, the connection establishment processing unit 102 can easily recognize that each learner can communicate with each portable communication terminal set in a communicable communication group. The color tone of the touch panel display device 72 of each portable communication terminal may be changed to a specific color, or a symbol indicating that a communication group has been set may be displayed.

  In the same way as in the first embodiment, the connection target terminal specific information processing unit 100 of the portable communication terminal between the portable communication terminals in which the communication group is set as described above is connected to other portable communication in which the communication group is set. Multicast distribution and unicast distribution of connection target terminal inquiry information to terminals. In addition, the connection target terminal specific information processing unit 100 receives connection target terminal response information sent from another portable communication terminal in which a communication group is set.

  Then, the connection target terminal specific correspondence determination processing unit 101 executes a process for determining a match between the connection target terminal inquiry information and the connection target terminal response information. When the connection target terminal inquiry information matches the connection target terminal response information, a communication connection between the portable communication terminals is established.

  Next, as in the first embodiment, the combination position correspondence processing unit 111 of the combination position setting processing unit 11 of each portable communication terminal determines whether the combination position response information matches or corresponds to the combination position inquiry information. To do. The combination position inquiry information and the combination position response information include information indicating the combination position and movement start time information thereof.

  In the present embodiment, when the portable communication terminal A and the portable communication terminal B in which the communication group is set are combined, the icon displayed at the “right” position of the portable communication terminal A as shown in FIG. And an icon displayed at the “left” position of the portable communication terminal B, a so-called “pinch” operation is performed. The combination position processing is started by performing the “pinch” operation on each icon in this way. In this case, the icon combination position inquiry information is information indicating the combination position “right” and the movement start time information of the icon, whereas the icon combination position response information is information indicating the combination position “left” and the icon. Is the movement start time information. A determination table of the relationship between the combination position inquiry information and the combination position response information is schematically shown in FIG. In the movement start time information, the movement start time information of the combination position response information is not limited to the case where the movement start time information of the combination position inquiry information and the movement start time information of the combination position response information are the same time. If it is within a predetermined time from the information movement start time information, it is determined that the timing is the same and that it corresponds.

  When the combination position correspondence processing unit 111 determines that the combination position inquiry information and the combination position response information match or correspond to each other, information indicating the combination position of the combination position inquiry information and an icon of the communication group inquiry information It may be determined whether the position information matches or corresponds, and whether the information indicating the combination position of the combination position response information matches the icon position information of the communication group response information. For example, when the information indicating the combination position of the combination position inquiry information is “right”, it is determined whether the icon position information of the communication group inquiry information is “right”, and information indicating the combination position of the combination position response information Is “left”, it is determined whether the icon position information of the communication group response information is “left”.

  Then, when the combination position correspondence processing unit 111 determines that the combination position inquiry information and the combination position response information match or correspond, the position determination processing unit 112 combines the portable communication terminal at the combination position. decide.

  Next, the communication group setting process of the connection target terminal specifying unit 10 according to the present embodiment will be described with reference to the sequence diagram of FIG. In the following description, it is group learning in a school lesson, and four learners (students) (learners A to D) have their respective portable communication terminals (portable communication terminals A to portable types). A case of combining communication terminals D) will be described. A detailed description of the same or similar processing as the processing described in the first to fourth embodiments in the connection target specifying processing unit 10 will be omitted below.

  Communication group setting in which portable communication terminal A to portable communication terminal D are portable communication terminals capable of communication connection as a pre-stage for establishing communication connection between portable communication terminal A to portable communication terminal D Start processing.

  When learner A makes a selection in portable communication terminal A to start communication group setting for another portable communication terminal (for example, tap the circle icon shown in FIG. 28), it is transferred to portable communication terminal A. The connection target terminal specific information processing unit 100 of A receives and broadcasts the communication group inquiry information that becomes the key. In this embodiment, icon selection time information (for example, “13:30:05”) and icon position information (for example, “right”) are distributed as communication group inquiry information.

  The communication group response information corresponding to the communication group inquiry information in the connection target terminal specific information processing unit 100 of the portable communication terminal B to the portable communication terminal D that has received the communication group inquiry information broadcast-distributed from the portable communication terminal A. Upon accepting the selection (for example, tapping the circle icon shown in FIG. 28), the connection target terminal specific information processing unit 100 in the portable communication terminal (for example, the portable communication terminal B) causes the portable communication terminal A to , Send communication group response information. As the communication group response information, icon selection time information (for example, “13:30:05”) and icon position information (for example, “left”) are transmitted.

  Then, the connection target terminal specific information processing unit 100 of the portable communication terminal A receives the communication group response information, and the connection target terminal specific correspondence determination processing unit 101 matches or corresponds to the communication group inquiry information and the communication group response information. Determine if there is a relationship. In this embodiment, the connection target terminal specific correspondence determination processing unit 101 has a correspondence between the icon position information (“right”) of the communication group inquiry information and the icon position information (“left”) of the communication group response information. Is determined. In addition, the connection target terminal specific correspondence determination processing unit 101 performs icon selection time information (“13:30:05”) of communication group inquiry information and icon selection time information (“13:30:05” of communication group response information). ) And the same time, it is determined that there is a correspondence relationship.

  As described above, when the connection target terminal specific correspondence determination processing unit 101 determines that the communication group inquiry information and the communication group response information match or have a correspondence relationship, the connection establishment processing unit 102 determines that the portable communication terminals A and B Set a communication group that can communicate. As shown in FIG. 33, the color tone of the touch panel display device 72 of the portable communication terminals A and B in which the communication group is set is changed to a specific color, while the portable communication terminal C in which no communication group is set. The color tone of the touch panel type display device 72 of D and D remains unchanged.

  The communication group setting process is repeated, and a communication group capable of communication is set for the portable communication terminal A and the portable communication terminals B to D. In this state, the portable communication terminals B to D have not yet established a communication connection with the portable communication terminal A or with another portable communication terminal.

  Next, in order for the portable communication terminal A to establish communication connection with the portable communication terminals B to D, the portable communication terminals B to D communicate with each other in the connection target specifying processing unit 10 of the portable communication terminal A. Execute the process of establishing a connection. The following process may be executed in any one of the connection target identification processing units 10 of the portable communication terminals B to D.

  When learner A selects to start the process of combining with portable communication terminals B to D in portable communication terminal A, it accepts it at connection target specific information processing unit 100 of portable communication terminal A, and Multicast distribution and unicast distribution of connection target terminal inquiry information. For example, communication group information set between the portable communication terminal A and the portable communication terminals B to D is distributed as the key.

  Since the portable communication terminals B to D that have received the connection target terminal inquiry information broadcast from the portable communication terminal A are set in a communication group that can communicate with the portable communication terminal A, they correspond to the key. Returns value by multicast or unicast.

  Then, when the information corresponding to the value corresponding to the information that is the key that has been multicast and unicast distributed from the portable communication terminal A is received from each portable communication terminal B to portable communication terminal D, the portable communication terminal A The connection target terminal specific correspondence determination processing unit 101 refers to the determination table to determine a match between the distributed connection target terminal inquiry information and the received connection target terminal response information. And the portable communication terminal B thru | or the portable communication terminal D with which the connection object terminal inquiry information and the connection object terminal response information corresponded are specified as a connection other party, and a communication connection is established similarly to Example 1. FIG.

  Even if connection target terminal response information is returned from a portable communication terminal that is not set in a communication group that can communicate with the portable communication terminal A, the connection target terminal inquiry information and the connection target terminal response information match. Therefore, since the portable communication terminal is not specified as the connection partner, the communication connection is not established.

  As described above, the portable communication terminal A to the portable communication terminal D can directly communicate with each other.

  Next, the combination position is set by the combination position setting processing unit 11 of the portable communication terminals A to D. An icon indicating the combination position is displayed on the display devices of the portable communication terminals A to D, and the selection (for example, “pinch” operation) is received by the combination position information processing unit 110, so that the portable communication terminal of the corresponding combination position is received. And a combination is made.

  For the portable communication terminals B to D identified as the connection target terminals by the connection target terminal measurement processing unit 10 described above, the combination position inquiry information indicating the combination position from the combination position information processing unit 110 of the portable communication terminal A ( key) is distributed by multicast. For example, when the combination position of the portable communication terminal B with respect to the portable communication terminal A is determined, the icon shown at the “right” position of the portable communication terminal A and the “left” position of the portable communication terminal B are set. When a so-called “pinch” operation is performed so that the displayed icons are attracted to each other, the combination position information processing unit 110 of the portable communication terminal A receives the information and indicates the combination position “right” as combination position inquiry information. The information and the movement start time information are transmitted to the portable communication terminals B to D.

  Of the combination position information processing units 110 of the portable communication terminals B to D that have received the combination position inquiry information described above, for example, the combination position information processing unit 110 of the portable communication terminal B includes the information “right” indicating the combination position. When input of “left” is received as combination position response information corresponding to the combination position inquiry information including the movement start time information “13:30:30”, information “left” indicating the combination position and the movement start time information thereof are received. The combination position response information consisting of “13:30:30” is transmitted.

  The combination position correspondence determination processing unit 111 of the portable communication terminal A that has received the combination position response information described above determines whether the combination position inquiry information and the combination position response information match or have a correspondence relationship. When it is determined that the two match or have a correspondence relationship, the position determination processing unit 112 of the portable communication terminal A determines that the portable communication terminal B is combined on the right side of the portable communication terminal A. . Then, the information is transmitted to the portable communication terminal B. The position determination processing unit 112 of the portable communication terminal B that has received this information determines that the portable communication terminal A is combined with the left side of the portable communication terminal B. The combination position is determined between the portable communication terminal A and the portable communication terminal B by the above processing.

  When the combination position correspondence processing unit 111 determines that the combination position inquiry information matches or corresponds to the combination position response information, information indicating the combination position of the combination position inquiry information and the icon position of the communication group inquiry information It may be determined whether the information matches or corresponds, and whether the information indicating the combination position of the combination position response information matches the icon position information of the communication group response information.

  The process of establishing the communication connection between the portable communication terminals B to D in the connection target specifying processing unit 10 of the portable communication terminal A and the combination position in the combination position setting processing unit 11 of the portable communication terminals A to D are as follows. The setting process has been described as a separate process for convenience of explanation, but may be executed as a single process.

  As described above, a combination of portable communication terminals is realized by performing a simple operation of “pinching” the icons displayed on each portable communication terminal to be combined across the portable communication terminals. It is possible to That is, even a learner who is unfamiliar with the operation of the electronic device is not confused by the operation because it is easy to feel sensuously. Furthermore, it is easy for the instructor explaining the operation to the learner to explain the operation.

  By using the display system 1 of the present invention, when a plurality of portable communication terminals are combined into a single display device, the display system 1 can easily set the combination position.

1: Display system 10: Connection target terminal identification processing unit 11: Combination position setting processing unit 12: Mount size setting processing unit 13: Operation processing unit 70: Computing device 71: Storage device 72: Touch panel display device 73: Communication device 100 : Connection target terminal specific information processing unit 101: connection target terminal specific correspondence determination processing unit 102: connection establishment processing unit 110: combination position information processing unit 111: combination position correspondence determination processing unit 112: position determination processing unit 113: combination Position display control processor

Claims (9)

A display system combining a plurality of portable communication terminals and displaying as one display device,
A connection target terminal identification processing unit that identifies a portable communication terminal that is a communication partner of the portable communication terminal;
When the combination with the specified portable communication terminal is displayed, the selection of the combination position is accepted by displaying the position that can be combined, and the portable communication terminal and the corresponding combination position can be selected. A combination position setting processing unit that combines the portable communication terminal with the combination position that has received the selection;
An operation processing unit for reflecting an operation performed on the portable communication terminal on the combined portable communication terminal and executing display of an area corresponding to the combined position;
A display system comprising: The combination position setting processing unit
When information on a combination position is received from the portable communication terminal, selection of the combination position is received at the portable communication terminal, and the information on the combination position received is transmitted to the portable communication terminal, thereby the portable communication terminal. Combine with the specified portable communication terminal at the combination position received by the terminal.
The display system according to claim 1. The combination position setting processing unit
A combination position information processing unit for transmitting information on the combination position received in the portable communication terminal to the portable communication terminal serving as the communication partner;
A combination position correspondence determination processing unit for determining a match or correspondence between the transmitted combination position information and the combination position information received from the portable communication terminal serving as the communication partner;
Based on the determination result, a position determination processing unit that combines the portable communication terminal and the portable communication terminal serving as the communication partner at the received combination position;
The display system according to claim 1, further comprising: The combination position setting processing unit
In the identified portable communication terminal, the portable communication terminal that has received the selection of the combination position transmits the information of the combination position that has received the selection to the identified portable communication terminal. A combination position display control processing unit for performing display control processing of display of a position corresponding to the combination position, or display of a position other than the position corresponding to the combination position;
The display system according to claim 1, further comprising: The display system further comprises:
A mount size setting processing unit for determining the size including the display range of the display device of the combined portable communication terminal as the size of the mount;
5. The display system according to claim 1, comprising: A display program that combines a plurality of portable communication terminals to display as one display device,
The display program displays the portable communication terminal,
A connection target terminal identification processing unit that identifies a portable communication terminal that is a communication partner of the portable communication terminal;
When the combination with the specified portable communication terminal is displayed, the selection of the combination position is accepted by displaying the position that can be combined, and the portable communication terminal and the corresponding combination position can be selected. A combination position setting processing unit for combining the portable communication terminal with the combination position that has received the selection;
An operation processing unit that reflects an operation performed on the portable communication terminal on the combined portable communication terminal and displays an area corresponding to the combined position;
Display program characterized by functioning as A display method for performing display by combining a plurality of portable communication terminals as one display device,
Transmitting connection target terminal inquiry information for identifying a portable communication terminal that is a communication partner of the portable communication terminal;
Receiving connection target terminal response information corresponding to the connection target terminal inquiry information from another portable communication terminal;
Identifying a portable communication terminal to be the communication partner by determining whether the connection target terminal inquiry information and the connection target terminal response information match or correspond;
Transmitting combination position inquiry information indicating a combination position to the identified portable communication terminal;
Receiving combination position response information corresponding to the combination position inquiry information;
When the combination position inquiry information corresponds to the combination position response information, the portable communication terminal that has transmitted the combination position inquiry information is the portable communication terminal that has transmitted the combination position response information at the combination position. Combination position, combination step,
Reflecting the operation performed on the portable communication terminal to the combined portable communication terminal;
Executing a display of an area corresponding to the combined position;
A display method characterized by comprising: The connection target terminal specifying process includes:
When the communication group setting information enabling communication connection is received from the portable communication terminal, the selection of the communication group setting is received at the portable communication terminal and the received communication group setting information is transmitted to the portable communication terminal. To set a communication group in the portable communication terminal.
The display system according to claim 1, wherein the display system is a display system. The connection target terminal specifying process includes:
A connection target terminal specific information processing unit that transmits information on the communication group setting received in the portable communication terminal to another portable communication terminal;
A connection target terminal specific correspondence determination processing unit for determining a match or correspondence between the transmitted communication group setting information and the communication group setting information received from the other portable communication terminal;
Based on the determination result, the portable communication terminal, the other portable communication terminal, a connection establishment processing unit for setting a communication group,
The display system according to any one of claims 1 to 5 or 8, characterized by comprising:

Images