JP2012185297A - Multi-display system, information processing terminal device, information processing method, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a multi-display system in which a plurality of users bring touch panel devices 10 storing respective pieces of display data not shared by the other devices to present respective pieces of display data and perform communication among them.SOLUTION: In a multi-display system configured by the touch panel devices 10, on condition that a proximity wireless communication interface of the touch panel device 10 determines that the other touch panel device 10 exists within a predetermined distance from the own device, and if transfer processing based on a user's instruction causes a display object AA03 to cross over a predetermined boundary 301, the touch panel device 10 transfers image data of the display object AA03 to the other touch panel 10 after converting display coordinate data of the display object AA03 on a screen so as to make the display object AA03 exist across a display screen of the other touch panel device 10 and a display screen of the own device 10.

Description

  The present invention relates to a multi-display system, an information processing terminal device, an information processing method, and a computer program. More specifically, the present invention relates to a multi-display system, an information processing terminal device, an information processing method, and a computer program that can realize image display in a configuration in which a plurality of displays that can operate independently are combined.

  As a device that processes and displays information, an information terminal called a touch panel is realized. This touch panel has a function to display an image input by a scanner or an image created by a computer on a display, and a function to move and transform an image using a touch panel integrated with the display or to write on the image by handwriting. have.

  If an image is stored on the touch panel instead of being printed on paper, the amount of paper used can be reduced.

  However, when comparing touch panels with paper, there are many points where paper is superior in terms of usability.

  FIG. 15 and FIG. 16 are conceptual diagrams for comparing and explaining a mode of using materials by printing on paper and a mode of using touch panels.

  For example, as shown in FIG. 15A, materials printed on a plurality of papers can be viewed side by side at the same time. On the other hand, in the case of a touch panel, a display screen can be divided and a plurality of images can be viewed side by side as shown in FIG. 15B, but each screen becomes small and difficult to see.

  Further, when printing on a large paper as shown in FIG. 16A, the paper can be folded and carried as shown in FIG. 16B. On the other hand, if an entire image having a size larger than the screen of the touch panel is displayed as shown in FIG.

  FIG. 17 is a conceptual diagram showing one method for solving the problem regarding the viewability of an image on the touch panel as described above.

  As shown in FIG. 17, in the case where there are a plurality of images to be displayed, a method of configuring a multi-display using a plurality of touch panels can be considered in order to improve the viewability on the touch panel.

  Patent Document 1 discloses a multi-display device in which a plurality of displays that can operate independently are combined and each display is provided with a four-way interface. This multi-display device can realize configuration recognition by executing signal transfer through an interface and image display in various modes. By using the multi-display device, it is possible to display images corresponding to various image display arrangement configurations based on images distributed in common to each display. The invention described in Patent Document 1 realizes a multi-display that displays “images distributed in common” on a plurality of displays using the plurality of displays.

JP 2003-280624 A

  Patent Document 1 describes a mechanism for combining a plurality of displays into a multi-display. However, in Patent Document 1, it is assumed that an image to be displayed on a multi-display is distributed to all the displays using a common interface such as wireless communication. In this method, an image that can be displayed on the multi-display is limited to one image transmitted through a common interface such as wireless communication.

  Therefore, in the multi-display as described in Patent Document 1, for example, as shown in FIG. 17, the materials are exchanged by bringing a plurality of touch panels, and the multi-display is configured by using each other's display. It was not possible to compare the contents of.

  The present invention has been made in order to solve the above-described problems, and an object of the present invention is to bring an information processing terminal device that stores a plurality of display data that are not shared with each other by a plurality of users. It is to provide a multi-display system, an information processing terminal device, an information processing method, and a computer program for communicating while presenting each display data.

  According to one aspect of the present invention, a multi-display system including a plurality of information processing terminal devices, each of the plurality of information processing terminal devices includes an input interface for receiving an instruction from a user, and other information processing A proximity wireless communication interface for data communication with a terminal device, a storage device for storing image data for displaying an object, and a display screen for displaying the object, and a display area of the display screen, Regardless of whether other information processing terminal devices exist within a predetermined distance range, the information processing terminal device includes an independent display area that is an area inside the display area for executing object display processing, and further includes a processor, Other information processing terminal devices within a predetermined distance by the proximity wireless communication interface If the object exceeds the boundary of the independent display area due to the movement process instructed by the user, the display coordinate data on the screen for displaying the object among the image data is However, in response to displaying from the display screen of another information processing terminal device so as to exist across the display screen of the other information processing device, the image data is converted to display coordinates on the other information processing terminal device and Multi-display system that transfers to the information processing terminal device.

  Preferably, the image data includes content data indicating the content of the object to be displayed, unique information for identifying the object, and display range information indicating a range in which the object is displayed. The processor determines whether or not the transferred image data is an already transferred object based on the unique information of the image data transferred from the other information processing terminal device, and is transferred from the other information processing terminal device. If the image data is an object that has been transferred, and the object is moved from the current display position, the display position of the object displayed by itself is changed.

  Preferably, when the image data transferred from another information processing terminal device is an already transferred object, when the object is changed from the current size, the size of the object displayed by itself is changed.

  Preferably, when the image data transferred from another information processing terminal device is a transferred object, when the display position and size of the object are changed from the current display position and size, the image data is displayed by itself. The display position and size of the object are changed through a plurality of stages up to the changed display position and size.

  According to another aspect of the present invention, an information processing terminal device capable of configuring a multi-display system including a plurality of display screens, an input interface for receiving an instruction from a user, and the other capable of configuring a multi-display system A proximity wireless communication interface for data communication with an information processing terminal device, a storage device for storing image data for displaying an object, a display screen for displaying the object, and a multi-display system A display screen for configuring the display screen, and the display area of the display screen is a display area for executing the object display process regardless of whether or not the other information processing terminal device exists within a predetermined distance range. Includes an independent display area, which is an internal area, and a processor The processor further includes a processor that moves the object according to an instruction from the user when the other wireless communication interface determines that another information processing terminal device is close within a predetermined distance. When it exceeds, display coordinate data on the screen for displaying the object in the image data so that the object exists across the display screen from the display screen of another information processing terminal device. Corresponding to the above, the image data is transferred to another information processing terminal device by converting into display coordinates in the other information processing terminal device.

  According to still another aspect of the present invention, there is provided an information processing method for an information processing terminal device capable of configuring a multi-display system composed of a plurality of display screens. A proximity wireless communication interface for data communication with an information processing terminal device, a storage device for storing image data for displaying an object, and a display screen for displaying the object, which constitute a multi-display system A display screen and a processor for performing display processing of an object regardless of whether or not the display area of the display screen is within a predetermined distance range of another information processing terminal device When including an independent display area that is an area inside the area, However, the step of determining whether another information processing terminal device is close within a predetermined distance by the proximity wireless communication interface and the processor is close to the other information processing terminal device within a predetermined distance In this case, a step for determining whether or not the object has exceeded the boundary of the independent display area by a moving process in accordance with an instruction from the user, and a screen for displaying the object in the image data when the processor exceeds the boundary. Corresponding to displaying the display coordinate data above so that the object exists across the display screen of the other information processing terminal device from the display screen of the other information processing terminal device, A converting step, and a processor transferring the converted image data to another information processing terminal device. And up, to run.

  According to still another aspect of the present invention, there is provided a computer program for causing a processor of an information processing terminal device capable of configuring a multi-display system including a plurality of display screens to execute information processing. Proximity wireless communication interface for data communication with other information processing terminal devices that can constitute a display system, a storage device for storing image data for displaying objects, and a display screen for displaying objects A display screen for configuring a multi-display system, and the display area of the display screen displays an object regardless of whether other information processing terminal devices are within a predetermined distance range. It is an area inside the display area where processing is executed. When including the independent display area, the processor determines whether or not the other information processing terminal device is close within a predetermined distance by the proximity wireless communication interface; and the processor determines whether the other information processing terminal device is predetermined. When the object has crossed the boundary of the independent display area by the moving process in response to an instruction from the user, and when the processor exceeds the boundary, In response to displaying the display coordinate data on the screen for displaying the object so that the object exists across the display screen of the other information processing terminal device from the display screen of the other information processing terminal device. A step of converting into display coordinates in the information processing terminal device; and a processor that converts the converted image data And forwarding the information processing terminal device, to execute the information processing terminal device, the computer program.

  Note that, preferably, when the mutual contact of the display screens is stopped, the display screens that are distant from each other can be displayed at different display positions and different display magnifications. In this case, a part of the image can be enlarged, or different places can be viewed simultaneously using a plurality of display screens.

  Alternatively, preferably, when there is an object having the same unique information when the display screen is brought into contact, the position and the display magnification are gradually changed so that the object becomes a common image, but the image in the selected state is displayed. The position may not be changed. Such a movement mechanism makes it easy for the user to know whether or not each other has a common image.

  According to the multi-display system, the information processing terminal device, the information processing method, and the computer program of the present invention, images stored on different display screens are brought close to each other and the images are moved on any display screen. Thus, a multi-display using both display screens can be automatically configured, and images held by each other can be exchanged.

  Alternatively, according to the multi-display system, the information processing terminal device, the information processing method, and the computer program of the present invention, when an image displayed on a certain display screen is moved or the display magnification is changed, the adjacent display If there are images having the same unique information on the screen, the display position or the display magnification is changed in the same way.

  Alternatively, according to the multi-display system, the information processing terminal device, the information processing method, and the computer program of the present invention, a multi-display is configured on the spot, and each display is used to enlarge a display screen or a plurality of materials. Comparison and mutual image data exchange.

It is a block diagram which shows typically the structure of the "multi-display system" in this Embodiment. It is a functional block diagram which shows the structure of the touch panel apparatus 10 which comprises the touch panel system of this Embodiment. 4 is a conceptual diagram for explaining a structure of image data displayed on a display 114 and a mode in which the image data is displayed on the display 114. FIG. It is a 1st flowchart which shows an example of the process sequence in the touchscreen apparatus 10 which comprises the touchscreen system of this Embodiment. It is a 2nd flowchart which shows an example of the process sequence in the touch panel apparatus 10 which comprises the touch panel system of this Embodiment. It is a conceptual diagram for demonstrating the example of a display process of the touch panel apparatus 10 of this Embodiment. It is a conceptual diagram for demonstrating the example of a display process of the touch panel apparatus 10 of this Embodiment. It is a conceptual diagram for demonstrating the example of a display process of the touch panel apparatus 10 of this Embodiment. It is a conceptual diagram for demonstrating the example of a display process of the touch panel apparatus 10 of this Embodiment. It is a conceptual diagram for demonstrating the example of a display process of the touch panel apparatus 10 of this Embodiment. It is a conceptual diagram for demonstrating the example of a display process of the touch panel apparatus 10 of this Embodiment. It is a conceptual diagram for demonstrating the example of a display process of the touch panel apparatus 10 of this Embodiment. It is a conceptual diagram for demonstrating the example of a display process of the touch panel apparatus 10 of this Embodiment. It is a conceptual diagram for demonstrating the boundary line in such a touch panel apparatus. It is a conceptual diagram for comparing and explaining the aspect using a document by printing on paper and the aspect using a touch panel. It is a conceptual diagram for comparing and explaining the aspect using a document by printing on paper and the aspect using a touch panel. It is a conceptual diagram which shows one method of solving the problem about the browsing property of the image in a touch panel as mentioned above.

Hereinafter, the present invention will be specifically described with reference to the drawings showing embodiments thereof.
FIG. 1 is a configuration diagram schematically showing a configuration of a “multi-display system” in the present embodiment.

  In FIG. 1, the multi-display system includes a plurality of information processing terminal devices for executing display processing on each display. More specifically, the multi-display system is a terminal device system including a plurality of portable display terminal devices arranged so as to come into contact with each other.

  As will be described below, in the present specification, the “portable display terminal device” has the following characteristics.

i) a device having a substantially rectangular parallelepiped housing,
ii) A display is provided on the main surface of the housing (the surface having the largest area among the surfaces forming the rectangular parallelepiped shape),
iii) A device capable of displaying an image corresponding to display data stored in a storage device in a portable display terminal device on the display,
iv) When the other portable display terminal device and any one of the sides of the main surface are in contact with each other and the respective displays are arranged so as to be arranged on substantially the same plane, The display is visible when a single display screen is formed. More specifically, the width of the frame portion of the display on the main surface is narrow enough to be visually recognized when a single display screen is formed when a plurality of displays are combined as described above. Say things. The “substantially rectangular parallelepiped shape” may be a flat plate shape.

  The display of the “portable display terminal device” can be a touch panel that allows a user to input an instruction by touching with a finger.

  A “touch panel” is an electronic component that combines a display device such as a liquid crystal panel and a position input device such as a touch pad, and is an input device that operates a device by pressing a display on a screen.

  Hereinafter, as a portable display terminal device constituting the multi-display system of the present embodiment, a touch panel device including a touch panel as a display will be described as an example.

  Accordingly, FIG. 1 shows the appearance of a touch panel system including a plurality of touch panel devices as a multi-display system.

  Referring to FIG. 1, a touch panel system is configured using nine touch panel devices 10. In the present embodiment, proximity wireless communication interfaces 2a, 2b, 2c, and 2d are mounted in four directions on the top, bottom, left, and right of each touch panel.

  The “proximity wireless communication interface” is not particularly limited, but, for example, an interface of TransferJet specification can be used. In the most basic operation of the TransferJet interface, data is automatically transferred by bringing two devices close to a connectable distance of about 3 cm.

  Therefore, using the TransferJet specification interface, the touch panel devices can determine the proximity of a predetermined connectable distance to operate as a multi-display system, as will be described later, and the communicable distance for data communication. In the case of approaching, the processing for executing the required data transfer is executed by the same interface device. That is, in this case, since the communicable distance is sufficiently small, it is possible to perform the processing assuming that the connectable distance and the communicable distance are equal.

  In addition, a separate sensor for determining whether or not the touch panel devices have approached each other up to the connectable distance as described above, for example, a proximity sensor that detects the presence of electromagnetic induction or a proximity sensor that transmits and receives light is used as wireless data. If the configuration is provided separately from the communication interface, such a wireless data communication interface may be, for example, Bluetooth (registered trademark), wireless USB (WUSB), which is a communication standard in which the communicable distance is larger than the connectable distance. ) Etc. can be used. That is, in this case, for example, the proximity sensor and the interface for wireless data communication can be considered as a “proximity wireless communication interface”.

  Therefore, in this specification, the interface is not limited to the TransferJet specification interface, and the “proximity wireless communication interface” means that devices equipped with the interface device are close to a predetermined connectable distance for operating as a multi-display system. This means an interface device that can execute both the determination processing and the processing for executing the required data transfer when the communication distance is close to the communicable distance.

  FIG. 2 is a functional block diagram showing the configuration of the touch panel device 10 constituting the touch panel system of the present embodiment.

  The touch panel device 10 constituting the touch panel system has a function as a personal computer, and includes a control unit 100, a temporary storage unit 101, a storage unit 102, an input processing unit 103, a display processing unit 104, and a communication. Processing units 201, 202, 203, and 204 are provided. Specifically, the touch panel device 10 may be a portable tablet personal computer having a flat outer shape and having a touch panel type display / input unit. The touch panel device 10 further includes a touch pad 113 and a display 114.

  The control unit 100 is configured by a CPU (Central Processing Unit), reads the touch panel program 1P stored in the storage unit 102 into the temporary storage unit 101, and executes it, thereby making the touch panel device 10 an information processing terminal device. Make it work.

  The storage unit 102 uses a non-volatile storage device such as a hard disk or an SSD (Solid State Drive). The storage unit 102 stores a touch panel program 1P. In addition, the storage unit 102 may store other application software programs in the touch panel device 10.

  The temporary storage unit 101 includes a volatile storage device such as an SRAM (Static Random Access Memory) or a DRAM (Dynamic Random Access Memory). The temporary storage unit 101 stores the touch panel program 1P read as described above, and functions as a storage work area of the control unit 100, and stores information generated by processing of the control unit 100.

  To the input processing unit 103, the touch panel device 10 is connected to a touch pad 113 that receives input from the pen 130 or the user's finger. The input processing unit 103 receives information such as button press information input by a user operation of the touch panel device 10 and coordinate information indicating a position on the screen, and notifies the control unit 100 of the information.

  A display 114 using a liquid crystal display or the like is connected to the display processing unit 104. The control unit 100 outputs a touch panel application screen on the display 114 via the display processing unit 104, and displays an image to be shared in the application screen. The display processing unit 104 includes, for example, a VRAM (Video RAM), a graphics processing unit GPU, and the like. Note that the GPU may be an on-board graphics chip.

  Although not particularly limited, the storage area of the VRAM corresponds to an area wider than the display area of the display 114, and an image corresponding to data existing in a predetermined range of the storage area of the VRAM is displayed on the display 114. It is good. In this case, since the display processing unit 104 uses the VRAM with a larger area than the display area of the display 114 as a drawing area, the graphic processing (object) that protrudes from the display area is also processed according to the instruction from the CPU. Although it is performed, the display 114 may be configured such that the display itself is not displayed until the figure enters a predetermined range.

  The communication processing units 201, 202, 203, and 204 are connected to antennas 201a, 202a, 203a, and 204a for performing close proximity wireless communication, and packets of information that are transmitted and received with other touch panels that touch in four directions, up, down, left, and right And reading information from packets. The communication processing unit 201 and the antenna 201a correspond to the proximity wireless communication interface 2a, the communication processing unit 202 and the antenna 202a correspond to the proximity wireless communication interface 2b, and the communication processing unit 203 and the antenna 203a correspond to the proximity wireless communication interface 2c. The communication processing unit 204 and the antenna 204a correspond to the close proximity wireless communication interface 2d.

  In order to realize the touch panel system according to the present embodiment, a protocol such as TransferJet may be used as a communication protocol for transmitting and receiving images and sounds by the communication processing units 201, 202, 203, and 204. However, the communication protocol is not limited to these.

  FIG. 3 is a conceptual diagram for explaining a structure of image data displayed on the display 114 and an aspect in which the image data is displayed on the display 114.

  First, FIG. 3B is an explanatory diagram illustrating an example of the main screen 400 of the application for the touch panel device displayed on the display 114 of the touch panel device 10 used by the user.

  The main screen 400 of the touch panel device application displays a plurality of images in a superimposed manner. As an example, in the example shown in FIG. 3, a photograph AA01, a text document AA02, and a video image AA03 are displayed.

  In the present specification, data such as the photograph AA01, the text document AA02, and the video image AA03 are referred to as “object” as a unit of display processing. An object is a unit that can be moved and edited as a unit on the display screen in accordance with a user instruction.

  In FIG. 3B, a thick selection frame 300 is displayed at the edge of the video image AA03, which indicates that the video image is selected. The selection operation is performed by the user clicking on the display 114 using the pen 130 or the mouse. Also, the selected data can be moved by dragging the inside of the selection frame 300. Also, the selected data can be enlarged or reduced by dragging the edge of the selection frame.

  FIG. 3A is a display list describing the contents (objects) displayed in FIG. In the first column, an ID unique to each object is recorded. In the second column, the type of data is recorded. The contents of the data are recorded in the third column. In the fourth column, an unprocessed flag indicating whether or not these display data has been processed is recorded. In the fifth column, a selection flag indicating whether or not these display data are selected is recorded. How these display list data are processed will be described with reference to a flowchart.

  FIG. 4 is a first flowchart showing an example of a processing procedure in the touch panel device 10 constituting the touch panel system of the present embodiment, and FIG. 5 is a second flowchart.

  Referring to FIGS. 4 and 5, control unit 100 performs the following processing in a state where main screen 400 is displayed on display 114.

  First, the control unit 100 initially sets all the unprocessed flags of the objects in the display list describing the objects to be displayed on the screen to ON (step S101). As will be described later, the unprocessed flag is turned off when it is determined whether data transfer processing to another touch panel device is necessary and the transfer processing is completed (step S150). Also, when the figure is moved or deformed (step S106) or corrected by comparison with the data in the transfer list (step S171), it is turned ON.

  Subsequently, the control unit 100 enters a standby state for receiving an event notification (step S102). Here, the “event” occurs when an operation is performed on the user interface, and also occurs at a predetermined time interval, for example, independently of the execution of the application program executed on the touch panel device 10.

  The control unit 100 determines whether or not the received event is data selection (step S103). When the control unit 100 determines that the data is selected (S103: YES), the control unit 100 turns on the selection flag of the selected object in the display list storing the data displayed on the screen, and selects the selected data. The selection flag of the object that has fallen off is turned off (step S104). In response to this, the display processing unit 104 changes the selected object to a display state in a selected state (for example, thickening the frame line). The control unit 100 returns the process to step S102 and enters a standby state for receiving the next event notification.

  When the control unit 100 determines that the received event is not data selection (S103: NO), the control unit 100 determines whether the received event is data movement or deformation (step S105). When it is determined that the received event is data movement or deformation (S105: YES), the control unit 100 rewrites information such as the coordinates of the moved / deformed object to the contents after the movement / deformation. Further, the unprocessed flag of the rewritten object is turned ON (step S106). The control unit 100 returns the process to step S102 and enters a standby state for receiving the next event notification.

  When the control unit 100 determines that it is not data movement / deformation (S105: NO), the control unit 100 proceeds to data transfer processing with another touch panel. The control unit 100 determines whether there is data whose unprocessed flag is ON in the display list (step S107). If the control unit 100 determines that there is data whose unprocessed flag is ON (S107: YES), the unprocessed data is set as data GA (step S108), and is it necessary to transfer the data GA to another touch panel? Judge whether.

  That is, first, in step 110, it is determined whether the touch panel is in contact with the right side. In step 120, it is determined whether the touch panel is in contact with the left side. In step 130, it is determined whether the touch panel is in contact with the upper side. In step 140, it is determined whether the touch panel is in contact with the lower side.

  When it is determined that the touch panel is in contact with the right side (S110: YES), the control unit 100 sets the right “boundary line for movement processing” (hereinafter simply referred to as “boundary line”) and unprocessed data. It is determined whether or not the circumscribed rectangle of the GA is in contact (step S111).

  Here, the “boundary line” will be described. FIG. 14 is a conceptual diagram for explaining a boundary line in such a touch panel device 10.

  Referring to FIG. 14, for example, a dotted line 301 in FIG. 14 is a right boundary line. That is, a line that is a predetermined distance inward from the right edge of the display area of the display 114 of the touch panel device 10 and is parallel to this edge is the “right boundary line”.

  In addition, more generally, an area having a line that is a certain distance inside the outer periphery of the display area of the display 114 is considered as an object moving process to another touch panel device 10 as will be described later. If it is called an “independent display area” in the sense that the display process is performed without doing so, it may be said that the outer peripheral line of the independent display area is a boundary line. When the display area of the display 114 is rectangular, the independent display area is also rectangular, and the boundary lines are four sides of the rectangle. Each side may be separated from the parallel side of the display area of the display 114 by the same distance, or each of the four sides may be separated by a different distance. It may be set independently on each of the four sides.

  When the control unit 100 determines that the circumscribed rectangle of the unprocessed data GA is in contact with the boundary line 301 (S111: YES), the control unit 100 reduces the X coordinate of the unprocessed data GA by the width of the display range of the touch panel, After correcting to the value moved to the left side, transfer to the right touch panel. The right touch panel device adds the transferred data to the transfer list 501 of the right touch panel (step S112). Thereafter, the process proceeds to step S120. In the example shown in FIG. 14, since the video image AA03 exceeds the right boundary line, the data of the video image AA03 is transferred and added to the transfer list 501 of the right touch panel.

  If the control unit 100 determines that the touch panel is not in contact with the right side (S110: NO), or determines that the circumscribed rectangle of the unprocessed data is not in contact with the boundary line (S111: NO), step The process moves to S120.

  When it is determined that the touch panel is in contact with the left side (S120: YES), the control unit 100 determines whether the preset left boundary line and the circumscribed rectangle of the unprocessed data GA are in contact (step S121). . Here, the dotted line 302 in FIG. 14 is the left boundary line.

  When the control unit 100 determines that the circumscribed rectangle of the unprocessed data GA is in contact with the boundary 302 (S121: YES), the control unit 100 adds the X coordinate of the unprocessed data GA by the width of the display range of the touch panel and adds it to the right side. After changing to the moved value, transfer to the left touch panel. The left touch panel device adds the transferred data to the transfer list 502 of the left touch panel (step S122). Thereafter, the process proceeds to step S130. In the example shown in FIG. 14, since the photograph AA01 exceeds the left boundary line, the data of the photograph AA01 is transferred and added to the transfer list 502 of the left touch panel.

  When the control unit 100 determines that the touch panel is not in contact with the left side (S120: NO), or when it is determined that the circumscribed rectangle of the unprocessed data GA is not in contact with the boundary line (S121: NO), The process moves to step S130.

  When it is determined that the touch panel is in contact with the upper side (S130: YES), the control unit 100 determines whether the upper boundary line set in advance and the circumscribed rectangle of the unprocessed data GA are in contact (Step S131). . Here, the dotted line 303 in FIG. 14 is the upper boundary line.

  When the control unit 100 determines that the circumscribed rectangle of the unprocessed data GA is in contact with the boundary line 303 (S131: YES), the control unit 100 reduces the Y coordinate of the unprocessed data GA by the vertical width of the display range of the touch panel. After correcting to the value moved to the side, transfer to the upper touch panel. The upper touch panel device adds the transferred data to the upper touch panel transfer list 503 (step S132). Thereafter, the process proceeds to step S140. In the example shown in FIG. 14, since the photograph AA01 exceeds the upper boundary line, the data of the photograph AA01 is transferred and added to the transfer list 503 of the upper touch panel.

  When the control unit 100 determines that the touch panel is not in contact with the upper side (S130: NO), or when it is determined that the circumscribed rectangle of the unprocessed data GA is not in contact with the boundary line (S131: NO), The process moves to step S140.

  When it is determined that the touch panel is in contact with the lower side (S140: YES), the control unit 100 determines whether the lower boundary line set in advance and the circumscribed rectangle of the unprocessed data GA are in contact (Step S140). S141). Here, a dotted line 304 in FIG. 14 is a lower boundary line.

  When the control unit 100 determines that the circumscribed rectangle of the unprocessed data GA is in contact with the boundary line 304 (S141: YES), the control unit 100 adds the Y coordinate of the unprocessed data GA by the vertical width of the display range of the touch panel and moves upward. After correcting to the value moved to, transfer to the lower touch panel. The lower touch panel device adds the transferred data to the lower touch panel transfer list (not shown in FIG. 14 because there is no corresponding object) (step S142). Thereafter, the process proceeds to step S150.

  The control unit 100 determines that the touch panel is not in contact with the lower side (S140: NO), or determines that the circumscribed rectangle of the unprocessed data GA is not in contact with the boundary line (S141: NO). Then, the process proceeds to step S150.

  In step S150, the control unit 100 turns off the unprocessed flag of the data GA, returns the process to step S102, and enters a standby state for receiving the next event notification.

  If the control unit 100 determines that there is no data whose unprocessed flag is ON in the display list (S107: NO), the control unit 100 moves the process from the node PA of FIG. 5 to step S160, and transmits data sent from another touch panel. It is determined whether there is any unprocessed data in its own transfer list that stores (S160). At this time, processing is performed in order from the newest data in the transfer list. If it is determined that there is data in the transfer list (S160: YES), the data at the head of the transfer list is set as data GB (step S161).

  The control unit 100 determines whether there is data GC having the same ID as the data GB in the transfer list (step S162). If there is a figure C having the same ID (S162: YES), the data GC is deleted from the transfer list (step S163), and the process returns to step S162. By repeating this process, only the latest data GB remains in the transfer list having the same ID as the data GB.

  Next, in step 164, the control unit 100 determines whether there is data GD having the same ID as the data GB in the display list. Here, when it is determined that there is no data having the same ID as the data GB in the display list (S164: NO), the data GB is added to the display list (step S165), and the added data GB is transferred. Delete from the list (step S166). By this processing, a graphic having an ID that has not existed in the display list until then is added from the transfer list to the display list. In response to this, the display processing unit 104 performs processing for displaying an object corresponding to the data GB added to the display list. Thereafter, the control unit 100 returns the processing from the node PB in FIG. 5 to the processing step S102 in FIG.

  If the control unit 100 determines in step 164 that there is data GD having the same ID as the data GB in the display list (S164: YES), the selection flag is turned on for the data GD in the display list. It is determined whether or not (step S167). If the selection flag of the data GD is ON, that is, if it is selected (S167: YES), the data GB is deleted from the transfer list (step S166).

  When the selection flag of the data GD having the same ID as the data GB is not ON in the display list, that is, when the selection flag is not selected (S167: NO), the control unit 100 displays the transfer list data GB in step S170. It is determined whether the display mode (display position, size) of the data GD of the list is the same. If it is determined that the contents of the data GB and the data GD are the same (S170: YES), the data GB is deleted from the transfer list (step S166), the processing of the data GB in the transfer list is finished, and the process starts from the node PB in FIG. The process returns to the process step S102 of 4.

  When it is determined that the display mode of the transfer list data GB is different from the display list data GD (S170: NO), the control unit 100 creates information in which the information of the data GB and the data GD is divided into N: 1. The information of the data GD is replaced with the internally divided information. Here, “information obtained by dividing the information of data GB and data GD into N: 1” means the display position and size of the object to be displayed by data GB and the display of the object currently displayed by data GD. It means image data in which the position and size are distributed at a predetermined internal ratio (N: 1). Then, the control unit 100 turns on the unprocessed flag of the data GD (step S171). Thereafter, the data GB is moved to the end of the transfer list (step S168). By performing this process, the data GD gradually approaches the position and size of the data GB.

  6, 7, 8, 9, 10, 11, 12, and 13 are conceptual diagrams for explaining a display processing example of the touch panel device 10 according to the present embodiment.

Hereinafter, a display processing example of the present embodiment will be described with reference to FIGS.
First, FIG. 6A shows a state in which the photograph AA01 is displayed at the center of the touch panel. FIG. 6B shows a state in which the photograph AA01 is selected and moved to the right side.

  On the other hand, FIG. 7 shows a virtual case where another touch panel is in contact with the right side when the state shown in FIG. In the state of FIG. 7, the photograph AA01 exceeds the right boundary line 301, so that the data is transferred to the right touch panel. If the data of the photograph AA01 is transferred as it is to the right touch panel, it will be arranged at the same position as the left touch panel, that is, AA01-2. However, in the touch panel device of the present embodiment, the touch panel X is transferred after the X coordinate of the touch panel is reduced by the display width by the processing of the flowchart in step S112 in FIG. 4, so two touch panels as shown in the photograph AA01 ′ in FIG. Are displayed as if they were one piece.

  Next, FIG. 9 shows an example in which the photograph AA01 'transferred to the right touch panel device is selected and moved to the right side. At this time, the photograph AA01 'is in contact with the left boundary line 302, but the photograph AA01 on the left touch panel is selected. In the determination of step S167 in the flowchart of FIG. 5, the data in the transfer list is ignored for the selected graphic. Because of this process, when you select a photo on the left touch panel and try to move or transform it, it prevents the photos from moving unintentionally due to the operation of other touch panel devices. be able to.

  FIG. 10 is a diagram illustrating a state in which the selection of the photograph AA01 'is canceled from the state of FIG. 9, and FIG. 11 is a case where the photograph AA01 of the left touch panel device is further enlarged from the state of FIG. At this time, since the photograph AA01 is in contact with the right boundary line 301, the data is transferred to the right touch panel. Thereafter, the process of flowchart step S171 in FIG. 5 gradually changes the size of the photograph AA01 'to a size that can be connected to the photograph AA01 on the left touch panel.

  That is, from the state of FIG. 11, during the processing of the next event, the display as shown in FIG. 12 is displayed on the right touch panel device. Subsequently, in the processing of the next event, a display as shown in FIG. 13 is displayed on the right touch panel device.

  That is, with respect to an object displayed across a plurality of touch panel devices, when only one touch panel device is selected, and the object is selected and moved or deformed, the display mode of the object on the other touch panel device is displayed. Also, it gradually changes according to the display mode of one of the touch panel devices.

  As will be apparent from the above description, in the touch panel system of the present embodiment, images stored in different touch panels are both brought into contact with each other by moving the images on either touch panel and moving or enlarging the images. A multi-display using a touch panel can be automatically configured to enlarge and display images and exchange images held by each other.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  1P touch panel program, 2a, 2b, 2c, 2d, 2a, 2b, 2c, 2d Proximity wireless communication interface, 10 touch panel device, 100 control unit, 101 temporary storage unit, 102 storage unit, 103 input processing unit, 104 display processing Part, 113 touch pad, 114 display, 130 pen, 201, 202, 203, 204 communication processing part, 201a, 202a, 203a, 204a antenna, 400 main screen, 501, 502, 503 transfer list.

Claims (7)

A multi-display system comprising a plurality of information processing terminal devices,
Each of the plurality of information processing terminal devices
An input interface for accepting instructions from the user;
A proximity wireless communication interface for data communication with other information processing terminal devices;
A storage device for storing image data for displaying the object;
A display screen for displaying the object,
The display area of the display screen is an independent area within the display area where the display process of the object is executed regardless of whether or not the other information processing terminal device exists within a predetermined distance range. Including the display area,
A processor,
The processor is
When it is determined by the close proximity wireless communication interface that the other information processing terminal device is close within the predetermined distance, the object moves the boundary of the independent display area by a movement process according to an instruction from the user. When exceeding the display coordinate data on the screen for displaying the object of the image data, the object seems to exist across the display screen of the other information processing terminal device from its own display screen. A multi-display system that converts the image data to display coordinates in the other information processing terminal device and transfers the image data to the other information processing terminal device in response to the display on the other information processing terminal device. The image data includes content data indicating the content of the object to be displayed, unique information for identifying the object, and display range information indicating a range in which the object is displayed,
The processor of the information processing terminal device determines whether the transferred image data is an already transferred object based on the unique information of the image data transferred from the other information processing terminal device,
When the image data transferred from the other information processing terminal device is a transferred object, and the object is moved from the current display position, the display position of the object displayed by itself is changed. The multi-display system according to claim 1.   When the image data transferred from the other information processing terminal device is a transferred object, and the object is changed from the current size, the size of the object displayed by itself is changed. Item 3. The multi-display system according to Item 2.   When the image data transferred from the other information processing terminal device is a transferred object, when the display position and size of the object are changed from the current display position and size, 4. The multi-display system according to claim 3, wherein the display position and size of the object are changed through a plurality of steps up to the changed display position and size. An information processing terminal device capable of configuring a multi-display system including a plurality of display screens,
An input interface for accepting instructions from the user;
A proximity wireless communication interface for data communication with other information processing terminal devices capable of configuring the multi-display system;
A storage device for storing image data for displaying the object;
A display screen for displaying the object, comprising a display screen for configuring the multi-display system,
The display area of the display screen is an independent area within the display area where the display process of the object is executed regardless of whether or not the other information processing terminal device exists within a predetermined distance range. Including the display area,
A processor,
The processor is
When it is determined by the close proximity wireless communication interface that the other information processing terminal device is close within the predetermined distance, the object moves the boundary of the independent display area by a movement process according to an instruction from the user. When exceeding the display coordinate data on the screen for displaying the object of the image data, the object seems to exist across the display screen of the other information processing terminal device from its own display screen. In response to display on the information processing terminal device, the information processing terminal device converts the display coordinates in the other information processing terminal device and transfers the image data to the other information processing terminal device. An information processing method for an information processing terminal device capable of configuring a multi-display system including a plurality of display screens,
The information processing terminal device includes a proximity wireless communication interface for data communication with another information processing terminal device capable of configuring the multi-display system, a storage device for storing image data for displaying an object, A display screen for displaying the object, comprising: a display screen for configuring the multi-display system; and a processor.
The display area of the display screen is an area inside the display area where the display process of the object is executed regardless of whether or not the other information processing terminal device exists within a predetermined distance range. When including the display area,
The processor determining whether or not the other information processing terminal device is in proximity within the predetermined distance by the proximity wireless communication interface;
The processor determines whether or not the object has crossed the boundary of the independent display area by a movement process in response to an instruction from the user when the other information processing terminal device is close within the predetermined distance. And steps to
When the processor crosses the boundary, the display coordinate data on the screen for displaying the object among the image data is displayed from the display screen of the other information processing terminal device. Corresponding to displaying so as to exist across the screen, converting to display coordinates in the other information processing terminal device;
The processor executes the step of transferring the converted image data to the other information processing terminal device. A computer program for causing a processor of an information processing terminal device capable of configuring a multi-display system composed of a plurality of display screens to execute information processing,
The information processing terminal device includes a proximity wireless communication interface for data communication with another information processing terminal device capable of configuring the multi-display system, a storage device for storing image data for displaying an object, A display screen for displaying the object, comprising a display screen for configuring the multi-display system,
The display area of the display screen is an area inside the display area where the display process of the object is executed regardless of whether or not the other information processing terminal device exists within a predetermined distance range. When including the display area,
The processor determining whether or not the other information processing terminal device is in proximity within the predetermined distance by the proximity wireless communication interface;
The processor determines whether or not the object has crossed the boundary of the independent display area by a movement process in response to an instruction from the user when the other information processing terminal device is close within the predetermined distance. And steps to
When the processor crosses the boundary, the display coordinate data on the screen for displaying the object among the image data is displayed from the display screen of the other information processing terminal device. Corresponding to displaying so as to exist across the screen, converting to display coordinates in the other information processing terminal device;
A computer program causing the information processing terminal device to execute the step of transferring the converted image data to the other information processing terminal device.

Images