JP2013210730A - Display system, control method of display system, controller, control method of controller, program, and information storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display system capable of making a plurality of display devices cooperate even when the respective display devices are not provided with a sensor for detecting that the display devices have collided with each other.SOLUTION: A display system 1 includes a plurality of display devices. Each of the plurality of display devices includes an instruction position detection part for detecting a position inside a screen instructed by a user. An instructed position acquisition part 50 acquires detection results of the respective instruction position detection parts of the plurality of display devices. A cooperation control part 56 makes the plurality of display devices cooperate on the basis of the detection results of the respective instruction position detection parts of the plurality of display devices.

Description

  The present invention relates to a display system, a display system control method, a control device, a control device control method, a program, and an information storage medium.

  A technique for cooperating a plurality of display devices is known. For example, Patent Document 1 discloses a technique for cooperating display units of a plurality of mobile phones. Specifically, it is disclosed that when a user taps a mobile phone on another mobile phone (lightly hits it), one screen is displayed using both display units of the mobile phones.

Special table 2011-511335 gazette

  However, in the above technique, each display device needs to include a sensor for detecting that the display devices (mobile phones) collide with each other. That is, if each display device does not have a sensor for detecting that the display devices collide, a plurality of display devices cannot be made to cooperate.

  The present invention has been made in view of the above problems, and its purpose is to cooperate a plurality of display devices even if each display device does not have a sensor for detecting that the display devices collide with each other. A display system, a display system control method, a control device, a control device control method, a program, and an information storage medium are provided.

  In order to solve the above problems, a display system according to the present invention is a display system including a plurality of display devices, each of the plurality of display devices detecting a position in a screen instructed by a user. The display system includes a pointing position acquisition unit that acquires a detection result of the pointing position detection unit of each of the plurality of display devices, and a detection result of the pointing position detection unit of each of the plurality of display devices. And a cooperative control means for cooperating the plurality of display devices.

  The display system control method according to the present invention is a display system control method including a plurality of display devices, wherein each of the plurality of display devices detects a position in a screen instructed by a user. The control method includes an indication position acquisition step of acquiring a detection result of the indication position detection means of each of the plurality of display devices, and a detection result of the indication position detection means of each of the plurality of display devices. And a cooperative control step for causing the plurality of display devices to cooperate with each other.

  Further, the control device according to the present invention is a means for obtaining the detection result of the indicated position detecting means for detecting the position within the screen of the display means designated by the user, and a plurality of display means corresponding to the plurality of display means, respectively. Instructed position acquisition means for acquiring the detection result of the indicated position detection means, and cooperative control means for cooperating the plurality of display means based on the detection results of the plurality of indicated position detection means. And

  Further, the control method of the control device according to the present invention is a step of acquiring the detection result of the indicated position detecting means for detecting the position in the screen of the display means specified by the user, and corresponds to each of the plurality of display means. An instruction position acquisition step of acquiring detection results of the plurality of instruction position detection means, and a cooperative control step of cooperating the plurality of display means based on the detection results of the plurality of instruction position detection means. It is characterized by that.

  The program according to the present invention is a means for obtaining the detection result of the indicated position detecting means for detecting the position in the screen of the display means designated by the user, and a plurality of instructions respectively corresponding to the plurality of display means. In order to cause the computer to function as an indication position acquisition means for acquiring a detection result of the position detection means, and a cooperative control means for cooperating the plurality of display means based on the detection results of the indication position detection means. It is a program.

  The information storage medium according to the present invention is a means for obtaining the detection result of the indicated position detecting means for detecting the position within the screen of the display means designated by the user, and a plurality of information storage media corresponding to the plurality of display means, respectively. The computer functions as an indication position acquisition means for acquiring detection results of the indication position detection means, and a cooperative control means for cooperating the plurality of display means based on the detection results of the indication position detection means. A computer-readable information storage medium storing a program for causing the program to be executed.

  In one aspect of the present invention, the determination unit determines whether a trajectory over the plurality of display devices is input by the user based on a detection result of the indicated position detection unit of each of the plurality of display devices. The cooperation control means may cause the plurality of display devices to cooperate when the trajectory over the plurality of display devices is input by the user.

  In the aspect of the invention, the plurality of display devices include a first display device and a second display device, and the determination unit includes the first display device and the second display device. When the detection result of the indicated position detection means satisfies a predetermined condition, it is determined that a trajectory extending between the first display device and the second display device is input by the user, and the predetermined condition is determined by the first condition. A condition that the indicated position is detected by the indicated position detecting means of the second display device after the indicated position is last detected by the indicated position detecting means of the display device; The condition that the last indicated position detected by the indicated position detecting means is included in the end region of the first display device, and the first detected by the indicated position detecting means of the second display device. Indicated position And conditions to be included in the end region of the second display device, may include a.

  In one embodiment of the present invention, the predetermined condition includes the timing at which the designated position is last detected by the designated position detecting unit of the first display device, and the designated position detecting unit of the second display device. May further include a condition that a difference between the timing at which the indicated position is first detected and the difference is less than a threshold value.

  In one embodiment of the present invention, the predetermined condition is indicated by the indicated position detection unit of the second display device when the indicated position is detected by the indicated position detection unit of the first display device. The indication position is detected by the indication position detection means of the first display device when the indication position is detected by the condition that the position is not detected and the indication position detection means of the second display device And a condition that it is not performed may be further included.

  In the aspect of the invention, the predetermined condition includes the direction indicated by the locus of the designated position detected by the designated position detecting unit of the first display device and the designated position detection of the second display device. You may make it further include the conditions that the value regarding the shift | offset | difference with the direction which the locus | trajectory of the designated position detected by the means shows is less than a threshold value.

  In one embodiment of the present invention, each of the plurality of display devices includes a first side, a second side that is orthogonal to or substantially orthogonal to the first side, and a first side that faces the first side. 3 and a fourth side facing the second side, and the indicated position detected by the indicated position detecting means is an axis extending parallel or substantially parallel to the first side. Represented by a first coordinate value that is a coordinate value of a direction and a second coordinate value that is a coordinate value of an axial direction extending parallel to or substantially parallel to the second side, and the predetermined condition is The indicated position last detected by the indicated position detecting means of the first display device is included in an end region corresponding to the first side or the third side, and the second display device The designated position first detected by the designated position detecting means corresponds to the first side or the third side. In the case of being included in the end region, the first coordinate value of the indicated position last detected by the indicated position detecting means of the first display device and the indicated position detecting means of the second display device The condition that the difference between the first coordinate value of the designated position detected first and the first coordinate value is less than a threshold value, and the designated position last detected by the designated position detection means of the first display device are The indicated position that is included in the end region corresponding to the second side or the fourth side and first detected by the indicated position detection means of the second display device is the second side or The second coordinate value of the indicated position last detected by the indicated position detecting means of the first display device and the second display when included in the end region corresponding to the fourth side By the indicated position detecting means of the apparatus. A second coordinate value of the first detected pointing position, and conditions the difference is less than the threshold, may further include a.

  Moreover, in one aspect of the present invention, the plurality of display devices include a first display device and a second display device, and the cooperative control means is (a) the indicated position of the first display device. The indicated position detected by the detecting means is included in the end region of the first display device, and (b) the indicated position detected by the indicated position detecting means of the second display device is the second position. When included in the end region of the display device, cooperation between the first display device and the second display device may be started.

  In the aspect of the invention, the cooperative control unit may further include: (a) the indication position detected by the indication position detection unit of the first display device is the end region of the first display device. And (b) the indicated position detected by the indicated position detection means of the second display device is included in the end region of the second display device, and (c) the The difference between the timing at which the indicated position is detected by the indicated position detection means of the first display device and the timing at which the indicated position is detected by the indicated position detection means of the first display device is less than a threshold value. In this case, the cooperation between the first display device and the second display device may be started.

  In one aspect of the present invention, the cooperating apparatus includes a positional relationship recognition unit that recognizes a positional relationship of the plurality of display devices based on a detection result of the indicated position detection unit of each of the plurality of display devices. The control means may cooperate the plurality of display devices based on the positional relationship.

  In the aspect of the invention, the plurality of display devices include a first display device and a second display device, and the positional relationship recognition unit corresponds to each of the plurality of sides of the first display device. Any of the plurality of end regions set as described above includes the indicated position detected by the indicated position detection means of the first display device, and the plurality of end regions of the second display device. The first display when the indicated position detected by the indicated position detecting means of the second display device is included in any of the plurality of end regions set to correspond to the sides respectively. The side of the first display device corresponding to the end region including the designated position detected by the designated position detecting unit of the apparatus and the instruction detected by the designated position detecting unit of the second display device The end containing the position Corresponding to frequency, the a side of the second display device, may be recognized and so as to be adjacent the first display device and the second display device are provided.

  Further, in one aspect of the present invention, the side of the first display device corresponding to the end region including the indicated position detected by the indicated position detection means of the first display device, and the first It is determined whether or not the combination with the side of the second display device corresponding to the end region including the designated position detected by the designated position detecting unit of the second display device is a predetermined combination. And means for outputting a predetermined message to at least one of the first display device and the second display device when the combination is not the predetermined combination.

  In the aspect of the invention, the plurality of display devices include a first display device, a second display device, a third display device, and a fourth display device, and the positional relationship recognition means includes Means for recognizing a positional relationship between the first display device and the second display device based on a detection result of the indicated position detection means of each of the first display device and the second display device; Means for recognizing a positional relationship between the second display device and the third display device based on a detection result of the indicated position detection means of each of the second display device and the third display device; Means for recognizing a positional relationship between the third display device and the fourth display device based on a detection result of the indicated position detection means of each of the third display device and the fourth display device. And positional relationship between the first display device and the second display device And the first display device based on the positional relationship between the second display device and the third display device and the positional relationship between the third display device and the fourth display device. Means for recognizing a positional relationship with the fourth display device.

  In the aspect of the invention, the cooperation control unit may configure a display screen by the plurality of display devices.

  In the aspect of the invention, the cooperation control unit displays a first screen for accepting the user's operation on at least one display device of the plurality of display devices, and the first screen. The second screen corresponding to the user's operation performed in step 1 may be displayed on at least one other display device of the plurality of display devices.

  In the aspect of the invention, the cooperation control unit may display the input screen for the user to input using the pointing position detection unit over the plurality of display devices. You may make it receive the said user's input using the said indication position detection means of this display apparatus.

  In one aspect of the present invention, each of the plurality of display devices includes a sound output unit, and the cooperative control unit includes a plurality of the sound output units of the plurality of display devices respectively corresponding to a plurality of channels. The sound may be output from the sound output means of the plurality of display devices.

  According to the present invention, a plurality of display devices can be made to cooperate even if each display device does not include a sensor for detecting that the display devices are collided with each other.

It is a figure which shows an example of the whole structure of the display system which concerns on embodiment of this invention. It is a figure which shows an example of the external appearance of a display apparatus. It is a figure for demonstrating an example of operation which a user should perform when cooperating two display apparatuses. It is a figure for demonstrating an example of operation which a user should perform when cooperating two display apparatuses. It is a figure which shows an example of an image. It is a figure which shows an example of the screen displayed on these two display devices, when two display devices cooperate. It is a figure which shows another example of the screen displayed on these two display devices, when two display devices cooperate. It is a functional block diagram of a display system. It is a figure which shows an example of the detection result of each touch panel of a some display apparatus. It is a figure for demonstrating an edge part area | region. It is a flowchart which shows an example of the process performed with a display system. It is a flowchart which shows an example of the process performed with a display system. It is a figure which shows an example of display apparatus data. It is a figure which shows an example of positional relationship data. It is a figure for demonstrating an example of operation which a user should perform when four display apparatuses are made to cooperate. It is a figure which shows an example of the detection result of each touch panel of a some display apparatus. It is a figure which shows another example of display apparatus data. It is a figure which shows another example of positional relationship data. It is a flowchart which shows another example of the process performed with a display system. It is a figure for demonstrating the conditions for determining whether the locus | trajectory over two display apparatuses was input by the user. It is a flowchart which shows another example of the process performed with a display system. It is a figure for demonstrating the process performed with a display system. It is a figure for demonstrating the process performed with a display system. It is a figure for demonstrating the conditions for determining whether the locus | trajectory over two display apparatuses was input by the user. It is a figure for demonstrating the conditions for determining whether the locus | trajectory over two display apparatuses was input by the user. It is a flowchart which shows another example of the process performed with a display system. It is a figure for demonstrating the process performed with a display system. It is a figure for demonstrating the process performed with a display system. It is a figure for demonstrating another example of operation which a user should perform when making two display apparatuses cooperate. It is a figure which shows another example of the whole structure of a display system.

  Hereinafter, examples of embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 shows the overall configuration of a display system according to an embodiment of the present invention. As shown in FIG. 1, the display system 1 according to the present embodiment includes a plurality of display devices 10 and a server device 20 (control device). The display device 10 is connected to the LAN 2 via the access point 4 for wireless LAN communication, and the display device 10 and the server device 20 can exchange data with each other via the LAN 2. Further, the display devices 10 can also exchange data with each other.

  The display device 10 is a device including a display unit. For example, the display device 10 is an information processing device in which a liquid crystal display unit, an organic EL display unit, or the like is incorporated, and more specifically, for example, a mobile phone (smart phone), a tablet computer, or a laptop computer. . Below, it demonstrates as the display apparatus 10 being a tablet computer. The display device 10 may be a single liquid crystal display device or an organic EL display device.

  FIG. 2 shows an example of the appearance of the display device 10. The display device 10 shown in FIG. 2 has a rectangular shape (or a substantially rectangular shape). The display device 10 includes an upper side 18U (first side), a left side 18L (second side) orthogonal to (or substantially orthogonal to) the upper side 18U, a lower side 18D (third side) facing the upper side 18U, A right side 18R (fourth side) opposite to the left side 18L. The upper side 18U and the lower side 18D are short sides, and the left side 18L and the right side 18R are long sides.

  As illustrated in FIG. 1, the display device 10 includes a control unit 11, a storage unit 12, a communication unit 13, a display unit 14, an audio output unit 15, an attitude detection sensor unit 16, and an operation unit 17. The control unit 11 includes, for example, one or a plurality of microprocessors, and executes information processing according to an operating system or a program stored in the storage unit 12. The storage unit 12 includes a main storage unit and an auxiliary storage unit.

  The communication unit 13 is used for the display device 10 to perform data communication with other devices. The communication unit 13 transmits data to other devices and receives data transmitted from other devices. For example, the communication unit 13 is for communicating with the server device 20 or another display device 10 via the access point 4.

  The program or data is supplied to the storage unit 12 via a communication network. That is, the program or data transmitted via the communication network is received by the display device 10 and stored in the storage unit 12. The display device 10 may include a component for reading a program or data stored in an information storage medium (for example, an optical disk or a memory card). The program or data read from the information storage medium may be stored in the storage unit 12.

  The display unit 14 is, for example, a liquid crystal display unit or an organic EL display unit, and displays a screen according to instructions from the control unit 11. The sound output unit 15 is, for example, a speaker or headphones, and outputs sound according to instructions from the control unit 11.

  The attitude detection sensor unit 16 includes one or a plurality of sensors for detecting the attitude (tilt) of the display device 10. For example, the posture detection sensor unit 16 includes at least one of an acceleration sensor and a gyro sensor. Information indicating the detection result of the posture detection sensor unit 16 is supplied to the control unit 11 every predetermined time (for example, 1/60 seconds).

  The control unit 11 can determine the attitude of the display device 10 based on the detection result of the attitude detection sensor unit 16. For example, it is determined whether the orientation of the display device 10 is a portrait orientation or a landscape orientation as viewed from the user, or it is determined whether the orientation of the display device 10 is an upside down orientation as seen from the user. It is possible. The “longitudinal posture” is a posture in which the longitudinal direction of the display device 10 is the vertical direction and the short side direction of the display device 10 is the horizontal direction. The posture is such that the short side direction is the vertical direction and the long side direction of the display device 10 is the horizontal direction. In the following, the posture shown in FIG. 2 is referred to as a “basic posture”. That is, the “basic posture” is a vertically long posture and a posture in which the button 17B is positioned below the display unit 14.

  The operation unit 17 is for receiving a user operation. For example, the operation unit 17 includes a button 17 </ b> B provided on the surface of the display device 10. The operation unit 17 may include an operation member (for example, a stick or a lever) other than the button 17B.

  In addition, the operation unit 17 includes an instruction position detection unit that detects a position in the screen of the display unit 14 instructed by the user. For example, the operation unit 17 includes a touch panel 17T provided on the display unit 14 so as to be overlapped. Note that the designated position detection unit may be other than the touch panel 17T.

  The touch panel 17T is a general touch panel and detects a position touched by the user. For example, the touch panel 17T is a capacitive touch panel. Note that the touch panel 17T may be a touch panel of a system other than the capacitive system (for example, a resistive film system).

  Information indicating the position touched by the user is supplied to the control unit 11 every predetermined time (for example, 1/60 seconds). For example, the position touched by the user is represented as a coordinate value in the screen coordinate system. The “screen coordinate system” is a coordinate system in which the upper left vertex of the display unit 14 when the display device 10 is in the basic posture is the origin O, the right direction is the X axis positive direction, and the lower direction is the Y axis positive direction. Yes (see FIG. 2). That is, the position touched by the user extends in parallel (or substantially parallel) to the X-axis direction coordinate value (first coordinate value) extending in parallel (or substantially parallel) to the upper side 18U and in parallel (or substantially parallel) to the left side 18L. It is represented by the coordinate value (second coordinate value) in the Y-axis direction.

  The server device 20 executes processing based on data received from each display device 10 or transmits data to each display device 10. As shown in FIG. 1, the server device 20 includes a control unit 21, a storage unit 22, a communication unit 23, and an optical disc drive unit 24. The control unit 21, the storage unit 22, and the communication unit 23 are the same as the control unit 11, the storage unit 12, and the communication unit 13 of the display device 10.

  The optical disk drive unit 24 is for reading a program or data stored in an optical disk (information storage medium). The program or data read from the optical disc by the optical disc drive unit 24 is stored in the storage unit 22. Note that a component for reading a program or data stored in an information storage medium (for example, a memory card) other than the optical disk may be included instead of the optical disk drive unit 24. The program or data may be supplied to the storage unit 22 via an information storage medium other than the optical disk. Alternatively, the program or data may be supplied to the storage unit 22 via a communication network.

  In the display system 1 according to the present embodiment, a program for causing a plurality of display devices 10 to cooperate is executed in each display device 10 and the server device 20, and a user can perform a plurality of operations by a relatively simple operation. The display device 10 can be made to cooperate. Hereinafter, this feature will be described.

  FIG. 3 is a diagram for explaining an example of an operation to be performed by the user when the two display devices 10A and 10B are made to cooperate. When cooperating the display devices 10A and 10B, the user first arranges the display devices 10A and 10B so that the display devices 10A and 10B are arranged. In the example shown in FIG. 3, the display devices 10A and 10B are arranged so that the display devices 10A and 10B are arranged side by side.

  Thereafter, the user slides his / her finger F or the like on the touch panel 17T of the display devices 10A and 10B, so that one trajectory 30 across the display devices 10A and 10B (in other words, one that passes through both the display devices 10A and 10B). Draw a trajectory 30). When such a trajectory 30 is drawn, it is determined that the cooperation of the display devices 10A and 10B is instructed by the user, and the cooperation of the display devices 10A and 10B is started.

  In the example shown in FIG. 3, the display devices 10A and 10B in the basic posture are arranged side by side. However, for example, as shown in FIG. 4, the display device 10A in the basic posture and the basic posture are inverted upside down. The display device 10B in a different posture may be arranged side by side.

  In the example shown in FIG. 3, the display devices 10A and 10B in the vertically long posture are arranged side by side, but the display devices 10A and 10B in the horizontally long posture may be arranged side by side. Further, in the example shown in FIG. 3, the display devices 10A and 10B are arranged side by side, but the display devices 10A and 10B may be arranged side by side.

  When the trajectory 30 over the display devices 10A and 10B is input, the cooperation of the display devices 10A and 10B is started. Hereinafter, an example of cooperation between the display devices 10A and 10B will be described.

  For example, when the cooperation of the display devices 10A and 10B is started, the display unit 14 of the display device 10A and the display unit 14 of the display device 10B are virtually associated, and display control related to the display unit 14 is performed. Executed.

  For example, one screen is displayed using both the display devices 10A and 10B. For example, the whole or a part of one image 40 as shown in FIG. 5 is displayed over both the display devices 10A and 10B.

  FIG. 6 shows an example when the image 40 shown in FIG. 5 is displayed across both the display devices 10A and 10B. In this case, the first area of the image 40 (for example, a rectangular area in which the upper left vertex is (0, 0) and the lower right vertex is (M-1, N-1)) is displayed on the display device 10A. Is done. Also, the second region of the image 40 adjacent to the first region (for example, the upper left vertex is (M, 0) and the lower right vertex is (2 * M−1, N−1)). A rectangular area) is displayed on the display device 10B.

  Further, for example, screens related to each other are displayed on the display devices 10A and 10B. For example, a first screen for accepting a user operation is displayed on one of the display devices 10A and 10B, and a second screen corresponding to the operation performed on the first screen is the other of the display devices 10A and 10B. Is displayed.

  FIG. 7 shows an example of a screen displayed on the display devices 10A and 10B. In the example shown in FIG. 7, the product list screen 42 is displayed on the display device 10A, and the product screen 44 is displayed on the display device 10B.

  The product list screen 42 is a screen showing a list of products. On the product list screen 42, the user performs an operation for selecting any product. For example, the user selects any product by bringing a finger or the like into contact with the touch panel 17T. The product screen 44 is a screen showing details of the product selected by the user from the products displayed on the product list screen 42.

  When the display devices 10A and 10B cooperate, the screen displayed on the display devices 10A and 10B is not limited to the example described above.

  For example, one menu screen may be displayed over both the display devices 10A and 10B.

  Further, for example, a search condition designation screen for designating product search conditions is displayed on the display device 10A, and a search result screen showing a list of products satisfying the search conditions designated on the search condition designation screen is displayed on the display device 10B. You may make it display.

  Further, for example, an image list screen including a plurality of thumbnail images is displayed on the display device 10A, and an original image of a thumbnail image selected by the user from among the plurality of thumbnail images displayed on the image list screen is displayed on the display device 10B. You may make it do.

  Further, for example, one image may be displayed on the display device 10A. Then, when a part of the one image is selected by the user, an image obtained by enlarging the part may be displayed on the display device 10B.

  In the above, as an example of cooperation between the display devices 10A and 10B, the example in which the display units 14 of the display devices 10A and 10B are virtually associated with each other and display control related to the display units 14 is executed has been described. The example of cooperation of display device 10A, 10B is not restricted to this example.

  For example, the touch panel 17T of the display device 10A and the touch panel 17T of the display device 10B are virtually associated with each other, and input acceptance control related to the touch panel 17T may be executed. Specifically, by displaying a character input screen (for example, a software keyboard) for a user to input characters using the touch panel 17T over both the display devices 10A and 10B, the touch panels 17T of both the display devices 10A and 10B. Character input may be received using. In this example, since a character input screen (for example, a software keyboard) is displayed over both the display devices 10A and 10B, this example indicates that the display units 14 of the display devices 10A and 10B are virtually associated with each other. This corresponds to “an example of executing display control related to the display unit 14”.

  Alternatively, for example, the audio output unit 15 of the display device 10 </ b> A and the audio output unit 15 of the display device 10 </ b> B may be virtually associated to execute audio output control related to the audio output unit 15. Specifically, the audio output may be performed by regarding the audio output unit 15 of the display device 10A and the audio output unit 15 of the display device 10B as a pair of speakers. For example, in the example shown in FIG. 3, the audio output unit 15 of the display device 10A is regarded as a left speaker (a speaker corresponding to the left channel), and the audio output unit 15 of the display device 10B is a right speaker (a speaker corresponding to the right channel). It may be considered that voice output is executed.

  According to the display system 1 described above, the user can cooperate with a plurality of display devices 10.

  According to the display system 1, even if each display device 10 does not include a sensor for detecting that the display devices 10 collide with each other, the user can cooperate with a plurality of display devices 10. . According to the display device 10, the touch panel 17 </ b> T generally provided in the display device 10 such as a tablet computer or a mobile phone is used to allow the user to cooperate with the plurality of display devices 10. Can be realized.

  According to the display system 1, the user can cooperate the plurality of display devices 10 by a relatively simple operation of inputting a trajectory over the plurality of display devices 10. That is, according to the display system 1, the user can designate a plurality of display devices 10 to be cooperated and the positional relationship between the plurality of display devices 10 by one operation of inputting a trajectory. become able to.

  A configuration for realizing the display system 1 as described above will be described. FIG. 8 is a functional block diagram showing functional blocks related to the present invention among the functional blocks realized in the display system 1. As shown in FIG. 8, the display system 1 includes an indicated position acquisition unit 50, a determination unit 52, a positional relationship recognition unit 54, and a cooperation control unit 56.

  For example, the designated position acquisition unit 50, the determination unit 52, the positional relationship recognition unit 54, and the cooperation control unit 56 are realized by the server device 20. That is, the control unit 21 of the server device 20 executes processing according to the program so that the control unit 21 functions as the designated position acquisition unit 50, the determination unit 52, the positional relationship recognition unit 54, and the cooperation control unit 56. Become.

  The designated position acquisition unit 50 will be described. The designated position acquisition unit 50 acquires information related to the detection results of the designated position detection units of each of the plurality of display devices 10. In the case of the display system 1 illustrated in FIG. 1, the touch panel 17 </ b> T corresponds to a “designated position detection unit”, and the designated position acquisition unit 50 acquires information regarding the detection result of each touch panel 17 </ b> T of the plurality of display devices 10.

  An application program is executed on the display device 10, and designated position information related to the designated position of the user detected by the touch panel 17 </ b> T is transmitted to the server device 20 together with the identification information of the display device 10. The indicated position acquisition unit 50 acquires indicated position information transmitted from each display device 10.

FIG. 9 shows an example of the detection result of the touch panel 17T of each of the plurality of display devices 10. FIG. 9 illustrates a detection result of the touch panel 17T of the display devices 10A and 10B when the locus 30 illustrated in FIG. 3 is input by the user. In FIG. 9, “display device A” indicates the display device 10A, and “display device B” indicates the display device 10B. In addition, “t ₁ ”, “t ₂ ”,..., “T _{i + j + 2} ” indicate, for example, timings at 1/60 second intervals. Timing “t ₁ ” is timing when the user touches the finger F on the touch panel 17T of the display device 10A. Further, the position (x _i , y _i ) detected by the touch panel 17T of the display device 10A at the timing “t _i ” is the indicated position PA shown in FIG. 3, and at the timing “t _{i + 1} ” by the touch panel 17T of the display device 10B. The detected position (x _{i + 1} , y _{i + 1} ) is the designated position PB shown in FIG. The designated position acquisition unit 50 acquires information as shown in FIG.

  The determination unit 52 will be described. The determination unit 52 determines whether the detection result of each indicated position detection unit (touch panel 17T) of the plurality of display devices 10 satisfies a predetermined condition.

  The determination unit 52 determines whether or not the trajectory over the plurality of display devices 10 is input by the user based on the detection result of each touch panel 17T of the plurality of display devices 10. For example, the determination unit 52 determines whether or not the trajectory over the plurality of display devices 10 is input by the user by determining whether or not the detection result of each touch panel 17T of the plurality of display devices 10 satisfies a predetermined condition. Determine.

  Hereinafter, the operation of the determination unit 52 will be described with reference to FIGS. 3 and 9. That is, the operation of the determination unit 52 when determining whether or not the locus 30 passing through the display device 10A (first display device) and the display device 10B (second display device) has been input by the user will be described.

  When the detection result of the touch panel 17T of the display devices 10A and 10B satisfies a predetermined condition, the determination unit 52 determines that the locus 30 across the display devices 10A and 10B is input by the user.

The “predetermined condition” includes, for example, the following conditions A, B, and C.
(A) Immediately after the user's designated position is finally detected by the touch panel 17T of the display device 10A, the user's designated position is detected by the touch panel 17T of the display device 10B.
(B) The indicated position PA last detected by the touch panel 17T of the display device 10A is included in the end region of the display device 10A.
(C) The designated position PB first detected by the touch panel 17T of the display device 10B is included in the end region of the display device 10B.

  Here, the “end region” will be described. FIG. 10 is a diagram for explaining the end region. In the present embodiment, an upper end region 60U, a lower end region 60D, a left end region 60L, and a right end region 60R are set.

  The upper end region 60U is a region where the distance from the upper side 62U of the display unit 14 is within the reference distance. The upper end region 60U corresponds to the upper side 18U of the display device 10. Further, the lower end region 60D is a region in which the distance from the lower side 62D of the display unit 14 is within the reference distance. The lower end region 60D corresponds to the lower side 18D of the display device 10.

  Similarly, the left end region 60L is a region where the distance from the left side 62L of the display unit 14 is within the reference distance. The left end region 60L corresponds to the left side 18L of the display device 10. The right end region 60R is a region where the distance from the right side 62R of the display unit 14 is within the reference distance. The right end region 60R corresponds to the right side 18R of the display device 10.

  Hereinafter, the upper end region 60U, the lower end region 60D, the left end region 60L, and the right end region 60R may be collectively referred to as an “end region 60”.

  When the pointing position PA last detected by the touch panel 17T of the display device 10A is included in any of the end regions 60 of the display device 10A, the determination unit 52 determines that the condition B is satisfied. Similarly, when the pointing position PB first detected by the touch panel 17T of the display device 10B is included in any of the end regions 60 of the display device 10B, the determination unit 52 determines that the condition C is satisfied. .

  When all of the above conditions A to C are satisfied, the determination unit 52 determines that the locus 30 over the display devices 10A and 10B has been input by the user.

The “predetermined condition” may further include the following condition D.
(D) The timing (t _i ) at which the user's designated position was last detected by the touch panel 17T of the display device 10A, and the timing (t _{i + 1} ) at which the user's designated position was first detected by the touch panel 17T of the display device 10B. , Is less than the threshold value.

  That is, when all of the above conditions A to D are satisfied, the determination unit 52 may determine that the trajectory 30 over the display devices 10A and 10B has been input by the user. By adding the condition D, it is possible to improve the determination accuracy of whether or not the trajectory 30 across the display devices 10A and 10B has been input by the user.

The “predetermined condition” may further include the following conditions E and F.
(E) When the user instruction position is detected by the touch panel 17T of the display device 10A, the user instruction position is not detected by the touch panel 17T of the display device 10B.
(F) When the user instruction position is detected by the touch panel 17T of the display device 10B, the user instruction position is not detected by the touch panel 17T of the display device 10A.

  That is, when all of the conditions A to C (or the conditions A to D) and the conditions E and F are satisfied, the determination unit 52 determines that the locus 30 over the display devices 10A and 10B is input by the user. You may make it do. By adding the conditions E and F, it is possible to improve the determination accuracy of whether or not the trajectory 30 over the display devices 10A and 10B has been input by the user.

  The positional relationship recognition unit 54 will be described. The positional relationship recognition unit 54 recognizes the positional relationship (relative positional relationship) of the plurality of display devices 10 based on the detection result of each indicated position detection unit (touch panel 17T) of the plurality of display devices 10.

  Hereinafter, the operation of the positional relationship recognition unit 54 will be described with reference to FIGS. 3 and 9. That is, the operation of the positional relationship recognition unit 54 when recognizing the positional relationship between the display device 10A (first display device) and the display device 10B (second display device) will be described.

  The indication position PA last detected by the touch panel 17T of the display device 10A is included in any of the end regions 60 of the display device 10A, and the indication position PB first detected by the touch panel 17T of the display device 10B is displayed. When included in any of the end regions 60 of the device 10B, the positional relationship recognition unit 54 includes the side of the display device 10A corresponding to the end region 60 including the designated position PA and the end including the designated position PB. It is recognized that the display devices 10A and 10B are arranged so that the side of the display device 10B corresponding to the partial area 60 is adjacent.

  For example, the pointing position PA last detected by the touch panel 17T of the display device 10A is included in the right end region 60R of the display device 10A, and the pointing position PB first detected by the touch panel 17T of the display device 10B is the display device. When included in the left end region 60L of 10B, the positional relationship recognition unit 54 arranges the display devices 10A and 10B so that the right side 18R of the display device 10A and the left side 18L of the display device 10B are adjacent to each other. recognize.

  On the other hand, as in the case of the example shown in FIG. 4, the pointing position PA last detected by the touch panel 17T of the display device 10A is included in the right end region 60R of the display device 10A, and by the touch panel 17T of the display device 10B. When the designated position PB detected first is included in the right end region 60R of the display device 10B, the positional relationship recognition unit 54 causes the display devices 10A and 10B to be adjacent to each other so that the right sides 18R of the display devices 10A and 10B are adjacent to each other. Recognize that it is placed.

  The cooperation control unit 56 will be described. The collaboration control unit 56 causes the plurality of display devices 10 to cooperate based on the detection result of each indicated position detection unit (touch panel 17T) of the plurality of display devices 10.

  The cooperation of the plurality of display devices 10 will be described. “Cooperate a plurality of display devices 10” virtually associates the plurality of display devices 10 and executes at least one of display control, audio output control, or input reception control related to the plurality of display devices 10 It means to do.

  First, a case where a plurality of display devices 10 are virtually associated and display control related to the plurality of display devices 10 is executed will be described.

  For example, “virtually associating a plurality of display devices 10 and executing display control related to the plurality of display devices 10” means that a plurality of display devices 10 constitute one display screen (multi-display screen). Means. In other words, “virtually associating a plurality of display devices 10 and executing display control relating to the plurality of display devices 10” means displaying one display screen using the plurality of display devices 10. To do.

  The example shown in FIG. 6 is an example in which a plurality of display devices 10 constitute one display screen (multi-display screen). In the example shown in FIG. 6, one image 40 (one image display screen) is displayed across the display devices 10A and 10B.

  Alternatively, “virtually associating a plurality of display devices 10 and executing display control related to the plurality of display devices 10” means displaying a plurality of linked screens on the plurality of display devices 10. Specifically, “virtually associating a plurality of display devices 10 and executing display control related to the plurality of display devices 10” means that at least one display device 10 displays a first screen that receives a user operation. And the second screen corresponding to the user operation performed on the first screen is displayed on at least one other display device 10.

  For example, the “first screen” is a screen on which the user performs a selection operation for selecting at least one piece of information from a list of information. On the other hand, the “second screen” is a screen that displays information selected by the user. For example, in this case, a processing request is transmitted to an information providing apparatus (for example, a Web server) according to the selection operation performed on the first screen. That is, the information selected on the first screen is requested from the information providing apparatus. Then, a second screen showing the information returned from the information providing device is displayed on the display device 10B.

  The example illustrated in FIG. 7 is an example in which a plurality of screens to be linked are displayed on a plurality of display devices 10. In the example illustrated in FIG. 7, a product list screen 42 (first screen) on which the user performs a selection operation for selecting at least one product from the product list is displayed on the display device 10A. In addition, a product screen 44 (second screen) showing details of the product selected by the user on the product list screen 42 is displayed on the display device 10B.

  Note that examples of the “first screen” and the “second screen” are not limited to those described above.

  For example, the “first screen” may be a search condition designation screen for the user to perform an operation for designating a search condition for searching for information and an operation for instructing execution of the search. Further, the “second screen” may be a search result screen showing a search result that satisfies a search condition specified by the user.

  Further, for example, the “first screen” may be a screen on which the user performs a selection operation for selecting at least one image from a list of images. In addition, the “second screen” may be a screen that displays (for example, enlarged display) an image selected by the user on the first screen.

  Further, for example, the “first screen” may be a screen on which the user performs a selection operation for selecting a part of the image. Further, the “second screen” may be a screen that enlarges and displays a portion selected by the user on the first screen.

  Next, a case will be described in which a plurality of display devices 10 are virtually associated and input reception control related to the plurality of display devices 10 is executed.

  For example, “virtually associating a plurality of display devices 10 and executing input acceptance control regarding the plurality of display devices 10” means that a single input screen on which a user performs input using the touch panel 17T is displayed in a plurality of ways. By displaying over the device 10, it means that the input is received using the touch panel 17T of the plurality of display devices 10. More specifically, by displaying a single character input screen (for example, a software keyboard) on which a user inputs characters using the touch panel 17T over the plurality of display devices 10, the touch panels 17T of the plurality of display devices 10 are used. Means to accept character input.

  Finally, a case will be described in which a plurality of display devices 10 are virtually associated and audio output control related to the plurality of display devices 10 is executed.

  For example, “virtually associating a plurality of display devices 10 and executing sound output control related to the plurality of display devices 10” means that the sound output unit 15 of the plurality of display devices 10 is set to a set of speakers (that is, And a plurality of speakers respectively corresponding to a plurality of channels). For example, in the case of the example shown in FIG. 3, the audio output unit 15 of the display device 10A is regarded as the left speaker (the speaker corresponding to the left channel), and the audio output unit 15 of the display device 10B is the right speaker (corresponding to the right channel). And performing sound output corresponds to “virtually associating a plurality of display devices 10 and performing sound output control on the plurality of display devices 10”.

  The cooperation control unit 56 starts cooperation of the plurality of display devices 10 when a trajectory over the plurality of display devices 10 is input by the user.

  In addition, the cooperation control unit 56 causes the plurality of display devices 10 to cooperate based on the positional relationship recognized by the positional relationship recognition unit 54.

  For example, as shown in FIG. 3, a case is assumed where it is recognized that the display devices 10A and 10B are arranged such that the right side 18R of the display device 10A and the left side 18L of the display device 10B are adjacent to each other.

  In the case where one image 40 is displayed using both the display devices 10A and 10B in such a state, for example, the first region (for example, the left half region) of the image 40 is displayed on the display device 10A. A second area (for example, the right half area) adjacent to the first area is displayed on the display device 10B (see FIG. 6).

  When the product list screen 42 and the product screen 44 are displayed on the display devices 10A and 10B in the above-described state, for example, the product list screen 42 is displayed on the display device 10A, and the product screen 44 is displayed on the display device 10B. Is displayed.

  Further, for example, as shown in FIG. 4, a case is assumed in which it is recognized that the display devices 10A and 10B are arranged so that the right sides 18R of the display devices 10A and 10B are adjacent to each other.

  When one image 40 is displayed using both the display devices 10A and 10B in such a state, for example, the first area of the image 40 is displayed on the display device 10A, and the second of the image 40 is displayed. Is displayed on the display device 10B in a state where the region is vertically inverted.

  Further, when the product list screen 42 and the product screen 44 are displayed on the display devices 10A and 10B in the above-described state, for example, the product list screen 42 is displayed on the display device 10A, and the product screen 44 is turned upside down. Displayed on the display device 10B.

  Next, processing executed in the display system 1 to realize the functional blocks described above will be described. 11 and 12 are flowcharts showing an example of processing executed by the server device 20. When the control unit 21 of the server device 20 executes the processes shown in FIGS. 11 and 12 according to the program, the control unit 21 performs the indicated position acquisition unit 50, the determination unit 52, the positional relationship recognition unit 54, and the cooperation control unit 56. Will function as.

  As shown in FIG. 11, first, the control unit 21 initializes a variable n to 1 (S101). The control unit 21 determines whether or not the user's designated position is detected in at least one display device 10 (S102). As described above, each display device 10 transmits the designated position information related to the detection result of the touch panel 17T to the server device 20. The control unit 21 performs the above determination based on the indicated position information transmitted from each display device 10.

  In any display device 10, when the user's designated position is not detected, the control unit 21 continues the process of step S102. On the other hand, when the user's designated position is detected in at least one display device 10, the control unit 21 determines whether the number of the display devices 10 detecting the designated position is one (S103). ). The case where the number of the display devices 10 detecting the indicated position is not one is a case where the user is touching the touch panels 17T of the plurality of display devices 10. In such a case, the control unit 21 transmits error message data to the plurality of display devices 10 and causes the plurality of display devices 10 to output error messages (S104). In this case, the process is temporarily terminated and the process is executed from the beginning.

When the number of display devices 10 that detect the indicated position is one, the control unit 21 sets the one display device 10 as a display device [n] (S105). Here, the display device [n] means the display device 10 touched nth by the user. For example, in the example shown in FIGS. 3 and 9, since the user's designated position is detected only by the display device 10A at the timing “t ₁ ”, the display device 10A is set as the display device [1].

  The storage unit 22 stores data indicating the display device 10 set as the display device [n]. FIG. 13 shows an example of display device data stored in the storage unit 22. The display device data is data indicating the display device 10 set as the display device [n]. In the display device data shown in FIG. 13, the display device 10A is registered as the display device [1], and the display device 10B is registered as the display device [2].

After the process of step S105 is executed, the control unit 21 monitors whether or not the user's designated position continues to be detected on the display device [n] (S106). For example, when the variable n is “1”, it is monitored whether or not the indication position of the user is continuously detected on the display device [1]. In the example illustrated in FIGS. 3 and 9, it is determined that the user's designated position is continuously detected by the display device [1] (display device 10A) during the period of timing “t ₁ ” to “t _i ”. become.

  When the user's designated position is detected in the display device [n], the control unit 21 determines whether the user's designated position is detected in the display devices 10 other than the display device [n]. (S107). When the user's designated position is not detected on the display devices 10 other than the display device [n], the control unit 21 re-executes the process of step S106. On the other hand, when the user's designated position is detected in the display devices 10 other than the display device [n], the control unit 21 executes the process of step S118 in FIG. The process of step S118 will be described later.

  When the user's designated position is no longer detected on the display device [n], as shown in FIG. 12, the control unit 21 determines that the user's designated position last detected on the display device [n] is at either end. It is determined whether it is included in the area 60 (S108).

  When the end position 60 of the user detected last in the display device [n] is included in any of the end regions 60, the control unit 21 detects the last position indicated by the user in the display device [n]. Monitoring of whether or not the elapsed time has reached the reference time is started (S109).

  When the elapsed time has not reached the reference time, the control unit 21 determines whether or not the user's designated position is detected in at least one display device 10 (S110). In any display device 10, when the user's designated position is not detected, the control unit 21 re-executes the processes of steps S109 and S110.

  On the other hand, when the user's designated position is detected on at least one display device 10, the control unit 21 determines whether the number of the display devices 10 detecting the designated position is one (S111). . When the number of display devices 10 detecting the indicated position is one, the control unit 21 determines whether the one display device 10 is a display device 10 other than the display devices [1] to [n]. Is determined (S112). If the variable n is 1, it is determined whether or not the one display device 10 is a display device 10 other than the display device [1].

  When the one display device 10 is a display device 10 other than the display devices [1] to [n], the control unit 21 temporarily sets the one display device 10 as the display device [n + 1] (S113). Then, the control unit 21 determines whether any end region 60 includes the user's designated position detected first in the display device [n + 1] (S114).

  When the user's designated position detected first in the display device [n + 1] is included in any of the end regions 60, the control unit 21 performs the main setting of the one display device 10 as the display device [n + 1]. (S115). That is, the control unit 21 registers the one display device 10 as display device [n + 1] in the display device data. Furthermore, the control unit 21 sets the side of the display device [n] corresponding to the user's designated position detected last on the display device [n] and the user's designated position detected first on the display device [n + 1]. The combination of the side of the corresponding display device [n + 1] is stored in the storage unit 22 (S116).

  FIG. 14 shows an example of positional relationship data stored in the storage unit 22. The positional relationship data includes a combination of a side corresponding to the user's designated position last detected on the display device [n] and a side corresponding to the user's designated position detected first on the display device [n + 1]. Is registered.

  Note that the positional relationship data shown in FIG. 14 corresponds to the examples shown in FIGS. In the example shown in FIGS. 3 and 9, the display device 10A is set as the display device [1], and the display device 10B is set as the display device [2]. In addition, since the user's designated position PA detected last in the display device 10A is included in the right end region 60R, it is determined that the right side 18R is a side corresponding to the designated position PA. Furthermore, since the user's designated position PB detected first in the display device 10B is included in the left end region 60L, it is determined that the left side 18L is a side corresponding to the designated position PB.

  As a result, the positional relationship data shown in FIG. 14 corresponds to the side corresponding to the user's designated position detected last on the display device [1] and the user's designated position detected first on the display device [2]. (Right side, left side) are registered as a combination of the side to be performed. This indicates that the display device [1] and the display device [2] are arranged so that the right side 18R of the display device [1] and the left side 18L of the display device [2] are adjacent to each other.

  After the process of step S116 is executed, the control unit 21 adds 1 to the value of the variable n (S117), and then re-executes the process of step S106.

  If it is determined in step S108 that the end position 60 of the user last detected by the display device [n] is not included in any of the end regions 60, the control unit 21 causes the user to input a locus. The following processing is executed assuming that

  First, the control unit 21 determines whether or not the value of the variable n is 2 or more (S118). In the processing described above, the value of the variable n is 2 or more when a trajectory over a plurality of display devices 10 is input by the user. For this reason, the case where the value of the variable n is 2 or more is a case where the user inputs a trajectory over a plurality of display devices 10. On the other hand, the case where the value of the variable n is not 2 or more, that is, the case where the value of the variable n is 1 is a case where the user does not input a trajectory across the plurality of display devices 10.

  When the value of the variable n is not 2 or more, the control unit 21 ends this process. In this case, the control unit 21 may transmit error message data to the display device 10 (for example, the display device [1]) and cause the display device 10 to output an error message.

  On the other hand, when the value of the variable n is 2 or more, the control unit 21 starts cooperation of the display devices [1] to [n] based on the display device data and the positional relationship data (S119).

  For example, in step S119, the control unit 21 virtually associates the display devices [1] to [n] to start display control regarding the display devices [1] to [n].

  Specifically, the control unit 21 instructs each control unit 11 of the display devices [1] to [n] via data communication to display one screen on the display devices [1] to [n]. Display.

  For example, in the case of the example shown in FIG. 6, the control unit 21 displays the first region of the image 40 on the display device 10A by transmitting the data of the first region of the image 40 to the display device 10A. Let Moreover, the control part 21 displays the 2nd area | region of the image 40 on the display apparatus 10B by transmitting the data of the 2nd area | region of the image 40 to the display apparatus 10B. The “data of the first region of the image 40” may be image data of only the first region portion of the image 40, or the image data of the entire image 40 and the first region may be displayed as display target regions. It may be a combination with data designated as. The same applies to “data in the second region of the image 40”.

  Alternatively, the control unit 21 exchanges data with each control unit 11 of the display devices [1] to [n] via data communication, thereby displaying a plurality of screens to be linked with the display devices [1] to [n]. To display.

  For example, in the case of the example illustrated in FIG. 7, the control unit 21 causes the display device 10 </ b> A to display the product list screen 42 by transmitting the data of the product list screen 42 to the display device 10 </ b> A. In addition, the control unit 21 receives data indicating the operation contents of the user performed on the product list screen 42 from the display device 10A. When receiving this data, the control unit 21 causes the display device 10B to display the product screen 44 by transmitting data of the product screen 44 corresponding to the operation content to the display device 10B. Note that the data of the product list screen 42 and the product screen 44 is acquired when the control unit 12 performs data communication with a system that provides product information.

  Further, for example, in step S119, the control unit 21 virtually associates the display devices [1] to [n], and starts input reception control regarding the display devices [1] to [n].

  Specifically, the control unit 21 instructs the control unit 11 of each of the display devices [1] to [n] via data communication to allow the user to input one character using the touch panel 17T. An input screen (for example, a software keyboard) is displayed over the display devices [1] to [n]. Moreover, the control part 21 judges the character input by the user by receiving the data regarding the position which the user instruct | indicated from each of display apparatus [1]-[n].

  Further, for example, in step S119, the control unit 21 virtually associates the display devices [1] to [n] and starts sound output control regarding the display devices [1] to [n].

  For example, when the display devices 10A and 10B arranged as shown in FIG. 3 correspond to the display devices [1] and [2], the control unit 21 causes the display device 10A to output a sound as a left speaker. Is transmitted to the display device 10A, thereby causing the audio output unit 15 of the display device 10A to function as a left speaker. Moreover, the control part 21 functions the audio | voice output part 15 of the display apparatus 10B as a right speaker by transmitting the data for making the display apparatus 10B perform the audio | voice output as a right speaker to the display apparatus 10B.

  By the way, in step S119, an instruction to start cooperation of the display devices [1] to [n] may be transmitted to at least one of the display devices [1] to [n]. Then, the cooperation of the display devices [1] to [n] is realized by exchanging data between the display devices [1] to [n] without going through the server device 20. Also good. At this time, any one of the display devices [1] to [n] is selected as a server, and the control unit 11 of the display device 10 selected as the server also plays the role of the control unit 21 as described above. What should I do?

  The selection of the server may be executed by exchanging data between the display devices [1] to [n], or may be executed by the control unit 21. For example, in the latter case, in step S119, the control unit 21 may select any one of the display devices [1] to [n] as a server. Then, the control unit 21 transmits display device data, positional relationship data, and data necessary for data communication between the display devices [1] to [n] to the display device 10 selected as a server. You can do it. In addition, the control unit 21 or the control unit 11 of the display device 10 selected as the server is connected to the other display device 10 (the display device 10 not selected as the server). You may make it notify that it was elected as a member of [n], and the display apparatus 10 elected as a server.

  Even when it is determined in step S109 that the elapsed time has reached the reference time, the control unit 21 considers that the user has completed the input of the locus, and executes the process of step S118.

  In addition, when it is determined in step S111 that the number of display devices 10 that detect the user's designated position is not one, the control unit 21 regards that the user has completed the input of the trajectory, and step S118. Execute the process.

  Furthermore, when it is determined in step S112 that the display device 10 that detects the user's designated position is not the display device 10 other than the display devices [1] to [n], that is, the user's designated position is detected. Even when it is determined that the displayed display device 10 is the display device [1] to [n], the control unit 21 considers that the user has completed the input of the locus, and executes the process of step S118.

  Even when it is determined in step S114 that the indicated position first detected by the display device [n + 1] is not included in any of the end regions 60, the control unit 21 allows the user to input a locus. Assuming completion, the process of step S118 is executed. This is the end of the description of the processing in FIGS. 11 and 12.

  In addition, although the case where the two display devices 10A and 10B are made to cooperate mainly was demonstrated above, in the display system 1, it is also possible to make three or more display devices 10 cooperate. Here, the case where the four display apparatuses 10 are made to cooperate is demonstrated. 15-18 is a figure for demonstrating the case where the four display apparatuses 10 are made to cooperate.

  FIG. 15 is a diagram for explaining an example of an operation to be performed by the user when the display devices 10A, 10B, 10C, and 10D are made to cooperate. When the display devices 10A, 10B, 10C, and 10D are made to cooperate, as shown in FIG. 15, the user arranges the display devices 10A, 10B, 10C, and 10D, and displays a trajectory 30 that extends over the display devices 10A, 10B, 10C, and 10D. Draw.

FIG. 16 shows an example of the detection results of the touch panels 17T of the display devices 10A, 10B, 10C, and 10D when the trajectory 30 passing through the display devices 10A, 10B, 10C, and 10D is drawn. In FIG. 16, “display device A”, “display device B”, “display device C”, and “display device D” indicate display devices 10A, 10B, 10C, and 10D, respectively. In addition, “t ₁ ”, “t ₂ ”,..., “T _{i + j + k + 2} ” indicate, for example, timing at 1/60 second intervals.

Timing “t ₁ ” indicates the timing at which the user touches the finger F on the touch panel 17T of the display device 10A. Further, the position (x _i , y _i ) detected by the touch panel 17T of the display device 10A at the timing “t _i ” is the indicated position PA shown in FIG. 15, and at the timing “t _{i + 1} ” by the touch panel 17T of the display device 10B. The detected position (x _{i + 1} , y _{i + 1} ) is the designated position PB1 shown in FIG.

Further, the position (x _{i + j} , y _{i + j} ) detected by the touch panel 17T of the display device 10B at the timing “t _{i + j} ” is the designated position PB2 shown in FIG. 15, and at the timing “t _{i + j + 1} ” by the touch panel 17T of the display device 10C. The detected position (x _{i + j + 1} , y _{i + j + 1} ) is the designated position PC1 shown in FIG. Similarly, the position (x _{i + j + k} , y _{i + j + k} ) detected by the touch panel 17T of the display device 10C at the timing “t _{i + j + k} ” is the designated position PC2 shown in FIG. 15, and the touch panel 17T of the display device 10D at the timing “t _{i + j + k + 1} ”. The position (x _{i + j + k + 1} , y _{i + j + k + 1} ) detected by is the designated position PD shown in FIG.

  In the example shown in FIGS. 15 and 16, in the processing shown in FIGS. 11 and 12, the display device 10A is set as the display device [1], and the display device 10B is set as the display device [2]. Further, the display device 10C is set as the display device [3], and the display device 10D is set as the display device [4]. As a result, display device data as shown in FIG. 17 is generated in the storage unit 22, for example.

  In the case of the example shown in FIGS. 15 and 16, the positional relationship data as shown in FIG. 18, for example, is generated in the storage unit 22 by executing the processing shown in FIGS. 11 and 12.

  In the case of the example shown in FIGS. 15 and 16, the positional relationship between the display devices 10A and 10B based on the detection result of the touch panel 17T of the display device 10A (display device [1]) and the display device 10B (display device [2]). Is judged. That is, since the user's designated position PA detected last in the display device 10A is included in the right end region 60R, it is determined that the right side 18R is a side corresponding to the designated position PA. Further, since the user's designated position PB1 detected first in the display device 10B is included in the left end region 60L, it is determined that the left side 18L is a side corresponding to the designated position PB1. As a result, in the positional relationship data shown in FIG. 18, a combination of (right side, left side) is registered in association with the combination of the display devices [1], [2]. This indicates that the display devices [1] and [2] are arranged so that the right side 18R of the display device [1] and the left side 18L of the display device [2] are adjacent to each other.

  In the case of the example shown in FIGS. 15 and 16, the display devices 10 </ b> B and 10 </ b> C are based on the detection results of the touch panel 17 </ b> T of the display device 10 </ b> B (display device [2]) and the display device 10 </ b> C (display device [3]). The positional relationship is determined. That is, since the user's designated position PB2 detected last in the display device 10B is included in the lower end region 60D, it is determined that the lower side 18D is a side corresponding to the designated position PB2. Further, since the user's designated position PC1 first detected in the display device 10C is included in the upper end region 60U, it is determined that the upper side 18U is a side corresponding to the designated position PC1. As a result, in the positional relationship data shown in FIG. 18, combinations of (lower side, upper side) are registered in association with the combinations of the display devices [2] and [3]. This indicates that the display devices [2] and [3] are arranged so that the lower side 18D of the display device [2] and the upper side 18U of the display device [3] are adjacent to each other.

  Further, in the case of the example illustrated in FIGS. 15 and 16, the display devices 10 </ b> C and 10 </ b> D are displayed based on the detection results of the touch panel 17 </ b> T of the display device 10 </ b> C (display device [3]) and the display device 10 </ b> D (display device [4]). The positional relationship is determined. That is, since the user's designated position PC2 detected last in the display device 10C is included in the left end region 60L, it is determined that the left side 18L is a side corresponding to the designated position PC2. Further, since the user's designated position PD first detected in the display device 10D is included in the right end region 60R, it is determined that the right side 18R is a side corresponding to the designated position PD. As a result, in the positional relationship data shown in FIG. 18, a combination of (left side, right side) is registered in association with the combination of the display devices [3], [4]. This indicates that the display devices [3] and [4] are arranged so that the left side 18L of the display device [3] and the right side 18R of the display device [4] are adjacent to each other.

  In this case, based on the positional relationship between the display devices [1] and [2], the positional relationship between the display devices [2] and [3], and the positional relationship between the display devices [3] and [4]. The positional relationship between the display devices [1] and [4] can be estimated. For example, the positional relationship between the display devices [1] and [2], the positional relationship between the display devices [2] and [3], and the positional relationship between the display devices [3] and [4] are shown in FIGS. When the positional relationship is as shown, the display devices [4] and [1] are arranged such that the upper side 18U of the display device [4] and the lower side 18D of the display device [1] are adjacent to each other. Become. As a result, the control unit 21 registers the combination (upper side, lower side) in the positional relationship data in association with the combination of the display devices [4] and [1]. As described above, the control unit 21 (the positional relationship recognition unit 54) determines the positional relationship between the display devices [1] and [2], the positional relationship between the display devices [2] and [3], and the display devices [3] and [3]. The positional relationship between the display devices [4] and [1] is estimated by determining whether the positional relationship of [4] is a predetermined positional relationship.

  In the case of the example shown in FIG. 15, the user first detected by the display device 10B (display device [2]) from the user's designated position PA detected last by the display device 10A (display device [1]). Of the user first detected on the display device 10C (display device [3]) from the direction to the designated position PB1 and the user's designated position PB2 last detected on the display device 10B (display device [2]) The positional relationship between the display devices [1], [2], and [3] may be determined based on the direction toward the designated position PC1. For example, in the case of the example shown in FIG. 15, the difference between the direction from the designated position PA to the designated position PB1 and the direction from the designated position PB2 to the designated position PC1 is about 90 degrees. ] To the display device [2] and the direction from the display device [2] to the display device [3] are set to 90 degrees so that the display devices [1], [2], [3 ] May be determined.

  Similarly, the direction from the user designated position PB2 last detected on the display device 10B (display device [2]) to the user designated position PC1 detected first on the display device 10C (display device [3]). The direction from the user's designated position PC2 detected last on the display device 10C (display device [3]) to the user's designated position PD detected first on the display device 10D (display device [4]) , The positional relationship between the display devices [2], [3], and [4] may be determined. For example, in the example shown in FIG. 15, the difference between the direction from the designated position PB2 to the designated position PC1 and the direction from the designated position PC2 to the designated position PD is about 90 degrees. ] To the display device [3] and the direction from the display device [3] to the display device [4] are set to 90 degrees so that the display devices [2], [3], [4 ] May be determined.

  When the trajectory 30 over the display devices 10A, 10B, 10C, and 10D as shown in FIG. 15 is drawn by the user, the control unit 21 (cooperation control unit 56) displays the display device data shown in FIG. The display devices 10A, 10B, 10C, and 10D start cooperation based on the positional relationship data shown in FIG.

  For example, one display screen is configured by the display devices 10A, 10B, 10C, and 10D. That is, one image 40 is displayed over the display devices 10A, 10B, 10C, and 10D. Alternatively, for example, the product list screen 42 is displayed using the display devices 10A and 10D, and the product screen 44 is displayed using the display devices 10B and 10C. That is, the product list screen 42 is configured by the display devices 10A and 10D, and the product screen 44 is configured by the display devices 10B and 10C.

  Alternatively, for example, by displaying a character input screen (for example, a software keyboard) on which the user inputs characters using the touch panel 17T over the display devices 10A, 10B, 10C, and 10D, the display devices 10A, 10B, 10C, and 10D are displayed. Character input may be received using the touch panel 17T. Alternatively, for example, the audio output unit 15 of the display devices 10A, 10B, 10C, and 10D may be regarded as a set of speaker sets to execute audio output.

  According to the display system 1 described above, even if each display device 10 does not include a sensor for detecting that the display devices 10 collide with each other, it is possible to cooperate a plurality of display devices 10. Become. In recent years, the display device 10 (for example, a tablet computer or a mobile phone) is often provided with a touch panel. According to the display system 1, it is possible to cooperate a plurality of display devices 10 using the touch panel. .

  Further, according to the display system 1, the user designates the plurality of display devices 10 to be cooperated by a relatively simple operation of drawing a trajectory over the plurality of display devices 10 using the touch panels 17T of the plurality of display devices 10. It is possible to specify the positional relationship between the plurality of display devices 10. That is, according to the display system 1, the user can designate a plurality of display devices 10 to be cooperated and the positional relationship between the plurality of display devices 10 by one operation.

  The present invention is not limited to the embodiment described above.

  [First Modification] For example, the user may be guided to arrange a plurality of display devices 10 such that the long sides or the short sides of the display devices 10 are adjacent to each other. For example, when the display device 10 is arranged so that the long side of the display device 10 and the short side of another display device 10 are adjacent to each other, a predetermined message (for example, an error message) is output. You may do it.

  In this first modification, when it is determined in step S114 of FIG. 12 that the user's designated position first detected by the touch panel 17T of the display device [n + 1] is included in any one of the end regions 60, The control unit 21 executes the process shown in FIG.

  That is, the control unit 21 sets the side corresponding to the user's designated position last detected by the touch panel 17T of the display device [n] and the user's designated position first detected by the touch panel 17T of the display device [n + 1]. It is determined whether or not the combination of the corresponding side is a predetermined combination (S201).

  Here, the “side corresponding to the designated position” is a side corresponding to the end region 60 including the designated position. For example, when the designated position is included in the left end region 60L, the left side 18L corresponds to the “side corresponding to the designated position”. The “predetermined combination” is a combination of long sides or a combination of short sides.

  When it is determined in step S201 that the above combination is a predetermined combination, the control unit 21 executes the process of step S115 in FIG. On the other hand, when it is determined that the combination is not a predetermined combination, the control unit 21 transmits error message data to at least one of the display device “n” and the display device “n + 1”, and the error message is displayed on the display device “n”. And output to at least one of the display devices “n + 1” (S202). Then, the control part 21 complete | finishes this process.

[Second Modification] For example, the “predetermined condition” for the determination unit 52 to determine whether or not the trajectory over the display devices 10A and 10B has been input by the user may include the following condition G.
(G) The deviation between the direction indicated by the locus of the user's designated position detected by the touch panel 17T of the display device 10A and the direction indicated by the locus of the user's designated position detected by the touch panel 17T of the display device 10B is less than the threshold. It is.

FIG. 20 is a diagram for explaining the condition G described above. In the second modification, the determination unit 52 acquires the designated position PA0 detected by the touch panel 17T of the display device 10A before the designated position PA1 last detected by the touch panel 17T of the display device 10A. For example, the determination unit 52 acquires the designated position PA0 detected by the touch panel 17T of the display device 10A immediately before the designated position PA1 last detected by the touch panel 17T of the display device 10A. Then, the determination unit 52 acquires a vector _VA indicating the direction from the designated position PA0 to the designated position PA1.

In addition, the determination unit 52 acquires a designated position PB0 detected by the touch panel 17T of the display device 10B after the designated position PB1 first detected by the touch panel 17T of the display device 10B. For example, the determination unit 52 acquires the designated position PB0 detected by the touch panel 17T of the display device 10B immediately after the designated position PB1 first detected by the touch panel 17T of the display device 10B. Then, determination unit 52 obtains the vector _{V B} indicating the direction from the indication position PB1 to the indicated position PB0.

Then, the determination unit 52 determines whether or not the angle (θ) formed by the vector V _A and the vector V _B is less than a threshold value. For example, the determination unit 52 calculates the cosine (cos (θ)) of the angle (θ) formed by the vector V _A and the vector V _B. In this case, cos (θ) approaches 1 as the angle (θ) approaches 0 degrees. On the other hand, as the angle (θ) approaches 180 degrees, cos (θ) approaches -1. For this reason, the determination unit 52 determines whether or not the angle (θ) formed by the vector V _A and the vector V _B is less than the threshold by determining whether or not the value of cos (θ) is larger than a predetermined value. Determine whether. When the angle (θ) formed by the vector V _A and the vector V _B is less than the threshold value, the determination unit 52 determines that the condition G is satisfied.

  By adding the condition G, it is possible to improve the determination accuracy of whether or not the trajectory 30 across the display devices 10A and 10B has been input by the user.

  Processing in the second modification will be described. In this second modified example, when it is determined in step S114 of FIG. 12 that the indicated position first detected by the touch panel 17T of the display device [n + 1] is included in any one of the end regions 60, the control unit 21 executes the processing shown in FIG.

That is, first, the control unit 21 determines the vector indicating the direction of the locus of the designated position detected by the touch panel 17T of the display device [n] and the direction of the locus of the designated position detected by the touch panel 17T of the display device [n + 1]. It is determined whether the angle formed by the vector to be displayed is less than a threshold value (S301). For example, the control unit 21 determines whether or not the angle formed by the vector V _A and the vector V _B shown in FIG. 20 is less than a threshold value.

  Here, for example, as illustrated in FIG. 4, a state is assumed in which the display device 10 </ b> A and the display device 10 </ b> B inverted upside down are arranged side by side. That is, it is assumed that the display devices 10A and 10B are arranged so that the right sides 18R of the display devices 10A and 10B are adjacent to each other.

  22A and 22B are diagrams for explaining the processing in step S301 in the above-described state. When the trajectory 30 shown in FIG. 22A is input by the user in the above state, the directions of the display devices 10A and 10B are reversed (the top and bottom are inverted), and thus the touch panel 17T of the display device 10B is actually used. The detected indication positions PB1, PB0 are as shown in FIG. 22B.

In such a case, the control unit 21 acquires a position PB1 ′ having a point-symmetrical relationship with the designated position PB1 with the center point C of the touch panel 17T (display unit 14) as a symmetric point (symmetric center). Similarly, the control unit 21 acquires a position PB0 ′ having a point-symmetrical relationship with the designated position PB0 with the center point C of the touch panel 17T as a symmetric point. Then, the control unit 21 acquires a vector V _B ′ indicating the direction from the position PB1 ′ to the position PB0 ′, and whether or not the angle (θ) formed by the vector V _A and the vector V _B ′ is less than a threshold value. Determine.

Since the vector V _B ′ is an inverse vector of the vector V _B , the control unit 21 determines whether or not the angle (θ) formed by the vector V _A and the inverse vector of the vector V _B is less than a threshold value. You may make it determine.

In the above description, the positions PB1 ′ and PB0 ′ having a point-symmetrical relationship with the designated positions PB1 and PB0 detected on the touch panel 17T of the display device 10B have been described. Instead of acquiring, the positions PA0 ′ and PA1 ′ having a point-symmetrical relationship with the designated positions PA0 and PA1 detected by the touch panel 17T of the display device 10A may be acquired. Then, the control unit 21, the vector _{V A} 'indicating the direction to the' position PA1 from 'position PA0, the vector _{V B} indicating the direction from the indication position PB1 to the indicated position PB0, the angle (theta) is the threshold of You may make it determine whether it is less than.

  Moreover, although the case where the right sides 18R of the display devices 10A and 10B are adjacent to each other has been described above, the upper sides 18U of the display devices 10A and 10B are adjacent to each other when the left sides 18L of the display devices 10A and 10B are adjacent to each other. The same applies to the case where the adjacent sides of the display devices 10A and 10B are adjacent to each other.

  When it determines with the said angle being less than a threshold value in step S301, the control part 21 performs the process of step S115 of FIG. On the other hand, when it determines with the said angle not being less than a threshold value in step S301, the control part 21 performs the process of step S118 of FIG.

  The second modification described above may be combined with the first modification. That is, when it is determined in step S114 in FIG. 12 that the pointing position first detected by the touch panel 17T of the display device [n + 1] is included in any one of the end regions 60, the control unit 21 in FIG. Step S201 may be executed. And when it determines with said combination being a predetermined combination in step S201, you may make it the control part 21 perform the process of step S301 of FIG.

[Third Modification] For example, the “predetermined condition” for the determination unit 52 to determine whether or not the trajectory over the display devices 10A and 10B has been input by the user may include the following conditions H and I. FIG. 23 is a diagram for explaining the following condition H, and FIG. 24 is a diagram for explaining the following condition I.
(H) The user's designated position PA last detected by the touch panel 17T of the display device 10A is included in the left end region 60L or the right end region 60R, and the user first detected by the touch panel 17T of the display device 10B When the designated position PB is included in the left end region 60L or the right end region 60R, the difference value D between the Y axis coordinate value of the designated position PA and the Y axis coordinate value of the designated position PB is less than the threshold value.
(I) The user's designated position PA last detected by the touch panel 17T of the display device 10A is included in the upper end region 60U or the lower end region 60D, and the user first detected by the touch panel 17T of the display device 10B When the designated position PB is included in the upper end region 60U or the lower end region 60D, the difference value D between the X axis coordinate value of the designated position PA and the X axis coordinate value of the designated position PB is less than the threshold value.

  By adding the conditions H and I, it is possible to improve the determination accuracy as to whether or not the user has input the trajectory 30 across the display devices 10A and 10B. The edge portions of the display devices 10A and 10B (the upper side 18U, the lower side 18D, the left side 18L, and the right side 18R of the display devices 10A and 10B, the upper side 62U, the lower side 62D, the left side 62L, and the right side of the display unit 14 (touch panel 17T). The determination accuracy can be improved by the conditions H and I as the portion between 62R is narrower.

  Processing in the third modification will be described. In the third modified example, when it is determined in step S114 of FIG. 12 that the indicated position first detected by the touch panel 17T of the display device [n + 1] is included in any one of the end regions 60, the control unit 21 executes the processing shown in FIG.

  That is, first, the control unit 21 includes the pointed position detected last by the touch panel 17T of the display device [n] in the left end region 60L or the right end region 60R, and first uses the touch panel 17T of the display device [n + 1]. It is determined whether or not the indicated position detected in the step is included in the left end region 60L or the right end region 60R (S401).

  When the determination result in step S301 is true (Y), the control unit 21 determines the Y-axis coordinate value of the indicated position last detected by the touch panel 17T of the display device [n] and the touch panel 17T of the display device [n + 1]. The absolute value of the difference from the Y-axis coordinate value of the designated position detected first by is calculated as the difference value D (S402).

  Here, for example, as shown in FIG. 4, a state is assumed in which the display device 10 </ b> A and the vertically inverted display device 10 </ b> B are arranged side by side. That is, it is assumed that the display devices 10A and 10B are arranged so that the right sides 18R of the display devices 10A and 10B are adjacent to each other.

  FIG. 26A and FIG. 26B are diagrams for explaining the processing in step S402 in this state. In this state, when the locus 30 shown in FIG. 26A is input by the user, the directions of the display devices 10A and 10B are reversed (upside down), and thus actually detected by the touch panel 17T of the display device 10B. The designated position PB is as shown in FIG. 26B.

  In such a case, the control unit 21 obtains a position PB ′ having a point-symmetrical relationship with the designated position PB, with the center point C of the touch panel 17T (display unit 14) as a symmetry point (symmetric center). Then, the control unit 21 acquires the absolute value of the difference between the Y-axis coordinate value of the designated position PA and the Y-axis coordinate value of the position PB ′ as the difference value D.

  In the above description, it has been described that the position PB ′ having a point-symmetrical relationship with the designated position PB detected by the touch panel 17T of the display device 10B is acquired. Instead of acquiring the position PB ′, the display device 10A Alternatively, a position PA ′ having a point-symmetrical relationship with the designated position PA detected last by the touch panel 17T may be acquired. Then, the control unit 21 may acquire the absolute value of the difference between the Y-axis coordinate value of the position PA ′ and the Y-axis coordinate value of the designated position PB as the difference value D.

  Moreover, although the case where the right sides 18R of the display devices 10A and 10B are adjacent to each other has been described above, the same applies to the case where the left sides 18L of the display devices 10A and 10B are adjacent to each other.

  When the determination result in step S401 is false (N), the control unit 21 includes the indicated position last detected by the touch panel 17T of the display device [n] in the upper end region 60U or the lower end region 60D, and Then, it is determined whether or not the indicated position first detected by the touch panel 17T of the display device [n + 1] is included in the upper end region 60U or the lower end region 60D (S403).

  When the determination result in step S403 is true (Y), the control unit 21 determines the X-axis coordinate value of the indicated position last detected by the touch panel 17T of the display device [n] and the touch panel 17T of the display device [n + 1]. The absolute value of the difference from the X-axis coordinate value of the indicated position first detected by is calculated as a difference value D (S404).

  When the upper sides 18U of the display devices 10A and 10B are adjacent to each other, or when the lower sides 18D of the display devices 10A and 10B are adjacent to each other, the left sides 18L of the display devices 10A and 10B are adjacent to each other. In the same manner as described above (see FIG. 26B), the difference value D is calculated.

  When the process of step S402 or S404 is executed, the control unit 21 determines whether or not the difference value D calculated in step S402 or S404 is less than a threshold value (S405). When it is determined that the difference value D is less than the threshold value, the control unit 21 executes the process of step S115 in FIG. On the other hand, when it determines with the said difference value D not being less than a threshold value in step S405, the control part 21 performs the process of step S118 of FIG. Also, when the determination result in step S403 is false (N), the control unit 21 executes the process of step S118 of FIG.

  You may make it combine the 3rd modification demonstrated above with a 1st modification. The case where the determination result in step S403 of FIG. 25 is false (N) is a case where the display devices [n] and [n + 1] are not arranged so that the long sides or the short sides are adjacent to each other. For this reason, when the determination result in step S403 is false (N), the control unit 21 may execute the process of step S202 of FIG.

  Further, the third modification may be combined with the second modification. That is, when the determination result in step S114 in FIG. 12 is true (Y), the control unit 21 may execute the process in step S301 in FIG. And when it determines with the said angle being less than a threshold value in step S301, the control part 21 may be made to perform the process of step S401 of FIG. Alternatively, when the determination result in step S114 in FIG. 12 is true (Y), the control unit 21 may execute the process in step S401 in FIG. And when it determines with the said difference value D being less than a threshold value in step S405, you may make it the control part 21 perform the process of step S301 of FIG.

  Further, the third modification may be combined with the first modification and the second modification.

  [Fourth Modification] In the above description, when a user draws a single trajectory across a plurality of display devices 10, the cooperation of the plurality of display devices 10 is started. The operation to be performed by the user in order to start cooperation is not limited to the above operation. FIG. 27 shows another example of an operation to be performed by the user in order to start cooperation of the plurality of display devices 10. FIG. 27 shows a case where the display devices 10A and 10B are made to cooperate.

  When the display devices 10A and 10B are caused to cooperate, the user brings the finger F into contact with one of the end regions 60 of the touch panel 17T of the display device 10A. In the example shown in FIG. 27, the finger F is in contact with the right end region 60R of the display device 10A. Further, the user brings the finger F into contact with any one of the end regions 60 of the touch panel 17T of the display device 10B. In the example shown in FIG. 27, the finger F is in contact with the left end region 60L of the display device 10B. Thereafter, the user arranges the display devices 10 </ b> A and 10 </ b> B so that the sides corresponding to the end region 60 in contact with the finger F are adjacent to each other. In the case of the example shown in FIG. 27, the display devices 10A and 10B are arranged so that the right side 18R of the display device 10A and the left side 18L of the display device 10B are adjacent to each other. When the user performs such an operation, the cooperation of the display devices 10A and 10B may be started.

  Note that the cooperation of the display devices 10A and 10B only when the time from when the user's designated position is detected on one of the display devices 10A and 10B to when the user's designated position is detected on the other side is less than the threshold. You may make it start work.

  In the above description, it has been described that the user brings the finger F or the like into contact with the end regions 60 of the display devices 10A and 10B before the display devices 10A and 10B are arranged so that the display devices 10A and 10B are adjacent to each other. Of course, after the display devices 10A and 10B are arranged so that the display devices 10A and 10B are adjacent to each other, the user may contact the end region 60 of the display devices 10A and 10B with the finger F or the like.

In the fourth modification, the cooperation control unit 56 starts cooperation between the display device 10A and the display device 10B when both of the following conditions a and b are satisfied.
(A) The user's designated position detected by the touch panel 17T of the display device 10A is included in one of the end regions 60 of the display device 10A.
(B) The user's designated position detected by the touch panel 17T of the display device 10B is included in one of the end regions 60 of the display device 10B.

The cooperation control unit 56 may start the cooperation between the display device 10A and the display device 10B when all of the above conditions a and b and the following condition c are satisfied.
(C) The difference between the timing at which the user instruction position is detected by the touch panel 17T of the display device 10A and the timing at which the user instruction position is detected by the touch panel 17T of the display device 10B is less than the threshold.

  [Fifth Modification] For example, as shown in FIG. 28, the display system 1 may not include the server device 20.

  In the case of the fifth modification, data is exchanged between the plurality of display devices 10 by an application program executed on each of the plurality of display devices 10. Note that data exchange between the plurality of display devices 10 may be performed via the access point 4 or may be performed directly without the access point 4.

  In the case of the fifth modification, any one of the plurality of display devices 10 is selected as a server. Server selection is performed according to a predetermined rule. For example, the display device 10 in which the application program is first activated among the plurality of display devices 10 is selected as a server.

  The display device 10 (control device) selected as the server also plays the role of the server device 20. In other words, the processing described as being executed by the control unit 21 of the server device 20 is executed by the control unit 11 of the display device 10 selected as the server. That is, when the control unit 11 of the display device 10 selected as the server executes processing according to the program, the control unit 11 performs the designated position acquisition unit 50, the determination unit 52, the positional relationship recognition unit 54, and the cooperation control unit 56. Will function as. Further, the program and data described as being stored in the storage unit 22 of the server device 20 are stored in the storage unit 12 of the display device 10 selected as the server.

  In the case of the fifth modification, each display device 10 other than the display device 10 selected as the server transmits the instruction position information regarding the detection result of the touch panel 17T to the display device 10 selected as the server. Become.

  In the fifth modification, the display device 10 selected as the server may be a member of the cooperating display device 10.

  1 display system, 2 LAN, 4 access point, 10, 10A, 10B, 10C, 10D display device, 11, 21 control unit, 12, 22 storage unit, 13, 23 communication unit, 14 display unit, 15 audio output unit, 16 posture detection sensor unit, 17 operation unit, 17B button, 17T touch panel, 18U, 62U upper side, 18D, 62D lower side, 18L, 62L left side, 18R, 62R right side, 20 server device, 24 optical disc drive unit, 30 locus, 40 images 42 Product list screen, 44 Product screen, 50 Pointed position acquisition unit, 52 Determination unit, 54 Position relation recognition unit, 56 Cooperation control unit, 60U Upper end region, 60D Lower end region, 60L Left end region, 60R Right end region.

Claims (22)

In a display system including a plurality of display devices,
Each of the plurality of display devices is
Indicated position detecting means for detecting the position in the screen instructed by the user,
The display system includes:
Indicated position acquisition means for acquiring a detection result of the indicated position detection means of each of the plurality of display devices;
Cooperating control means for cooperating the plurality of display devices based on a detection result of the indicated position detection means for each of the plurality of display devices;
A display system characterized by that. The display system according to claim 1,
Determination means for determining whether or not a trajectory over the plurality of display devices is input by the user based on a detection result of the indicated position detection unit of each of the plurality of display devices;
The cooperation control means causes the plurality of display devices to cooperate when the trajectory over the plurality of display devices is input by the user.
A display system characterized by that. The display system according to claim 2,
The plurality of display devices include a first display device and a second display device,
The determination means includes the first display device and the second display device when detection results of the indicated position detection means of the first display device and the second display device satisfy a predetermined condition. It is determined that the trajectory is input by the user,
The predetermined condition is:
A condition that the indicated position is detected by the indicated position detecting means of the second display device after the indicated position is last detected by the indicated position detecting means of the first display device;
A condition that the indicated position last detected by the indicated position detecting means of the first display device is included in an end region of the first display device;
Including a condition that the indicated position first detected by the indicated position detecting means of the second display device is included in an end region of the second display device.
A display system characterized by that. The display system according to claim 3, wherein
The predetermined condition is that the indication position is detected last by the indication position detection means of the first display device and the indication position is detected first by the indication position detection means of the second display device. A display system further comprising a condition that a difference between the timing and the timing is less than a threshold value. The display system according to claim 3 or 4,
The predetermined condition is:
A condition that the indication position is not detected by the indication position detection means of the second display device when the indication position is detected by the indication position detection means of the first display device;
And a condition that the indicated position is not detected by the indicated position detecting means of the first display device when the indicated position is detected by the indicated position detecting means of the second display device. ,
A display system characterized by that. The display system according to any one of claims 3 to 5,
The predetermined condition includes a direction indicated by a locus of the indicated position detected by the indicated position detection unit of the first display device and a locus of the indicated position detected by the indicated position detection unit of the second display device. The display system further includes a condition that a value related to the direction indicated by is less than a threshold value. The display system according to any one of claims 3 to 6,
Each of the plurality of display devices includes a first side, a second side orthogonal or substantially orthogonal to the first side, a third side facing the first side, and the second side. A fourth side facing the side;
The designated position detected by the designated position detecting means is a first coordinate value that is an axial coordinate value extending parallel to or substantially parallel to the first side, and parallel or substantially parallel to the second side. A second coordinate value that is an axial coordinate value extending to
The predetermined condition is:
The pointing position last detected by the pointing position detecting means of the first display device is included in an end region corresponding to the first side or the third side, and the second display The indicated position of the first display device when the indicated position first detected by the indicated position detecting means of the device is included in an end region corresponding to the first side or the third side The difference between the first coordinate value of the indicated position last detected by the detecting means and the first coordinate value of the indicated position first detected by the indicated position detecting means of the second display device is a threshold value. The condition of being less than, and
The indicated position detected last by the indicated position detecting means of the first display device is included in an end region corresponding to the second side or the fourth side, and the second display The indication position of the first display device when the indication position first detected by the indication position detection means of the device is included in an end region corresponding to the second side or the fourth side The difference between the second coordinate value of the indicated position last detected by the detecting means and the second coordinate value of the indicated position first detected by the indicated position detecting means of the second display device is a threshold value. A condition of being less than, and
A display system characterized by that. The display system according to claim 1,
The plurality of display devices include a first display device and a second display device,
The cooperative control means includes: (a) an indication position detected by the indication position detection means of the first display device is included in an end region of the first display device; and (b) the first display device. When the indicated position detected by the indicated position detection means of the second display device is included in the end region of the second display device, the first display device and the second display device cooperate with each other. To start the
A display system characterized by that. The display system according to claim 8,
The cooperative control means includes: (a) the indicated position detected by the indicated position detecting means of the first display device is included in the end region of the first display device; and (b) The indicated position detected by the indicated position detecting means of the second display device is included in the end region of the second display device, and (c) the indicated position of the first display device When the difference between the timing at which the indication position is detected by the detection means and the timing at which the indication position is detected by the indication position detection means of the first display device is less than a threshold, Starting cooperation between the display device and the second display device;
A display system characterized by that. The display system according to any one of claims 1 to 9,
A positional relationship recognition means for recognizing a positional relationship of the plurality of display devices based on a detection result of the indicated position detection means for each of the plurality of display devices;
The cooperation control means causes the plurality of display devices to cooperate based on the positional relationship.
A display system characterized by that. The display system according to claim 10, wherein
The plurality of display devices include a first display device and a second display device,
The positional relationship recognizing means is provided by any one of a plurality of end regions set so as to correspond to a plurality of sides of the first display device by the indicated position detecting means of the first display device. The indication of the second display device is included in any of a plurality of end regions that include the detected indication position and that respectively correspond to the plurality of sides of the second display device. When the indicated position detected by the position detecting means is included, the first display device corresponding to the end region including the indicated position detected by the indicated position detecting means of the first display device. The first and the second display device corresponding to the edge region including the indicated position detected by the indicated position detecting means of the second display device are adjacent to each other. Display device and said It recognizes that the second display device is disposed,
A display system characterized by that. The display system according to claim 11, wherein
The side of the first display device and the indicated position detection of the second display device corresponding to the end region including the designated position detected by the designated position detection means of the first display device Means for determining whether or not a combination of the side of the second display device corresponding to the end region including the indication position detected by the means is a predetermined combination;
Means for outputting a predetermined message to at least one of the first display device and the second display device when the combination is not the predetermined combination;
A display system comprising: The display system according to any one of claims 10 to 12,
The plurality of display devices include a first display device, a second display device, a third display device, and a fourth display device,
The positional relationship recognition means includes
Means for recognizing a positional relationship between the first display device and the second display device based on a detection result of the indicated position detection means of each of the first display device and the second display device; ,
Means for recognizing a positional relationship between the second display device and the third display device based on a detection result of the indicated position detection means of each of the second display device and the third display device; ,
Means for recognizing a positional relationship between the third display device and the fourth display device based on a detection result of the indicated position detection means of each of the third display device and the fourth display device; ,
The positional relationship between the first display device and the second display device, the positional relationship between the second display device and the third display device, the third display device and the fourth display And recognizing the positional relationship between the first display device and the fourth display device based on the positional relationship with the device,
A display system characterized by that. The display system according to any one of claims 1 to 13,
The display system according to claim 1, wherein the cooperative control unit configures a display screen by the plurality of display devices. The display system according to any one of claims 1 to 13,
The cooperation control means displays a first screen for accepting the user's operation on at least one display device of the plurality of display devices, and performs the user's operation performed on the first screen. And displaying a second screen corresponding to the second display device on at least one other display device of the plurality of display devices. The display system according to any one of claims 1 to 13,
The cooperating control means displays the one input screen for the user to input using the designated position detecting means over the plurality of display devices, thereby indicating the designated position detecting means of the plurality of display devices. A display system that accepts an input from the user using a computer. The display system according to any one of claims 1 to 13,
Each of the plurality of display devices includes audio output means,
The cooperative control means regards the sound output means of the plurality of display devices as a plurality of speakers respectively corresponding to a plurality of channels, and causes the sound output means of the plurality of display devices to output sound.
A display system characterized by that. In a control method of a display system including a plurality of display devices,
Each of the plurality of display devices is
Indicated position detecting means for detecting the position in the screen instructed by the user,
The control method is:
An instruction position acquisition step of acquiring a detection result of the instruction position detection means of each of the plurality of display devices;
A cooperative control step of causing the plurality of display devices to cooperate based on a detection result of the indicated position detection means of each of the plurality of display devices.
A control method for a display system. A means for obtaining a detection result of a designated position detecting means for detecting a position of the display means in the screen designated by a user, wherein the detection results of a plurality of designated position detecting means respectively corresponding to the plurality of display means are obtained. Pointing position acquisition means;
Cooperative control means for causing the plurality of display means to cooperate based on detection results of the plurality of designated position detection means;
The control apparatus characterized by including. A step of obtaining detection results of designated position detecting means for detecting the position of the display means in the screen designated by the user, wherein the detection results of a plurality of designated position detecting means respectively corresponding to the plurality of display means are obtained; An indicated position acquisition step;
A cooperative control step of causing the plurality of display means to cooperate based on detection results of the plurality of designated position detection means;
The control method of the control apparatus characterized by including. A means for obtaining a detection result of a designated position detecting means for detecting a position of the display means in the screen designated by a user, wherein the detection results of a plurality of designated position detecting means respectively corresponding to the plurality of display means are obtained. Indicated position acquisition means, and
Cooperative control means for cooperating the plurality of display means based on detection results of the plurality of designated position detection means;
As a program to make the computer function as. A means for obtaining a detection result of a designated position detecting means for detecting a position of the display means in the screen designated by a user, wherein the detection results of a plurality of designated position detecting means respectively corresponding to the plurality of display means are obtained. Indicated position acquisition means, and
Cooperative control means for cooperating the plurality of display means based on detection results of the plurality of designated position detection means;
A computer-readable information storage medium having recorded thereon a program for causing the computer to function.

Images