JP2012173542A - Display system, display method, terminal device, and computer program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display system, a display method, a terminal device, and a computer program, which enhance flexible operability and convenience of an extended screen display using plural terminals.SOLUTION: A display system 1 includes: a proximity detection part 106 for detecting that a terminal 200 approaches or contacts to a terminal 100 displaying a first image; and a display instruction part 110 for instructing the image display part 202 of the terminal 200 to display a second image that is applicable to the position of the image display part 202 of the terminal 200 that has detected the approach or contact and is to be connected to the first image displayed on the image display part 102 of the terminal 100.

Description

  The present invention relates to a display system, a display method, a terminal device, and a computer program, and more particularly, to a display system, a display method, a terminal device, and a computer program that perform display on a plurality of display devices.

  In recent years, in the case of a terminal device having a display unit such as a mobile phone or a smartphone, the screen size has been increased with the enhancement of its function, and a display corresponding to the entire surface of the housing has been displayed. Has a part.

By the way, by arranging a plurality of such terminal devices in parallel in an arbitrary state, there are cases in which a multi-screen (large screen) is used as a whole.
An example of a portable terminal device having such a display function is described in Patent Document 1. The portable terminal device described in Patent Document 1 detects a contact with another terminal using a magnet provided on each terminal side surface, and forms a series of display units using display units of a plurality of terminals. Is.

In addition, for example, by arranging two mobile phones in a horizontal direction so that two display units are in a side-by-side state adjacent to the left and right, two pages of data can be displayed on the left and right and used as a spread book. is there.
In addition, two mobile phones are arranged in a vertical direction so that the two display units are vertically aligned adjacent to each other, and a soft keyboard (touch keyboard) is displayed on the lower display unit to form an input screen. By using a text screen that displays input information from the keyboard on the display unit, it may be used like a notebook PC (Personal Computer).

  In addition, four mobile phones are arranged in 2 rows x 2 columns, and the map data is displayed in four parts in a matrix arrangement in which the four display units are adjacent to the left, right, top, bottom, top, and bottom. May be used like so.

  Further, when a plurality of display devices are connected by a PC, an enlarged display (for example, a multi-screen display in which an image connected to the right side of the basic display screen is displayed on an additional display device) is used. Sometimes.

  In addition, the image display system described in Patent Document 2 has a plurality of terminal devices arranged in parallel and connected to each other via an information transmission medium, and the arrangement of each display device is indicated by an identification number display and its identification number display. By specifying the arrangement of each display device based on the image information obtained by photographing the multi-display, a multi-display can be configured without installing the display device in a predetermined arrangement.

  Further, in Patent Document 2, when each display device deviates from a predetermined arrangement position of each display device, a command for correcting the image display displacement according to the displacement is given to each display device as fine adjustment information. It is described to give.

JP 2010-85853 A JP 2009-109671 A

  In the technique described in Patent Document 2 described above, when a plurality of display devices are arranged in parallel, each display device is arranged so as to have a predetermined positional relationship, or the arrangement state thereof is determined. It is not necessary for the user to input the positional relationship shown by performing an operation. However, in the above-described technique, it is necessary to connect a plurality of display devices to each other via an information transmission medium and manage and control each terminal using an external control device. For this reason, there is a problem that flexible usage such as using a plurality of terminals individually and using a plurality of terminals according to the situation is not possible.

  Also, even in the technique described in Patent Document 1, when a plurality of terminal devices are arranged adjacent to each other, if the arrangement is shifted, the image displayed at that time can be maintained, but it is adjacent. There is a problem in that an image corresponding to a location moved away from the terminal cannot be displayed.

  Further, in the technique described in Patent Document 1 or 2, for example, as in the case of PC multi-screening, the left and right arrangements of the two display devices are set in advance, and are expanded to the left and right. The screen is simply divided and displayed on each device. Therefore, even if the relative position of the display device is changed, the images on the individual display units are not changed and are fixed.

  As described above, since it is possible to correct the deviation from the predetermined arrangement, for example, when there is a difference in height in the arrangement of the display device, it is possible to correct the level difference between the images across the two screens. . However, for example, when it is desired to check an image slightly outside the currently displayed image, even if the display device is separated, the display image area does not increase. For this reason, when the user wants to see a wider image according to the state of the displayed image, an operation such as scrolling the screen is required, which is unusable.

  An object of the present invention is to provide a display system, a display method, a terminal device, and a computer program that improve the flexible operability and convenience of extended screen display using a plurality of terminals, which are the problems described above.

The display system of the present invention includes:
An approach detecting means for detecting the approach or contact of the second display device to the first display device displaying the first image;
A display for instructing the second display device to display a second image corresponding to the position of the second display device that detects the approach or contact and is connected to the first image displayed on the first display device. Instruction means.

The display method of the present invention includes:
A display method for displaying images on a plurality of display devices,
A display device for displaying the first image;
Detecting the proximity or contact of other display devices with your device,
A display method for instructing the other display device to display a second image corresponding to the position of the other display device that has detected the approach or contact and is connected to the first image displayed on the device itself. .

The first terminal device of the present invention is:
A display unit;
Display control means for displaying the first image on the display unit;
Proximity detection means for detecting the approach or contact of another terminal device to the device;
Instructs the display unit of the other terminal device to display the second image corresponding to the position of the other terminal device that detects the approach or contact, which is connected to the first image displayed on the display unit. Display instruction means.

The second terminal device of the present invention
A display unit;
A second image corresponding to the position of the own device is connected to the first image displayed on the display unit of the other terminal device from another terminal device approaching or contacting the own device. Receiving means for receiving an instruction to be displayed on the display unit;
Display control means for displaying the second image on the display unit of the device according to the received instruction.

The first computer program of the present invention is:
A display device for displaying an image;
A computer including an approach detection unit that detects an approach or contact of another display device with respect to the display device;
A procedure for the approach detection unit to detect the approach or contact of another display device with respect to the display device displaying the first image;
Execute a procedure for instructing the other display device to display a second image corresponding to the position of the other display device that detects the approach or contact, connected to the first image displayed on the display device. It is a computer program for making it happen.

The second computer program of the present invention is:
In a computer equipped with a display device,
A procedure for receiving an instruction to display, on another display device, the second image corresponding to the position of the own device, which is connected to the first image displayed on the other display device, on the display device of the own device;
It is a computer program for executing a procedure for displaying the second image on the display device of its own device in accordance with the received instruction.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, etc. are also effective as an aspect of the present invention.

  The various components of the present invention do not necessarily have to be independent of each other. A plurality of components are formed as a single member, and a single component is formed of a plurality of members. It may be that a certain component is a part of another component, a part of a certain component overlaps with a part of another component, or the like.

  Moreover, although the several procedure is described in order in the method and computer program of this invention, the order of the description does not limit the order which performs a several procedure. For this reason, when implementing the method and computer program of this invention, the order of the several procedure can be changed in the range which does not interfere in content.

  Furthermore, the plurality of procedures of the method and the computer program of the present invention are not limited to being executed at different timings. For this reason, another procedure may occur during the execution of a certain procedure, or some or all of the execution timing of a certain procedure and the execution timing of another procedure may overlap.

  According to the present invention, there are provided a display system, a display method, a terminal device, and a computer program that improve flexible operability and convenience of extended screen display using a plurality of terminals.

It is a functional block diagram which shows the structure of the display system which concerns on embodiment of this invention. It is a block diagram which shows the structure of each terminal which concerns on embodiment of this invention. It is a figure for demonstrating the cooperation screen display process of the terminal of the display system which concerns on embodiment of this invention. It is a flowchart which shows an example of schematic operation | movement of the display system which concerns on embodiment of this invention. It is a functional block diagram which shows the structure of the display system which concerns on embodiment of this invention. It is a flowchart which shows the detailed example of operation | movement of the display system which concerns on embodiment of this invention. It is a flowchart which continues the flowchart of FIG. It is a figure for demonstrating the combination of the screen display of the terminal of the display system which concerns on embodiment of this invention. It is a figure for demonstrating the example of a screen display of the terminal of the display system which concerns on embodiment of this invention. It is a figure for demonstrating the example of a screen display of the terminal of the display system which concerns on embodiment of this invention. It is a figure for demonstrating the combination of the screen display of the terminal of the display system which concerns on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, the same reference numerals are given to the same components, and the description will be omitted as appropriate.

(First embodiment)
FIG. 1 is a functional block diagram showing a configuration of a display system 1 according to an embodiment of the present invention.
The display system 1 of the present embodiment detects the approach or contact of the second display device (the image display unit 202 of the terminal 200) with respect to the first display device (the image display unit 102 of the terminal 100) displaying the first image. The second image corresponding to the position of the image display unit 202 of the terminal 200 that detects the approach or contact, and is connected to the first image displayed on the image display unit 102 of the terminal 100 A display instruction unit 110 for instructing display on the 200 image display units 202.

  In the present embodiment, the first display device and the second display device can be display devices of various mobile terminals. For example, a mobile phone, a PHS (Personal Handyphone System), a smartphone, a tablet information terminal, a PDA (PDA) Personal digital assistants), notebook PCs (Personal Computers), portable DVD players, portable game machines, and portable television receivers. The first display device and the second display device of the present invention are the first terminal 100 (hereinafter also referred to as “terminal A”) and the second terminal 200 (hereinafter also referred to as “terminal B”) in FIG. 1, respectively. Corresponds to the image display unit 102 and the image display unit 202 of FIG.

FIG. 2 is a block diagram showing configurations of terminal 100 and terminal 200 according to the embodiment of the present invention.
The terminal 100 and the terminal 200 are portable terminals having the same configuration, but they are not necessarily the same type. Moreover, although this embodiment has been described using two terminals, the present invention is not limited to this. Two or more terminals may be used.

  As illustrated in FIG. 2, the terminal 100 and the terminal 200 include a CPU 2, a ROM 4, a RAM 6, a network communication control unit 8, a first antenna 10, an operation unit 12, an operation reception unit 14, and a display unit 16. A display control unit 18, an acceleration sensor 20, an inter-terminal communication control unit 22, and a second antenna 24.

  The CPU 2 is connected to each element of the terminal 100 or the terminal 200 via the bus 30 and controls the terminal 100 or the entire terminal 200 together with each element. The ROM 4 stores the control program of the present invention. A basic program and various application programs for operating the terminal 100, various setting data used when these programs operate, and the like are stored. The RAM 6 has a work area for operating the program.

  The network communication control unit 8 communicates via the first antenna 10 by connecting to a mobile communication network via a base station (not shown), a LAN (Local Area Network), the Internet, or a network combining these. Do.

  For example, the terminal 100 and the terminal 200 have a function of accessing various sites on the mobile communication network and the Internet using the network communication control unit 8. The user can display information on various sites connected using the network communication control unit 8 on the display unit 16 described later, or download and use application programs and contents.

  The operation unit 12 includes keys, buttons, switches, a jog dial, a touch pad, a touch panel, and the like operated by the user. The operation reception unit 14 receives a user operation of the operation unit 12 and notifies the CPU 2 via the bus 30.

The display unit 16 includes an LED (Light Emitting Diode) display, a liquid crystal display, an organic EL (ElectroLuminescence) display, and the like. The display control unit 18 performs various display controls on the display unit 16 in accordance with instructions from the CPU 2.
The acceleration sensor 20 detects gravity, vibration, movement, and impact applied to its own device. By using the output signal from the acceleration sensor 20, not only the contact of another terminal can be detected, but also the orientation, tilt, movement, etc. of the device itself can be detected.

  The inter-terminal communication control unit 22 approaches or contacts the own terminal via the second antenna 24 using, for example, a weak radio wave communication function such as infrared communication, non-contact IC communication, Bluetooth, or a wireless LAN communication function. Communicate with other terminals.

  Each component of the terminal 100 or the terminal 200 includes a CPU 2, a memory (RAM 6), a program that implements the components shown in the figure loaded in the memory, a storage unit (ROM 4) such as a hard disk for storing the program, and a network connection It is realized by using any combination of hardware and software centering on the interface (communication control unit 8 and antenna 10). It will be understood by those skilled in the art that there are various modifications to the implementation method and apparatus. Each figure described below shows functional unit blocks, not hardware unit configurations.

  In each of the following drawings, the configuration of parts not related to the essence of the present invention is omitted. For example, voice input / output function units such as speakers and microphones, which are the configurations of the terminal 100 or the terminal 200, and vibrations are omitted. The functional unit and the like are not shown. Note that the operation unit 12 of the terminal 100 or the terminal 200 may accept an instruction by voice input using a microphone.

  In each terminal of the display system 1 of the present embodiment, various units are realized as various functions by the CPU 2 executing the processing procedure described in the computer program of the present invention.

  The computer program according to the present embodiment is a computer for realizing the terminal 100, and another display device (terminal) for the display device (the image display unit 102 of the terminal 100) on which the approach detection unit 106 displays the first image. 200), a second step corresponding to the position of the image display unit 202 of the terminal 200 that detects the approach or contact, and is connected to the first image displayed on the image display unit 102 of the terminal 100. A procedure for instructing the image display unit 202 of the terminal 200 to display the image is described.

  The computer program of this embodiment may be recorded on a computer-readable recording medium. The recording medium is not particularly limited, and various forms can be considered. The program may be loaded from a recording medium into a computer memory, or downloaded to a computer through a network and loaded into the memory.

The operation of the display system 1 of the present embodiment configured as described above will be described below.
FIG. 4 shows an outline of the procedure of the display method of the present invention. Hereinafter, description will be made with reference to FIGS. FIG. 4 shows a flowchart of the main terminal (terminal A) on the left side, and a flowchart of the sub-terminal (terminal B) on the right side.

  The display method of the present embodiment is a display method for displaying images on a plurality of display devices (terminal A and terminal B in FIG. 1), and a display device for displaying a first image (image display unit 102 of terminal A). However, the approach or contact of the other display device (terminal B) with respect to the own device (terminal A) is detected (YES in step S103 in FIG. 4) and displayed on the own device (image display unit 102 of terminal A). The second image corresponding to the position of the other display device (image display unit 202 of terminal B) that detects the approach or contact is connected to the first image to the other display device (image display unit 202 of terminal B). A display instruction is given (step S105 in FIG. 4).

  Specifically, first, it is assumed that the terminal A is in a state where an application program capable of the cooperative screen display processing of the present invention is activated. At this time, it is assumed that the image display unit 102 of the terminal A displays the first image (step S101 in FIG. 4). The state of each terminal at this time is shown in FIG. A first image 120 is displayed on the image display unit 102 of the terminal A. Here, for example, a map is displayed.

  Then, in a state where the first image 120 (FIG. 3) is displayed, the approach detection unit 106 (FIG. 1) of the terminal A monitors the approach or contact of another display device with respect to the own device (terminal A) ( Step S103 in FIG. At this time, the operation mode of the terminal B is set to the cooperation mode, and the image display unit 202 displays an image 220 (FIG. 3A) unrelated to the display image of the terminal A, for example, a standby image. (Step S201 in FIG. 4).

  Then, when the approach detection unit 106 (FIG. 1) of the terminal A detects the approach or contact of another display device, that is, the terminal B, to the own device (terminal A) (YES in step S103 in FIG. 4). Proceed to step S105 in FIG. FIG. 3B shows a state when the terminal B is brought into contact with the terminal A.

  Then, the display instruction unit 110 (FIG. 1) of the terminal A is connected to the first image displayed on the own device (the image display unit 102 of the terminal A), and the other display device (terminal) that detects the approach or contact A second image corresponding to the position of the B image display unit 202) is instructed to be displayed on another display device (the image display unit 202 of the terminal B) (step S105 in FIG. 4).

Then, when the image display unit 202 (FIG. 1) of the terminal B receives a second image display instruction from the terminal A (YES in step S203 of FIG. 4), the second image is displayed according to the instruction from the terminal A. (Step S205 in FIG. 4). FIG. 3C shows a state in which the second image 222 corresponding to the position of the terminal B connected to the first image 120 displayed on the image display unit 102 of the terminal A is displayed on the terminal B. . Here, a map continuing from the map displayed on terminal A is displayed on terminal B. In this way, using the two terminals, the user can see a wide range of maps with the enlarged images.
Thereafter, terminal A and terminal B operate in cooperation.

  In the example of FIG. 3, the terminal A and the terminal B are arranged such that the vertical screen 130 of the terminal A and the vertical screen 230 of the terminal B are arranged side by side in the horizontal direction as shown in FIG. Although described using an example, the display method of the present invention is not limited to this arrangement. The positional relationship between the left and right terminals A and B may be switched. Further, for example, as shown in FIG. 8B, the horizontal screen 132 of the terminal A and the horizontal screen 232 of the terminal B may be arranged vertically in the vertical direction. Here, the upper and lower positional relationship between the terminal A and the terminal B may be interchanged.

Further, as shown in FIG. 8C, the vertical screen 130 of the terminal A and the vertical screen 234 of the terminal B may be arranged vertically. Here, the upper and lower positional relationship between the terminal A and the terminal B may be interchanged. Further, as shown in FIG. 8D, the horizontal screen 132 of the terminal A and the horizontal screen 236 of the terminal B may be arranged side by side in the horizontal direction. Here, the positional relationship between the left and right terminals A and B may be interchanged.
Further, for example, the screen orientations of the terminal A and the terminal B may be different such that the terminal A is horizontally oriented and the terminal B is vertically oriented.

  As described above, according to the present invention, when a plurality of terminals are arranged in parallel for the user, the terminals are arranged so as to have a predetermined positional relationship, or the positional relationship between them. This eliminates the need for complicated preparations such as inputting user information by performing user operations. Further, since the arrangement state of each terminal can be easily specified without providing any special connection means, a display system with high convenience can be realized.

(Second Embodiment)
FIG. 5 is a functional block diagram showing the configuration of the display system 51 according to the embodiment of the present invention.
In the display system 51 of the present embodiment, specific examples such as a method for determining a second image based on the relative positions of the first display device and the second display device, and a method for transmitting image information between the display devices will be described.

  As shown in FIG. 5, in the display system 51, a terminal 150 (terminal A) includes an image display unit 102, an approach detection unit 106, a display instruction unit 110, which are the same as the terminal 100 of the display system 1 in FIG. And a display control unit 104, a position detection unit 108, and a communication interface unit (shown as “I / F” in the drawing) 112. The terminal 250 (terminal B) includes an image display unit 202 similar to the terminal 200 of the display system 1 of FIG. 1, and further includes a display control unit 204, an approach detection unit 206, a position detection unit 208, It includes an instruction receiving unit 210 and a communication interface unit (shown as “I / F” in the figure) 212.

  In addition, the terminal 150 and the terminal 250 of this embodiment shall have the structure similar to the terminal 100 and the terminal 200 shown in FIG. 2 of the said embodiment.

  The communication interface unit 112 of the terminal 150 and the communication interface unit 212 of the terminal 250 correspond to the inter-terminal communication control unit 22 and the second antenna 24 of FIG. In the present embodiment, the communication interface unit 112 and the communication interface unit 212 are connected to another terminal using, for example, an infrared communication function to perform communication.

  The image display unit 102 of the terminal 150 and the image display unit 202 of the terminal 250 correspond to the display unit 16 of FIG. In the present embodiment, the image display unit 102 and the image display unit 202 extend to at least one surface of the casing of the terminal 150 and the terminal 250, respectively. Each display unit 16 preferably extends over almost the entire area of at least one surface of the casing of each terminal, but is not limited thereto. In the present embodiment, the screen of the display unit 16 is rectangular, but is not particularly limited thereto. Various screen shapes are possible.

  The display control unit 104 of the terminal 150 and the display control unit 204 of the terminal 250 correspond to the display control unit 18 of FIG. The display control unit 104 and the display control unit 204 perform control to display images on the screens of the image display unit 102 and the image display unit 202, respectively.

  In the terminal 150 of the present embodiment, the CPU 2 (FIG. 2) executes an application program capable of the cooperative screen display processing of the present invention, and the first image is displayed on the image display unit 102. The application program activation method is not particularly limited. For example, the user may instruct operation on the menu screen, or may be specified to be automatically activated at a predetermined time.

  The application program is not particularly limited. For example, a computer program to be described later that realizes the function of the linkage screen display processing of the display system 51 of the present invention can be added to various application programs as a function module.

In each terminal of the display system 51 of the present embodiment, various units are realized as various functions by the CPU 2 executing the processing procedure described in the computer program of the present invention.
Since the computer program for realizing the terminal 150 of the present embodiment is the same as the computer program of the terminal 100 of the above embodiment, description thereof is omitted.

  Furthermore, the computer program according to the present embodiment connects a computer for realizing the terminal 250 to the first image displayed on the image display unit 102 of the terminal 150 from another display device (terminal 150). A procedure for receiving an instruction to display the second image corresponding to the position of the own device (image display unit 202 of terminal 250) on the display device (image display unit 202) of own terminal 250, and the second image according to the received instruction. The procedure for displaying on the image display unit 202 of the terminal 250 is described.

  The computer program of this embodiment may be recorded on a computer-readable recording medium. The recording medium is not particularly limited, and various forms can be considered. The program may be loaded from a recording medium into a computer memory, or downloaded to a computer through a network and loaded into the memory.

  The proximity detection unit 106 of the terminal 150 and the proximity detection unit 206 of the terminal 250 each use an output signal from the acceleration sensor 20 of FIG. 2, and the other terminals (the terminal 150 is the terminal 250 and the terminal 150 is the terminal 150). Detect approach or touch. In addition to the acceleration sensor 20, the approach detection unit 106 and the approach detection unit 206 can also detect the approach or contact of another terminal using a proximity sensor, Bluetooth (registered trademark), or infrared communication. In this embodiment, the terminals are brought into contact with each other so as to lightly collide with each other, and the cooperation screen display process between the terminals is started.

  Here, the terminal 150 and the terminal 250 have a function of setting to a cooperation mode for performing a cooperation screen display process between terminals. It is assumed that this cooperation mode is not dedicated to a specific application program but is common to application programs capable of the cooperation mode. The operation accepting unit 14 in FIG. 2 may perform mode setting according to an operation by accepting a predetermined key operation or an operation on a setting screen displayed on the display unit 16.

  A specific example of a contact or approach detection method of another terminal in the approach detection unit 106 and the approach detection unit 206 will be described. Here, a method for detecting contact of another terminal using an output signal from the acceleration sensor 20 of FIG. 2 will be described. The approach detection unit 106 and the approach detection unit 206 periodically perform acceleration measurement processing at the timing of interruption or polling to detect acceleration. And the approach detection part 106 or the approach detection part 206 detects that there was contact with another terminal by determining whether the detected acceleration is more than a predetermined threshold value.

  Then, when it is determined that the detected acceleration is equal to or greater than the threshold value, the approach detection unit 106 and the approach detection unit 206 assume that there is a large acceleration such that there is contact with another terminal, and the direction and generation time of the acceleration. Is recorded in the RAM 6 (FIG. 2). Each terminal further includes a clock (not shown). The occurrence time can be acquired from a clock.

  Then, at least one of the approach detection unit 106 and the approach detection unit 206 that has detected contact with another terminal performs communication negotiation via the communication interface unit 112 or the communication interface unit 212 and searches for another terminal. When the proximity detection unit 106 or the proximity detection unit 206 finds another terminal, the acceleration generation time recorded in the RAM 6 is transmitted to or received from another terminal.

  Then, the approach detection unit 106 or the approach detection unit 206 compares the acceleration generation time recorded in the own device with the acceleration generation time received from another terminal, and determines whether or not they match. Then, the approach detection unit 106 or the approach detection unit 206 determines that another terminal is in contact when the acceleration generation times coincide with each other, and notifies the position detection unit 108 or the position detection unit 208 of the contact.

  The position detection unit 108 of the terminal 150 and the position detection unit 208 of the terminal 250 each detect an approach or a contact direction when approaching or contacting another terminal from the acceleration direction using an output signal from the acceleration sensor 20. Then, the relative position between the other terminal and the own terminal is detected.

  In addition to the acceleration sensor 20, the position detection unit 108 and the position detection unit 208 detect the approach direction using a plurality of proximity sensors, or acquire them from other terminals that have approached or contacted using GPS or acceleration sensors. This can be realized by receiving location information. Here, it is assumed that the screen display surfaces of the display unit 16 (FIG. 2) of the two terminals (terminal 150 and terminal 250) are arranged on the same plane so as to form part of a continuous image. . Therefore, the relative position may be expressed by a position in the plane direction, for example, a two-dimensional coordinate (X, Y).

  In addition, even when the screen display surfaces of the display unit 16 (FIG. 2) of the terminal 150 and the terminal 250 are not arranged on the same plane, the front-rear shift (information in the three-dimensional direction) is ignored and only the two-dimensional direction is ignored. The relative position may be obtained based on the information.

  The display instruction unit 110 of the terminal 150 is connected to the first image displayed on the image display unit 102 of the terminal 150, and displays a second image corresponding to the position of the image display unit 202 of the terminal 250 that detects the approach or contact. The display instruction is given to the terminal 250. The display instruction may be to generate the second image itself and transmit the image data to the terminal 250, or to transmit image information necessary for the terminal 250 to display the second image to the terminal 250. Also good. The display instruction unit 110 transmits image data or image information to the terminal 250 using, for example, the inter-terminal communication control unit 22 of FIG.

  For example, based on the contact direction of the other terminal 250 detected by the position detection unit 108, the display instruction unit 110 displays the “adjacent image (first image) in the contact direction of the first image currently displayed on the image display unit 102. 2 images) ”. Then, the generated adjacent image is transmitted to the terminal 250 via the communication interface unit 112.

The instruction receiving unit 210 of the terminal 250 is displayed on the image display unit 102 of the other terminal device (terminal 150) from another terminal device (terminal 150) approaching or in contact with the own device (terminal 250). An instruction to display the second image corresponding to the position of the own device (terminal 250) connected to the first image on the display unit (image display unit 202) of the own device (terminal 250) is received.
The display control unit 204 of the terminal 250 displays the second image on the display unit (image display unit 202) of the own device (terminal 250) according to the received instruction.

  In this embodiment, the terminal 150 is the main terminal, the terminal 250 is the sub-terminal, and the terminal 150 has the initiative to instruct the terminal 250 to display an image. However, the present invention is not limited to this. The terminal 150 may further include the same instruction receiving unit as the instruction receiving unit 210 of the terminal 250, and the terminal 250 may further include the same display instruction unit as the display instruction unit 110 of the terminal 150. Then, both the terminal 150 and the terminal 250 may be able to perform control with one of the initiative of the cooperation screen display process depending on the situation.

The operation of the display system 51 of the present embodiment configured as described above will be described below.
6 and 7 show examples of specific operations of the display system 51 of the present embodiment. This will be described below with reference to FIGS.
6 and 7 show a flowchart of the main terminal (terminal A) side on the left side and a flowchart of the sub-terminal (terminal B) on the right side, respectively.

  Here, the main terminal A is a terminal that is initially operating an application program that can independently perform the cooperative screen display processing of the display system 51, and the sub-terminal B is a terminal that is linked with the main terminal A later. .

  First, the main terminal A is executing an application program that can link the screen with the sub-terminal B (step S111 in FIG. 6). At this time, the first image is displayed on the image display unit 102 of the main terminal A as a result of the CPU 2 executing the application program.

  Here, when the sub terminal B is linked to the terminal A, the user gives an operation instruction to set the sub terminal B to the linked mode. In the terminal B, the operation reception unit 14 (FIG. 2) receives a user instruction, and the CPU 2 (FIG. 2) sets the operation mode to the cooperation mode (step S211 in FIG. 6).

  Here, it is assumed that the cooperation mode is not dedicated to a specific application, but is common to applications capable of the cooperation mode. For example, the operation mode setting operation is performed by causing the terminal B to display an operation screen for accepting the operation mode setting on the display unit 16 (FIG. 2) and allowing the operation accepting unit 14 to accept a user operation instruction. Can be realized.

Then, the user brings the sub terminal B into contact with the main terminal A (step S213 in FIG. 6). For example, the user may perform an operation of lightly hitting the terminal A and the terminal B. The process of step S213 in FIG. 6 is a user operation and not a process of the terminal B, and thus is indicated by a broken line.
At that time, the approach detection unit 106 (FIG. 5) of the main terminal A performs acceleration measurement processing at the timing of interruption or polling, and detects the acceleration (step S113 in FIG. 6).

  And the approach detection part 106 of the main terminal A determines whether the detected acceleration is more than a predetermined threshold value (step S115 of FIG. 6). Here, if the acceleration is less than the threshold value (<in step S115 in FIG. 6), the process returns to step S111 in FIG.

On the other hand, if the acceleration is equal to or greater than the threshold (≧ in step S115 in FIG. 6), the proximity detection unit 106 of the terminal A determines the direction of acceleration and the generation time, assuming that there is a large acceleration such that the sub terminal B is in contact Is recorded in the RAM 6 (FIG. 2) (step S117 in FIG. 6).
On the other hand, since the acceleration caused by the contact is also generated on the sub-terminal B side, the approach detection unit 206 (FIG. 5) detects the acceleration and detects the acceleration (step S215 in FIG. 6).

  Also in the sub terminal B, the approach detection unit 206 determines whether or not the detected acceleration is equal to or greater than a predetermined threshold (step S217 in FIG. 6). Here, if the acceleration is less than the threshold value (<in step S217 in FIG. 6), the process returns to step S215 in FIG. 6 on the assumption that there is no large acceleration in contact with the main terminal A.

  On the other hand, if the acceleration is equal to or greater than the threshold (≧ of step S217 in FIG. 6), the proximity detection unit 206 of the terminal B determines the direction and generation time of the acceleration, assuming that there is a large acceleration that has contacted the main terminal A. Recording is performed in the RAM 6 (FIG. 2) (step S219 in FIG. 6).

  Then, after step S117 and step S219 in FIG. 6, the main terminal A and the sub-terminal B perform communication negotiations to search and connect to other terminals (steps S119 and S221 in FIG. 6). These communication processes are performed by the communication interface unit 112 and the communication interface unit 212.

  At this time, if the sub-terminal B cannot find the main terminal A (NO in step S223 in FIG. 6), the process returns to step S215 in FIG. On the other hand, when the sub terminal B finds the main terminal A (YES in step S223 in FIG. 6), the communication interface unit 212 of the terminal B transmits the acceleration occurrence time 302 to the main terminal A (step S225 in FIG. 6).

  On the other hand, if the main terminal A cannot find the sub-terminal B (NO in step S121 in FIG. 6), the process returns to step S111 in FIG.

  On the other hand, when the main terminal A finds the sub-terminal B (YES in step S121 in FIG. 6), the communication interface unit 112 of the terminal A performs processing for receiving the acceleration occurrence time on the sub-terminal B side, and from the sub-terminal B side. Is received (step S123 in FIG. 6).

  In step S121 and step S223 in FIG. 6, for example, a predetermined retry process is performed so that the process proceeds without delay even when either one cannot find another terminal and the other finds another terminal. And time-out processing.

  The approach detection unit 106 of the main terminal A compares whether the acceleration generation time recorded in the RAM 6 of the main terminal A matches the acceleration generation time 302 received from the sub terminal B (step S125 in FIG. 6). If the acceleration occurrence times do not match (NO in step S125 of FIG. 6), the communication interface unit 112 of the terminal A transmits the occurrence time comparison information 304 indicating that the acceleration occurrence time is “mismatch” to the sub-terminal B. (Step S127 in FIG. 6). Then, the communication with the terminal B is terminated (step S129 in FIG. 6), and the process returns to step S111 in FIG.

  On the other hand, if the acceleration generation times match (YES in step S125 of FIG. 6), the communication interface unit 112 of the terminal A transmits the generation time comparison information 304 indicating that the acceleration generation times “match” to the sub-terminal B. (Step S131 in FIG. 6).

The communication interface unit 212 of the sub-terminal B receives the occurrence time comparison information 304 (step S227 in FIG. 6).
If the occurrence time comparison information 304 received from the terminal A is “mismatch” (NO in step S229 in FIG. 6), the communication interface unit 212 of the terminal B ends communication (step S231 in FIG. 6). Return to step S215 of step 6.

  On the other hand, if the occurrence time comparison information 304 received from the terminal A is “match” (YES in step S229 in FIG. 6), the process proceeds to step S233 in FIG.

Up to this point, communication has been established by recognizing that both terminals have contacted each other.
From here, the image displayed on the screen of the sub-terminal B is generated.
The position detection unit 108 of the main terminal A specifies the direction in which the sub terminal B is in contact from the acceleration direction (step S133 in FIG. 7).

  Then, an “adjacent image” in the contact direction of the display image (first image) of the main terminal A is generated (step S135 in FIG. 7). Actually, the display instruction unit 110 of the terminal A generates an adjacent image in the direction in which the sub-terminal B is in contact with the first image displayed on the main terminal A. Then, the display instruction unit 110 of the terminal A transmits the adjacent image 306 to the terminal B via the communication interface unit 112 (step S137 in FIG. 7).

When the occurrence time comparison information 304 “matches” in step S229 in FIG. 6 described above, the instruction receiving unit 210 of the sub terminal B receives the adjacent image 306 transmitted from the main terminal A via the communication interface unit 212. (Step S233 in FIG. 7). Then, the display control unit 204 of the sub terminal B displays the adjacent image 306 on the screen of the image display unit 202 (step S235 in FIG. 7).
Thereafter, the main terminal A and the sub terminal B operate in cooperation.

  As described above, according to the display system 51 of the present embodiment, the same effects as those of the above-described embodiment can be obtained, and a plurality of terminals can be freely operated based on the user's intention and flexibly linked according to the situation. Screen display processing can be performed, improving usability.

As mentioned above, although embodiment of this invention was described with reference to drawings, these are the illustrations of this invention, Various structures other than the above are also employable.
For example, in the display system 51 of the above embodiment, the sub terminal B is configured to display the second image after detecting the approach or contact with the main terminal A, but is not limited thereto.

  In the above embodiment, in order to display the second image, the terminal B is assumed to start the application program that displays the first image on the terminal A and display the second image. Then, after detecting the approach or contact with another terminal, the sub-terminal B activates an application program that can perform the linked screen display process and displays the second image.

  However, in other embodiments, the sub-terminal B may activate an application program that can perform the cooperation screen display process in advance and display the first image, for example. And according to the display instruction from the terminal A, it is good also as a structure which switches a display to a 2nd image, or transfers (moves).

  Alternatively, in another embodiment, after detecting that the terminals have approached each other before contacting each other, a predetermined image is displayed on each terminal, and when the terminals contact each other as a trigger, the first is displayed on the main terminal. The image and the second image may be displayed on the sub-terminal. Thus, the timing of image display can be changed by combining the approach and the detection of contact.

  Further, in the above embodiment, as shown in FIG. 9A, the main terminal A and the sub terminal B are mutually connected to the screen 140 of the image display unit 102 (FIG. 5) of the main terminal A and the image display unit of the sub terminal B. The screen 240 of 202 (FIG. 5) matches the orientation of the apparatus and the display direction, but is not limited to this. Here, the screen 140 of the terminal A has a screen upper end 142 and a screen lower end 144, and the terminal B screen 240 has a screen upper end 242 and a screen lower end 244.

  In FIG. 9B, the upper end 142 of the screen 140 of the image display unit 102 of the main terminal A and the upper end 242 of the screen 240 of the image display unit 202 of the sub-terminal B face each other and approach or contact each other. An example is shown. In this way, the display instruction unit 110 of the main terminal A issues an instruction to display the second image in the reverse direction with respect to the first image so that the display direction is opposite to the device direction of the sub terminal B. You can also.

  Such a change in image orientation can be used, for example, when a terminal such as a game machine is used by a plurality of people. When one person uses two terminals, or when a plurality of persons use the terminals side by side, the screen orientation and the display direction of each terminal are matched as shown in FIG.

On the other hand, for example, when two people face each other and use the terminal face-to-face, the second image to be displayed on the sub-terminal B is displayed on the main terminal A as shown in FIG. A second image reversed from the direction of the first image is displayed.
In this case, the second image that has been reversed in advance may be transmitted from the terminal A to the terminal B, or the second image in the same direction as the first image may be transmitted, and an instruction to reverse is transmitted from the terminal A to the terminal B. May be sent to. Alternatively, the terminal B may detect the relative orientation relationship with the screen of the terminal A and automatically rotate the image received from the terminal A.

  That is, the display system of another embodiment includes a first display device (the image display unit 102 of the terminal A in FIG. 1 or FIG. 5) and a second display device (the image display unit 202 of the terminal B in FIG. 1 or FIG. 5). It is possible to further include an orientation detection unit (not shown) for detecting the relative orientation of the. The display instruction unit 110 (FIG. 1 or FIG. 5) is connected to the first image displayed on the image display unit 102 of the terminal A based on the relative orientation of the display screens of the terminal A and the terminal B. Alternatively, it is possible to determine the display direction of the second image corresponding to the position of the image display unit 202 of the terminal B that has detected contact, and instruct the display to the image display unit 202 of the terminal B.

  There are various methods for detecting the orientations of the terminals A and B. For example, the position of the own device and the orientation of the device (for example, the angle formed by the same direction axis of the display screen of each terminal) are detected using the acceleration sensor 20 (FIG. 2) or GPS, and the information is exchanged. It is also possible to determine the relative orientation of the partner device and the device itself. The display direction of the first image and the second image can be determined based on the relative orientation. These processes may be performed by the display instruction unit 110 (FIG. 1 or 5) of the main terminal A, the image display unit 202 (FIG. 1 or 5) of the sub-terminal B, or both. You may adjust with.

Moreover, in the said embodiment, although it was set as the structure which the display instruction | indication part 110 (FIG. 1 or FIG. 5) transmits a 2nd image from the main terminal A to the subterminal B, it is not limited to this.
For example, the display instruction unit 110 does not send the second image itself from the main terminal A to the sub terminal B, but notifies the image information for displaying the second image on the image display unit 202 of the sub terminal B. May be. Then, the image display unit 202 of the sub terminal B may display the second image based on the notified information.

  That is, terminal A further includes an information generation unit (not shown) that generates or acquires image information for causing terminal B to display the second image. Then, the display instruction unit 110 (FIG. 1 or 5) notifies the terminal B of the image information generated or acquired by the information generation unit, thereby instructing the image display unit 202 of the terminal B to display the second image. be able to. Here, the image information may be, for example, URL (Uniform Resource Locator), display area or position instruction information, and the like.

  For example, in the case of a map display, the main terminal A may send a map image to the sub-terminal B, but it sends the URL of the map information providing site to be displayed, latitude / longitude information, display magnification, etc. to the sub-device, Based on the information, the sub terminal may access the site and acquire and display a map image.

  Furthermore, in the display system of the present invention, the image displayed on each terminal is not limited to a fixed case. In another embodiment, for example, when the two terminals are moved together while displaying a map as shown in FIG. 3C, the first image and the second image are displayed so that the display of both terminals changes accordingly. An image may be generated and displayed. As described above, the cooperation screen display process is started by detecting that the terminals have contacted or approached each other, and then the two terminals are moved while moving based on the start position until an end instruction is received. Screen display processing may be performed.

  Display control to change the display image position based on the moving position while detecting the moving position after detecting the position of the initial two terminals in the same way as the detection of the relative orientation of the terminal described above. can do.

  In addition, when an operation such as scrolling is performed on one terminal, the display on both terminals can be operated together.

  In addition, once the cooperation screen display process is started, the display can be changed in accordance with the change in the positional relationship of the terminals. For example, the terminal A detects the movement of the terminal B, and changes the second image to be displayed on the terminal B according to the movement position.

  According to this configuration, in an application program for displaying a map, the sub terminal is arranged on the right side of the main terminal, and after checking the map on the right side, the sub terminal is further moved and arranged on the left side of the main terminal. You can check the map on the left.

  Further, as shown in FIG. 10A, after the terminal A and the terminal B start the cooperation screen display process, as shown in FIG. You can check the map at the bottom. Alternatively, as shown in FIG. 10A, after the terminal A and the terminal B start the cooperation screen display process, for example, the terminal B is moved away from the terminal A and moved to the right side, so that the image on the right side can be displayed. It can also be displayed on terminal B. In this case, the terminal B and the terminal A can be separated as long as communication between the terminal A and the terminal B can be maintained.

In the said embodiment, as shown to Fig.10 (a), although the terminal provided with the display part of the same shape was demonstrated to the example, it is not limited to this. For example, the cooperation screen display process can be performed between terminals having display units having different shapes.
Here, a method suitable for an application program for displaying an image, such as aligning one of the top, bottom, left, or right of the screen, or aligning the center as shown in FIG. That's fine.

  Even if the information of the image display unit 102 (FIGS. 1 and 5) and the image display unit 202 (FIGS. 1 and 5) is exchanged between the terminals that are approaching or in contact with each other, the arrangement of the devices and the screens is determined. Good. Alternatively, a message for instructing the user how to match each terminal, an alignment mark, or the like may be displayed on the screen to notify the user.

  In addition, after the terminal A and the terminal B detect the approach or contact, when the distance between the terminal A and the terminal B becomes far away and mutual communication cannot be maintained, a notification unit (notifying a user) (Not shown) may be provided. The notification unit outputs a message, such as a message for notifying the user that the terminals are too far apart to be able to cooperate with each other and instructing the terminals to approach each other by voice, display, or vibration.

Moreover, as shown in FIG. 11, the display system of the present invention is not limited to image cooperation of two terminals. Three or more terminals may be used.
For example, when the terminal C is added to the terminal A (main) and the terminal B (sub) (FIG. 11A), when the terminal C is added, as shown in FIG. -In the arrangement like terminal B, terminal A is the main and terminal C is the sub.

Also, as shown in FIG. 11C, in the case of an arrangement such as terminal A-terminal B-terminal C, terminal B is the main and terminal C is the sub.
As described above, when three or more devices are used, various relationships between the main terminal and the sub-terminal are conceivable. As described above, the display system of the present invention can be a terminal that can be sub-main and sub-type.

  FIG. 11D shows an example in which four terminals A to D are used. Thus, the display system of the present invention can also combine a plurality of terminals.

  Moreover, as another aspect, for example, the second image is enlarged as a magnifying glass as the second terminal is overlapped with the first terminal in the Z-axis direction and the distance is increased. Can be displayed. In this case, the relative position can be expressed by three-dimensional coordinates. At this time, the relative position can be detected based on the GPS data of each terminal.

  In other embodiments, each terminal may have, for example, a one-segment function unit (not shown). Then, a television image received using the one-segment function unit may be displayed on a plurality of terminal devices in cooperation screen display. In this case, an image can be displayed by enlarging the screen according to the size of the screen formed using a plurality of terminals.

  While the present invention has been described with reference to the embodiments and examples, the present invention is not limited to the above embodiments and examples. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.

  In the present invention, when information relating to a user (in the present invention, terminal location information, etc.) is acquired and used, this is legally performed.

(Appendix 1) Approach detection means for detecting the approach or contact of the second display device with respect to the first display device displaying the first image;
A display for instructing the second display device to display a second image corresponding to the position of the second display device that detects the approach or contact and is connected to the first image displayed on the first display device. And a display unit.
(Appendix 2) In the display system described in (Appendix 1),
Further, when the approach detection means detects the approach or contact of the second display device, the search of the second display device is started, and when the second display device is found as a result of the search, 2. A display system comprising communication means for performing communication establishment processing with a display device.
(Appendix 3) In the display system described in (Appendix 1) or (Appendix 2),
The approach detection means detects the approach or contact of the first display device with respect to the second display device,
The display system further includes means for acquiring times when the approach or contact of the first display device and the second display device is detected, respectively.
A display system comprising: determination means for determining that the first display device and the second display device have approached or contacted when the acquired time of the first display device coincides with the time of the second display device.
(Supplementary Note 4) Display unit,
Display control means for displaying the first image on the display unit;
Proximity detection means for detecting the approach or contact of another terminal device to the device;
Instructs the display unit of the other terminal device to display the second image corresponding to the position of the other terminal device that detects the approach or contact, which is connected to the first image displayed on the display unit. And a display instruction means.
(Appendix 5) In the terminal device described in (Appendix 4),
The approach detection means includes
Including an acceleration detection unit that detects acceleration in any of the upper, lower, left, and right directions of the own device,
A terminal device that detects contact of the other terminal device when the magnitude of acceleration when contacting the other terminal device detected by the acceleration detection unit exceeds a predetermined value.
(Appendix 6) In the terminal device described in (Appendix 5),
When the approach detection unit detects the approach or contact of the other terminal device, the approach detection unit further includes a specifying unit that specifies a contact direction of the other terminal device based on the acceleration detected by the acceleration detection unit,
The display instruction unit is a terminal device that instructs the other terminal device to display a second image adjacent to the first image in the contact direction specified by the specifying unit.
(Appendix 7) In the terminal device according to any one of (Appendix 4) to (Appendix 6),
A communication means for starting and establishing communication between the terminal device and the other terminal device when the approach detection means detects that the other terminal device has contacted;
Receiving means for receiving, using the communication means, a time at which it is detected that the terminal device has been in contact with the other terminal device;
A time determination unit that determines whether or not the received time and the time when the approach detection unit detects that the other terminal device is in contact with each other; and
A terminal device in which the display instruction means instructs the other terminal device to perform the display when the times coincide.

DESCRIPTION OF SYMBOLS 1 Display system 8 Network communication control part 10 1st antenna 12 Operation part 14 Operation reception part 16 Display part 18 Display control part 20 Acceleration sensor 22 Inter-terminal communication control part 24 2nd antenna 30 Bus 100 Terminal 102 Image display part 106 Approach detection Unit 110 display instruction unit 200 terminal 202 image display unit 51 display system 150 terminal 104 display control unit 108 position detection unit 112 communication interface unit 120 image 250 terminal 204 display control unit 206 approach detection unit 208 position detection unit 210 instruction reception unit 212 communication Interface unit 222 Image 302 Acceleration occurrence time 304 Occurrence time comparison information 306 Adjacent image

Claims (10)

An approach detecting means for detecting the approach or contact of the second display device to the first display device displaying the first image;
A display for instructing the second display device to display a second image corresponding to the position of the second display device that detects the approach or contact and is connected to the first image displayed on the first display device. And a display unit. The display system according to claim 1,
A position detecting means for detecting a relative position of the second display device with respect to the first display device;
The display instruction means connects the approach or contact with the first image displayed on the first display device based on the detected relative position of the second display device with respect to the first display device. A display system that determines the second image corresponding to the detected position of the second display device and instructs the second display device to display the second image. The display system according to claim 1 or 2,
Direction detecting means for detecting a relative direction of the first display device and the second display device;
The display instruction means is connected to the first image displayed on the first display device based on a relative orientation of display screens of the first display device and the second display device. A display system that determines a display direction of the second image corresponding to the position of the second display device that has detected contact, and instructs the second display device to display the second image. The display system according to any one of claims 1 to 3,
Image generating means for generating the second image for instructing display on the second display device;
The display system instructing the second display device to display the second image by transmitting the generated second image to the display device. The display system according to any one of claims 1 to 4,
Comprising information generating means for generating image information for displaying the second image on the second display device;
The display system instructing the second display device to display the second image by notifying the second display device of the image information of the second image. A display method for displaying images on a plurality of display devices,
A display device for displaying the first image;
Detecting the proximity or contact of other display devices with your device,
A display method for instructing the other display device to display a second image corresponding to the position of the other display device that detects the approach or contact and is connected to the first image displayed on the device itself. A display unit;
Display control means for displaying the first image on the display unit;
Proximity detection means for detecting the approach or contact of another terminal device to the device;
Instructs the display unit of the other terminal device to display the second image corresponding to the position of the other terminal device that detects the approach or contact, which is connected to the first image displayed on the display unit. And a display instruction means. A display unit;
A second image corresponding to the position of the own device is connected to the first image displayed on the display unit of the other terminal device from another terminal device approaching or contacting the own device. Receiving means for receiving an instruction to be displayed on the display unit;
A terminal device comprising: display control means for displaying the second image on the display unit of the device according to the received instruction. A display device for displaying an image;
A computer including an approach detection unit that detects an approach or contact of another display device with respect to the display device;
A procedure for the approach detection unit to detect the approach or contact of another display device with respect to the display device displaying the first image;
Execute a procedure for instructing the other display device to display a second image corresponding to the position of the other display device that detects the approach or contact, connected to the first image displayed on the display device. Computer program to let you. In a computer equipped with a display device,
A procedure for receiving an instruction to display, on another display device, the second image corresponding to the position of the own device, which is connected to the first image displayed on the other display device, on the display device of the own device;
A computer program for executing a procedure for displaying the second image on the display device of the device according to the received instruction.

Images