JP2012252356A - Display control device, display system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display an image corresponding to an image displayed in a common area on a display screen of a second device on a display screen of a first device.SOLUTION: The display system comprises: a horizontal type display device 10; a portable display device 20; and a sharing screen control device 30. An ID detection section 181 and a position calculation section 182 of the horizontal type display device 10 specify ID and position of the portable display device 20 on the basis of an ID held by an ID holding section 261 of the portable display device 20. A communication section 19 transmits these pieces of information to the sharing screen control device 30. A communication section 29 transmits document information to be an operation object received by an operation receiving section 22 of the portable display device 20 to the sharing screen control device 30. In the sharing screen control device 30, a display state management section 31 determines information about a display state, a document acquisition section 32 acquires an electronic document, and a communication section 39 transmits the electronic document and the information about the display state to the horizontal type display device 10.

Description

  The present invention relates to a display control device, a display system, and a program.

  A technique for causing a table or a wall surface to function as a work environment for spatially expanding a portable computer is known (see, for example, Patent Document 1). In Patent Document 1, for example, a “hyper-drag” operation in which a drag operation on a computer display of a certain user is directly inherited to a plane (table or wall surface) on which the computer is installed is possible.

JP 2001-136504 A

  An object of the present invention is to enable an image corresponding to an image displayed in a shared area on the display screen of the second device to be displayed on the display screen of the first device.

According to the first aspect of the present invention, there is provided connection means for connecting a first device having a display screen and a second device having a display screen, and an image is displayed in a shared area on the display screen of the second device. Control means for controlling so that a predetermined image corresponding to the image displayed in the shared area is displayed on the display screen of the first device, and the second device is an image in the shared region. And updating means for updating the display of the predetermined image displayed on the display screen of the first device in response to an operation to update the display of the first device. The display control device.
The invention according to claim 2 further includes position specifying means for specifying the position of the second apparatus on the display screen of the first apparatus, and the control means is specified by the position specifying means. 2. The display control device according to claim 1, wherein control is performed so that the predetermined image is displayed at a predetermined position on a display screen of the first device according to a position of the second device. .
According to a third aspect of the present invention, the predetermined image is an image having a predetermined relationship with an image displayed in the shared area, and the predetermined position is specified by the position specifying unit. The display control apparatus according to claim 2, wherein the display control apparatus is a position having a relationship corresponding to the predetermined relationship.
According to a fourth aspect of the present invention, the predetermined image is two images that precede and follow the image displayed in the shared area in a predetermined order relationship, and the predetermined position is the position specifying unit. 4. The display control device according to claim 2, wherein the display control device has two symmetrical positions with respect to the position of the second device specified by the above.
According to a fifth aspect of the present invention, the position specifying unit determines the position of the second device based on information obtained when the first device acquires information held by the second device. 5. The display control device according to claim 2, wherein the display control device is specified.
According to a sixth aspect of the invention, the position specifying means determines the position of the second device based on information obtained when the second device acquires information held by the first device. 5. The display control device according to claim 2, wherein the display control device is specified.
The invention according to claim 7 further includes direction specifying means for specifying the direction of the second device on the display screen of the first device, and the control means is specified by the direction specifying means. The display control apparatus according to claim 1, wherein the display control apparatus controls the predetermined image to be displayed in accordance with a direction of the second apparatus.
The invention according to claim 8 is characterized in that the second device is a portable terminal device including a notebook PC, a PDA, a digital camera, and a mobile phone. The display control apparatus according to any one of the above.
The invention according to claim 9 is a first display means for displaying an image on a first display screen, a second display means for displaying an image on a second display screen, and the first display means. When an image is displayed in a shared area on the second display screen and a connecting means for connecting to the second display means, a predetermined image corresponding to the image displayed in the shared area is the first image When the control means for controlling the display to be displayed on the display screen and the second display means receive an operation for updating the display of the image in the shared area, the first display is changed according to the updating operation. And a updating unit that updates the display of the predetermined image displayed on the display screen.
According to a tenth aspect of the present invention, there is provided a function of connecting a first device having a display screen and a second device having a display screen to a computer, and an image in a shared area on the display screen of the second device. Is displayed, a function for controlling the predetermined image corresponding to the image displayed in the shared area to be displayed on the display screen of the first apparatus, and the second apparatus in the shared area A program for realizing a function of updating the display of the predetermined image displayed on the display screen of the first device in response to an operation to update the display of an image in response to the operation to update is there.

The invention of claim 1 has an effect that an image corresponding to the image displayed in the shared area on the display screen of the second device can be displayed on the display screen of the first device.
The invention according to claim 2 is capable of displaying an image corresponding to the image displayed on the second device at a position corresponding to the position of the second device on the display screen of the first device. Have
According to a third aspect of the present invention, the relationship between the position of the second device and the display position of the image on the display screen of the first device is the same as the image displayed on the second device and the display screen of the first device. It has the effect that it can be made according to the relationship with the image to be displayed.
The invention according to claim 4 displays the two images that precede and follow the image displayed on the second device in a predetermined order at two positions that are symmetrical about the second device. Has the effect of being able to.
The invention of claim 5 has the effect that the mechanism for acquiring information used for specifying the position of the second device need not be provided in the second device.
The invention of claim 6 has the effect that the mechanism for acquiring information used for specifying the position of the second device need not be provided in the first device.
The invention of claim 7 has an effect that an image can be displayed in accordance with the direction of the second device on the display screen of the first device.
The invention of claim 8 has the effect that the second device can be taken to a place where the first device is located.
The invention of claim 9 has the effect that an image corresponding to the image displayed in the shared area on the display screen of the second display means can be displayed on the display screen of the first display means.
The invention of claim 10 has the effect that an image corresponding to the image displayed in the shared area on the display screen of the second device can be displayed on the display screen of the first device.

It is the figure which showed the 1st example of the horizontal type display apparatus with which embodiment of this invention is applied, and a portable display apparatus. It is the figure which showed the example of the code | cord | chord image used by the 1st example. It is the figure shown about the area | region provided in the horizontal type display apparatus of embodiment of this invention. It is the figure which showed the 2nd example of the horizontal type display apparatus with which embodiment of this invention is applied, and a portable display apparatus. It is the figure which showed the example of the code | cord | chord image used in the 2nd example. It is the figure which showed the 3rd example of the horizontal type display apparatus and portable display apparatus with which embodiment of this invention is applied. It is the figure which showed the structure of the wireless sensor used in the 3rd example. It is the figure which showed the 1st example of the display implement | achieved by embodiment of this invention. It is the figure which showed the 2nd example of the display implement | achieved by embodiment of this invention. It is the figure which showed the 1st example of the structure of the display system in embodiment of this invention. It is the figure which showed the 2nd example of the structure of the display system in embodiment of this invention. It is the flowchart which showed the 1st example of operation | movement of the display system in embodiment of this invention. It is the figure which showed the management information used in a 1st example. It is the flowchart which showed the 2nd example of operation | movement of the display system in embodiment of this invention. It is the figure which showed the management information used in a 2nd example. It is a hardware block diagram of the computer which can implement | achieve embodiment of this invention.

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.
In the present embodiment, as an example of a display device, a horizontal display device is used for surrounding discussions and the like by a plurality of users. A portable display device brought in by a user is placed on the horizontal display device, and an electronic document displayed on the portable display device is shared on a shared screen on the horizontal display device, so that discussions and the like are performed. First, the mechanism of the horizontal display device and the portable display device will be described.

First, a first example of a mechanism of a horizontal display device and a portable display device will be described.
FIG. 1 is a cross-sectional view when a portable display device 20 is mounted on a horizontal display device 10 in the first example. The portable display device 20 is normally in contact with the horizontal display device 10. However, in the figure, for the sake of easy viewing, a gap is provided between the horizontal display device 10 and the portable display device 20. Yes.
As shown in the figure, the horizontal display device 10 includes a top plate 11 as a work table for discussion and the like, and legs 12 a to 12 d that support the top plate 11. In addition, the projector includes a projection unit 13 that projects an image onto the top plate 11 from the back surface, casters 14 a to 14 d that support the projection unit 13 movably, and a projector 15 that projects an image to be projected on the top plate 11. Furthermore, the infrared light source 17 which irradiates infrared light with respect to the bottom face of the portable display apparatus 20 and the infrared camera 18a which receives the infrared light reflected by the bottom face of the portable display apparatus 20 are provided. However, since FIG. 1 is a sectional view, the leg portions 12c and 12d and the casters 14c and 14d do not appear in the drawing.

The top plate 11 is, for example, a circular one so that the user can stand up and participate in discussions at any position around it. Further, for example, a milky white translucent filter is attached to a base material such as a glass plate to form a transmission screen, and the display unit 13 functions as a display screen (for example, a large screen display) that displays an image projected by the projection unit 13. That is, in this embodiment, the top plate 11 is used as an example of the display means. Furthermore, a touch panel function for detecting a user operation on the displayed image is also provided. Here, the touch panel may be realized by covering the surface of the top plate 11 with a transparent screen on which elements for detecting contact are arranged, and infrared light is vertically and horizontally applied to the surface of the top plate 11. It may be realized by running and detecting the blocked position. However, in the present embodiment, as shown in the figure, the portable display device 20 may be placed on the top plate 11. Therefore, the function of the touch panel included in the top plate 11 is to process a touch on the bottom surface of the portable display device 20 separately from a touch as a user operation. For example, when a touched location exceeds a certain area, a signal indicating a user operation may not be generated.
The leg portions 12a to 12d are examples in the case of four legs, but the number of leg portions is not limited to this.

The projection unit 13 is a quadrangular prism box whose surface on the top plate 11 side is open, and includes mirrors 13a and 13b therein. Here, it is assumed that the mirrors 13 a and 13 b are fixed at an angle as shown in the figure and attached to the side surface of the box of the projection unit 13.
The casters 14 a to 14 d are attached to the bottom surface of the projection unit 13 so that the projection unit 13 can be moved in accordance with the movement of the table including the top plate 11, the leg portions 12 a to 12 d and the projector 15. However, the relative position of the projection unit 13 with respect to the table is not shifted. Here, the number of casters is four, but the number is not limited to this.
The projector 15 is suspended and fixed under the top plate 11, and projects an image in the direction of the mirror 13a. Then, the image is reflected by the mirror 13 b and projected onto the top plate 11.

For example, the infrared light source 17 is pulse-lit in synchronization with the shutter timing of the infrared camera 18a. Thereby, infrared light is regularly irradiated with respect to the area | region where the portable display apparatus 20 of the top plate 11 may be mounted. For example, an infrared LED may be used as the infrared light source 17.
The infrared camera 18a images the bottom surface of the portable display device 20 irradiated with infrared light with an image sensor having sensitivity in the infrared region. Then, by analyzing the captured image, the ID and position of the portable display device 20 are detected. Here, for example, a CMOS sensor or a CCD sensor may be used as the image sensor.
In the present embodiment, the image is read using the infrared light in this way so that the image of the projector 15 by the visible light is not affected. Further, in order to perform more reliable projection and ID recognition, the top plate 11 may be a holographic optical element that transmits light other than a certain angle of light. Alternatively, a method is also conceivable in which a film capable of changing transmission / non-transmission electrically is attached to the top plate 11 and projection and ID recognition are switched in a short cycle.

  On the other hand, the portable display device 20 may be any portable terminal device. A notebook PC is a typical example, but it may be a PDA (Personal Digital Assistants), a digital camera, a mobile phone, or the like. However, on the bottom surface of the portable display device 20, a color material (for example, toner) having an absorption region in the infrared region so that the ID and position are detected using the infrared light source 17 and the infrared camera 18a. The code image 26a formed using is attached.

FIG. 2 is a diagram illustrating an example of an image or the like that configures the code image 26a.
First, unit patterns constituting the code image 26a will be described.
FIG. 2A shows an example of the unit pattern.
The unit pattern is the minimum unit for embedding information. In the figure, the black area and the shaded area are areas where dots can be arranged, and the white area between them is an area where dots cannot be arranged. In addition, among the areas where dots can be arranged, dots are arranged in black areas, and dots are not arranged in hatched areas. That is, the figure shows an example in which a unit pattern is configured by arranging dots at two locations selected from nine locations where dots can be arranged. Here, since there are 36 (= ₉ C ₂ ) combinations for selecting two locations out of nine locations, there are 36 types of unit patterns. Of these, four types of unit patterns are used as synchronization patterns. The synchronization pattern is a pattern for detecting the rotation of the image or specifying the relative position of the identification code. In particular, since it is necessary to detect the rotation of the image, the four types of synchronization patterns are selected such that when one of the synchronization patterns is rotated 90 degrees, another synchronization pattern is obtained. Further, the 32 types of unit patterns other than the 4 types of unit patterns are used as information patterns that express identification codes, and 5-bit information is expressed.

  By the way, the dots shown in FIG. 2A are only dots for information expression, and do not necessarily match the dots that mean the minimum points constituting the image. In the present embodiment, the dots for information expression (the minimum square in FIG. 2A) have a size of 2 dots × 2 dots at 600 dpi. Since the size of one dot at 600 dpi is 0.0423 mm, one side of a dot for information expression (the minimum square in FIG. 2A) is 84.6 μm (= 0.0423 mm × 2). The larger the dot for information expression, the more likely it is to be noticeable. Therefore, it is preferable that the dot is as small as possible. However, if it is too small, printing with a printer becomes impossible. Therefore, the above values larger than 50 μm and smaller than 100 μm are employed as the size of dots for information expression. However, the above value 84.6 μm is a numerical value to the last, and is about 100 μm in the actually printed toner image.

Next, a code block composed of such unit patterns will be described.
FIG. 2B shows an example of the code block layout. Here, not the image but the code arrangement immediately before being replaced by the pattern image is shown. That is, a unit pattern (any one of 36 unit patterns) as shown in FIG. 2A is arranged in the smallest square (hereinafter referred to as “unit block”) in FIG. Will be formed.
In the layout of FIG. 2B, the synchronization code is arranged in one unit block at the upper left of the code block. Further, four unit blocks on the right side of the unit block in which the synchronization code is arranged, four unit blocks on the lower side of the unit block in which the synchronization code is arranged, and 16 (= 4) surrounded by these unit blocks X4) Identification codes are arranged in unit blocks.

In the present embodiment, the ID of the portable display device 20 is encoded and used as the identification code in the code image 26a. In this way, when the image captured by the infrared camera 18 a is analyzed, the ID of the portable display device 20 is obtained, and it can be seen which portable display device 20 is mounted on the horizontal display device 10.
On the other hand, the position of the portable display device 20 on the horizontal display device 10 is obtained based on the position and size of the code image in the image captured by the infrared camera 18a. For example, in the image captured by the infrared camera 18a, if the code image is on the upper side, it can be understood that infrared light is received from substantially vertically above, and if the code image is on the lower side, it is more horizontal than the vertical direction. It can be seen that infrared light is received from a direction close to the direction. Further, the size of the code image 26a is determined in advance, and the distance from the infrared camera 18a to the code image 26a is recognized by comparing with the size of the code image in the image captured by the infrared camera 18a. Then, the position of the portable display device 20 in the three-dimensional space is specified from the direction and the distance obtained here.

The toner used for forming the code image 26a includes K (black including carbon) toner and special toner.
Here, as the special toner, an invisible toner having a maximum absorption rate of 7% or less in the visible light region (400 nm to 700 nm) and an absorption rate of 30% or more in the near infrared region (800 nm to 1000 nm) is exemplified. . However, “visible” and “invisible” are not related to whether they can be recognized visually. “Visible” and “invisible” are distinguished depending on whether or not the code image can be recognized by the presence or absence of color developability caused by absorption of a specific wavelength in the visible light region. Also, “invisible” includes those that have some color developability due to absorption of a specific wavelength in the visible light region but are difficult to be recognized by human eyes.

Next, a second example of the mechanism of the horizontal display device and the portable display device will be described.
FIG. 3 is a cross-sectional view when the portable display device 20 is mounted on the horizontal display device 10 in the second example. Also in this figure, a gap is provided between the horizontal display device 10 and the portable display device 20 for easy viewing.
As shown in the drawing, the horizontal display device 10 includes a top plate 11, legs 12a to 12d, a projection unit 13 including mirrors 13a and 13b, casters 14a to 14d, and a projector 15. Since this is the same as that in the horizontal display device 10 shown in FIG.

In FIG. 1, the horizontal display device 10 reads the code image held by the portable display device 20, but FIG. 3 shows the code image held by the horizontal display device 10 on the contrary. The type display device 20 reads. That is, in FIG. 3, the portable display device 20 may be a notebook PC or the like as in FIG. 1, but includes an infrared light source 27 and an infrared camera 28 instead of the code image 26a. . The functions of the infrared light source 27 and the infrared camera 28 are the same as the functions of the infrared light source 17 and the infrared camera 18a in FIG.
On the other hand, the horizontal display device 10 does not include the infrared light source 17 and the infrared camera 18a. Instead, a color material (for example, toner) having an absorption region in the infrared region on the surface of the top plate 11 so that the ID and position thereof are detected using the infrared light source 27 and the infrared camera 28. A code image 16 formed by using is attached.

FIG. 4 is a diagram illustrating an example of an image and the like constituting the code image 16.
FIG. 4A shows an example of a unit pattern constituting the code image 16, which is the same as that described with reference to FIG. . However, in FIG. 2 (a), the information pattern other than the synchronization pattern among the unit patterns has been described as representing only the identification code. However, in FIG. 4, not only the identification code but also the position code is described. Express.

Next, a code block composed of such unit patterns will be described.
FIG. 4B shows an example of the code block layout. Here, not the image but the code arrangement immediately before being replaced by the pattern image is shown. That is, a unit pattern as shown in FIG. 4A (any one of 36 unit patterns) is arranged in the smallest square (unit block) in FIG. 4B, and the image is formed on the medium. become.
In the layout of FIG. 4B, the synchronization code is arranged in one unit block at the upper left of the code block. Further, the X position code is arranged in the four unit blocks on the right side of the unit block in which the synchronization code is arranged, and the Y position code is arranged in the four unit blocks on the lower side of the unit block in which the synchronization code is arranged. . Furthermore, identification codes are arranged in 16 (= 4 × 4) unit blocks surrounded by unit blocks in which these position codes are arranged.

In the present embodiment, the ID of the horizontal display device 10 is encoded and used as the identification code in the code image 16. In addition, the coordinate position on the horizontal display device 10 is encoded to be a position code in the code image 16. In this way, when the image captured by the infrared camera 28 is analyzed, the ID of the horizontal display device 10 and the coordinate position on the horizontal display device 10 are obtained, and at which position on which horizontal display device 10 the portable display device. You can see if 20 has been placed.
The toner used for forming the code image 16 may be the same as that shown in FIG.

Next, a third example of the mechanism of the horizontal display device and the portable display device will be described.
FIG. 5 is a cross-sectional view when the portable display device 20 is mounted on the horizontal display device 10 in the third example. Also in this figure, a gap is provided between the horizontal display device 10 and the portable display device 20 for easy viewing.
As shown in the drawing, the horizontal display device 10 includes a top plate 11, legs 12a to 12d, a projection unit 13 including mirrors 13a and 13b, casters 14a to 14d, and a projector 15. Since it is the same as that in the horizontal display device 10 shown in FIGS. 1 and 3, the description thereof is omitted.

  Incidentally, in FIG. 1, the information held by the portable display device 20 is read by the horizontal display device 10 using infrared light. However, in FIG. 5, the information held by the portable display device 20 is read by the horizontal display device. 10 is read by wireless communication. That is, in FIG. 5, the portable display device 20 may be a notebook PC or the like as in FIG. 1, but includes a wireless sensor 26b instead of the code image 26a. On the other hand, the horizontal display device 10 includes a transceiver 18b instead of the infrared light source 17 and the infrared camera 18a.

Here, the wireless sensor 26b will be described.
FIG. 6 is a diagram illustrating a configuration of the wireless sensor 26b. The wireless sensor 26b is formed on a substrate made of Si through an oxide film, and is formed on a dielectric thin film 61 that propagates a surface acoustic wave (SAW), and the dielectric thin film 61. Comb electrodes (IDT: Inter-digital Transducer) 62a and 62b for converting an electric signal into a surface acoustic wave or converting a surface acoustic wave into an electric signal are provided. The antennas 64a and 64b are connected to one of the comb-shaped electrodes 62a and 62b via the impedance matching units 63a and 63b and exchange radio signals with the transceiver 18b, and the other of the comb-shaped electrodes 62a and 62b. And grounds 65a and 65b connected to each other.

  The comb electrodes 62a and 62b, the antennas 64a and 64b, and the impedance matching portions 63a and 63b are integrally formed by a conductive pattern. As a material of this conductive pattern, metals such as Ti, Cr, Cu, W, Ni, Ta, Ga, In, Al, Pb, Pt, Au, Ag, or Ti-Al, Al-Cu, Ti-N It is preferable to stack an alloy such as Ni—Cr in a single layer or a multilayer structure of two or more layers. In particular, Au, Ti, W, Al, and Cu are preferable as the metal. Moreover, it is preferable that the film thickness of this metal layer shall be 1 nm or more and less than 10 micrometers.

  A plurality of wireless sensors 26b having such a configuration are prepared, and each holds the ID of the portable display device 20 corresponding thereto. In principle, the plurality of wireless sensors 26b use the same frequency, but in order to obtain different IDs at the same frequency, the separation dimension d between the comb-shaped electrodes 62a and 62b is made different between the wireless sensors 26b. What is necessary is just to change the time which a surface wave moves between the comb-shaped electrodes 62a and 62b. The movement time of the surface acoustic wave that moves on the dielectric thin film 61 is much longer than the time that the radio wave signal moves between the transmitter / receiver 18b and the wireless sensor 26b. It is set according to the transmission time t of the surface acoustic wave between 62b. For example, an ID setting table in which the transmission time t and the ID are associated with each other may be stored in a storage device (not shown) of the horizontal display device 10.

The basic operation of ID detection using the wireless sensor 26b is as follows.
First, the transceiver 18b transmits a sensor inquiry signal having a frequency of 300 MHz. When receiving the sensor inquiry signal, the wireless sensor 26b generates a surface acoustic wave in the dielectric thin film 61 and transmits a sensor response signal. Then, the transceiver 18b receives this sensor response signal, performs analysis processing, and reads the ID with reference to the ID setting table based on the transmission time t calculated by this analysis processing.

  On the other hand, the horizontal display device 10 obtains the distance to the portable display device 20 based on the intensity of the radio wave received by the transceiver 18b from the wireless sensor 26b, and calculates the position of the portable display device 20 based on this. By providing a plurality of transceivers 18b, the accuracy of the position in the three-dimensional space is improved.

  In the present embodiment, the horizontal display device 10 is used as an example of a display device having a substantially horizontal display screen. Here, “substantially horizontal” does not mean that the top plate 11 is completely parallel to the ground or the floor surface, and the portable display device 20 may be placed on the top plate 11. It should be level so that it does not fall off. Hereinafter, the case where the present invention is applied to the horizontal display device 10 will be described, but the present invention may be applied to other types of display devices such as a vertical type.

  In the present embodiment, the display as shown in FIGS. 7 and 8 is realized by using the horizontal display device 10 described above. Here, in order to hold a conference while referring to a shared screen realized on the horizontal display device 10, it is assumed that participants in the conference bring their portable display devices 20 into the conference room.

FIG. 7 shows a first example in which an electronic document displayed on the portable display device 20 is displayed on the horizontal display device 10.
First, the participant places the portable display device 20 on the horizontal display device 10 and performs, for example, connection work to a predetermined line in the conference room. Then, as shown to (a), the area | region (shared area | region 21a) corresponding to a shared screen is displayed on the display screen 21 of the portable display apparatus 20. FIG. In the figure, the shared area 21a is shown as an area (shaded area) having a certain area on the display screen 21, but it may be a folder, for example. On the other hand, the area other than the shared area 21a is a personal display area (personal area 21b), and an image of an electronic document that is not shared at this point is displayed.
Next, the participant selects an image of the electronic document displayed in the personal area 21b, and moves to the shared area 21a by, for example, a drag operation. Then, the display on the horizontal display device 10 and the portable display device 20 is as shown in FIG. That is, the moved electronic document is displayed in the shared area 21a, and the electronic document is called from a server or the like and displayed on the horizontal display device 10 next to the portable display device 20, for example.

  In this example, the electronic document image is displayed so that the upper side of the image of the electronic document is away from the operator of the portable display device 20. Here, the upper side of the image means the upper side when the image is arranged in a predetermined direction as an attribute unique to the image. The natural orientation when a human sees an image, for example, the orientation in which a human can read a character in the case of an image including a character, may be set as a direction unique to the image. In this way, the upper side of the image is away from the operator of the portable display device 20, which means that the image is displayed in a direction that is easy for the operator of the portable display device 20 to view on the horizontal display device 10. Will mean. However, other display methods may be employed as the method for displaying the image of the electronic document. For example, a participant who operates the portable display device 20 will be described with reference to the display screen 21 of the portable display device 20, and other participants will be described with reference to the display on the horizontal display device 10. The scene to receive is also considered. In such a case, it is desirable that an image is displayed on the horizontal display device 10 in a direction that is easy to see for participants other than the operator of the portable display device 20. That is, the image of the electronic document may be displayed with the upper side thereof facing the normal viewing side of the display screen 21 of the portable display device 20.

FIG. 8 shows a second example in which an electronic document displayed on the portable display device 20 is displayed on the horizontal display device 10.
First, the participant places the portable display device 20 on the horizontal display device 10. At this time, it is assumed that the third page of the electronic document is displayed on the display screen 21 of the portable display device 20. Then, as shown in (a), in the horizontal display device 10, the second page of the electronic document is displayed on the left side of the portable display device 20, and the fourth page of the electronic document is displayed on the right side.
Next, when the participant performs an operation of turning the pages of the electronic document, the information is sequentially transmitted to the horizontal display device 10 and the display is updated. For example, if the fourth page of the electronic document is displayed on the portable display device 20 as shown in (b), the left image is updated to the third page, and the right image is updated to the fifth page. .

Next, a configuration of a display system that realizes such a schematic operation will be described.
In the display system of the present embodiment, as shown in FIGS. 1 and 5, the horizontal display device 10 recognizes the ID of the portable display device 20 and the position of the portable display device 20 on itself. In some cases, as shown in FIG. 3, the portable display device 20 may recognize the ID of the horizontal display device 10 and its position on the horizontal display device 10.
Therefore, the former will be described as a first configuration example, and the latter will be described as a second configuration example.

FIG. 9 is a diagram illustrating a first configuration example.
As shown in the figure, the first configuration example of the display system according to the present embodiment includes a horizontal display device 10, a portable display device 20, and a horizontal display device according to information received from the portable display device 20. 10 and a shared screen control device 30 for controlling the shared screen on the computer 10. Here, as shown in FIG. 1, the horizontal display device 10 receives an infrared light source 17 that irradiates infrared light, and an infrared camera that receives infrared light reflected from the bottom surface of the portable display device 20. 18a, the code image 26a is affixed to the portable display device 20. As shown in FIG. 5, when the horizontal display device 10 includes a transceiver 18b that performs wireless communication, the portable display device 20 is provided with a wireless sensor 26b. The horizontal display device 10 and the shared screen control device 30 and the portable display device 20 and the shared screen control device 30 are connected by, for example, a LAN. In the figure, the horizontal display device 10 and the portable display device 20 are connected to one shared screen control device 30 one by one, but a plurality of them may be connected.

  In the present embodiment, the horizontal display device 10 is used as an example of the first device and the first display device, and the top plate is used as an example of the display screen and the first display screen of the first device. 11 (see FIGS. 1 and 5) was used. The portable display device 20 is used as an example of the second device and the second display device, and the display screen 21 (see FIGS. 7 and 8) as an example of the display screen of the second device and the second display screen. Was used. Further, the shared screen control device 30 is used as an example of the display control device and the control device.

Here, an internal functional configuration of each apparatus will be described.
The horizontal display device 10 includes a display unit 111 that performs processing for displaying an image, an ID detection unit 181 that detects an ID of the portable display device 20 (hereinafter referred to as “portable ID”), and the top plate 11. A position calculation unit 182 that calculates the position of the portable display device 20 (hereinafter referred to as “portable position”) and a communication unit 19 that transmits and receives information to and from the shared screen control device 30 are provided.
The display unit 111 outputs an image to be projected on the top plate 11 to the projector 15 according to information on the display state received from the shared screen control device 30 by the communication unit 19, for example, information on the display position and display direction.
The ID detection unit 181 detects a portable ID by analyzing an image captured by the infrared camera 18a or information received by the transceiver 18b.
The position calculation unit 182 calculates the portable position by analyzing the image captured by the infrared camera 18a or the information received by the transceiver 18b.
The communication unit 19 transmits its own ID, portable ID, and portable position to the shared screen control device 30, and receives information related to the display state of the electronic document and the display unit 111 from the shared screen control device 30.

The portable display device 20 includes a display unit 211 that performs processing for displaying an image, an operation reception unit 22 that receives a user operation on the image, an ID holding unit 261 that holds a portable ID, and a shared screen control device 30. And a communication unit 29 for transmitting / receiving information to / from.
The display unit 211 performs processing for displaying an electronic document or changing the display content of the electronic document according to a user operation, and displays an image on the display screen 21 (see FIGS. 7 and 8).
The operation accepting unit 22 accepts a user operation and transmits information related to the user operation to the display unit 211 so that a display based on the user operation is performed, and updates the display based on the user operation in the horizontal display device 10. Information about the user operation is transmitted to the communication unit 29.
The ID holding unit 261 is realized by attaching the code image 26 a to the bottom surface of the portable display device 20 or attaching the wireless sensor 26 b to the portable display device 20. That is, in this embodiment, information held by the code image 26a and the wireless sensor 26b is used as an example of information held by the second device.
The communication unit 29 transmits its own ID and information (hereinafter referred to as “document information”) regarding the electronic document that is the target of the user operation received by the operation receiving unit 22 to the shared screen control device 30. Here, the document information is, for example, information for uniquely identifying an electronic document (hereinafter referred to as “document ID”) or a page number in the electronic document.

The shared screen control device 30 includes a display state management unit 31 that manages a display state on the horizontal display device 10, a document acquisition unit 32 that acquires an electronic document to be displayed on the horizontal display device 10, and a portable display device. 20 and a communication unit 39 that transmits and receives information to and from the horizontal display device 10.
The display state management unit 31 grasps which portable display device 20 is mounted on which horizontal display device 10. In addition, the position where the portable display device 20 is placed is also grasped. That is, in the present embodiment, this functional part of the display state management unit 31 is provided as an example of a position specifying unit for specifying a position. Furthermore, it is grasped which direction the portable display device 20 is mounted. That is, in this embodiment, this functional part of the display state management unit 31 is provided as an example of a direction specifying unit that specifies the direction. Furthermore, it is also grasped which electronic document image is displayed on the display screen 21 (see FIGS. 7 and 8) of the portable display device 20 and how the image has been changed. That is, in this embodiment, this functional part of the display state management unit 31 is provided as an example of an image specifying unit that specifies an image and a recognition unit that recognizes a change in the image.

When a new electronic document or page to be displayed on the horizontal display device 10 is generated, the document acquisition unit 32 displays the electronic document or page as a document server (not shown), the portable display device 20, or the like in advance. Read out from a memory (not shown) or the like in the shared screen control device 30 in which the electronic document is stored.
The communication unit 39 receives a horizontal ID, a portable ID, and a portable position from the horizontal display device 10, and receives a portable ID and document information from the portable display device 20. In addition, the electronic document and information related to the display state are transmitted to the horizontal display device 10. That is, in the present embodiment, the communication unit 39 is provided as an example of a control unit that controls display.

FIG. 10 is a diagram illustrating a second configuration example.
As shown in the figure, the second configuration example of the display system according to the present embodiment also includes a horizontal display device 10, a portable display device 20, and a horizontal display device according to information received from the portable display device 20. 10 and a shared screen control device 30 for controlling the shared screen on the computer 10. Here, as shown in FIG. 3, the portable display device 20 receives the infrared light source 27 that irradiates infrared light and the red light that receives the infrared light reflected by the top plate 11 of the horizontal display device 10. In the case where the camera is provided with the outer camera 28, the code image 16 is affixed to the horizontal display device 10. Also in this configuration example, the horizontal display device 10 and the shared screen control device 30 and the portable display device 20 and the shared screen control device 30 are connected by, for example, a LAN. In the figure, the horizontal display device 10 and the portable display device 20 are connected to one shared screen control device 30 one by one, but a plurality of them may be connected.

  In the present embodiment, the horizontal display device 10 is used as an example of the first device and the first display device, and the top plate is used as an example of the display screen and the first display screen of the first device. 11 (see FIG. 3) was used. In addition, the portable display device 20 is used as an example of the second device and the second display device, and the display screen 21 (see FIGS. 7 and 8) as an example of the display screen of the second device and the second display screen. Reference) was used. Further, the shared screen control device 30 is used as an example of the display control device and the control device.

Here, an internal functional configuration of each apparatus will be described.
The horizontal display device 10 includes a display unit 111 that performs processing for displaying an image, an ID holding unit 161 that holds an ID of the horizontal display device 10 (hereinafter referred to as “horizontal ID”), and shared screen control. And a communication unit 19 that transmits and receives information to and from the device 30.
The display unit 111 outputs an image to be projected on the top plate 11 to the projector 15 according to information on the display state received from the shared screen control device 30 by the communication unit 19, for example, information on the display position and display direction.
The ID holding unit 161 is realized, for example, by pasting the code image 16 on the surface of the top plate 11. That is, in the present embodiment, information held by the code image 16 is used as an example of information held by the first device.
The communication unit 19 receives information related to the display state of the electronic document and the display unit 111 from the shared screen control device 30.

The portable display device 20 includes a display unit 211 that performs processing for displaying an image, an operation reception unit 22 that receives a user operation on the image, an ID detection unit 281 that detects a horizontal ID, and the horizontal display device 10. It includes a position detection unit 282 that detects a portable position that is its own position above, and a communication unit 29 that transmits and receives information to and from the shared screen control device 30.
The display unit 211 performs processing for displaying an electronic document or changing the display content of the electronic document according to a user operation, and displays an image on the display screen 21 (see FIGS. 7 and 8).
The operation accepting unit 22 accepts a user operation and transmits information related to the user operation to the display unit 211 so that a display based on the user operation is performed, and updates the display based on the user operation in the horizontal display device 10. Information about the user operation is transmitted to the communication unit 29.
The ID detection unit 281 detects a horizontal ID by analyzing an image captured by the infrared camera 28.
The position detection unit 282 calculates a portable position by analyzing an image captured by the infrared camera 28.
The communication unit 29 transmits to the shared screen control device 30 the horizontal ID, its own ID, the portable position, and document information regarding the electronic document that is the target of the user operation received by the operation receiving unit 22.

The shared screen control device 30 includes a display state management unit 31 that manages a display state on the horizontal display device 10, a document acquisition unit 32 that acquires an electronic document to be displayed on the horizontal display device 10, and a portable display device. 20 and a communication unit 39 that transmits and receives information to and from the horizontal display device 10.
The display state management unit 31 grasps which portable display device 20 is mounted on which horizontal display device 10. In addition, the position where the portable display device 20 is placed is also grasped. That is, in the present embodiment, this functional part of the display state management unit 31 is provided as an example of a position specifying unit for specifying a position. Furthermore, it is grasped which direction the portable display device 20 is mounted. That is, in this embodiment, this functional part of the display state management unit 31 is provided as an example of a direction specifying unit that specifies the direction. Furthermore, it is also grasped which electronic document image is displayed on the display screen 21 (see FIGS. 7 and 8) of the portable display device 20 and how the image has been changed. That is, in this embodiment, this functional part of the display state management unit 31 is provided as an example of an image specifying unit that specifies an image and a recognition unit that recognizes a change in the image.

When a new electronic document or page to be displayed on the horizontal display device 10 is generated, the document acquisition unit 32 displays the electronic document or page as a document server (not shown), the portable display device 20, or the like in advance. Read out from a memory (not shown) or the like in the shared screen control device 30 in which the electronic document is stored.
The communication unit 39 receives a horizontal ID, a portable ID, a portable position, and document information from the portable display device 20. In addition, the electronic document and information related to the display state are transmitted to the horizontal display device 10. That is, in the present embodiment, the communication unit 39 is provided as an example of a control unit that controls display.

  9 and 10, the shared screen control device 30 is provided separately from the horizontal display device 10, but the shared screen control device 30 may be provided integrally with the horizontal display device 10. And when such a structure is employ | adopted, horizontal type ID does not necessarily need to be managed in management information.

Next, the operation in the display system of this embodiment will be described.
In FIG. 9, first, in the horizontal display device 10, the ID detection unit 181 detects a portable ID, the position calculation unit 182 calculates a portable position, and the communication unit 19 includes these information together with the horizontal ID. Is transmitted to the shared screen control device 30. In the portable display device 20, the operation reception unit 22 receives a user operation, and the communication unit 29 transmits the document information of the electronic document that is the target of the user operation to the shared screen control device 30 together with the portable ID.
In FIG. 10, in the portable display device 20, the ID detection unit 281 detects the horizontal ID, the position detection unit 282 detects the portable position, and the communication unit 29 controls the information together with the portable ID. To device 30. Similarly, in the portable display device 20, the operation accepting unit 22 accepts a user operation, and the communication unit 29 transmits the document information of the electronic document targeted for the user operation to the shared screen control device 30 together with the portable ID. To do.

Thereby, the operation of the shared screen control device 30 starts. Here, the operation for realizing the display of FIGS. 7 and 8 will be described separately.
FIG. 11 is a flowchart showing the operation of the shared screen control device 30 for realizing the display of FIG.
In the shared screen control device 30, first, it is determined whether the communication unit 39 has received information including a horizontal ID, a portable ID, and a portable position, or has received information including a portable ID and a document ID. (Step 301).

  When it is determined that information including the horizontal ID, the portable ID, and the portable position is received, the received information is passed to the display state management unit 31. In the case of the system configuration of FIG. 9, this information is received from the horizontal display device 10. In the case of the system configuration of FIG. 10, this information is received from the portable display device 20. Then, the display state management unit 31 determines whether or not the correspondence between the horizontal ID, the portable ID, and the portable position has changed (step 302). If there is no change, the process is terminated. If there is a change, the correspondence between the received horizontal ID, portable ID, and portable position is registered (step 303).

  Even when it is determined that the information including the portable ID and the document ID is received, the received information is passed to the display state management unit 31. In this case, this information is received from the portable display device 20 regardless of the system configuration of FIG. 9 or the system configuration of FIG. Then, the display state management unit 31 determines whether or not the correspondence between the portable ID and the document ID has changed (step 304). If there is no change, the process ends. If there is a change, the correspondence between the received portable ID and the document ID is registered (step 305).

  If it is determined that there has been a change in step 302, the display state management unit 31 continues to the process of step 303. The display position and display direction of the electronic document are calculated (step 306). For example, in FIG. 7, the horizontal position of the portable position received in step 301 is calculated as the display position.

  Then, the document acquisition unit 32 reads the electronic document to be displayed (step 307). Here, the electronic document to be displayed is not necessarily the same as the electronic document that is the target of the user operation on the portable display device 20. For example, another electronic document previously associated with the electronic document that is the target of the user operation may be selected as the electronic document to be displayed. In this case, an image of another electronic document associated in advance is an example of an image having a predetermined relationship. In addition, when an image having a predetermined relationship is selected in this way, the display position and the display direction calculated in step 306 may be in accordance with the predetermined relationship.

Thereafter, the communication unit 39 transmits the information on the display position and display direction calculated in step 306 and the electronic document read in step 307 to the horizontal display device 10 (step 308).
Thereby, in the horizontal display apparatus 10, the image of the transmitted electronic document is displayed at the transmitted display position in the transmitted display direction.

Here, management information that the display state management unit 31 refers to and updates in the processing of FIG. 11 will be described. The management information may be stored in a memory (not shown) that can be referred to by the display state management unit 31.
Before describing the management information, first, the coordinates on the screen of the horizontal display device 10 will be described. FIG. 12A shows an example of coordinates set on the screen. Here, the screen is rectangular and the center point is the origin. The X axis is taken in the longitudinal direction and the Y axis is taken in the short direction.
On the screen, the position on which the portable display device 20 is placed is indicated by a rectangle having A1, B1, C1, and D1 as vertices and a rectangle having A2, B2, C2, and D2 as vertices. However, this is merely an example, and for example, the points existing in the region where the portable display device 20 is placed among the points arranged in a grid pattern at short intervals may be managed.

FIG. 12B shows the contents of the management information when the portable display device 20 is placed in this way. However, (a) shows the state in which the portable display device 20 is placed on the horizontal display device 10 with the horizontal ID “P001”, and the horizontal ID “P002” is separate from the horizontal display device 10. It is assumed that the horizontal display device 10 is also managed.
Note that the coordinates in the portable position field of (b) represent the X coordinate of the point by adding “x” after the symbol attached to the point in (a), and attached to the point in (a). It is assumed that the Y coordinate of the point is represented by adding “y” after the symbol. Further, in this case, the portable display device 20 is approximated by a rectangle and represents the range in which the portable display device 20 is placed by coordinates of four vertices. In order to indicate in which direction it is placed on the screen, The coordinates of the three points of the upper left point, the upper right point, and the lower left point are stored. Further, the management information also stores the document ID of the electronic document that is the target of the user operation among the electronic documents displayed on the portable display device 20.

  In step 302 of FIG. 11, it is determined whether or not the correspondence relationship between the horizontal ID, the portable ID, and the portable position has changed in the management information of FIG. If it is determined that there is a change, the registered correspondence is changed to a new correspondence in step 303. Further, in step 304 in FIG. 11, it is determined whether or not the correspondence relationship between the portable ID and the document ID has changed in the management information in FIG. If it is determined that there has been a change, then in step 305, the registered correspondence is changed to a new correspondence.

FIG. 13 is a flowchart showing the operation of the shared screen control device 30 for realizing the display of FIG.
In the shared screen control device 30, first, the communication unit 39 has received information consisting of a horizontal ID, a portable ID, and a portable position, or has received information consisting of a portable ID, a document ID, and a page number. Is determined (step 351).

  When it is determined that information including the horizontal ID, the portable ID, and the portable position is received, the received information is passed to the display state management unit 31. In the case of the system configuration of FIG. 9, this information is received from the horizontal display device 10. In the case of the system configuration of FIG. 10, this information is received from the portable display device 20. Then, the display state management unit 31 determines whether or not the correspondence between the horizontal ID, the portable ID, and the portable position has changed (step 352). If there is no change, the process is terminated. If there is a change, the correspondence between the received horizontal ID, portable ID, and portable position is registered (step 353).

  Even when it is determined that information including a portable ID, a document ID, and a page number has been received, the received information is passed to the display state management unit 31. In this case, this information is received from the portable display device 20 regardless of the system configuration of FIG. 9 or the system configuration of FIG. Then, the display state management unit 31 determines whether or not the correspondence between the portable ID, the document ID, and the page number has changed (step 354). If there is no change, the process ends. If there is a change, the correspondence between the received portable ID, document ID, and page number is registered (step 355).

  If it is determined in step 352 that there is a change, the display state management unit 31 continues the processing in step 353, and if it is determined in step 354 that there is a change, the display state management unit 31 performs the portable display device 20. The display position and the display direction on the horizontal display device 10 of the page before and after the page of the electronic document displayed in (1) are calculated (step 356). For example, in FIG. 8, the left and right positions of the portable position received in step 351 are calculated as display positions.

  Then, the document acquisition unit 32 reads out the pages before and after the page displayed on the portable display device 20 as display target pages (step 357). However, the display target page is not necessarily the previous or next page. For example, you may make it select the other page previously linked | related with the page displayed on the portable display apparatus 20 as a display target page. Alternatively, the display control on the horizontal display device 10 may not be performed in units of pages. For example, among the image data under a certain folder, the image data created one time earlier than the image data displayed on the portable display device 20 and the image data created one after are read as display targets. Also good. That is, in the present embodiment, the image of the previous page and the image of the next page are used as an example of the two images that precede and follow in a predetermined order relationship. Further, the left side position and the right side position of the portable display device 20 are used as an example of two positions symmetrical about the position of the second device.

Thereafter, the communication unit 39 transmits the display position and display direction information calculated in step 356 and the page read in step 357 to the horizontal display device 10 (step 358).
Thereby, in the horizontal display device 10, the transmitted page is displayed at the transmitted display position in the transmitted display direction.

Here, management information that the display state management unit 31 refers to and updates in the processing of FIG. 13 will be described. The management information may be stored in a memory (not shown) that can be referred to by the display state management unit 31.
In this management information, it is assumed that coordinates are expressed in the same manner as described with reference to FIG. 12A, and the portable display device 20 is placed as shown in FIG.
FIG. 14 shows the contents of the management information when the portable display device 20 is placed in this way. However, here, it is assumed that the horizontal display device 10 with the horizontal ID “P002” is managed separately from the horizontal display device 10 with the horizontal ID “P001” shown in FIG. The management information also stores the document ID and page of the electronic document that is the target of the user operation among the electronic documents displayed on the portable display device 20.

  In step 352 of FIG. 13, it is determined whether or not there is a change in the correspondence between the horizontal ID, the portable ID, and the portable position in the management information of FIG. If it is determined that there has been a change, in step 353, the registered correspondence is changed to a new correspondence. In step 354 of FIG. 13, it is determined whether or not the correspondence relationship between the portable ID, the document ID, and the page number has changed in the management information of FIG. If it is determined that there has been a change, then in step 355, the registered correspondence is changed to a new correspondence.

Finally, assuming that the present embodiment is realized by the computer 90, the hardware configuration of the computer 90 will be described.
FIG. 15 is a diagram illustrating a hardware configuration of the computer 90.
As shown in the figure, the computer 90 includes a CPU (Central Processing Unit) 91 as a calculation means, a main memory 92 as a storage means, and a magnetic disk device (HDD: Hard Disk Drive) 93. Here, the CPU 91 executes various types of software such as an OS (Operating System) and applications to realize the above-described functions. The main memory 92 is a storage area for storing various software and data used for execution thereof, and the magnetic disk device 93 is a storage area for storing input data for various software, output data from various software, and the like. .
Further, the computer 90 includes a communication I / F 94 for performing communication with the outside, a display mechanism 95 including a video memory and a display, and an input device 96 such as a keyboard and a mouse.

  The program for realizing the present embodiment can be provided not only by communication means but also by storing it in a recording medium such as a CD-ROM.

DESCRIPTION OF SYMBOLS 10 ... Horizontal type display apparatus, 11 ... Top plate, 13 ... Projection unit, 15 ... Projector, 20 ... Portable display apparatus

Claims (10)

Connection means for connecting a first device having a display screen and a second device having a display screen;
When an image is displayed in the shared area on the display screen of the second device, control is performed so that a predetermined image corresponding to the image displayed in the shared area is displayed on the display screen of the first device. Control means to
When the second device receives an operation for updating the display of the image in the shared area, the display of the predetermined image displayed on the display screen of the first device is updated according to the update operation. A display control apparatus comprising: an updating unit configured to perform updating. A position specifying means for specifying the position of the second device on the display screen of the first device;
The control means controls the predetermined image to be displayed at a predetermined position on the display screen of the first device according to the position of the second device specified by the position specifying means. The display control apparatus according to claim 1. The predetermined image is an image having a predetermined relationship with an image displayed in the shared area,
The display control according to claim 2, wherein the predetermined position is a position having a relationship corresponding to the predetermined relationship with the position of the second device specified by the position specifying unit. apparatus. The predetermined images are two images that are first and second in a predetermined order with respect to the image displayed in the shared area,
The display control apparatus according to claim 2, wherein the predetermined position is two positions symmetrical about the position of the second device specified by the position specifying unit.   The position specifying means specifies the position of the second device based on information obtained when the first device acquires information held by the second device. The display control apparatus according to claim 2.   The position specifying means specifies the position of the second device based on information obtained when the second device acquires information held by the first device. The display control apparatus according to claim 2. Direction specifying means for specifying the direction of the second device on the display screen of the first device;
7. The control unit according to claim 1, wherein the control unit controls the predetermined image to be displayed according to the direction of the second device specified by the direction specifying unit. The display control apparatus according to 1.   8. The display control device according to claim 1, wherein the second device is a portable terminal device including a notebook PC, a PDA, a digital camera, and a mobile phone. First display means for displaying an image on a first display screen;
Second display means for displaying an image on a second display screen;
Connection means for connecting the first display means and the second display means;
Control means for controlling so that a predetermined image corresponding to the image displayed in the shared area is displayed on the first display screen when an image is displayed in the shared area on the second display screen; ,
When the second display unit accepts an operation for updating the display of the image in the shared area, the display of the predetermined image displayed on the first display screen is updated according to the update operation. A display system comprising update means. On the computer,
A function of connecting a first device having a display screen and a second device having a display screen;
When an image is displayed in the shared area on the display screen of the second device, control is performed so that a predetermined image corresponding to the image displayed in the shared area is displayed on the display screen of the first device. Function to
When the second device receives an operation for updating the display of the image in the shared area, the display of the predetermined image displayed on the display screen of the first device is updated according to the update operation. Program to realize the function to perform.

Images