US20150220298A1 - Display control device, display, display system and computer-readable medium - Google Patents
Display control device, display, display system and computer-readable medium Download PDFInfo
- Publication number
- US20150220298A1 US20150220298A1 US14/688,785 US201514688785A US2015220298A1 US 20150220298 A1 US20150220298 A1 US 20150220298A1 US 201514688785 A US201514688785 A US 201514688785A US 2015220298 A1 US2015220298 A1 US 2015220298A1
- Authority
- US
- United States
- Prior art keywords
- display
- portable
- image
- horizontal
- displayed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1415—Digital output to display device ; Cooperation and interconnection of the display device with other functional units with means for detecting differences between the image stored in the host and the images displayed on the displays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
- G06F3/1462—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay with means for detecting differences between the image stored in the host and the images displayed on the remote displays
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/12—Synchronisation between the display unit and other units, e.g. other display units, video-disc players
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0492—Change of orientation of the displayed image, e.g. upside-down, mirrored
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2356/00—Detection of the display position w.r.t. other display screens
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G2370/042—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller for monitor identification
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/16—Use of wireless transmission of display information
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/22—Detection of presence or absence of input display information or of connection or disconnection of a corresponding information source
Definitions
- the invention relates to a display control device, a display, a display system, and a computer-readable medium.
- a display control device includes a position specifying unit, an image specifying unit and a controller.
- the position specifying unit specifies a position of a second apparatus on a display screen of a first apparatus.
- the image specifying unit specifies one of an image displayed on a display screen of the second apparatus and an image that is designated from among two or more images displayed on the display screen of the second apparatus.
- the controller controls such that a certain image according to the image specified by the image specifying unit is displayed at a certain position on the display screen of the first apparatus according to the position of the second apparatus specified by the position specifying unit.
- FIG. 1 is a drawing to show a first example of a horizontal display and a portable display to which an exemplary embodiment of the invention is applied;
- FIG. 2A shows an example of a unit pattern
- FIG. 2B shows an example of layout of a code block
- FIG. 3 is a drawing to show a second example of a horizontal display and a portable display to which the exemplary embodiment of the invention is applied;
- FIG. 4A shows an example of a unit pattern forming a code image
- FIG. 4B shows an example of layout of a code block
- FIG. 5 is a drawing to show a third example of a horizontal display and a portable display to which the exemplary embodiment of the invention is applied;
- FIG. 6 is a drawing to show the configuration of a wireless sensor used in the third example.
- FIG. 7A is a drawing showing an area corresponding to the shared screen displayed on a display screen of a portable display
- FIG. 7B is a drawing showing the horizontal display and the portable display following an action where a participant selects an image of an electronic document displayed in a personal area and moves it to a shared area by a dragging operation;
- FIG. 8A is a drawing showing a horizontal display when a second page of an electronic document is displayed to the left of the portable display and a fourth page of the electronic document is displayed to the right of the portable display;
- FIG. 8B is a drawing showing a fourth page of an electronic document displayed on a portable display where the left image is updated to the third page and the right image is updated to a fifth page;
- FIG. 9 is a drawing to show a first configuration example of a display system in the exemplary embodiment of the invention.
- FIG. 10 is a drawing to show a second configuration example of the display system in the exemplary embodiment of the invention.
- FIG. 11 is a flowchart to show a first operation example of the display system in the exemplary embodiment of the invention.
- FIG. 12A is a drawing showing an example of coordinates set on a screen
- FIG. 12B is a drawing showing contents of the management information when the portable displays are placed.
- FIG. 13 is a flowchart to show a second operation example of the display system in the exemplary embodiment of the invention.
- FIG. 14 is a drawing to show management information used in the second operation example.
- FIG. 15 is a diagram to show the hardware configuration of a computer that can implement the exemplary embodiment of the invention.
- a horizontal display for plural users to have a discussion with gathering about the display is used as an example of a display.
- a portable display carried in by one user is placed on the horizontal display and an electronic document displayed on the portable display is shared on a shared screen on the horizontal display, to thereby have a discussion. Then, first the mechanisms of the horizontal display and the portable display will be described.
- FIG. 1 is a section view when a portable display 20 is placed on a horizontal display 10 in the first example.
- the portable display 20 is in contact with the horizontal display 10 , but a gap is provided between the horizontal display 10 and the portable display 20 in the figure for ease to view.
- the horizontal display 10 includes a top plate 11 as a workbench for having a discussion, and leg portions 12 a to 12 d for supporting the top plate 11 .
- the horizontal display 10 also includes a projection unit 13 for projecting an image onto the top plate 11 from its rear, casters 14 a to 14 d for movably supporting the projection unit 13 , and a projector 15 for projecting the image to be projected onto the top plate 11 .
- the horizontal display 10 further includes an infrared light source 17 for irradiating the bottom surface of the portable display 20 with infrared light and an infrared camera 18 a for receiving the infrared light reflected on the bottom of the portable display 20 .
- FIG. 1 is a section view and therefore the legs portions 12 c and 12 d and the casters 14 c and 14 d do not appear in the figure.
- the top plate 11 is circular, for example, so that each user can participate in discussion with standing at any desired position in the surrounding of the top plate 11 .
- a translucent white filter is put on a base material of a glass plate, etc., to form a transmission-type screen so that the top plate 11 functions as a display screen (for example, large screen display) for displaying an image projected by the projection unit 13 .
- the top plate 11 is used as an example of a display unit.
- the top plate 11 also includes a function of a touch panel for detecting user's operation on the displayed image.
- the touch panel may be provided by covering the surface of the top plate 11 with a transparent screen where elements for detecting contact are placed or may be provided by running infrared light vertically and horizontally on the surface of the top plate 11 and detecting a position where the infrared is blocked.
- the portable display 20 may be placed on the top plate 11 as shown in the figure. Therefore, it is assumed that the function of the touch panel of the top plate 11 is a function of discriminating between touch with the bottom surface of the portable display 20 and touch as user's operation, for processing. For example, if the touch part exceeds a given area, a signal representing user's operation may be suppressed.
- the number of the legs ( 12 a to 12 d ) is four by way of example, but is not limited to four.
- the projection unit 13 is formed of a square pole box with a side surface of the top plate 11 being open and contains mirrors 13 a and 13 b therein. It is assumed that the mirrors 13 a and 13 b are fixed at angles as shown in the figure and are attached to side surfaces of the box of the projection unit 13 .
- the casters 14 a to 14 d are attached to the bottom surface of the projection unit 13 so that the projection unit 13 can be moved with a move of a table made up of the top plate 11 , the leg portions 12 a to 12 d, and the projector 15 .
- the relative position of the projection unit 13 to the table is prevented from shifting.
- the number of the casters is four, but is not limited to four.
- the projector 15 is hung from the top plate 11 and is fixed and projects an image in the direction of the mirror 13 a . Then, the image is reflected on the mirror 13 a and is projected onto the top plate 11 .
- the infrared light source 17 blinks in a pulse fashion in synchronization with the shutter timing of the infrared camera 18 a, for example. Accordingly, an area of the top plate 11 where there is a possibility that the portable display 20 may be placed is irradiated with the infrared light on a regular basis.
- an infrared LED may be used as the infrared light source 17 .
- the infrared camera 18 a captures an image of the bottom surface of the portable display 20 , with which infrared light is irradiated, by an image sensor having sensitivity to the infrared region.
- the captured image is analyzed. Thereby, an ID and a position of the portable display 20 are detected.
- a CMOS sensor or a CCD sensor may be used as the image sensor.
- an image is thus read with the infrared light, so that video produced by visible light of the projector 15 is not affected.
- a holographic optical element for allowing any other than light at a given angle to pass through may be used in the top plate 11 .
- a method of putting a film, which is electrically changeable between transmission and non-transmission, on the top plate 11 and switching between projection and ID recognition in a short cycle may also be adopted.
- the portable display 20 may any so long as it is a portable-type terminal.
- a notebook PC is a representative example; a PDA (Personal Digital Assistant), a digital camera, a mobile telephone, etc., may be adopted.
- a code image 26 a formed of a color material (for example, toner) having an absorption region in the infrared region is put on the bottom surface of the portable display 20 so that the ID and the position of the portable display 20 are detected using the infrared light source 17 and the infrared camera 18 a.
- FIGS. 2A and 2B are drawings showing an example of an image forming the code image 26 a.
- FIG. 2A shows an example of a unit pattern.
- the unit pattern refers to the minimum unit of embedded information.
- black regions and hatched regions are regions where dot can be placed and white regions existing therebetween is regions where a dot cannot be placed. Dots are placed in the black regions of the regions where dot can be placed; dots are not placed in the hatched regions. That is, the figure shows an example in which a unit pattern is formed by placing dots in two positions selected from among the nine positions where dot can be placed.
- the four types of unit patterns are used as synchronous patterns.
- the synchronous patterns are patterns to detect image rotation and specify a relative position of an identification code.
- selected as the four types of unit patterns are patterns such that if one of the synchronous patterns is rotated 90 degrees, it becomes another of the synchronous patterns are selected.
- the 32 types of unit patterns except the four types of unit patterns are used as information patterns representing an identification code, to represent five-bit information.
- the dots shown in FIG. 2A are dots for representing information and do not necessarily match a dot meaning the minimum point forming a part of an image.
- the dot for representing information may be small as much as possible because the larger the dot becomes, the more conspicuous the dot becomes. However, if the dot is made too small, it cannot be printed by a printer.
- the above-mentioned value falling within a range of from 50 ⁇ m to 100 ⁇ m is adopted as the size of the dot for representing information.
- the above-mentioned value 84.6 ⁇ m is a numeric value on calculation and the size becomes about 100 ⁇ m in an actually printed toner image.
- FIG. 2B shows an example of layout of a code block.
- the figure shows a code array just before replacement with a pattern image rather than an image. That is, a unit pattern (any of 36 types of unit patterns) as in FIG. 2A is placed in the minimum square in FIG. 2B (which will be hereinafter referred to as “unit block”) and the resultant image is formed on a medium.
- a synchronous code is placed in one unit block in the upper left corner of the code block.
- the ID of the portable display 20 is coded and used as the identification code in the code image 26 a. In so doing, if the image captured by the infrared camera 18 a is analyzed, the ID of the portable display 20 is obtained and also it is possible to find which portable display 20 is placed on the horizontal display 10 .
- the position of the portable display 20 on the horizontal display 10 is found based on the position and the size of the code image in the image captured by the infrared camera 18 a. For example, if the code image exists on the upper side in the image captured by the infrared camera 18 a, it can be found that the infrared light is received from roughly above in the vertical direction. More specifically, it is assumed that an image is captured so that one side of the infrared camera 18 a closer to a table surface is on an upper side of the captured image.
- the code image appears at the center of the captured image; if the portable display 20 is closer to the infrared camera 18 a than the optical axis, the code image appears in the upper portion of the captured image; and if the portable display 2 is farther from the infrared camera 18 a than the optical axis, the code image appears in the lower portion of the captured image. If the code image exists on the lower side in the image captured by the infrared camera 18 a, it can be found that the infrared light is received from a direction closer to the horizontal direction than the vertical direction.
- the size of the code image 26 a is determined in advance and is compared with the size of the code image in the image captured by the infrared camera 18 a . Thereby, a distance from the infrared camera 18 a to the code image 26 a is recognized. Then, the position of the portable display 20 in a three-dimensional space is determined from the found direction and distance
- invisible toner having the maximum absorption ratio in a visible light region (400 nm to 700 nm) being 7% or less and the absorption ratio in a near-infrared region (800 nm to 1000 nm) being 30% or more is illustrated.
- “visible” and “invisible” do not have a bearing on whether or not the toner (code image) can be recognized by human's eyes.
- “Visible” and “invisible” are distinguished depending on whether or not the code image can be recognized according to the presence or absence of color development property due to absorption of a specific wavelength in the visible light region. If the toner (code image) is hard to recognize with human's eyes although there is some color development property due to absorption of the specific wavelength in the visible light region, it is also contained in “invisible.”
- FIG. 3 is a section view when a portable display 20 is placed on a horizontal display 10 in the second example. A gap is also provided between the horizontal display 10 and the portable display 20 in this figure for ease to view.
- the horizontal display 10 includes a top plate 11 , leg portions 12 a to 12 d, a projection unit 13 containing mirrors 13 a and 13 b, casters 14 a to 14 d , and a projector 15 , which are similar to those of the horizontal display 10 shown in FIG. 1 and therefore will not be described again.
- the horizontal display 10 reads the code image retained by the portable display 20 ; whereas, in FIG. 3 , the portable display 20 reads a code image retained by the horizontal display 10 .
- the portable display 20 may be a notebook PC, etc., as in FIG. 1 , but includes an infrared light source 27 and an infrared camera 28 in place of the code image 26 a.
- the functions of the infrared light source 27 and the infrared camera 28 are the same as the functions of the infrared light source 17 and the infrared camera 18 a in FIG. 1 and therefore will not be described again.
- the horizontal display 10 does not include the infrared light source 17 or the infrared camera 18 a. Instead, a code image 16 formed with a color material (for example, toner) having an absorption region in the infrared region is put on the surface of the top plate 11 so that an ID and a position of the horizontal display 10 are detected using the infrared light source 27 and the infrared camera 28 .
- a code image 16 formed with a color material for example, toner
- FIGS. 4A and 4B are drawings showing an example of an image, etc., forming the code image 16 .
- FIG. 4A shows an example of a unit pattern forming the code image 26 a, but it is similar to that previously described with reference to FIG. 2A and therefore will not be described again.
- information patterns other than the synchronous pattern among the unit patterns are described as those only representing an identification code. However, in FIG. 4 , they represent not only the identification code, but also a position code as described later.
- FIG. 4B shows an example of layout of a code block.
- this figure shows a code array just before it is replaced by a pattern image, rather than an image. That is, a unit pattern (any of 36 types of unit patterns) as in FIG. 4A is placed in the minimum square in FIG. 4B (which will be hereinafter referred to as a “unit block”) and the resultant image is formed on a medium.
- a unit pattern any of 36 types of unit patterns
- the synchronous code is placed in one unit block in the upper left corner of the code block.
- An X position code is placed in four unit blocks to the right of the unit block in which the synchronous code is placed.
- a Y position code is placed in four unit blocks below the unit block in which the synchronous code is placed.
- the ID of the horizontal display 10 is coded as the identification code in the code image 16 .
- the coordinate positions on the horizontal display 10 are coded as the position codes in the code image 16 . In so doing, if the image captured by the infrared camera 28 is analyzed, the ID of the horizontal display 10 and a coordinate position on the horizontal display 10 are obtained and it is made possible to find which position on which horizontal display 10 the portable display 20 is placed at.
- FIG. 5 is a section view when a portable display 20 is placed on a horizontal display 10 in the third example. A gap is also provided between the horizontal display 10 and the portable display 20 in the figure for ease to view.
- the horizontal display 10 includes a top plate 11 , leg portions 12 a to 12 d, a projection unit 13 containing mirrors 13 a and 13 b, casters 14 a to 14 d , and a projector 15 , which are similar to those of the horizontal display 10 shown in FIGS. 1 and 3 and therefore will not be described again.
- the horizontal display 10 reads the information retained by the portable display 20 using infrared light.
- the horizontal display 10 reads the information retained by the portable display 20 by conducting wireless communications. That is, in FIG. 5 , the portable display 20 may be a notebook PC, etc., as in FIG. 1 , but includes a wireless sensor 26 b in place of the code image 26 a.
- the horizontal display 10 includes a transceiver 18 b in place of the infrared light source 17 and the infrared camera 18 a.
- the wireless sensor 26 b will be described.
- FIG. 6 is a drawing to show the configuration of the wireless sensor 26 b.
- the wireless sensor 26 b includes: a dielectric thin film 61 formed, via an oxide film on a substrate made of Si for propagating a surface acoustic wave (SAW); and comb-shaped electrodes (IDT: Inter-digital Transducer) 62 a and 62 b formed on the dielectric thin film 61 for converting an electric signal into a surface acoustic wave and converting a surface acoustic wave into an electric signal.
- SAW surface acoustic wave
- IDT Inter-digital Transducer
- the wireless sensor 26 b also includes: antennas 64 a and 64 b connected to the comb-shaped electrodes 62 a and 62 b through impedance matching parts 63 a and 63 b, respectively, for transferring a radio wave signal to and from the transceiver 18 b; and grounds 65 a and 65 b connected to the other of the comb-shaped electrode 62 a and 62 b.
- the comb-shaped electrode 62 a and 62 b, the antennas 64 a and 64 b, and the impedance matching parts 63 a and 63 b are formed of a conductive pattern in an integrated fashion.
- a material of the conductive pattern metal selected from Ti, Cr, Cu, W, Ni, Ta, Ga, In, Al, Pb, Pt, Au, Ag, etc., or any of an alloy of Ti—Al, Al—Cu, Ti—N, Ni—Cr, etc., may be deposited as a single layer or a multilayer structure of two or more layers.
- Au, Ti, W, Al, and Cu is preferable as metal.
- the film thickness of the metal layer may be 1 nm or more and less than 10 ⁇ m.
- the plural wireless sensors 26 b thus configured are provided.
- Each of the wireless sensors 26 b holds the ID of a corresponding portable display 20 .
- the wireless sensors 26 b use the same frequency in principle. However, in order to obtain different IDs with the same frequency, distance dimension d between the comb-shaped electrode 62 a and 62 b the wireless sensors 26 b may be made different from each other to change a moving time of a surface acoustic wave between the comb-shaped electrode 62 a and 62 b.
- the ID is set in accordance with a propagation time t of a surface acoustic wave between the comb-shaped electrode 62 a and 62 b . It is advisable to previously store an ID setting table that associates the propagation times t and the IDs with each other, in storage (not shown) of the horizontal display 10 , for example.
- the basic operation of detecting an ID using the wireless sensor 26 b is as follows:
- the transceiver 18 b transmits a sensor question signal having a frequency of 300 MHz.
- the wireless sensor 26 b causes the dielectric thin film 61 to generate a surface acoustic wave and transmits a sensor answer signal.
- the transceiver 18 b receives the sensor answer signal, conducts an analysis process, and references the ID setting table based on the propagation time t calculated in the analysis process to read the ID.
- the horizontal display 10 finds a distance to the portable display 20 based on an intensity of the radio wave received by the transceiver 18 b from the wireless sensor 26 b and calculates a position of the portable display 20 based on the distance. If plural transceivers 18 b are provided, the position accuracy in the three-dimensional space is enhanced.
- the horizontal display 10 is used as an example of a display having a substantially horizontal display screen. It is assumed that the expression “substantially horizontal” does not require that the top plate 11 be completely parallel to the ground or floor face and may be horizontal to such an extent that the portable display 20 does not fall if the portable display 20 is placed on the top plate 11 .
- the exemplary embodiment may be applied to a display of any other type such as a vertical display.
- display as shown in FIGS. 7 and 8 is implemented using the horizontal display 10 described above.
- a scene is assumed where participants in a conference carry their respective portable displays 20 into a conference room to have a conference while referencing a shared screen implemented on the horizontal display 10 .
- FIGS. 7A and 7B are drawings showing a first example of displaying an electronic document, which is displayed on the portable display 20 , on the horizontal display 10 .
- each participant places the portable display 20 on the horizontal display 10 and connects the portable display 20 to a predetermined line in the conference room, for example.
- an area corresponding to the shared screen (shared area 21 a ) is displayed on a display screen 21 of the portable display 20 as shown in FIG. 7A .
- the shared area 21 a is shown as an area having a given area (shaded area) on the display screen 21 , but may be a folder or the like, for example.
- any area other than the shared area 21 a is a personal display area (personal area 21 b ) and an image of an electronic document not shared at this time is displayed.
- the participant selects an image (one of images) of the electronic document displayed in the personal area 21 b and moves it to the shared area 21 a by a dragging operation, for example.
- display on the horizontal display 10 and that on the portable display 20 becomes as shown in FIG. 7B . That is, the moved electronic document is displayed in the shared area 21 a and the electronic document is called from a server, etc., and is displayed beside the portable display 20 , for example, on the horizontal display 10 .
- the upper side of the image of the electronic document is displayed so as to become an opposite side to an operator of the portable display 20 .
- the upper side of the image refers to an upper side in the case where the image is placed in a predetermined orientation that is determined as a unique attribute to the image.
- the natural orientation when a human sees an image for example, if the image contains text, an orientation in which a human can read the text may be adopted as the predetermined orientation as the unique attribute to the image.
- the upper side of the image becomes the opposite side to the operator of the portable display 20 , it means that the image is displayed in the orientation easy to see for the operator of the portable display 20 on the horizontal display 10 .
- any other display method may be adopted.
- a scene is also possible where the participant who operates the portable display 20 explains while referencing the display screen 21 of the portable display 20 and any other participant receives the explanation while referencing the display on the horizontal display 10 .
- the image should be displayed in the orientation easy to see for the participators other than the operator of the portable display 20 . That is, the image of the electronic document may be displayed in a state where the upper side of the image is oriented to a direction along which the display screen of the display screen 21 of the portable display 20 is usually viewed.
- FIGS. 8A and 8B are drawings showing a second example of displaying an electronic document displayed on the portable display 20 on the horizontal display 10 .
- each participant places the portable display 20 on the horizontal display 10 .
- a third page of an electronic document is displayed on the display screen 21 of the portable display 20 .
- a second page of the electronic document is displayed to the left of the portable display 20 and a fourth page of the electronic document is displayed to the right of the portable display 20 as shown in FIG. 8A .
- the participant performs operation of turning a page of the electronic document
- information is transmitted to the horizontal display 10 and the display is updated. For example, if the fourth page of the electronic document is displayed on the portable display 20 , the left image is updated to the third page and the right image is updated to a fifth page as shown in FIG. 8B .
- the display system of the exemplary embodiment includes (i) the case where the horizontal display 10 recognizes the ID of the portable display 20 and the position of the portable display 20 on the horizontal display 10 as shown in FIGS. 1 and 5 and (ii) the case where the portable display 20 recognizes the ID of the horizontal display 10 and the position of the portable display 20 on the horizontal display 10 as shown in FIG. 3 .
- the former case will be described as a first configuration example of the display system, and the latter case will be described as a second example of the display system.
- FIG. 9 is a drawing to show the first configuration example.
- the first configuration example of the display system of the exemplary embodiment includes the horizontal display 10 , the portable display 20 , and a shared screen controller 30 for controlling the shared screen on the horizontal display 10 in accordance with information received from the portable display 20 .
- the horizontal display 10 includes the infrared light source 17 for irradiating with infrared light and the infrared camera 18 a for receiving the infrared light reflected on the bottom surface of the portable display 20 as shown in FIG. 1
- the code image 26 a is put on the portable display 20 .
- the horizontal display 10 includes the transceiver 18 b for conducting wireless communications as shown in FIG. 5
- the wireless sensor 26 b is attached to the portable display 20 .
- the horizontal display 10 and the shared screen controller 30 , and the portable display 20 and the shared screen controller 30 are connected by a LAN, for example.
- one horizontal display 10 and one portable display 20 are connected to one shared screen controller 30
- plural horizontal displays 10 and plural portable displays may be connected to the shared screen controller 30 .
- the horizontal display 10 is used as an example of a first apparatus and an example of a first display
- the top plate 11 (see FIGS. 1 and 5 ) is used as an example of a display screen of the first apparatus and an example of a first display screen.
- the portable display 20 is used as an example of a second apparatus and an example of a second display
- the display screen 21 (see FIGS. 7 and 8 ) is used as an example of a display screen of the second apparatus and an example of a second display screen.
- the shared screen controller 30 is used as an example of a display control device and an example of a controller.
- the horizontal display 10 includes a display section 111 for performing an image display process, an ID detection section 181 for detecting the ID of the portable display 20 (which will be hereinafter referred to as a “portable ID”), a position calculation section 182 for calculating a position of the portable display 20 on the top plate 11 (which will be hereinafter referred to as a “portable position”), and a communication section 19 for transmitting and receiving information to and from the shared screen controller 30 .
- an ID detection section 181 for detecting the ID of the portable display 20 (which will be hereinafter referred to as a “portable ID”)
- a position calculation section 182 for calculating a position of the portable display 20 on the top plate 11 (which will be hereinafter referred to as a “portable position”)
- a communication section 19 for transmitting and receiving information to and from the shared screen controller 30 .
- the display section 111 outputs an image to be projected onto the top plate 11 to the projector 15 in accordance with information concerning a display state received by the communication section 19 from the shared screen controller 30 , for example, information concerning a display position and a display direction (orientation).
- the ID detection section 181 analyzes an image captured by the infrared camera 18 a or the information received by the transceiver 18 b, thereby detecting the portable ID.
- the position calculation section 182 analyzes the image captured by the infrared camera 18 a or the information received by the transceiver 18 b, thereby calculating the portable position.
- the communication section 19 transmits an ID of the communication section 19 , the portable ID, and the portable position to the shared screen controller 30 and receives an electronic document and the information concerning the display state in the display section 111 from the shared screen controller 30 .
- the portable display 20 includes a display section 211 for performing an image display process, an operation acceptance section 22 for accepting a user's operation for an image, an ID retention section 261 for retaining its portable ID, and a communication section 29 for transmitting and receiving information to and from the shared screen controller 30 .
- the display section 211 performs processes for displaying an electronic document and changing display contents of the electronic document in response to the user's operation and displays an image on the display screen 21 (see FIGS. 7 and 8 ).
- the operation acceptance section 22 accepts the user's operation and transmits information concerning the user's operation to the display section 211 so as to produce display based on the user's operation.
- the operation acceptance section 22 also transmits the information concerning the user's operation to the communication section 29 so that the display in the horizontal display 10 is updated based on the user's operation.
- the ID retention section 261 is implemented by putting the code image 26 a on the bottom surface of the portable display 20 or attaching the wireless sensor 26 b to the portable display 20 . That is, in the exemplary embodiment, the code image 26 a or information retained by the wireless sensor 26 b is used as an example of information retained by the second apparatus.
- the communication section 29 transmits an ID of the communication section 29 and information concerning the electronic document for which the user's operation accepted by the operation acceptance section 22 is performed (which will be hereinafter referred to as “document information”) to the shared screen controller 30 .
- the document information mentioned here may include information for uniquely identifying the electronic document (which will be hereinafter referred to as a “document ID”) and page number in the electronic document.
- the shared screen controller 30 includes a display state management section 31 for managing the display state of the horizontal display 10 , a document acquisition section 32 for acquiring an electronic document to be displayed on the horizontal display 10 , and a communication section 39 for transmitting and receiving information to and from the portable display 20 and the horizontal display 10 .
- the display state management section 31 keeps track of which portable display 20 is placed on which horizontal display 10 .
- the display state management section 31 also keeps track of which position the portable display 20 is placed at. That is, in the exemplary embodiment, the function portion of the display state management section 31 is provided as an example of a position specifying unit for specifying the position of the second apparatus. Further, the display state management section 31 also keeps track of which orientation the placed portable display 20 is directed toward. That is, in the exemplary embodiment, the function portion of the display state management section 31 is provided as an example of an orientation specifying unit for specifying the orientation of the second apparatus. Further, the display state management section 31 also keeps track of an image of which electronic document is displayed on the display screen 21 of the portable display 20 (see FIGS. 7 and 8 ) and how the image has been changed. That is, in the exemplary embodiment, the function portion of the display state management section 31 is provided as an example of an image specifying unit for specifying the image and a recognition unit for recognizing change in the image.
- the document acquisition section 32 reads the electronic document or the page from a document server (not shown), the portable display 20 , a memory (not shown) in the shared screen controller 30 in which the electronic document is previously stored, etc.
- the communication section 39 receives the horizontal ID, the portable ID, the portable position from the horizontal display 10 and the portable ID and document information from the portable display 20 .
- the communication section 39 also transmits the electronic document and the information concerning the display state to the horizontal display 10 . That is, in the exemplary embodiment, the communication section 39 is provided as an example of a controller for controlling display.
- FIG. 10 is a drawing to show the second configuration example.
- the second configuration example of the display system of the exemplary embodiment also includes the horizontal display 10 , the portable display 20 , and the shared screen controller 30 for controlling the shared screen on the horizontal display 10 in accordance with information received from the portable display 20 .
- the portable display 20 includes the infrared light source 27 for irradiating with infrared light and the infrared camera 28 for receiving infrared light reflected on the top plate 11 of the horizontal display 10 as shown in FIG. 3
- the code image 16 is put on the horizontal display 10 .
- the horizontal display 10 and the shared screen controller 30 , and the portable display 20 and the shared screen controller 30 are connected by a LAN, for example.
- one horizontal display 10 and one portable display 20 are connected to one shared screen controller 30 .
- plural horizontal displays 10 and plural potable displays 20 may be connected to the shared screen controller 30 .
- the horizontal display 10 is used as an example of the first apparatus and an example of the first display
- the top plate 11 (see FIG. 3 ) is used as an example of the display screen of the first apparatus and an example of the first display screen.
- the portable display 20 is used as an example of the second apparatus and an example of the second display
- the display screen 21 (see FIGS. 7 and 8 ) is used as an example of the display screen of the second apparatus and an example of the second display screen.
- the shared screen controller 30 is used as an example of the display control device and an example of the controller.
- the horizontal display 10 includes a display section 111 for performing an image display process, an ID retention section 161 for retaining the ID of the horizontal display 10 (which will be hereinafter referred to as a “horizontal ID”), and a communication section 19 for transmitting and receiving information to and from the shared screen controller 30 .
- the display section 111 outputs an image to be projected onto the top plate 11 to the projector 15 in accordance with information concerning a display state received by the communication section 19 from the shared screen controller 30 , for example, information concerning a display position and a display direction (orientation).
- the ID retention section 161 is implemented by putting the code image 16 on the surface of the top plate 11 . That is, in the exemplary embodiment, information retained by the code image 16 is used as an example of information retained by the first apparatus.
- the communication section 19 receives an electronic document and the information concerning the display state of the display section 111 from the shared screen controller 30 .
- the portable display 20 includes a display section 211 for performing an image display process, an operation acceptance section 22 for accepting a user's operation for an image, an ID detection section 281 for detecting the horizontal ID, a position detection section 282 for detecting a portable position that is a position of the portable display 20 itself on the horizontal display 10 , and a communication section 29 for transmitting and receiving information to and from the shared screen controller 30 .
- the display section 211 performs processes for displaying an electronic document and changing display contents of the electronic document in accordance with the user's operation and displays an image on the display screen (see FIGS. 7 and 8 ).
- the operation acceptance section 22 accepts the user's operation and transmits information concerning the user's operation to the display section 211 so as to produce display based on the user's operation. Also, the operation acceptance section 22 transmits the information concerning the user's operation to the communication section 29 so that the display in the horizontal display 10 is updated based on the user's operation.
- the ID detection section 281 analyzes an image captured by the infrared camera 28 , thereby detecting the horizontal ID.
- the position calculation section 282 analyzes the image captured by the infrared camera 28 , thereby calculating the portable position.
- the communication section 29 transmits the horizontal ID, the ID of the communication section 29 , the portable position, and document information concerning the electronic document for which user's operation accepted by the operation acceptance section 22 is performed to the shared screen controller 30 .
- the shared screen controller 30 includes a display state management section 31 for managing the display state of the horizontal display 10 , a document acquisition section 32 for acquiring an electronic document to be displayed on the horizontal display 10 , and a communication section 39 for transmitting and receiving information to and from the portable display 20 and the horizontal display 10 .
- the display state management section 31 keeps track of which portable display 20 is placed on which horizontal display 10 .
- the display state management section 31 also keeps track of which position the portable display 20 is placed at. That is, in the exemplary embodiment, the function portion of the display state management section 31 is provided as an example of a position specifying unit for specifying a position of the second apparatus. Further, the display state management section 31 also keeps track of which orientation the placed portable display 20 is directed toward. That is, in the exemplary embodiment, the function portion of the display state management section 31 is provided as an example of an orientation specifying unit for specifying an orientation of the second apparatus. Further, the display state management section 31 also keeps track of an image of which electronic document is displayed on the display screen 21 of the portable display 20 (see FIGS. 7 and 8 ) and how the image has been changed. That is, in the exemplary embodiment, the function portion of the display state management section 31 is provided as an example of an image specifying unit for specifying the image and a recognition unit for recognizing change in the image.
- the document acquisition section 32 reads the electronic document or the page from a document server (not shown), the portable display 20 , a memory (not shown) in the shared screen controller 30 in which the electronic document is previously stored, etc.
- the communication section 39 receives the horizontal ID, the portable ID, the portable position and the document information from the portable display 20 .
- the communication section 39 also transmits the electronic document and the information concerning the display state to the horizontal display 10 . That is, in the exemplary embodiment, the communication section 39 is provided as an example of a controller for controlling display.
- the shared screen controller 30 is provided separately from the horizontal display 10 , but may be provided integrally with the horizontal display 10 . If such a configuration is adopted, it is not necessary to manage the horizontal ID in the management information.
- the ID detection section 181 detects the portable ID
- the position calculation section 182 calculates the portable position
- the communication section 19 transmits these pieces of information (the portable ID and the portable position) together with the horizontal ID to the shared screen controller 30 .
- the operation acceptance section 22 accepts a user's operation
- the communication section 29 transmits the document information of the electronic document for which the user's operation is performed together with the portable ID to the shared screen controller 30 .
- the ID detection section 281 detects the horizontal ID
- the position detection section 282 detects the portable position
- the communication section 29 transmits these pieces of information (the horizontal ID and the portable position) together with the portable ID to the shared screen controller 30 .
- the operation acceptance section 22 accepts a user's operation and the communication section transmits the document information of the electronic document for which user's operation is performed together with the portable ID to the shared screen controller 30 .
- FIG. 11 is a flowchart to show the operation of the shared screen controller 30 to implement the display in FIG. 7 .
- the shared screen controller 30 first, determines as to which the communication section 39 receives either information containing the horizontal ID, the portable ID, and the portable position or information containing the portable ID and the document ID (step 301 ).
- the received information is passed to the display state management section 31 . If the system has the configuration shown in FIG. 9 , the information is received from the horizontal display 10 . If the system has the configuration shown in FIG. 10 , the information is received from the portable display 20 .
- the display state management section 31 determines as to whether or not association among the horizontal ID, the portable ID and the portable position changes (step 302 ). If change is not detected, the process is terminated. If change is detected, association among the received horizontal ID, the received portable ID, and the received portable position is registered (step 303 ).
- the received information is also passed to the display state management section 31 .
- the information is received from the portable display 20 regardless of whether the system has the configuration shown in FIG. 9 or that shown in FIG. 10 .
- the display state management section 31 determines as to whether or not association between the portable ID and the document ID changes (step 304 ). If change is not detected, the processing is terminated. If change is detected, association between the received portable ID and received the document ID is registered (step 305 ).
- the display state management section 31 calculates a display position and a display direction (orientation) of the electronic document on the horizontal display 10 (step 306 ). For example, in FIG. 7 , a position beside the portable position received at step 301 is calculated as the display position.
- the document acquisition section 32 reads the electronic document to be displayed (step 307 ).
- the electronic document to be displayed is the same as the electronic document for which the user's operation is performed in the portable display 20 .
- another electronic document previously associated with the electronic document for which the user's operation is performed may be selected as the electronic document to be displayed.
- an image of the other electronic document previously associated is an example of an image having a predetermined relationship. If the image having the predetermined relationship is thus selected, the display position and the display direction (orientation) calculated at step 306 may be set according to the predetermined relationship.
- the communication section 39 transmits information of the display position and the display direction (orientation) calculated at step 306 and the electronic document read at step 307 to the horizontal display 10 (step 308 ).
- the image of the transmitted electronic document is displayed at the transmitted display position in the transmitted display direction (orientation).
- Management information referenced and updated by the display state management section 31 in the process shown in FIG. 11 will be described. It is advisable to previously store the management information in a memory (not shown) that can be referenced by the display state management section 31 .
- FIG. 12A shows an example of the coordinates set on the screen.
- the screen is rectangular and its center point is the origin.
- An X axis is taken in the longer direction and a Y axis is taken in the shorter direction.
- positions where the portable display 20 is placed are indicated by a quadrangle having A 1 , B 1 , C 1 , and D 1 as vertexes and a quadrangle having A 2 , B 2 , C 2 , and D 2 as vertexes.
- a quadrangle having A 1 , B 1 , C 1 , and D 1 as vertexes and a quadrangle having A 2 , B 2 , C 2 , and D 2 as vertexes.
- this is an example.
- a point existing in an area where the portable display 20 is placed may be managed, for example.
- FIG. 12B shows contents of the management information when the portable displays 20 are thus placed. It is assumed that FIG. 12A shows a state where the portable displays 20 are placed on the horizontal display 10 having a horizontal ID “P 001 ” and that the horizontal display 10 having a horizontal ID “P 002 ” is also managed separately from the horizontal display 10 having the horizontal ID “P 001 .”
- the portable display 20 is approximated to a rectangle and a range where the portable display 20 is placed is represented by coordinates of four vertexes. In order to indicate which orientation the portable display 20 is placed in on the screen, coordinates of three points of an upper left point, an upper right point and a lower left point are stored. Further, document IDs of electronic documents, for which user's operation is performed, among the electronic documents displayed on the portable displays 20 are also stored in the management information.
- step 302 in FIG. 11 it is determined as to whether or not association among the horizontal ID, the portable ID, and the portable position changes in the management information shown in FIG. 12B . If it is determined that change is detected, the already registered association is changed to new association at step 303 .
- step 304 in FIG. 11 it is determined as to whether or not association between the portable ID and the document ID changes in the management information shown in FIG. 12B . If it is determined that change is detected, the already registered association is changed to new association at step 305 .
- FIG. 13 is a flowchart to show the operation of the shared screen controller 30 to implement the display in FIG. 8 .
- the communication section 39 receives either information including the horizontal ID, the portable ID, and the portable position or information including the portable ID, the document ID, and the page number (step 351 ).
- the received information is passed to the display state management section 31 . If the system has the configuration shown in FIG. 9 , the information is received from the horizontal display 10 . If the system has the configuration shown in FIG. 10 , the information is received from the portable display 20 .
- the display state management section 31 determines as to whether or not association among the horizontal ID, the portable ID, and the portable position changes (step 352 ). If change is not detected, the process is terminated. If change is detected, the association among the received horizontal ID, the received portable ID and the received portable position is registered (step 353 ).
- the received information is also passed to the display state management section 31 .
- the information is received from the portable display 20 regardless of either the system configuration is that shown in FIG. 9 or 10 .
- the display state management section 31 determines as to whether or not association among the portable ID, the document ID, and the page number changes (step 354 ). If change is not detected, the process is terminated. If change is detected, the association among the received portable ID, the received document ID and the received page number is registered (step 355 ).
- the display state management section 31 calculates display positions and a display direction (orientation) of pages preceding and following the page of the electronic document displayed on the portable display 20 placed on the horizontal display 10 (step 356 ). For example, in FIG. 8 , positions to the left and the right of the portable position received at step 351 are calculated as the display positions.
- the document acquisition section 32 reads the pages preceding and following the page displayed on the portable display 20 as pages to be displayed (step 357 ).
- the pages to be displayed are the pages preceding and following the displayed page.
- any other page previously associated with the page displayed on the portable display 20 may be selected as the page to be displayed.
- the display control on the horizontal display 10 may be performed in other units than the page units.
- image data created just before and image data created just after the image data displayed on the portable display 20 in the time sequence may be read as the data to be displayed. That is, in the exemplary embodiment, an image of the preceding page and an image of the following page are used as an example of the two images preceding and following in a predetermined order relation.
- the positions to the left and the right of the portable display 20 are used as an example of the two symmetrical positions with the position of second apparatus as a center.
- the communication section 39 transmits information of the display positions and the display directions (orientations) calculated at step 356 and the pages read at step 357 to the horizontal display 10 (step 358 ).
- the transmitted pages are displayed at the transmitted display positions in the transmitted display direction (orientation).
- Management information referenced and updated by the display state management section 31 in the process shown in FIG. 13 will be described. It is advisable to previously store the management information in a memory (not shown) that can be referenced by the display state management section 31 .
- FIG. 14 shows contents of the management information when the portable displays 20 are thus placed.
- the horizontal display 10 having a horizontal ID “P 002 ” is also managed separately from the horizontal display 10 having a horizontal ID “P 001 ” shown in FIG. 12A .
- Document IDs and pages of electronic documents for which a user's operation is performed among the electronic documents displayed on the portable displays 20 are also stored in the management information.
- step 352 in FIG. 13 it is determined as to whether or not the association among the horizontal ID, the portable ID and the portable position changes in the management information in FIG. 14 . If it is determined that change is detected, the already registered association is changed to new association at step 353 .
- step 354 in FIG. 13 it is determined as to whether or not the association among the portable ID, the document ID and the page number changes in the management information in FIG. 14 . If it is determined that change is detected, the already registered association is changed to new association at step 355 .
- FIG. 15 is a diagram to show the hardware configuration of the computer 90 .
- the computer 90 includes a CPU (Central Processing Unit) 91 of computation means and main memory 92 and a magnetic disk unit (HDD: Hard Disk Drive) 93 of storage means.
- the CPU 91 executes various types of software of OS (Operating System), applications, etc., for implementing the functions described above.
- the main memory 92 is a storage area for storing various types of software, data used for execution of the software, and the like
- the magnetic disk unit 93 is a storage area for storing input data to various types of software, output data from various types of software, and the like.
- the computer 90 includes a communication I/F 94 for conducting external communications, a display mechanism 95 made up of video memory, a display, etc., and input devices 96 of a keyboard, a mouse, etc.
- the program for implementing the exemplary embodiment can be provided not only through communication means, but also as a computer-readable recording (storage) medium such as a CD-ROM storing the program.
Abstract
A display control device includes a position specifying unit, an image specifying unit and a controller. The position specifying unit specifies a position of a second apparatus on a display screen of a first apparatus. The image specifying unit specifies one of an image displayed on a display screen of the second apparatus and an image that is designated from among two or more images displayed on the display screen of the second apparatus. The controller controls such that a certain image according to the image specified by the image specifying unit is displayed at a certain position on the display screen of the first apparatus according to the position of the second apparatus specified by the position specifying unit.
Description
- This application is a continuation application of U.S. patent application Ser. No. 13/904,615, filed on May 29, 2013, which in turn is a continuation application of U.S. patent application Ser. No. 11/984,185, filed on Nov. 14, 2007, which is based on and claims priority under 35 U.S.C. §119 from Japanese Patent Application No.2007-86656 filed Mar. 29, 2007. The disclosures of each of the above-identified applications are hereby incorporated by reference in their entireties.
- The invention relates to a display control device, a display, a display system, and a computer-readable medium.
- According to an aspect of the invention, a display control device includes a position specifying unit, an image specifying unit and a controller. The position specifying unit specifies a position of a second apparatus on a display screen of a first apparatus. The image specifying unit specifies one of an image displayed on a display screen of the second apparatus and an image that is designated from among two or more images displayed on the display screen of the second apparatus. The controller controls such that a certain image according to the image specified by the image specifying unit is displayed at a certain position on the display screen of the first apparatus according to the position of the second apparatus specified by the position specifying unit.
- Exemplary embodiments of the invention will be described in detail below with reference to the accompanying drawings, wherein:
-
FIG. 1 is a drawing to show a first example of a horizontal display and a portable display to which an exemplary embodiment of the invention is applied; -
FIG. 2A shows an example of a unit pattern; -
FIG. 2B shows an example of layout of a code block; -
FIG. 3 is a drawing to show a second example of a horizontal display and a portable display to which the exemplary embodiment of the invention is applied; -
FIG. 4A shows an example of a unit pattern forming a code image; -
FIG. 4B shows an example of layout of a code block; -
FIG. 5 is a drawing to show a third example of a horizontal display and a portable display to which the exemplary embodiment of the invention is applied; -
FIG. 6 is a drawing to show the configuration of a wireless sensor used in the third example; -
FIG. 7A is a drawing showing an area corresponding to the shared screen displayed on a display screen of a portable display; -
FIG. 7B is a drawing showing the horizontal display and the portable display following an action where a participant selects an image of an electronic document displayed in a personal area and moves it to a shared area by a dragging operation; -
FIG. 8A is a drawing showing a horizontal display when a second page of an electronic document is displayed to the left of the portable display and a fourth page of the electronic document is displayed to the right of the portable display; -
FIG. 8B is a drawing showing a fourth page of an electronic document displayed on a portable display where the left image is updated to the third page and the right image is updated to a fifth page; -
FIG. 9 is a drawing to show a first configuration example of a display system in the exemplary embodiment of the invention; -
FIG. 10 is a drawing to show a second configuration example of the display system in the exemplary embodiment of the invention; -
FIG. 11 is a flowchart to show a first operation example of the display system in the exemplary embodiment of the invention; -
FIG. 12A is a drawing showing an example of coordinates set on a screen; -
FIG. 12B is a drawing showing contents of the management information when the portable displays are placed; -
FIG. 13 is a flowchart to show a second operation example of the display system in the exemplary embodiment of the invention; -
FIG. 14 is a drawing to show management information used in the second operation example; and -
FIG. 15 is a diagram to show the hardware configuration of a computer that can implement the exemplary embodiment of the invention. - The exemplary embodiment(s) of the invention will be described in detail with reference to the accompanying drawings.
- In the exemplary embodiment, a horizontal display for plural users to have a discussion with gathering about the display is used as an example of a display. A portable display carried in by one user is placed on the horizontal display and an electronic document displayed on the portable display is shared on a shared screen on the horizontal display, to thereby have a discussion. Then, first the mechanisms of the horizontal display and the portable display will be described.
- To begin with, a first example of the mechanisms of the horizontal display and the portable display will be described.
-
FIG. 1 is a section view when aportable display 20 is placed on ahorizontal display 10 in the first example. Usually, theportable display 20 is in contact with thehorizontal display 10, but a gap is provided between thehorizontal display 10 and theportable display 20 in the figure for ease to view. - As shown in the figure, the
horizontal display 10 includes atop plate 11 as a workbench for having a discussion, andleg portions 12 a to 12 d for supporting thetop plate 11. Thehorizontal display 10 also includes aprojection unit 13 for projecting an image onto thetop plate 11 from its rear,casters 14 a to 14 d for movably supporting theprojection unit 13, and aprojector 15 for projecting the image to be projected onto thetop plate 11. Thehorizontal display 10 further includes aninfrared light source 17 for irradiating the bottom surface of theportable display 20 with infrared light and aninfrared camera 18 a for receiving the infrared light reflected on the bottom of theportable display 20. However,FIG. 1 is a section view and therefore the legs portions 12 c and 12 d and the casters 14 c and 14 d do not appear in the figure. - The
top plate 11 is circular, for example, so that each user can participate in discussion with standing at any desired position in the surrounding of thetop plate 11. For example, a translucent white filter is put on a base material of a glass plate, etc., to form a transmission-type screen so that thetop plate 11 functions as a display screen (for example, large screen display) for displaying an image projected by theprojection unit 13. That is, in the exemplary embodiment, thetop plate 11 is used as an example of a display unit. Further, thetop plate 11 also includes a function of a touch panel for detecting user's operation on the displayed image. The touch panel may be provided by covering the surface of thetop plate 11 with a transparent screen where elements for detecting contact are placed or may be provided by running infrared light vertically and horizontally on the surface of thetop plate 11 and detecting a position where the infrared is blocked. In the exemplary embodiment, however, theportable display 20 may be placed on thetop plate 11 as shown in the figure. Therefore, it is assumed that the function of the touch panel of thetop plate 11 is a function of discriminating between touch with the bottom surface of theportable display 20 and touch as user's operation, for processing. For example, if the touch part exceeds a given area, a signal representing user's operation may be suppressed. - The number of the legs (12 a to 12 d) is four by way of example, but is not limited to four.
- The
projection unit 13 is formed of a square pole box with a side surface of thetop plate 11 being open and containsmirrors mirrors projection unit 13. - The
casters 14 a to 14 d are attached to the bottom surface of theprojection unit 13 so that theprojection unit 13 can be moved with a move of a table made up of thetop plate 11, theleg portions 12 a to 12 d, and theprojector 15. However, the relative position of theprojection unit 13 to the table is prevented from shifting. The number of the casters is four, but is not limited to four. - The
projector 15 is hung from thetop plate 11 and is fixed and projects an image in the direction of themirror 13 a. Then, the image is reflected on themirror 13 a and is projected onto thetop plate 11. - The infrared
light source 17 blinks in a pulse fashion in synchronization with the shutter timing of theinfrared camera 18 a, for example. Accordingly, an area of thetop plate 11 where there is a possibility that theportable display 20 may be placed is irradiated with the infrared light on a regular basis. For example, an infrared LED may be used as the infraredlight source 17. - The
infrared camera 18 a captures an image of the bottom surface of theportable display 20, with which infrared light is irradiated, by an image sensor having sensitivity to the infrared region. The captured image is analyzed. Thereby, an ID and a position of theportable display 20 are detected. For example, a CMOS sensor or a CCD sensor may be used as the image sensor. - In the exemplary embodiment, an image is thus read with the infrared light, so that video produced by visible light of the
projector 15 is not affected. To conduct further reliable projection and ID recognition, a holographic optical element for allowing any other than light at a given angle to pass through may be used in thetop plate 11. Alternatively, a method of putting a film, which is electrically changeable between transmission and non-transmission, on thetop plate 11 and switching between projection and ID recognition in a short cycle may also be adopted. - On the other hand, the
portable display 20 may any so long as it is a portable-type terminal. A notebook PC is a representative example; a PDA (Personal Digital Assistant), a digital camera, a mobile telephone, etc., may be adopted. It is noted that acode image 26 a formed of a color material (for example, toner) having an absorption region in the infrared region is put on the bottom surface of theportable display 20 so that the ID and the position of theportable display 20 are detected using the infraredlight source 17 and theinfrared camera 18 a. -
FIGS. 2A and 2B are drawings showing an example of an image forming thecode image 26 a. - First, unit patterns forming the
code image 26 a will be described. -
FIG. 2A shows an example of a unit pattern. - The unit pattern refers to the minimum unit of embedded information. In the figure, black regions and hatched regions are regions where dot can be placed and white regions existing therebetween is regions where a dot cannot be placed. Dots are placed in the black regions of the regions where dot can be placed; dots are not placed in the hatched regions. That is, the figure shows an example in which a unit pattern is formed by placing dots in two positions selected from among the nine positions where dot can be placed. Here, the number of combinations of selecting two positions from among nine positions is equal to 36 (=9C2) and therefore, 36 types of unit patterns exist. Among them, the four types of unit patterns are used as synchronous patterns. The synchronous patterns are patterns to detect image rotation and specify a relative position of an identification code. Particularly, since it is necessary to detect image rotation, selected as the four types of unit patterns are patterns such that if one of the synchronous patterns is rotated 90 degrees, it becomes another of the synchronous patterns are selected. The 32 types of unit patterns except the four types of unit patterns are used as information patterns representing an identification code, to represent five-bit information.
- By the way, the dots shown in
FIG. 2A are dots for representing information and do not necessarily match a dot meaning the minimum point forming a part of an image. In the exemplary embodiment, the dot for representing information (minimum square inFIG. 2A ) has a size of two dots×two dots in 600 dpi. Since the size of one dot in 600 dpi is 0.0423 mm, one side of the dot for representing information (minimum square inFIG. 2A ) is 84.6 μm (=0.0423 mm×2). The dot for representing information may be small as much as possible because the larger the dot becomes, the more conspicuous the dot becomes. However, if the dot is made too small, it cannot be printed by a printer. Then, the above-mentioned value falling within a range of from 50 μm to 100 μm is adopted as the size of the dot for representing information. However, the above-mentioned value 84.6 μm is a numeric value on calculation and the size becomes about 100 μm in an actually printed toner image. - Next, a code block made up of such unit patterns will be described.
-
FIG. 2B shows an example of layout of a code block. Here, the figure shows a code array just before replacement with a pattern image rather than an image. That is, a unit pattern (any of 36 types of unit patterns) as inFIG. 2A is placed in the minimum square inFIG. 2B (which will be hereinafter referred to as “unit block”) and the resultant image is formed on a medium. - In the layout in
FIG. 2B , a synchronous code is placed in one unit block in the upper left corner of the code block. An identification code is placed in four unit blocks to the right of the unit block in which the synchronous code is placed and in four unit blocks below the unit block in which the synchronous code is placed. Furthermore, the identification code is placed in 16 (=4×4) unit blocks surrounded by these unit blocks. - In the exemplary embodiment, the ID of the
portable display 20 is coded and used as the identification code in thecode image 26 a. In so doing, if the image captured by theinfrared camera 18 a is analyzed, the ID of theportable display 20 is obtained and also it is possible to find whichportable display 20 is placed on thehorizontal display 10. - On the other hand, the position of the
portable display 20 on thehorizontal display 10 is found based on the position and the size of the code image in the image captured by theinfrared camera 18 a. For example, if the code image exists on the upper side in the image captured by theinfrared camera 18 a, it can be found that the infrared light is received from roughly above in the vertical direction. More specifically, it is assumed that an image is captured so that one side of theinfrared camera 18 a closer to a table surface is on an upper side of the captured image. In this case, if theportable display 20 is located on the optical axis, the code image appears at the center of the captured image; if theportable display 20 is closer to theinfrared camera 18 a than the optical axis, the code image appears in the upper portion of the captured image; and if theportable display 2 is farther from theinfrared camera 18 a than the optical axis, the code image appears in the lower portion of the captured image. If the code image exists on the lower side in the image captured by theinfrared camera 18 a, it can be found that the infrared light is received from a direction closer to the horizontal direction than the vertical direction. The size of thecode image 26 a is determined in advance and is compared with the size of the code image in the image captured by theinfrared camera 18 a. Thereby, a distance from theinfrared camera 18 a to thecode image 26 a is recognized. Then, the position of theportable display 20 in a three-dimensional space is determined from the found direction and distance - K (black containing carbon) toner and special toner are available as the toner used to form the
code image 26 a. - As the special toner, invisible toner having the maximum absorption ratio in a visible light region (400 nm to 700 nm) being 7% or less and the absorption ratio in a near-infrared region (800 nm to 1000 nm) being 30% or more is illustrated. However, “visible” and “invisible” do not have a bearing on whether or not the toner (code image) can be recognized by human's eyes. “Visible” and “invisible” are distinguished depending on whether or not the code image can be recognized according to the presence or absence of color development property due to absorption of a specific wavelength in the visible light region. If the toner (code image) is hard to recognize with human's eyes although there is some color development property due to absorption of the specific wavelength in the visible light region, it is also contained in “invisible.”
- Next, a second example of the mechanisms of the horizontal display and the portable display will be described.
-
FIG. 3 is a section view when aportable display 20 is placed on ahorizontal display 10 in the second example. A gap is also provided between thehorizontal display 10 and theportable display 20 in this figure for ease to view. - As shown in the figure, the
horizontal display 10 includes atop plate 11,leg portions 12 a to 12 d, aprojection unit 13 containingmirrors casters 14 a to 14 d, and aprojector 15, which are similar to those of thehorizontal display 10 shown inFIG. 1 and therefore will not be described again. - By the way, in
FIG. 1 , thehorizontal display 10 reads the code image retained by theportable display 20; whereas, inFIG. 3 , theportable display 20 reads a code image retained by thehorizontal display 10. That is, inFIG. 3 , theportable display 20 may be a notebook PC, etc., as inFIG. 1 , but includes an infraredlight source 27 and aninfrared camera 28 in place of thecode image 26 a. The functions of the infraredlight source 27 and theinfrared camera 28 are the same as the functions of the infraredlight source 17 and theinfrared camera 18 a inFIG. 1 and therefore will not be described again. - On the other hand, the
horizontal display 10 does not include the infraredlight source 17 or theinfrared camera 18 a. Instead, acode image 16 formed with a color material (for example, toner) having an absorption region in the infrared region is put on the surface of thetop plate 11 so that an ID and a position of thehorizontal display 10 are detected using the infraredlight source 27 and theinfrared camera 28. -
FIGS. 4A and 4B are drawings showing an example of an image, etc., forming thecode image 16. -
FIG. 4A shows an example of a unit pattern forming thecode image 26 a, but it is similar to that previously described with reference toFIG. 2A and therefore will not be described again. InFIG. 2A , information patterns other than the synchronous pattern among the unit patterns are described as those only representing an identification code. However, inFIG. 4 , they represent not only the identification code, but also a position code as described later. - Next, a code block formed of such unit patterns will be described.
-
FIG. 4B shows an example of layout of a code block. Here, this figure shows a code array just before it is replaced by a pattern image, rather than an image. That is, a unit pattern (any of 36 types of unit patterns) as inFIG. 4A is placed in the minimum square inFIG. 4B (which will be hereinafter referred to as a “unit block”) and the resultant image is formed on a medium. - In the layout in
FIG. 4B , the synchronous code is placed in one unit block in the upper left corner of the code block. An X position code is placed in four unit blocks to the right of the unit block in which the synchronous code is placed. A Y position code is placed in four unit blocks below the unit block in which the synchronous code is placed. Further, an identification code is placed in 16 (=4×4) unit blocks surrounded by the unit blocks in which the position codes are placed. - In the exemplary embodiment, the ID of the
horizontal display 10 is coded as the identification code in thecode image 16. The coordinate positions on thehorizontal display 10 are coded as the position codes in thecode image 16. In so doing, if the image captured by theinfrared camera 28 is analyzed, the ID of thehorizontal display 10 and a coordinate position on thehorizontal display 10 are obtained and it is made possible to find which position on whichhorizontal display 10 theportable display 20 is placed at. - As the toner used to form the
code image 16, it is advisable to use a toner similar to that inFIG. 1 . - Next, a third example of the mechanisms of the horizontal display and the portable display will be described.
-
FIG. 5 is a section view when aportable display 20 is placed on ahorizontal display 10 in the third example. A gap is also provided between thehorizontal display 10 and theportable display 20 in the figure for ease to view. - As shown in the figure, the
horizontal display 10 includes atop plate 11,leg portions 12 a to 12 d, aprojection unit 13 containingmirrors casters 14 a to 14 d, and aprojector 15, which are similar to those of thehorizontal display 10 shown inFIGS. 1 and 3 and therefore will not be described again. - By the way, in
FIG. 1 , thehorizontal display 10 reads the information retained by theportable display 20 using infrared light. InFIG. 5 , thehorizontal display 10 reads the information retained by theportable display 20 by conducting wireless communications. That is, inFIG. 5 , theportable display 20 may be a notebook PC, etc., as inFIG. 1 , but includes awireless sensor 26 b in place of thecode image 26 a. On the other hand, thehorizontal display 10 includes atransceiver 18 b in place of the infraredlight source 17 and theinfrared camera 18 a. - The
wireless sensor 26 b will be described. -
FIG. 6 is a drawing to show the configuration of thewireless sensor 26 b. Thewireless sensor 26 b includes: a dielectricthin film 61 formed, via an oxide film on a substrate made of Si for propagating a surface acoustic wave (SAW); and comb-shaped electrodes (IDT: Inter-digital Transducer) 62 a and 62 b formed on the dielectricthin film 61 for converting an electric signal into a surface acoustic wave and converting a surface acoustic wave into an electric signal. Thewireless sensor 26 b also includes:antennas electrodes impedance matching parts transceiver 18 b; andgrounds electrode - The comb-shaped
electrode antennas impedance matching parts - The
plural wireless sensors 26 b thus configured are provided. Each of thewireless sensors 26 b holds the ID of a correspondingportable display 20. Thewireless sensors 26 b use the same frequency in principle. However, in order to obtain different IDs with the same frequency, distance dimension d between the comb-shapedelectrode wireless sensors 26 b may be made different from each other to change a moving time of a surface acoustic wave between the comb-shapedelectrode thin film 61 is very large as compared with the moving time of a radio wave signal between thetransceiver 18 b and thewireless sensor 26 b, the ID is set in accordance with a propagation time t of a surface acoustic wave between the comb-shapedelectrode horizontal display 10, for example. - The basic operation of detecting an ID using the
wireless sensor 26 b is as follows: - First, the
transceiver 18 b transmits a sensor question signal having a frequency of 300 MHz. Upon reception of the sensor question signal, thewireless sensor 26 b causes the dielectricthin film 61 to generate a surface acoustic wave and transmits a sensor answer signal. Then, thetransceiver 18 b receives the sensor answer signal, conducts an analysis process, and references the ID setting table based on the propagation time t calculated in the analysis process to read the ID. - On the other hand, the
horizontal display 10 finds a distance to theportable display 20 based on an intensity of the radio wave received by thetransceiver 18 b from thewireless sensor 26 b and calculates a position of theportable display 20 based on the distance. Ifplural transceivers 18 b are provided, the position accuracy in the three-dimensional space is enhanced. - In the exemplary embodiment, the
horizontal display 10 is used as an example of a display having a substantially horizontal display screen. It is assumed that the expression “substantially horizontal” does not require that thetop plate 11 be completely parallel to the ground or floor face and may be horizontal to such an extent that theportable display 20 does not fall if theportable display 20 is placed on thetop plate 11. Hereinafter, the case where the exemplary embodiment is applied to thehorizontal display 10 will be described, but the exemplary embodiment may be applied to a display of any other type such as a vertical display. - In the exemplary embodiment, display as shown in
FIGS. 7 and 8 is implemented using thehorizontal display 10 described above. Here, a scene is assumed where participants in a conference carry their respectiveportable displays 20 into a conference room to have a conference while referencing a shared screen implemented on thehorizontal display 10. -
FIGS. 7A and 7B are drawings showing a first example of displaying an electronic document, which is displayed on theportable display 20, on thehorizontal display 10. - First, each participant places the
portable display 20 on thehorizontal display 10 and connects theportable display 20 to a predetermined line in the conference room, for example. Then, an area corresponding to the shared screen (sharedarea 21 a) is displayed on adisplay screen 21 of theportable display 20 as shown inFIG. 7A . In the figure, the sharedarea 21 a is shown as an area having a given area (shaded area) on thedisplay screen 21, but may be a folder or the like, for example. On the other hand, any area other than the sharedarea 21 a is a personal display area (personal area 21 b) and an image of an electronic document not shared at this time is displayed. - Next, the participant selects an image (one of images) of the electronic document displayed in the
personal area 21 b and moves it to the sharedarea 21 a by a dragging operation, for example. Then, display on thehorizontal display 10 and that on theportable display 20 becomes as shown inFIG. 7B . That is, the moved electronic document is displayed in the sharedarea 21 a and the electronic document is called from a server, etc., and is displayed beside theportable display 20, for example, on thehorizontal display 10. - In this example, the upper side of the image of the electronic document is displayed so as to become an opposite side to an operator of the
portable display 20. Here, the upper side of the image refers to an upper side in the case where the image is placed in a predetermined orientation that is determined as a unique attribute to the image. The natural orientation when a human sees an image, for example, if the image contains text, an orientation in which a human can read the text may be adopted as the predetermined orientation as the unique attribute to the image. In so doing, if the upper side of the image becomes the opposite side to the operator of theportable display 20, it means that the image is displayed in the orientation easy to see for the operator of theportable display 20 on thehorizontal display 10. However, as a method for displaying the image of the electronic document, any other display method may be adopted. For example, a scene is also possible where the participant who operates theportable display 20 explains while referencing thedisplay screen 21 of theportable display 20 and any other participant receives the explanation while referencing the display on thehorizontal display 10. In such a case, it is desirable that the image should be displayed in the orientation easy to see for the participators other than the operator of theportable display 20. That is, the image of the electronic document may be displayed in a state where the upper side of the image is oriented to a direction along which the display screen of thedisplay screen 21 of theportable display 20 is usually viewed. -
FIGS. 8A and 8B are drawings showing a second example of displaying an electronic document displayed on theportable display 20 on thehorizontal display 10. - First, each participant places the
portable display 20 on thehorizontal display 10. At this time, it is assumed that a third page of an electronic document is displayed on thedisplay screen 21 of theportable display 20. Then, on thehorizontal display 10, a second page of the electronic document is displayed to the left of theportable display 20 and a fourth page of the electronic document is displayed to the right of theportable display 20 as shown inFIG. 8A . - Next, whenever the participant performs operation of turning a page of the electronic document, information is transmitted to the
horizontal display 10 and the display is updated. For example, if the fourth page of the electronic document is displayed on theportable display 20, the left image is updated to the third page and the right image is updated to a fifth page as shown inFIG. 8B . - Next, the configuration of a display system for implementing such schematic operation will be described.
- The display system of the exemplary embodiment includes (i) the case where the
horizontal display 10 recognizes the ID of theportable display 20 and the position of theportable display 20 on thehorizontal display 10 as shown inFIGS. 1 and 5 and (ii) the case where theportable display 20 recognizes the ID of thehorizontal display 10 and the position of theportable display 20 on thehorizontal display 10 as shown inFIG. 3 . - Then, the former case will be described as a first configuration example of the display system, and the latter case will be described as a second example of the display system.
-
FIG. 9 is a drawing to show the first configuration example. - As shown in the figure, the first configuration example of the display system of the exemplary embodiment includes the
horizontal display 10, theportable display 20, and a sharedscreen controller 30 for controlling the shared screen on thehorizontal display 10 in accordance with information received from theportable display 20. If thehorizontal display 10 includes the infraredlight source 17 for irradiating with infrared light and theinfrared camera 18 a for receiving the infrared light reflected on the bottom surface of theportable display 20 as shown inFIG. 1 , thecode image 26 a is put on theportable display 20. If thehorizontal display 10 includes thetransceiver 18 b for conducting wireless communications as shown inFIG. 5 , thewireless sensor 26 b is attached to theportable display 20. Thehorizontal display 10 and the sharedscreen controller 30, and theportable display 20 and the sharedscreen controller 30 are connected by a LAN, for example. In the figure, onehorizontal display 10 and oneportable display 20 are connected to one sharedscreen controller 30, but pluralhorizontal displays 10 and plural portable displays may be connected to the sharedscreen controller 30. - In the exemplary embodiment, the
horizontal display 10 is used as an example of a first apparatus and an example of a first display, and the top plate 11 (seeFIGS. 1 and 5 ) is used as an example of a display screen of the first apparatus and an example of a first display screen. Theportable display 20 is used as an example of a second apparatus and an example of a second display, and the display screen 21 (seeFIGS. 7 and 8 ) is used as an example of a display screen of the second apparatus and an example of a second display screen. Further, the sharedscreen controller 30 is used as an example of a display control device and an example of a controller. - The internal functional configurations of the respective apparatus and units will be described.
- The
horizontal display 10 includes adisplay section 111 for performing an image display process, anID detection section 181 for detecting the ID of the portable display 20 (which will be hereinafter referred to as a “portable ID”), aposition calculation section 182 for calculating a position of theportable display 20 on the top plate 11 (which will be hereinafter referred to as a “portable position”), and acommunication section 19 for transmitting and receiving information to and from the sharedscreen controller 30. - The
display section 111 outputs an image to be projected onto thetop plate 11 to theprojector 15 in accordance with information concerning a display state received by thecommunication section 19 from the sharedscreen controller 30, for example, information concerning a display position and a display direction (orientation). - The
ID detection section 181 analyzes an image captured by theinfrared camera 18 a or the information received by thetransceiver 18 b, thereby detecting the portable ID. - The
position calculation section 182 analyzes the image captured by theinfrared camera 18 a or the information received by thetransceiver 18 b, thereby calculating the portable position. - The
communication section 19 transmits an ID of thecommunication section 19, the portable ID, and the portable position to the sharedscreen controller 30 and receives an electronic document and the information concerning the display state in thedisplay section 111 from the sharedscreen controller 30. - The
portable display 20 includes adisplay section 211 for performing an image display process, anoperation acceptance section 22 for accepting a user's operation for an image, anID retention section 261 for retaining its portable ID, and acommunication section 29 for transmitting and receiving information to and from the sharedscreen controller 30. - The
display section 211 performs processes for displaying an electronic document and changing display contents of the electronic document in response to the user's operation and displays an image on the display screen 21 (seeFIGS. 7 and 8 ). - The
operation acceptance section 22 accepts the user's operation and transmits information concerning the user's operation to thedisplay section 211 so as to produce display based on the user's operation. Theoperation acceptance section 22 also transmits the information concerning the user's operation to thecommunication section 29 so that the display in thehorizontal display 10 is updated based on the user's operation. - The
ID retention section 261 is implemented by putting thecode image 26 a on the bottom surface of theportable display 20 or attaching thewireless sensor 26 b to theportable display 20. That is, in the exemplary embodiment, thecode image 26 a or information retained by thewireless sensor 26 b is used as an example of information retained by the second apparatus. - The
communication section 29 transmits an ID of thecommunication section 29 and information concerning the electronic document for which the user's operation accepted by theoperation acceptance section 22 is performed (which will be hereinafter referred to as “document information”) to the sharedscreen controller 30. The document information mentioned here may include information for uniquely identifying the electronic document (which will be hereinafter referred to as a “document ID”) and page number in the electronic document. - The shared
screen controller 30 includes a displaystate management section 31 for managing the display state of thehorizontal display 10, adocument acquisition section 32 for acquiring an electronic document to be displayed on thehorizontal display 10, and acommunication section 39 for transmitting and receiving information to and from theportable display 20 and thehorizontal display 10. - The display
state management section 31 keeps track of whichportable display 20 is placed on whichhorizontal display 10. The displaystate management section 31 also keeps track of which position theportable display 20 is placed at. That is, in the exemplary embodiment, the function portion of the displaystate management section 31 is provided as an example of a position specifying unit for specifying the position of the second apparatus. Further, the displaystate management section 31 also keeps track of which orientation the placedportable display 20 is directed toward. That is, in the exemplary embodiment, the function portion of the displaystate management section 31 is provided as an example of an orientation specifying unit for specifying the orientation of the second apparatus. Further, the displaystate management section 31 also keeps track of an image of which electronic document is displayed on thedisplay screen 21 of the portable display 20 (seeFIGS. 7 and 8 ) and how the image has been changed. That is, in the exemplary embodiment, the function portion of the displaystate management section 31 is provided as an example of an image specifying unit for specifying the image and a recognition unit for recognizing change in the image. - If there is a request for newly displaying an electronic document or a page on the
horizontal display 10, thedocument acquisition section 32 reads the electronic document or the page from a document server (not shown), theportable display 20, a memory (not shown) in the sharedscreen controller 30 in which the electronic document is previously stored, etc. - The
communication section 39 receives the horizontal ID, the portable ID, the portable position from thehorizontal display 10 and the portable ID and document information from theportable display 20. Thecommunication section 39 also transmits the electronic document and the information concerning the display state to thehorizontal display 10. That is, in the exemplary embodiment, thecommunication section 39 is provided as an example of a controller for controlling display. -
FIG. 10 is a drawing to show the second configuration example. - As shown in the figure, the second configuration example of the display system of the exemplary embodiment also includes the
horizontal display 10, theportable display 20, and the sharedscreen controller 30 for controlling the shared screen on thehorizontal display 10 in accordance with information received from theportable display 20. If theportable display 20 includes the infraredlight source 27 for irradiating with infrared light and theinfrared camera 28 for receiving infrared light reflected on thetop plate 11 of thehorizontal display 10 as shown inFIG. 3 , thecode image 16 is put on thehorizontal display 10. Also in the configuration example, thehorizontal display 10 and the sharedscreen controller 30, and theportable display 20 and the sharedscreen controller 30 are connected by a LAN, for example. In the figure, onehorizontal display 10 and oneportable display 20 are connected to one sharedscreen controller 30. However, pluralhorizontal displays 10 and pluralpotable displays 20 may be connected to the sharedscreen controller 30. - In the exemplary embodiment, the
horizontal display 10 is used as an example of the first apparatus and an example of the first display, and the top plate 11 (seeFIG. 3 ) is used as an example of the display screen of the first apparatus and an example of the first display screen. Theportable display 20 is used as an example of the second apparatus and an example of the second display, and the display screen 21 (seeFIGS. 7 and 8 ) is used as an example of the display screen of the second apparatus and an example of the second display screen. Further, the sharedscreen controller 30 is used as an example of the display control device and an example of the controller. - The internal functional configurations of the respective apparatus and units will be described.
- The
horizontal display 10 includes adisplay section 111 for performing an image display process, anID retention section 161 for retaining the ID of the horizontal display 10 (which will be hereinafter referred to as a “horizontal ID”), and acommunication section 19 for transmitting and receiving information to and from the sharedscreen controller 30. - The
display section 111 outputs an image to be projected onto thetop plate 11 to theprojector 15 in accordance with information concerning a display state received by thecommunication section 19 from the sharedscreen controller 30, for example, information concerning a display position and a display direction (orientation). - The
ID retention section 161 is implemented by putting thecode image 16 on the surface of thetop plate 11. That is, in the exemplary embodiment, information retained by thecode image 16 is used as an example of information retained by the first apparatus. - The
communication section 19 receives an electronic document and the information concerning the display state of thedisplay section 111 from the sharedscreen controller 30. - The
portable display 20 includes adisplay section 211 for performing an image display process, anoperation acceptance section 22 for accepting a user's operation for an image, anID detection section 281 for detecting the horizontal ID, aposition detection section 282 for detecting a portable position that is a position of theportable display 20 itself on thehorizontal display 10, and acommunication section 29 for transmitting and receiving information to and from the sharedscreen controller 30. - The
display section 211 performs processes for displaying an electronic document and changing display contents of the electronic document in accordance with the user's operation and displays an image on the display screen (seeFIGS. 7 and 8 ). - The
operation acceptance section 22 accepts the user's operation and transmits information concerning the user's operation to thedisplay section 211 so as to produce display based on the user's operation. Also, theoperation acceptance section 22 transmits the information concerning the user's operation to thecommunication section 29 so that the display in thehorizontal display 10 is updated based on the user's operation. - The
ID detection section 281 analyzes an image captured by theinfrared camera 28, thereby detecting the horizontal ID. - The
position calculation section 282 analyzes the image captured by theinfrared camera 28, thereby calculating the portable position. - The
communication section 29 transmits the horizontal ID, the ID of thecommunication section 29, the portable position, and document information concerning the electronic document for which user's operation accepted by theoperation acceptance section 22 is performed to the sharedscreen controller 30. - The shared
screen controller 30 includes a displaystate management section 31 for managing the display state of thehorizontal display 10, adocument acquisition section 32 for acquiring an electronic document to be displayed on thehorizontal display 10, and acommunication section 39 for transmitting and receiving information to and from theportable display 20 and thehorizontal display 10. - The display
state management section 31 keeps track of whichportable display 20 is placed on whichhorizontal display 10. The displaystate management section 31 also keeps track of which position theportable display 20 is placed at. That is, in the exemplary embodiment, the function portion of the displaystate management section 31 is provided as an example of a position specifying unit for specifying a position of the second apparatus. Further, the displaystate management section 31 also keeps track of which orientation the placedportable display 20 is directed toward. That is, in the exemplary embodiment, the function portion of the displaystate management section 31 is provided as an example of an orientation specifying unit for specifying an orientation of the second apparatus. Further, the displaystate management section 31 also keeps track of an image of which electronic document is displayed on thedisplay screen 21 of the portable display 20 (seeFIGS. 7 and 8 ) and how the image has been changed. That is, in the exemplary embodiment, the function portion of the displaystate management section 31 is provided as an example of an image specifying unit for specifying the image and a recognition unit for recognizing change in the image. - If there is a request for newly displaying an electronic document or page in the
horizontal display 10, thedocument acquisition section 32 reads the electronic document or the page from a document server (not shown), theportable display 20, a memory (not shown) in the sharedscreen controller 30 in which the electronic document is previously stored, etc. - The
communication section 39 receives the horizontal ID, the portable ID, the portable position and the document information from theportable display 20. Thecommunication section 39 also transmits the electronic document and the information concerning the display state to thehorizontal display 10. That is, in the exemplary embodiment, thecommunication section 39 is provided as an example of a controller for controlling display. - In the system configurations shown in
FIGS. 9 and 10 , the sharedscreen controller 30 is provided separately from thehorizontal display 10, but may be provided integrally with thehorizontal display 10. If such a configuration is adopted, it is not necessary to manage the horizontal ID in the management information. - Next, an operation of the display system of the exemplary embodiment is will described below.
- In
FIG. 9 , first in thehorizontal display 10, theID detection section 181 detects the portable ID, theposition calculation section 182 calculates the portable position, and thecommunication section 19 transmits these pieces of information (the portable ID and the portable position) together with the horizontal ID to the sharedscreen controller 30. In theportable display 20, theoperation acceptance section 22 accepts a user's operation and thecommunication section 29 transmits the document information of the electronic document for which the user's operation is performed together with the portable ID to the sharedscreen controller 30. - In
FIG. 10 , in theportable display 20, theID detection section 281 detects the horizontal ID, theposition detection section 282 detects the portable position, and thecommunication section 29 transmits these pieces of information (the horizontal ID and the portable position) together with the portable ID to the sharedscreen controller 30. Similarly, in theportable display 20, theoperation acceptance section 22 accepts a user's operation and the communication section transmits the document information of the electronic document for which user's operation is performed together with the portable ID to the sharedscreen controller 30. - Accordingly, the operation of the shared
screen controller 30 starts. Here, the operation for implementing the display inFIG. 7 and that inFIG. 8 will be described separately. -
FIG. 11 is a flowchart to show the operation of the sharedscreen controller 30 to implement the display inFIG. 7 . - The shared
screen controller 30, first, determines as to which thecommunication section 39 receives either information containing the horizontal ID, the portable ID, and the portable position or information containing the portable ID and the document ID (step 301). - If it is determined that the
communication section 39 receives the information containing the horizontal ID, the portable ID and the portable position, the received information is passed to the displaystate management section 31. If the system has the configuration shown inFIG. 9 , the information is received from thehorizontal display 10. If the system has the configuration shown inFIG. 10 , the information is received from theportable display 20. The displaystate management section 31 determines as to whether or not association among the horizontal ID, the portable ID and the portable position changes (step 302). If change is not detected, the process is terminated. If change is detected, association among the received horizontal ID, the received portable ID, and the received portable position is registered (step 303). - If it is determined that the information containing the portable ID and the document ID is received, the received information is also passed to the display
state management section 31. In this case, the information is received from theportable display 20 regardless of whether the system has the configuration shown inFIG. 9 or that shown inFIG. 10 . The displaystate management section 31 determines as to whether or not association between the portable ID and the document ID changes (step 304). If change is not detected, the processing is terminated. If change is detected, association between the received portable ID and received the document ID is registered (step 305). - Following step 303 if it is determined at step 302 that change is detected or following step 305 if it is determined at step 304 that change is detected, the display
state management section 31 calculates a display position and a display direction (orientation) of the electronic document on the horizontal display 10 (step 306). For example, inFIG. 7 , a position beside the portable position received atstep 301 is calculated as the display position. - The
document acquisition section 32 reads the electronic document to be displayed (step 307). Here, it is not necessary that the electronic document to be displayed is the same as the electronic document for which the user's operation is performed in theportable display 20. For example, another electronic document previously associated with the electronic document for which the user's operation is performed may be selected as the electronic document to be displayed. In this case, an image of the other electronic document previously associated is an example of an image having a predetermined relationship. If the image having the predetermined relationship is thus selected, the display position and the display direction (orientation) calculated at step 306 may be set according to the predetermined relationship. - Then, the
communication section 39 transmits information of the display position and the display direction (orientation) calculated at step 306 and the electronic document read at step 307 to the horizontal display 10 (step 308). - Accordingly, in the
horizontal display 10, the image of the transmitted electronic document is displayed at the transmitted display position in the transmitted display direction (orientation). - Management information referenced and updated by the display
state management section 31 in the process shown inFIG. 11 will be described. It is advisable to previously store the management information in a memory (not shown) that can be referenced by the displaystate management section 31. - Before the management information is described, first, coordinates on a screen of the
horizontal display 10 will be described.FIG. 12A shows an example of the coordinates set on the screen. Here, the screen is rectangular and its center point is the origin. An X axis is taken in the longer direction and a Y axis is taken in the shorter direction. - On the screen, positions where the
portable display 20 is placed are indicated by a quadrangle having A1, B1, C1, and D1 as vertexes and a quadrangle having A2, B2, C2, and D2 as vertexes. However, this is an example. Of points arranged like a lattice with short spacing, a point existing in an area where theportable display 20 is placed may be managed, for example. -
FIG. 12B shows contents of the management information when theportable displays 20 are thus placed. It is assumed thatFIG. 12A shows a state where theportable displays 20 are placed on thehorizontal display 10 having a horizontal ID “P001” and that thehorizontal display 10 having a horizontal ID “P002” is also managed separately from thehorizontal display 10 having the horizontal ID “P001.” - For the coordinates in the portable position column in
FIG. 12 B, “x” is suffixed to a symbol assigned to a point inFIG. 12A , thereby representing an X coordinate of that point, and “y” is suffixed to a symbol assigned to a point inFIG. 12A , thereby representing a Y coordinate of that point. In this case, theportable display 20 is approximated to a rectangle and a range where theportable display 20 is placed is represented by coordinates of four vertexes. In order to indicate which orientation theportable display 20 is placed in on the screen, coordinates of three points of an upper left point, an upper right point and a lower left point are stored. Further, document IDs of electronic documents, for which user's operation is performed, among the electronic documents displayed on theportable displays 20 are also stored in the management information. - At step 302 in
FIG. 11 , it is determined as to whether or not association among the horizontal ID, the portable ID, and the portable position changes in the management information shown inFIG. 12B . If it is determined that change is detected, the already registered association is changed to new association at step 303. At step 304 inFIG. 11 , it is determined as to whether or not association between the portable ID and the document ID changes in the management information shown inFIG. 12B . If it is determined that change is detected, the already registered association is changed to new association at step 305. -
FIG. 13 is a flowchart to show the operation of the sharedscreen controller 30 to implement the display inFIG. 8 . - In the shared
screen controller 30, first it is determined which thecommunication section 39 receives either information including the horizontal ID, the portable ID, and the portable position or information including the portable ID, the document ID, and the page number (step 351). - If it is determined that the information including the horizontal ID, the portable ID, and the portable position is received, the received information is passed to the display
state management section 31. If the system has the configuration shown inFIG. 9 , the information is received from thehorizontal display 10. If the system has the configuration shown inFIG. 10 , the information is received from theportable display 20. The displaystate management section 31 determines as to whether or not association among the horizontal ID, the portable ID, and the portable position changes (step 352). If change is not detected, the process is terminated. If change is detected, the association among the received horizontal ID, the received portable ID and the received portable position is registered (step 353). - If it is determined that the information including the portable ID, the document ID, and the page number is received, the received information is also passed to the display
state management section 31. In this case, the information is received from theportable display 20 regardless of either the system configuration is that shown inFIG. 9 or 10. Then, the displaystate management section 31 determines as to whether or not association among the portable ID, the document ID, and the page number changes (step 354). If change is not detected, the process is terminated. If change is detected, the association among the received portable ID, the received document ID and the received page number is registered (step 355). - Following step 353 if it is determined at step 352 that change is detected or following step 355 if it is determined at step 354 that change is detected, the display
state management section 31 calculates display positions and a display direction (orientation) of pages preceding and following the page of the electronic document displayed on theportable display 20 placed on the horizontal display 10 (step 356). For example, inFIG. 8 , positions to the left and the right of the portable position received at step 351 are calculated as the display positions. - The
document acquisition section 32 reads the pages preceding and following the page displayed on theportable display 20 as pages to be displayed (step 357). However, it is not necessary that the pages to be displayed are the pages preceding and following the displayed page. For example, any other page previously associated with the page displayed on theportable display 20 may be selected as the page to be displayed. Alternatively, the display control on thehorizontal display 10 may be performed in other units than the page units. For example, among image data in one folder, image data created just before and image data created just after the image data displayed on theportable display 20 in the time sequence may be read as the data to be displayed. That is, in the exemplary embodiment, an image of the preceding page and an image of the following page are used as an example of the two images preceding and following in a predetermined order relation. The positions to the left and the right of theportable display 20 are used as an example of the two symmetrical positions with the position of second apparatus as a center. - Then, the
communication section 39 transmits information of the display positions and the display directions (orientations) calculated atstep 356 and the pages read atstep 357 to the horizontal display 10 (step 358). - Accordingly, in the
horizontal display 10, the transmitted pages are displayed at the transmitted display positions in the transmitted display direction (orientation). - Management information referenced and updated by the display
state management section 31 in the process shown inFIG. 13 will be described. It is advisable to previously store the management information in a memory (not shown) that can be referenced by the displaystate management section 31. - Also in the management information, it is assumed that coordinates are represented in the same manner as those previously described with reference to
FIG. 12A and theportable displays 20 are placed as inFIG. 12A . -
FIG. 14 shows contents of the management information when theportable displays 20 are thus placed. Here, it is assumed that thehorizontal display 10 having a horizontal ID “P002” is also managed separately from thehorizontal display 10 having a horizontal ID “P001” shown inFIG. 12A . Document IDs and pages of electronic documents for which a user's operation is performed among the electronic documents displayed on theportable displays 20 are also stored in the management information. - At step 352 in
FIG. 13 , it is determined as to whether or not the association among the horizontal ID, the portable ID and the portable position changes in the management information inFIG. 14 . If it is determined that change is detected, the already registered association is changed to new association at step 353. At step 354 inFIG. 13 , it is determined as to whether or not the association among the portable ID, the document ID and the page number changes in the management information inFIG. 14 . If it is determined that change is detected, the already registered association is changed to new association at step 355. - Last, to implement the exemplary embodiment as a
computer 90, the hardware configuration of thecomputer 90 will be described. -
FIG. 15 is a diagram to show the hardware configuration of thecomputer 90. - As shown in the figure, the
computer 90 includes a CPU (Central Processing Unit) 91 of computation means andmain memory 92 and a magnetic disk unit (HDD: Hard Disk Drive) 93 of storage means. TheCPU 91 executes various types of software of OS (Operating System), applications, etc., for implementing the functions described above. Themain memory 92 is a storage area for storing various types of software, data used for execution of the software, and the like, and themagnetic disk unit 93 is a storage area for storing input data to various types of software, output data from various types of software, and the like. - Further, the
computer 90 includes a communication I/F 94 for conducting external communications, adisplay mechanism 95 made up of video memory, a display, etc., andinput devices 96 of a keyboard, a mouse, etc. - The program for implementing the exemplary embodiment can be provided not only through communication means, but also as a computer-readable recording (storage) medium such as a CD-ROM storing the program.
- The foregoing description of the exemplary embodiments of the invention has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Obviously, many modifications and variations will be apparent to practitioners skilled in the art. The exemplary embodiments were chosen and described in order to best explain the principles of the invention and its practical applications, thereby enabling others skilled in the art to understand the invention for various embodiments and with the various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the following claims and their equivalents.
Claims (2)
1. A display system, comprising:
a first display unit including a first display screen;
a connection unit that connects the first display unit and the second display unit; and
a receiving unit that receives, from a user, an instruction regarding sharing an image which is displayed on the first display screen and the second display screen, and
wherein a part of images which are displayed on the second display screen is displayed both on the first display screen and the second display screen, and
the other part of images is not displayed on the first display screen when the receiving unit receives the instruction from the user.
2. A display unit, comprising:
a display screen;
a connection unit that connects the display unit to another display unit; and
a receiving unit that receives, from a user, an instruction regarding sharing an image which is displayed on the display screen and the other display screen, and
wherein a part of images which are displayed on the display screen is displayed both on the display screen and the other display screen, and
the other part of images is not displayed on the other display screen when the receiving unit received the instruction from the user.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/688,785 US20150220298A1 (en) | 2007-03-29 | 2015-04-16 | Display control device, display, display system and computer-readable medium |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007-086656 | 2007-03-29 | ||
JP2007086656A JP2008242367A (en) | 2007-03-29 | 2007-03-29 | Display-control device, display device, display system, and program |
US11/984,185 US8482483B2 (en) | 2007-03-29 | 2007-11-14 | Display control device, display, display system and computer-readable medium |
US13/904,615 US9024841B2 (en) | 2007-03-29 | 2013-05-29 | Display device that depicts images on first display apparatus in accordance with position of a second display apparatus and display system and computer readable-medium thereof |
US14/688,785 US20150220298A1 (en) | 2007-03-29 | 2015-04-16 | Display control device, display, display system and computer-readable medium |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/904,615 Continuation US9024841B2 (en) | 2007-03-29 | 2013-05-29 | Display device that depicts images on first display apparatus in accordance with position of a second display apparatus and display system and computer readable-medium thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
US20150220298A1 true US20150220298A1 (en) | 2015-08-06 |
Family
ID=39793496
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/984,185 Expired - Fee Related US8482483B2 (en) | 2007-03-29 | 2007-11-14 | Display control device, display, display system and computer-readable medium |
US13/904,615 Active US9024841B2 (en) | 2007-03-29 | 2013-05-29 | Display device that depicts images on first display apparatus in accordance with position of a second display apparatus and display system and computer readable-medium thereof |
US14/688,785 Abandoned US20150220298A1 (en) | 2007-03-29 | 2015-04-16 | Display control device, display, display system and computer-readable medium |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/984,185 Expired - Fee Related US8482483B2 (en) | 2007-03-29 | 2007-11-14 | Display control device, display, display system and computer-readable medium |
US13/904,615 Active US9024841B2 (en) | 2007-03-29 | 2013-05-29 | Display device that depicts images on first display apparatus in accordance with position of a second display apparatus and display system and computer readable-medium thereof |
Country Status (2)
Country | Link |
---|---|
US (3) | US8482483B2 (en) |
JP (1) | JP2008242367A (en) |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008242367A (en) * | 2007-03-29 | 2008-10-09 | Fuji Xerox Co Ltd | Display-control device, display device, display system, and program |
JP5506241B2 (en) * | 2009-05-25 | 2014-05-28 | キヤノン株式会社 | Communication apparatus, system, and control method |
JP5669425B2 (en) * | 2010-04-19 | 2015-02-12 | キヤノン株式会社 | Display control apparatus and control method thereof |
US9582178B2 (en) * | 2011-11-07 | 2017-02-28 | Immersion Corporation | Systems and methods for multi-pressure interaction on touch-sensitive surfaces |
EP2919103B1 (en) | 2012-11-09 | 2020-04-01 | Sony Corporation | Information processing device, information processing method and computer-readable recording medium |
US9727298B2 (en) * | 2013-05-28 | 2017-08-08 | Sony Corporation | Device and method for allocating data based on an arrangement of elements in an image |
EP3109743B1 (en) * | 2014-02-17 | 2020-10-21 | Sony Corporation | Information processing system, information processing method and program |
JP2016048532A (en) * | 2014-08-28 | 2016-04-07 | Necパーソナルコンピュータ株式会社 | Information apparatus, information processing system, information processing method, and program |
TWI506534B (en) * | 2014-12-09 | 2015-11-01 | Awind Inc | Mirror display system having low data traffic and method thereof |
JP6312044B2 (en) * | 2014-12-10 | 2018-04-18 | カシオ計算機株式会社 | Information display control device and program |
KR102091021B1 (en) * | 2018-09-06 | 2020-03-19 | 황복득 | Moving sign board |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020075250A1 (en) * | 2000-10-10 | 2002-06-20 | Kazuyuki Shigeta | Image display apparatus and method, information processing apparatus using the image display apparatus, and storage medium |
US20060161624A1 (en) * | 2001-04-13 | 2006-07-20 | Elaine Montgomery | Methods and apparatuses for dynamically sharing a portion of a display for application based screen sampling |
US20060284786A1 (en) * | 2005-06-20 | 2006-12-21 | Fuji Xerox Co., Ltd. | Display control apparatus, system, and display control method |
US20070239981A1 (en) * | 2006-03-30 | 2007-10-11 | Sony Ericsson Mobile Communication Ab | Data Communication In An Electronic Device |
US20110001686A1 (en) * | 2009-07-03 | 2011-01-06 | International Business Machines Corporation | Pushing content from a local device to a remote display |
Family Cites Families (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3494451B2 (en) * | 1993-05-27 | 2004-02-09 | 株式会社日立製作所 | Conference screen display control method and electronic conference system |
US5745711A (en) | 1991-10-23 | 1998-04-28 | Hitachi, Ltd. | Display control method and apparatus for an electronic conference |
CA2196048A1 (en) * | 1994-07-28 | 1996-02-08 | Pinhas Gilboa | Computerized game board |
JPH08278512A (en) | 1995-04-06 | 1996-10-22 | Sharp Corp | Liquid crystal display device |
JPH09319556A (en) | 1996-05-28 | 1997-12-12 | Matsushita Electric Ind Co Ltd | Information processor |
US5826962A (en) * | 1997-04-30 | 1998-10-27 | Minnesota Mining And Manufacturing Company | LCD integrated/overhead projector |
US5956026A (en) | 1997-12-19 | 1999-09-21 | Sharp Laboratories Of America, Inc. | Method for hierarchical summarization and browsing of digital video |
JP3826598B2 (en) | 1999-01-29 | 2006-09-27 | 株式会社日立製作所 | Image monitoring apparatus and recording medium |
JP2001136504A (en) | 1999-11-08 | 2001-05-18 | Sony Corp | System and method for information input and output |
JP4332964B2 (en) | 1999-12-21 | 2009-09-16 | ソニー株式会社 | Information input / output system and information input / output method |
JP4868195B2 (en) * | 2000-10-24 | 2012-02-01 | ソニー株式会社 | Electronic apparatus and information processing apparatus |
JP2004015332A (en) | 2002-06-05 | 2004-01-15 | Olympus Corp | Table type display apparatus and assembling method therefor |
JP2004164069A (en) * | 2002-11-11 | 2004-06-10 | Nippon Telegr & Teleph Corp <Ntt> | Information control system, information control method, program for the same, recording medium recording that program |
KR100968457B1 (en) * | 2003-05-14 | 2010-07-07 | 삼성전자주식회사 | Computer System And Display Method Thereof |
US20040263424A1 (en) * | 2003-06-30 | 2004-12-30 | Okuley James M. | Display system and method |
JP4618401B2 (en) * | 2003-07-04 | 2011-01-26 | 富士ゼロックス株式会社 | Information display system and information display method |
JP2005100050A (en) * | 2003-09-24 | 2005-04-14 | Fuji Xerox Co Ltd | Information display system and method |
BRPI0417656A (en) * | 2003-12-19 | 2007-04-03 | Speechgear Inc | method, computer readable medium, and system |
EP1569140A3 (en) | 2004-01-30 | 2006-10-25 | Hewlett-Packard Development Company, L.P. | Apparatus, methods and software for associating electronic and physical documents |
US7134756B2 (en) * | 2004-05-04 | 2006-11-14 | Microsoft Corporation | Selectable projector and imaging modes of display table |
JP3899375B2 (en) | 2004-09-03 | 2007-03-28 | 国立大学法人北陸先端科学技術大学院大学 | Display control device |
US8195659B2 (en) | 2005-08-23 | 2012-06-05 | Ricoh Co. Ltd. | Integration and use of mixed media documents |
US7474983B2 (en) | 2005-01-05 | 2009-01-06 | Massachusetts Institute Of Technology | Method for object identification and sensing in a bounded interaction space |
JP4293135B2 (en) | 2005-01-20 | 2009-07-08 | 日本電信電話株式会社 | Conference information sharing support apparatus, method and program |
US7641348B2 (en) * | 2006-01-31 | 2010-01-05 | Hewlett-Packard Development Company, L.P. | Integrated portable computer projector system |
JP5109439B2 (en) * | 2007-03-29 | 2012-12-26 | 富士ゼロックス株式会社 | Display control apparatus and program |
JP2008242367A (en) * | 2007-03-29 | 2008-10-09 | Fuji Xerox Co Ltd | Display-control device, display device, display system, and program |
US20090063542A1 (en) | 2007-09-04 | 2009-03-05 | Bull William E | Cluster Presentation of Digital Assets for Electronic Devices |
-
2007
- 2007-03-29 JP JP2007086656A patent/JP2008242367A/en active Pending
- 2007-11-14 US US11/984,185 patent/US8482483B2/en not_active Expired - Fee Related
-
2013
- 2013-05-29 US US13/904,615 patent/US9024841B2/en active Active
-
2015
- 2015-04-16 US US14/688,785 patent/US20150220298A1/en not_active Abandoned
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020075250A1 (en) * | 2000-10-10 | 2002-06-20 | Kazuyuki Shigeta | Image display apparatus and method, information processing apparatus using the image display apparatus, and storage medium |
US20060161624A1 (en) * | 2001-04-13 | 2006-07-20 | Elaine Montgomery | Methods and apparatuses for dynamically sharing a portion of a display for application based screen sampling |
US20060284786A1 (en) * | 2005-06-20 | 2006-12-21 | Fuji Xerox Co., Ltd. | Display control apparatus, system, and display control method |
US20070239981A1 (en) * | 2006-03-30 | 2007-10-11 | Sony Ericsson Mobile Communication Ab | Data Communication In An Electronic Device |
US20110001686A1 (en) * | 2009-07-03 | 2011-01-06 | International Business Machines Corporation | Pushing content from a local device to a remote display |
Also Published As
Publication number | Publication date |
---|---|
US8482483B2 (en) | 2013-07-09 |
JP2008242367A (en) | 2008-10-09 |
US9024841B2 (en) | 2015-05-05 |
US20130335299A1 (en) | 2013-12-19 |
US20080238954A1 (en) | 2008-10-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9024841B2 (en) | Display device that depicts images on first display apparatus in accordance with position of a second display apparatus and display system and computer readable-medium thereof | |
US7355587B2 (en) | Method and apparatus for computer input using six degrees of freedom | |
JP3834766B2 (en) | Man machine interface system | |
US8199170B2 (en) | Display control device, media management device, and computer-readable medium | |
JP5950130B2 (en) | Camera-type multi-touch interaction device, system and method | |
JP4627781B2 (en) | Coordinate input / detection device and electronic blackboard system | |
KR20100027976A (en) | Gesture and motion-based navigation and interaction with three-dimensional virtual content on a mobile device | |
US20180104816A1 (en) | Robot device and non-transitory computer readable medium | |
CN103814343A (en) | Manipulating and displaying image on wearable computing system | |
US10290120B2 (en) | Color analysis and control using an electronic mobile device transparent display screen | |
US10888228B2 (en) | Method and system for correlating anatomy using an electronic mobile device transparent display screen | |
JP2019511049A (en) | Method and apparatus for providing a user interface with a computer system to interact with a virtual environment | |
JP2012079167A (en) | Information processing apparatus, information processing system and information processing method | |
US10162507B2 (en) | Display control apparatus, display control system, a method of controlling display, and program | |
Robinson et al. | The LivePaper system: augmenting paper on an enhanced tabletop | |
JP2017175580A (en) | Information display system and information providing terminal | |
JP2017175579A (en) | Information display system and information providing terminal | |
JP2008250376A (en) | Document creation device, display control device and program | |
US20050231767A1 (en) | Touch sensitive scan area selection apparatus and method | |
US20150253932A1 (en) | Information processing apparatus, information processing system and information processing method | |
JP2007264006A (en) | Image admiration system, image display device, electronic photograph stand, data handling device, image display method, data handling method, image display program, and data handling program | |
US20150339538A1 (en) | Electronic controller, control method, and control program | |
US11500103B2 (en) | Mobile terminal | |
JP2012252356A (en) | Display control device, display system and program | |
CN112529770A (en) | Image processing method, image processing device, electronic equipment and readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |