JP4618401B2 - Information display system and information display method - Google Patents

Information display system and information display method Download PDF

Info

Publication number
JP4618401B2
JP4618401B2 JP2003271155A JP2003271155A JP4618401B2 JP 4618401 B2 JP4618401 B2 JP 4618401B2 JP 2003271155 A JP2003271155 A JP 2003271155A JP 2003271155 A JP2003271155 A JP 2003271155A JP 4618401 B2 JP4618401 B2 JP 4618401B2
Authority
JP
Japan
Prior art keywords
display
medium
content
position
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2003271155A
Other languages
Japanese (ja)
Other versions
JP2005031448A (en
Inventor
恒正 三田
宏之 堀田
実 小清水
吉嗣 広瀬
幹夫 戸崎
泰則 斎藤
恵理子 田丸
努 石井
公威 蓮池
育太郎 長束
Original Assignee
富士ゼロックス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士ゼロックス株式会社 filed Critical 富士ゼロックス株式会社
Priority to JP2003271155A priority Critical patent/JP4618401B2/en
Publication of JP2005031448A publication Critical patent/JP2005031448A/en
Application granted granted Critical
Publication of JP4618401B2 publication Critical patent/JP4618401B2/en
Application status is Expired - Fee Related legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

  The present invention relates to an information display technique for easily handling display contents of a medium having an image display function.

  Conventionally, various display operations such as displaying a lot of information on a display screen, changing the display position on the screen, and printing out the information on paper have been performed. In general, a pointing device such as a mouse or a keyboard is used for these operations. In this case, since the location where the screen and the pointing device are provided is different, for example, when moving the displayed image, the movement of the image on the screen does not match the movement of the pointing device operated by the user. , Was a barrier for unfamiliar users.

  In addition, it is possible to display a plurality of pieces of information on the display screen in a conventional manner, but switching the information is cumbersome, causing stress on the user, and a more intuitive user interface is required. Yes.

  Further, when information is printed out, the display screen and the printer are separate, so the display screen and the print result often do not match. In addition, the operation is complicated because it targets different devices. In order to return the printed information to the display screen, another device such as a scanner must be used. As described above, the exchange of information with the display screen using paper as a medium is very complicated.

On the other hand, in recent years, media having an image display function called electronic paper have been developed. There are various methods for realizing the image display function. In any case, the display contents can be erased and rewritten any number of times, and the displayed contents can be maintained for a long time. For example, in the optical writable electronic paper described in Patent Document 1, information can be repeatedly written using display light when displaying information on a display device, for example, and once written information is erased or newly written. As long as no information is written, it is maintained semi-permanently. Taking advantage of these properties, it has attracted attention as a paper replacement that can be used repeatedly.
JP 2002-90716 A

  The present invention has been made in view of the above-described circumstances. A medium having an image display function is used for an operation on display content on a display screen, and a bidirectional display content between the display device and the medium is used. An object of the present invention is to provide an information display system and an information display method that enable exchange.

  The present invention corresponds to display means, detection means for detecting the position and state of a medium having optical writing and image display functions, and a display area of the medium on a display screen of the display means according to a detection result by the detection means. The display content to be displayed on the medium is detected in accordance with the size of the area by detecting the area, and the display content by the image display function of the medium is changed by the display light of the display means on the medium. It has a control means. With such a configuration, for example, according to the position where the medium is present on the display screen, the display content to be displayed on the medium can be displayed on the medium after matching the size of the medium. Therefore, the user can take out or move the contents displayed on the display means by a simple operation of moving and arranging the medium on the display screen of the display means. Such a medium operation may be performed directly on the display screen, and is not an operation at another place as in a conventional pointing device, so that the operation is intuitive and easy to understand.

  In addition, when a plurality of display contents are displayed in an overlapping manner on the display means, one or more display contents are identified from among the plurality of display contents displayed according to the position of the medium, and the medium content is determined based on the identified display contents. Display contents can be changed. After the content displayed on the display means is displayed on the medium, the display on the display means may be continued as it is or may be controlled to be erased. In that case, the erased display area may be configured to temporarily display a display different from the background so that the user can visually confirm the transfer to the medium.

  For detection of the position and state of the medium by the detection means, a marker may be added to the medium and the marker may be detected. In addition to providing the marker on the medium itself, for example, if the medium is provided with power supply means for an image display function, the marker may be attached to the power supply means. Further, an electromagnetic communication means such as an RFID tag may be used as the marker. The detection means can be configured to detect a two-dimensional position of a medium or a marker provided on the medium, for example, in a two-dimensional arrangement on the display means.

  According to the present invention, at least the display content can be transferred from the display means to the medium by a direct operation such as holding the medium over the display means. As in the case of using a conventional pointing device such as a mouse, it is possible to provide a user interface capable of handling information by a more intuitive and simple operation by wiping away troublesomeness due to remote operation and an uncomfortable feeling of operation.

  Furthermore, by enabling bidirectional transfer of display contents between the display means and the medium, information can be transferred bidirectionally that could only be performed in one direction by a conventional printer or the like. Thus, the degree of freedom regarding the handling of information can be further increased, and the use mode of information can be expanded. According to the present invention, such effects can be obtained, and various effects can be obtained as described later.

  FIG. 1 is a block diagram showing a first embodiment of the present invention. In the figure, 11 is a display unit, 12 is a position detection unit, 13 is a control unit, 21 is a medium, and 22 is a position marker. The display unit 11 can display various contents (display contents) under the control of the control unit 13. At this time, for example, a plurality of contents can be displayed in an overlapping manner. The display unit 11 can be arbitrarily configured as long as display is possible. For example, the display unit 11 may be various displays of a computer, a television, a projector, a projection display device, or the like.

  The position detection unit 12 detects the position and state of the medium 21. As an example, a position marker 22 is provided on the medium 21 as described later, and the position of the position marker 22 is detected. From the position information of the detected position marker 22, it is possible to detect the state of the medium 21, such as the position of the medium 21 itself, the orientation, the front and back, and the overlap between a plurality of media. In addition to being provided on the medium 21, the marker may detect, for example, one attached to a power source that supplies power to the medium 21. Of course, the present invention is not limited to the marker, and may be configured to detect, for example, a characteristic portion of the medium 21. The position detection method is arbitrary. For example, when there are a plurality of media 21 such as a 3D pointer, optical interferometry, a touch panel, analysis of image information taken from the upper surface or the rear surface, sensor display, ultrasonic waves, and other combinations thereof. The log of the detection order can be used.

  The control unit 13 associates the display unit 11 with the medium 21 based on the position and state of the medium 21 detected by the position detection unit 12. Then, the display content of the medium 21 is changed with respect to the medium 21 according to the position on the display screen of the display unit 11 corresponding to the position of the medium 21. For example, among the contents displayed on the display screen of the display unit 11, the display contents of the area where the medium 21 exists are displayed on the medium 21, or the content corresponding to the position of the medium 21 or the entire screen is displayed on the medium 21. Are displayed on the medium 21 in accordance with the size of the display area. At this time, when a plurality of contents are displayed on the display unit 11, one or more contents can be selected from the position of the medium 21, and the contents (including a part) can be displayed on the medium 21. In addition, when displaying content on the medium 21, for example, the control unit 13 sends the content to the medium 21 for display, and also sends information specifying the content to the medium 21 so that the medium 21 acquires the content. Alternatively, it is also possible to instruct an external device to send content to the medium 21 and to receive the medium 21 from the external device.

  Further, if the content displayed on the display unit 11 and the content displayed on the medium 21 are associated with each other, the control unit 13 causes the display unit 11 to respond to the movement or removal of the medium 21, for example. The displayed content can be moved or deleted. For example, when there is only one medium 21 or it can be specified by an ID or the like, it is possible to newly display the corresponding content when the medium 21 is newly detected on the display unit 11. In these cases, when a plurality of media 21 are arranged so as to overlap, such movement, deletion, new display, and the like can be performed according to the degree of overlap between the media 21.

  When the medium 21 is an optical writable medium, the content can be written to the medium 21 by the display light of the display unit 11. However, the control unit 13 can perform the writing of the content to the medium 21. Display control is also performed.

  The medium 21 has an image display function such as electronic paper. As specific examples, optical writing type electronic paper, electrophoretic type electronic paper, powder display, and the like can be used. Needless to say, not only electronic paper but also an apparatus such as a PDA, a mobile phone, or a digital camera can be used as the medium 21 as long as it has an image display function. In the following description, when content or the like is displayed by the image display function of the medium 21, it may be abbreviated that the content or the like is displayed on the medium 21.

  The medium 21 is provided with position markers 22 at four corners so that the position detector 12 can detect the position in this example. The position marker 22 is provided with a marker corresponding to the detection method of the position detection unit 12. For example, a specific color or a reflective tape may be applied, or an LED or a light bulb may be emitted. Furthermore, in the detection method for performing image recognition, it is sufficient that a specific shape is provided, and a part of the medium 21 can be used as the position marker 22 without providing the position marker 22 again.

  Further, the positions where the position markers 22 are provided need not be provided at the four corners as shown, and may be provided at predetermined positions. FIG. 2 is an explanatory diagram of another example of the medium 21. In the figure, reference numeral 23 denotes a power supply unit. For example, when the power supply unit 23 for supplying power to the medium 21 is provided, the position marker 22 may be provided in the power supply unit 23 as shown in FIG. Similarly, when there is a configuration added to the medium 21, for example, when an interface is provided on the medium 21, the position marker 22 can be added to the added configuration. In such a configuration, it is not necessary to provide the position marker 22 on the medium 21 itself, so that the structure of the medium 21 can be simplified.

  Further, since the position marker 22 is used when the medium 21 is used together with the display unit 11, it is not necessary when the medium 21 is used alone. Therefore, for example, when the position marker 22 is detachably used with the display unit 11, the position marker 22 may be used by being attached to the medium 21.

  When a plurality of media 21 are used, it is necessary to specify the position of each medium 21. Therefore, for example, the position marker 22 can be configured to be different for each medium 21. For example, changing the color, changing the reflection frequency (reflection color), changing the emission color, the frequency of blinking, or the amount of light fluctuation when using an illuminant such as an LED, etc. Various methods are conceivable, such as changing the partial shape of 21. This can be used as the ID of each medium 21, and the position of each medium 21 can be specified and the displayed content can be associated.

  Some specific examples of the position marker 22 provided on the position detection unit 12 and the medium 21 described above are shown. FIG. 3 is an explanatory diagram of a configuration example in which an optical detection unit is used as the position detection unit 12. In this example, detection means for optically detecting positions are provided at two corners of the display unit 11. By detecting the amount of light from the position marker 22 in these two detection means, the position of the display unit 11 on the display plane can be detected. In this case, as the position marker 22, a light emitter or a reflective marker can be used. When a reflective marker is used, a specific light source may be prepared, and the position detection unit 12 may receive light from the light source reflected by the reflective marker. As such a position detection means, for example, a configuration described in JP-A-2002-14763 can be used.

  FIG. 4 is an explanatory diagram of a configuration example in which the position detection unit 12 is provided at four corners. As shown in FIG. 4, the position detector 12 may be provided at four corners (or three corners). Here, as an example, a detector capable of detecting electromagnetic intensity is provided as the position detection unit 12. Further, as the position marker 22, an element that performs electromagnetic communication such as an RFID tag is provided. The reception intensity at the position detection unit 12 varies depending on the distance from each position detection unit 12 to the RFID tag. By utilizing this, the position of the RFID tag can be obtained by calculation from the received intensity at each position detection unit 12. The reception intensity is obtained as a numerical value, and the position of the position marker 22 is specified from the threshold value that can detect the electromagnetic wave from the RFID tag and the detection order between the position detection units 12 by increasing and decreasing the reception sensitivity of the position detection unit 12 Can do.

  FIG. 5 is an explanatory diagram of a configuration example in which the position detection unit 12 is arranged on the display screen of the display unit 11. For example, a position detection method used in a touch panel, a digitizer, or the like can be used as the position detection unit 12. For example, in the case of an electrostatic type, a metal piece may be used as the position marker 22 and electrically connected to the user's hand. Moreover, if it is a piezoelectric type, the position marker 22 should just be provided with the part which a user can press the position detection part 12 (surface of the display part 11) with the medium 21. FIG. Furthermore, if it is a magnetostriction type, a magnet may be provided as the position marker 22. Furthermore, similarly to the case described with reference to FIG. 4, an RFID tag may be used as the position marker 22, and electromagnetic detection means may be two-dimensionally arranged as the position detection unit 12.

  Of course, the examples shown in FIGS. 3 to 5 are merely examples, and the position detection unit 12 and the corresponding position marker 22 are not limited to these, and various known methods can be applied.

  Next, an example of the operation in the first exemplary embodiment of the present invention will be described using some specific examples. FIG. 6 is an explanatory diagram showing an example of an operation when the content displayed on the display unit is transferred to the medium in the first embodiment of the present invention. In the example illustrated in FIG. 6, the display unit 11 is a computer display, and the content is transferred to the medium 21 by holding the medium 21 over the display screen of the display. Note that the medium 21 is optically writable electronic paper.

  In FIG. 6A, an image is displayed on the display unit 11. The medium 21 is placed over the display screen of the display unit 11 as shown in FIG. Then, the position of the position marker 22 added to the medium 21 is detected by the position detector 12 (in this example, sensors are provided on the upper left and right of the display screen). This makes it possible to detect the position, angle, front and back, etc. of the medium 21, and to detect what area the display area of the medium 21 corresponds to on the display screen of the display unit 11. At this time, for example, the state of the medium 21 can also be detected, for example, the front and back of the medium 21 are reversed. If the medium 21 is not in the correct state, control can be performed so that subsequent processing cannot be performed. it can.

  Here, for example, when the user instructs writing on the medium 21, power is supplied to the medium from the power supply unit 23 of the medium 21, and the content displayed on the display screen of the display unit 11 is transmitted to the medium 21 by the display light. Written. Alternatively, the user may instruct the control unit 13 and the control unit 13 may instruct the medium 21 to write. Further, at the time of writing, the control unit 13 controls the display unit 11 to display a display image optimal for writing to the medium 21 in at least the display region of the display unit 11 that overlaps the display region of the medium 21. Also good.

  In this way, as shown in FIG. 6C, the image of the part where the medium 21 overlaps the display area of the display unit 11 is transferred to the medium 21. After the transfer, the image is maintained as it is due to the characteristics of the medium 21. In addition, by such writing, the medium 21 and the content written on the medium 21 can be associated with each other.

  FIG. 7 is an explanatory diagram of a display example of the display unit 11 after the content displayed on the display unit is transferred to the medium in the first embodiment of the present invention. In the example illustrated in FIG. 6C, the display on the display unit 11 is not changed even after the image of the area overlapping the medium 21 on the display unit 11 is transferred to the medium 21. However, the present invention is not limited to this, and the image of the display area transferred to the medium 21 can be erased simultaneously with the transfer. At this time, for example, after the transfer to the medium 21 as shown in FIG. 7A, the display area transferred to the medium 21 is displayed in a color different from the background or a frame is displayed as shown in FIG. 7B. can do. In FIG. 7, the background portion is shown in white, and the transfer portion to the medium 21 is hatched. Further, it can be gradually changed to a background image, and after a certain amount of time, it can be a background image as shown in FIG. By adopting such a display method, it is possible to visually confirm the act of transcription to the user.

  FIG. 8 is an explanatory diagram of another example of the operation when the content displayed on the display unit is transferred to the medium in the first embodiment of the present invention. The example shown in FIG. 8 is substantially the same as the example shown in FIG. 6, but shows a case where the content displayed on the display unit 11 is written after being matched with the size of the display area of the medium 21.

  Similar to the example illustrated in FIG. 6, the medium 21 is held over the display screen of the display unit 11 while an image is displayed on the display unit 11 as illustrated in FIG. Then, the position of the position marker 22 added to the medium 21 is detected by the position detection unit 12, and the position, angle, front and back, etc. of the medium 21 are detected. Thereby, it is possible to detect what area the display area of the medium 21 corresponds to on the display screen of the display unit 11.

  Here, for example, when the user instructs the control unit 13 to write, the control unit 13 converts the content displayed on the display unit 11 and to be written on the medium 21 into the size of the display area of the medium and converts the converted content to the medium. It is displayed on the display area of the display unit 11 corresponding to the 21 display areas. At the same time, power is supplied to the medium from the power supply unit 23 of the medium 21, and the content displayed on the display screen of the display unit 11 is written to the medium 21 by the display light. When the user instructs the medium 21 to write, the content can be similarly written to the medium 21 by transmitting the instruction to the control unit 11.

  In this way, as shown in FIG. 8B, the entire content displayed on the display unit 11 is converted in accordance with the display area of the medium 21 and transferred to the medium 21. After the transfer, the image is maintained as it is due to the characteristics of the medium 21. In addition, by such writing, the medium 21 and the content written on the medium 21 can be associated with each other.

  Even in this example, after the content is transferred to the medium 21 as described with reference to FIG. 7, the content displayed on the display unit 11 may be controlled to be erased. Further, at the time of erasing, display control such as changing the display form for a certain amount of time for the erased area is also possible.

  FIG. 9 is an explanatory diagram of another example of the operation when the content displayed on the medium is transferred to the display unit in the first embodiment of the present invention. In the example shown in FIG. 9, the content displayed on the medium 21 is displayed on the display screen of the display unit 11, contrary to the examples of FIGS. 6 and 8 described above. For example, when content or the like is written on the medium 21 as in the examples shown in FIGS. 6 and 8, the medium 21 can be associated with the written content. It can be saved in memory.

  As shown in FIG. 9A, the medium 21 on which content or the like is written is held over the display unit 11 as shown in FIG. 9B. Then, the position detection unit 12 detects the position marker 22 provided on the medium 21 and detects the position and angle of the medium 21 and other states. At this time, for example, if the position marker 22 is made different for each medium 21, the medium 21 can be specified.

  If the medium 21 can be identified, the content or the like previously written on the medium 21 can be found from the correspondence between the medium 21 stored at the time of writing and the written content or the like. This content or the like is displayed at a position on the display screen of the display unit 11 over which the medium 21 is placed (an area corresponding to the display area of the medium 21). In this way, the content displayed on the medium 21 can be transferred to the display unit 11.

  In the above description, the medium 21 is specified by the position marker 22. Of course, when only one medium 21 is used, the medium 21 need not be specified. Moreover, the identification method of the medium 21 is not limited to the position marker 22, and various identification methods can be used. For example, when an RFID tag or a barcode for identifying each medium 21 is attached to each medium 21, a means for reading them may be provided separately to identify each medium 21. In that case, it is only necessary to acquire information for specifying the medium 21 at the time of writing the content and associate it with the written content.

  If only a part of the content or the like has been transferred to the medium 21, a part of the corresponding content is cut out and displayed on the display unit 11 during the transfer to the display unit 11. Alternatively, the entire content or the like may be displayed so as to protrude from the area of the display unit 11 corresponding to the display area of the medium 21.

  By using such a writing function to the display unit 11, for example, when the medium 21 is moved on the display screen of the display unit 11, the display position of the display unit 11 can be moved following the movement. . As a result, the user can move the display position of the content or the like by a direct method of actually moving the medium 21 on the display screen, and can determine the display position.

  FIG. 10 is an explanatory diagram of a display example of the medium 21 after the content displayed on the medium is transferred to the display unit in the first embodiment of the present invention. In the example shown in FIG. 9C, after the content displayed on the medium 21 is displayed on the display unit 11, the display on the medium 21 is not changed. However, the present invention is not limited to this, and the display on the medium 21 can be erased after being transferred to the display unit 11. In this case, for example, the medium 21 is held over the display unit 11 as shown in FIG. 10 (A), transferred to the display unit 11 as shown in FIG. 10 (B), and then the medium 21 as shown in FIG. 10 (C). Control to erase the display. For example, when self-rewritable electronic paper is used as the medium 21, the display erasure control of the medium 21 is performed after displaying the transferred image on the display unit 11 as described above. The display of may be deleted. However, in the case of optical writing type electronic paper, since it is necessary to erase the display of the medium 21 by the display light of the display unit 11, display control for erasing the display of the medium 21 is performed on the display unit 11, and thereafter In addition, the content transferred from the medium 21 is controlled to be displayed. In addition, when the display of the medium 21 is erased, the association between the medium 21 and the written content or the like is changed, or when the medium 21 stores the content itself or information for specifying the content, The stored information is also updated.

  In this way, by erasing the display on the medium 21, the user can visually confirm that the content displayed on the medium 21 has been transferred to the display unit 11. If the medium 21 is removed from the display unit 11 after the transfer, the transferred content is displayed on the display unit 11 as shown in FIG. Further, the display on the medium 21 remains erased. Also in this example, similarly to the example shown in FIG. 7 described above, the display form of the display area transferred to the display unit 11 is temporarily changed to allow the user to visually confirm that the transfer has been performed. Display control can be performed as described above.

  FIG. 11 is an explanatory diagram showing an example of transfer to the display unit when a plurality of media are arranged in a stacked manner in the first embodiment of the present invention. As described with reference to FIG. 9, the content displayed on the medium 21 can be transferred and displayed on the display unit 11, but when a plurality of media 21 are used, the degree of overlap between them is determined. It is desirable to display on the display unit 11. FIG. 11 shows such an example.

  Here, it is assumed that the four media 21-1 to 21-4 shown in FIGS. 11A to 11D are overlapped and held over the display unit 11 as shown in FIG. As a method of specifying each medium 21, various methods can be adopted as described with reference to FIG. For example, when the position markers 22 are provided at the four corners of each of the media 21-1 to 21-4, the overlapping state is determined using the fact that a part of the position marker 22 of the medium that has been lowered due to the overlap cannot be detected. be able to. That is, the uppermost medium 21-4 can be detected by the four position markers 22 at the four corners, but in the lower mediums 21-1 to 21-3, which are partially overlapped, one or two position markers 22 are upper. Hidden in the medium. Further, if there is a portion that is not hidden even at only one corner, the position marker 22 can be detected, and if the size of the medium is known, it can be determined where the corner is hidden.

  For example, the medium 21-3 cannot detect the upper right position marker 22, but can detect the other three position markers 22, and can also estimate the position of the upper right position marker 22. Since the position where the upper right position marker 22 is estimated is an area where the medium 21-4 exists, it can be seen that the medium 21-3 is overlapped under the medium 21-4. In this way, the overlap can be determined for each of the media 21-1 to 21-4.

  When the overlap of the media 21-1 to 4 can be detected in this way, the contents displayed on the respective media 21-1 to 4 may be displayed on the display unit 11 in accordance with the overlap. Thereby, a display screen of the display unit 11 as shown in FIG.

  FIG. 12 is a block diagram showing a second embodiment of the present invention. In the figure, the same parts as those in FIG. 14 is an information acquisition unit, and 24 is a storage unit. In the second embodiment, the storage unit 24 is provided in the medium 21, and an information acquisition unit 14 that stores information in the storage unit 24 and acquires information stored in the storage unit 24 is provided. This is different from the first embodiment.

  A storage unit 24 having both an information storage function and a communication function can be mounted on the medium 21 like the RFID tag described in the above-described examples. In this embodiment, it is assumed that the storage unit 24 not only holds fixed information such as a medium ID but also allows information to be rewritten. As for the communication function, the storage unit 24 itself may have a function of performing communication like the above-described RFID tag. For example, when the position marker 22 is configured by an LED, the LED is used. The communication unit may be provided in the medium 21 separately. Correspondingly, the information acquisition unit 14 can also be configured to have communication means corresponding to the communication function of the medium 21 or share a part of the function of the position detection unit 12.

  In such a configuration, various types of information can be stored in the storage unit 24 of the medium 21. One of them is to store an ID for specifying the medium 21 described above. Furthermore, the content itself displayed on the medium 21 or specific information for specifying the content can be stored. In the first embodiment described above, when content is written on the medium 21 in advance, the medium 21 is associated with the content and the information is stored. However, if the storage unit 24 provided in the medium 21 is used, the association with the content may not be stored in the control unit 13, and the medium 21 may be held even when it is held over a different display unit 11. It is possible to specify the content displayed on the screen.

  FIG. 13 is an explanatory diagram showing an example of an operation when the content displayed on the display unit is transferred to a medium in the second embodiment of the present invention. In the figure, reference numerals 15 and 25 denote antennas. In the example illustrated in FIG. 13, communication between the medium 21 and the information acquisition unit 14 is performed using radio waves. For this purpose, an antenna 15 and an antenna 25 on the medium 21 side which are a part of the information acquisition unit 14 are illustrated.

  In a state where an image is displayed on the display unit 11 as shown in FIG. 13A, the medium 21 is held over the display screen of the display unit 11 as shown in FIG. Then, the position detection unit 12 detects the position of the position marker 22 added to the medium 21. As a result, the position, angle, and other states of the medium 21 can be detected, and it can be detected what area the display area of the medium 21 corresponds to on the display screen of the display unit 11.

  Here, for example, when the user instructs writing on the medium 21, the content displayed on the display screen of the display unit 11 is written on the medium 21 as described with reference to FIGS. As a result, as shown in FIG. 13C, the image of the portion where the medium 21 overlaps the display area of the display unit 11 is transferred to the medium 21.

  At this time, the information acquisition unit 14 communicates with the medium 21, sends the content itself written in the medium 21 or specific information for specifying the content to the medium 21 and stores it in the storage unit 24 in the medium 21. . The identification information may be any information as long as the information can identify the content, such as a content file name or an address (URL). For example, when a part of the content is cut out and written on the medium 21 and displayed, information on the cut-out area is also stored in the storage unit 24. In addition, various types of information such as the date and time of writing and the device ID that performed the writing may be stored in the storage unit 24 of the medium 21.

  Note that content can be displayed on the medium 21 by the display light of the display unit 11 as in the examples shown in FIGS. 6 and 8 described above when the medium 21 is optical writing type electronic paper. However, in the case of the medium 21 such as self-rewritable electronic paper, the content to be displayed on the medium 21 is transferred from the information acquisition unit 14 to the medium 21 using the communication function between the information acquisition unit 14 and the medium 21. And writing on the medium 21 can be performed. Alternatively, for example, when the medium 21 is a medium 21 having a more advanced communication function, such as a communication function of a mobile phone or a PDA, the information acquisition unit 14 uses only specific information for specifying content. It is also possible to transfer to the medium 21 so that the medium 21 acquires and displays the content from the outside through a network, for example, according to the specific information.

  FIG. 14 is an explanatory diagram of another example of the operation when the content displayed on the medium is transferred to the display unit in the second embodiment of the present invention. In the example shown in FIG. 14, the content displayed on the medium 21 is displayed on the display screen of the display unit 11, contrary to the example of FIG. 13 described above. For example, when content or the like is written on the medium 21 as described above with reference to FIG. 13, the content itself or specific information for specifying the content is stored in the storage unit 24.

  As shown in FIG. 14A, the medium 21 on which content or the like is written is held over the display unit 11. Then, the position detection unit 12 detects the position marker 22 provided on the medium 21 and detects the position and angle of the medium 21 and other states. At this time, the information acquisition unit 14 communicates with the medium 21 and acquires the content itself displayed on the medium 21 or specific information for specifying the content. When the content itself is acquired, the acquired content is displayed in the area of the display screen of the display unit 11 where the medium 21 is held. Alternatively, when specific information is acquired from the medium 21, the content is acquired according to the specific information, and similarly, the content is displayed in an area of the display screen of the display unit 11 where the medium 21 is held. The content may be acquired from the outside through, for example, a network in addition to reading the content stored in the system. In this way, the content displayed on the medium 21 is transferred to the display unit 11 as shown in FIG.

  When the content displayed on the medium 21 is transferred to the display unit 11 in this way, what content is displayed on the medium 21 by the control unit 13 as in the first embodiment described above. There is no need to know in advance. Therefore, for example, the content written on the medium 21 by the first display unit can be transferred to another second display unit.

  As in the example described with reference to FIG. 11 described above, even when a plurality of media 21 are held over each other, they are written to the respective media 21 by communicating with the respective media 21. The content itself can be acquired, or specific information can be acquired to access the content, and the overlap can be determined and displayed on the display unit 11 as shown in FIG.

  Furthermore, using such a transfer function to the display unit 11, for example, it is possible to display the content on the display unit 11 by moving the medium 21, and various other modifications in the first embodiment. The same can be done in the second embodiment.

  FIG. 15 is an explanatory diagram of an application example of the present invention, and FIG. 16 is a plan view showing an example of the operation state. In the figure, 31 is a table, 32 is a projector, and 33 is a transmission / reception unit. In this application example, an example in which the display unit 11 is configured by a table 31 and a projector 32 is shown. This is a kind of projection type display device that projects a display image from the back of the top plate of the table 31 by the projector 32. Position detection units 12 are provided at the four corners of the table 31, and a transmission / reception unit 33 for performing communication with the medium 21 is provided around the table 31, and functions as a part of the information acquisition unit 14.

  In such a configuration, as described in the first or second embodiment, the content displayed on the table 31 is transferred to the medium 21, and the content displayed on the medium 21 is transferred. The image can be transferred to the display surface of the table 31. This state is shown in FIG. A thick frame indicates the medium 21, and a thin frame indicates the content transferred to the display surface of the table 31 or transferred to the medium 21. For example, the same content is displayed at a plurality of positions such as the content indicated by “A”, or overlapping display such as the content indicated by “D”, “E”, and “F” is also displayed on the medium 21. This can be done depending on the overlap. Furthermore, contents such as “X”, “Y”, and “Z” are contents displayed only on the table 31. For example, it is possible to make corrections on the display surface of the table 31, and various conventionally developed techniques such as a touch panel or digitizer technique or a handwriting tracking technique based on image recognition can be applied.

  Using such a table 31, the medium 21 can be placed on the table 31 and transferred from the display surface of the table 31 to the medium 21, or conversely, transfer from the medium 21 to the display surface of the table 31 can be performed. Information can be transferred between the two contents in a visualized state. Content can be arranged by a direct operation of placing the medium at a position where the medium is to be displayed. Therefore, it is possible to provide a user interface that is very easy for the user to understand.

  Using such a table-type display unit 11, for example, information search and information arrangement are performed on a large screen, and the arranged information is transferred to the medium 21. Furthermore, it is possible to extract desired information by rearranging or selecting the media 21 or to grasp the tendency of the information. Furthermore, when the medium on which information is transferred is brought close to a display of another computer, a mobile device, a PDA information terminal, a projector, a digital TV, or a printer, the content displayed on the medium 21 is displayed or printed on the device. Can be made.

  In the large screen configuration such as the table type shown in the figure, a plurality of users can work on the same display screen, and for example, information can be directly handled by the medium 21 while holding a meeting or the like.

  Here, an example of the table-type display unit 11 is shown, and the first and second embodiments described above are described assuming a computer display or the like, but the present invention is not limited to these, The present invention can be applied to various devices as described above. Further, the medium 21 is not limited to electronic paper, and devices having any display function such as a mobile phone, a PDA, and a digital camera can be used as the medium.

It is a block diagram which shows the 1st Embodiment of this invention. 11 is an explanatory diagram of another example of the medium 21. FIG. It is explanatory drawing of the structural example using an optical detection means as the position detection part. It is explanatory drawing of the structural example which provided the position detection part 12 in four corners. 3 is an explanatory diagram of a configuration example in which a position detection unit 12 is arranged on a display screen of a display unit 11. FIG. It is explanatory drawing of an example of the operation | movement at the time of transferring the content currently displayed on the display part to a medium in the 1st Embodiment of this invention. It is explanatory drawing of the example of a display of the display part 11 after transcribe | transferring the content currently displayed on the display part to the medium in the 1st Embodiment of this invention. It is explanatory drawing of another example of operation | movement at the time of transferring the content currently displayed on the display part to a medium in the 1st Embodiment of this invention. It is explanatory drawing of another example of operation | movement at the time of transferring the content currently displayed on the medium in the 1st Embodiment of this invention to a display part. It is explanatory drawing of the example of a display of the medium after transferring the content currently displayed on the medium in the 1st Embodiment of this invention to the display part. It is explanatory drawing of an example of the transcription | transfer to a display part when the some medium is arrange | positioned in piles in the 1st Embodiment of this invention. It is a block diagram which shows the 2nd Embodiment of this invention. It is explanatory drawing of an example of the operation | movement at the time of transferring the content currently displayed on the display part to a medium in the 2nd Embodiment of this invention. It is explanatory drawing of another example of operation | movement at the time of transferring the content currently displayed on the medium in the 2nd Embodiment of this invention to a display part. It is explanatory drawing of the example of application of this invention. It is a top view which shows an example of the operation state in the application example of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 11 ... Display part, 12 ... Position detection part, 13 ... Control part, 14 ... Information acquisition part, 15 ... Antenna, 21 ... Medium, 22 ... Position marker, 23 ... Power supply part, 24 ... Memory | storage part, 25 ... Antenna, 31 ... Table, 32 ... Projector, 33 ... Transmission / reception unit.

Claims (16)

  1. A detection unit that detects a position and a state of a medium having optical writing and image display functions; and a region corresponding to a display area of the medium on a display screen of the display unit according to a detection result by the detection unit. Control means for displaying the display content to be displayed on the medium in the area in accordance with the size of the area and changing the display content of the medium by the image display function on the medium by the display light of the display means. An information display system characterized by that.
  2. The medium is provided with a marker for detection by the detection unit, and the detection unit detects a marker applied to the medium to detect a position and a state of the medium. The information display system according to claim 1.
  3. The medium is provided with power supply means for the image display function, and the power supply means is provided with a marker to be detected by the detection means. The information display system according to claim 1, wherein a marker attached to the power supply unit is detected to detect the position and state of the medium.
  4. The medium is provided with electromagnetic communication means as a marker to be detected by the detection means, and the detection means detects the electromagnetic signal intensity from the marker and detects the position of the medium. The information display system according to claim 1, wherein a state is detected.
  5. The information display according to claim 1, wherein the detection unit is provided in a two-dimensional manner on the display unit, and detects the medium or a marker provided on the medium as two-dimensional position information. system.
  6. The display means can display a plurality of display contents overlapping each other, and the control means specifies one or more display contents from among the plurality of display contents displayed on the display means according to the position of the medium. The information display system according to claim 1, wherein the specified display content is displayed by the image display function of the medium.
  7. The information display system according to any one of claims 1 to 6, wherein the control unit erases the display of the display area on the display unit used for changing the display content of the medium. .
  8. The information display system according to claim 7, wherein the control unit temporarily causes the display area from which the display on the display unit is erased to be displayed differently from the background.
  9. Detection is performed by a detection unit that detects the position and state of a medium having optical writing and image display functions, and the control unit displays the medium on the display screen of the display unit in an area corresponding to the display area of the medium according to the detection result. An information display method characterized in that display content is displayed in accordance with the size of the area, and display content by the image display function of the medium is changed by the display light of the display means on the medium.
  10. 10. The medium is provided with a marker to be detected by the detecting means, and detects the position and state of the medium by detecting the marker applied to the medium. Information display method described in 1.
  11. The medium is provided with power supply means for the image display function, and the power supply means is provided with a marker for detection by the detection means, and is applied to the power supply means of the medium. The information display method according to claim 9, wherein the marker is detected to detect a position or a state of the medium.
  12. The medium is provided with electromagnetic communication means as a marker to be detected by the detection means, and detects the position and state of the medium by detecting the electromagnetic signal intensity from the marker. The information display method according to claim 9.
  13. The information display according to claim 9, wherein the detection unit is provided two-dimensionally on the display unit, and detects the medium or a marker provided on the medium as two-dimensional position information. Method.
  14. A plurality of display contents can be displayed in an overlapping manner on the display means, and one or more display contents are specified from among the plurality of display contents displayed on the display means according to the position of the medium, and the specified display The information display method according to claim 9, wherein the display content of the image display function of the medium is changed according to the content.
  15. 15. The display of the display area on the display means used for changing the display content is deleted after changing the display content of the medium by the image display function. The information display method according to item 1.
  16. The information display method according to claim 15, wherein a display different from the background is temporarily displayed for a display area in which the display on the display unit is deleted.
JP2003271155A 2003-07-04 2003-07-04 Information display system and information display method Expired - Fee Related JP4618401B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2003271155A JP4618401B2 (en) 2003-07-04 2003-07-04 Information display system and information display method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2003271155A JP4618401B2 (en) 2003-07-04 2003-07-04 Information display system and information display method

Publications (2)

Publication Number Publication Date
JP2005031448A JP2005031448A (en) 2005-02-03
JP4618401B2 true JP4618401B2 (en) 2011-01-26

Family

ID=34209118

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2003271155A Expired - Fee Related JP4618401B2 (en) 2003-07-04 2003-07-04 Information display system and information display method

Country Status (1)

Country Link
JP (1) JP4618401B2 (en)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4971594B2 (en) * 2004-03-31 2012-07-11 キヤノン株式会社 Program and display control device
EP1817088B1 (en) * 2004-11-24 2014-06-25 Koninklijke Philips N.V. Privacy overlay for interactive display tables
JP4622761B2 (en) * 2005-09-13 2011-02-02 富士ゼロックス株式会社 Display recording medium access device
WO2007080651A1 (en) * 2006-01-13 2007-07-19 Fujitsu Limited Information editing device
US7880718B2 (en) 2006-04-18 2011-02-01 International Business Machines Corporation Apparatus, system, and method for electronic paper flex input
JP5521226B2 (en) * 2006-05-25 2014-06-11 富士フイルム株式会社 Display system, display method, and display program
JP4949763B2 (en) * 2006-07-31 2012-06-13 シャープ株式会社 Display device, control method, and program
JP2008242367A (en) 2007-03-29 2008-10-09 Fuji Xerox Co Ltd Display-control device, display device, display system, and program
JP5219926B2 (en) * 2009-06-01 2013-06-26 キヤノン株式会社 Data selection apparatus, control method thereof, and program
JP2011033807A (en) * 2009-07-31 2011-02-17 Canon Inc Display control system, control method thereof and program
JP5669425B2 (en) * 2010-04-19 2015-02-12 キヤノン株式会社 Display control apparatus and control method thereof
JP5516074B2 (en) * 2010-05-26 2014-06-11 大日本印刷株式会社 User interface system
JP5655515B2 (en) * 2010-11-11 2015-01-21 ソニー株式会社 Information processing apparatus, table, display control method, program, portable terminal, and information processing system
CA2817823C (en) * 2011-06-22 2019-05-07 International Business Machines Corporation Mobile touch-generating device and communication with a touchscreen
JP5681840B2 (en) * 2011-11-11 2015-03-11 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation Movable touch generation device, system, communication method, and computer program medium (movable as a safety loupe for touch panel devices
JP5974461B2 (en) * 2011-11-28 2016-08-23 コニカミノルタ株式会社 Electronic conference support device, electronic conference system, display device, image forming device, control method for electronic conference support device, and control program for electronic conference support device
JP5884444B2 (en) * 2011-11-28 2016-03-15 コニカミノルタ株式会社 Electronic conference support device, electronic conference system, display device, terminal device, image forming device, control method for electronic conference support device, and control program for electronic conference support device
TWI512547B (en) * 2011-12-20 2015-12-11 Univ Nat Chiao Tung Interactive system and interactive device
JP2013130982A (en) * 2011-12-21 2013-07-04 Sharp Corp Information display device
JP2015092304A (en) * 2012-02-24 2015-05-14 パナソニック株式会社 Information display device
JP5912810B2 (en) * 2012-04-25 2016-04-27 シャープ株式会社 Display system and display program
JP2012252356A (en) * 2012-08-10 2012-12-20 Fuji Xerox Co Ltd Display control device, display system and program
JP5966861B2 (en) * 2012-10-30 2016-08-10 コニカミノルタ株式会社 Image capturing device, image capturing method, and image capturing program
US9753534B2 (en) 2012-11-09 2017-09-05 Sony Corporation Information processing apparatus, information processing method, and computer-readable recording medium
JP6248687B2 (en) * 2014-02-20 2017-12-20 富士通株式会社 Information processing apparatus, menu selection program, and menu selection method
JP6044676B2 (en) * 2014-06-17 2016-12-14 キヤノンマーケティングジャパン株式会社 Information processing apparatus, control method and program thereof, and information processing system, control method and program thereof
JP6417787B2 (en) * 2014-08-22 2018-11-07 株式会社リコー Display device, transmission system, and transmission method
JP5999236B2 (en) * 2014-09-12 2016-09-28 キヤノンマーケティングジャパン株式会社 Information processing system, its control method, and program, and information processing device, its control method, and program
JP6103025B2 (en) * 2014-12-22 2017-03-29 キヤノンマーケティングジャパン株式会社 Information processing apparatus, control method thereof, and program

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0981475A (en) * 1995-09-18 1997-03-28 Toshiba Corp Information terminal equipment
JPH10171620A (en) * 1996-12-06 1998-06-26 Hitachi Ltd Electronic paper
JP2002244583A (en) * 2001-02-14 2002-08-30 Mitsubishi Heavy Ind Ltd Paper display device and display system
JP2003005149A (en) * 2001-06-26 2003-01-08 Fuji Xerox Co Ltd Method and device for image writing
JP2003150100A (en) * 2001-11-09 2003-05-21 Konica Corp Sheet type display medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0981475A (en) * 1995-09-18 1997-03-28 Toshiba Corp Information terminal equipment
JPH10171620A (en) * 1996-12-06 1998-06-26 Hitachi Ltd Electronic paper
JP2002244583A (en) * 2001-02-14 2002-08-30 Mitsubishi Heavy Ind Ltd Paper display device and display system
JP2003005149A (en) * 2001-06-26 2003-01-08 Fuji Xerox Co Ltd Method and device for image writing
JP2003150100A (en) * 2001-11-09 2003-05-21 Konica Corp Sheet type display medium

Also Published As

Publication number Publication date
JP2005031448A (en) 2005-02-03

Similar Documents

Publication Publication Date Title
US7131061B2 (en) System for processing electronic documents using physical documents
KR880000488B1 (en) Blackboard
US6943779B2 (en) Information input/output apparatus, information input/output control method, and computer product
US6992655B2 (en) Input unit arrangement
JP4188920B2 (en) Optical system and input device for computing input device
RU2669717C2 (en) Handbook input / output system, digital ink sheet, information intake system and sheet supporting information input
US8638984B2 (en) Display of results of a measurement of workpieces as a function of the detection of the gesture of a user
US8493601B2 (en) Techniques for performing actions based upon physical locations of paper documents
US7317557B2 (en) Paper-to-computer interfaces
EP2261793A2 (en) Method for transmitting content with intuitively displayed content transmission direction and device using the same
US5742279A (en) Input/display integrated information processing device
JP2008516292A (en) Easy copy between electronic paper and display
EP1256049B1 (en) Method and system for using an electronic reading device on non-paper devices
US6232962B1 (en) Detector assembly for use in a transcription system
JP2005196795A (en) Computing input device and computing system
US20030051615A1 (en) Method and system for position-aware freeform printing within a position-sensed area
JP5521226B2 (en) Display system, display method, and display program
EP1275081B1 (en) Method and system for information association
US20010050669A1 (en) Handwriting communication system and handwriting input device used therein
KR20150025452A (en) Method for processing data and an electronic device thereof
EP0622722B1 (en) Interactive copying system
US20060139338A1 (en) Transparent optical digitizer
EP0498082B1 (en) Apparatus for the interactive handling of objects
US6111565A (en) Stylus for use with transcription system
KR20140010596A (en) Control method for terminal using touch and gesture input and terminal thereof

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20060622

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20091228

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20100203

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20100402

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20100818

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20100907

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20100929

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20101012

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20131105

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees