JP2012195730A - Information provision device, projector, image display device, image display system, and image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a projector and the like that are capable of providing information with which a past additional image can be displayed.SOLUTION: A projector 100 includes: an information generation unit 140 that generates additional information 126 which indicates an additional image added to a presentation image and is associated with a state of the presentation image; and a communication unit 110 that transmits the additional information 126 to an image display device capable of displaying the presentation image to which the additional image is added based on the additional information 126.

Description

  The present invention relates to an information providing device, a projector, an image display device, an image display system, and an image display method.

  In Japanese Patent Application Laid-Open No. 2010-122263, real-time image data such as presentation materials prepared in advance includes additional information such as a pointer image indicating a position indicated by a remote controller (remote controller) or a mouse, a handwritten image such as an underline. A client that captures real-time video including additional images and displays the browser on the client PC terminal only when a display request is received from the client PC terminal for the purpose of providing a projector capable of displaying a clear video It describes creating a browser display file.

JP 2010-122263 A

  However, in the case of the method disclosed in Japanese Patent Application Laid-Open No. 2010-122263, it is difficult to confirm an additional image displayed in the past. For example, if a student is taking a lesson and the next document is displayed while writing in a notebook, the next document and an image showing a new additional image can be checked using the above method. However, it is not possible to confirm the previous material to be confirmed and the additional image corresponding to the material.

  Some aspects according to the present invention provide an information providing apparatus, a projector, or the like that can provide information capable of displaying a past additional image by solving the above-described problems, or a past An image display device, an image display system, and an image display method capable of displaying the additional image are provided.

  An information providing apparatus according to one aspect of the present invention includes an information generation unit that generates an additional information that indicates an additional image added to a presentation image and is associated with a state of the presentation image, and the additional information includes: A providing-side communication unit that transmits the presentation image to which the additional image is added based on the additional information to an image display device capable of displaying the presentation image.

  According to another aspect of the present invention, a projector includes the information providing apparatus and a projection unit that projects the presentation image.

  In addition, an image display device according to one aspect of the present invention includes a display-side communication unit that receives additional information indicating an additional image associated with a state of a presentation image, a display-side reception unit that receives a selection regarding the state, A display-side image generation unit that generates the presentation image to which the additional image is added in a state according to the selection based on presentation data indicating the presentation image and the additional information according to the selection; And a display unit for displaying a presentation image.

  According to another aspect of the present invention, an image display system includes the information providing apparatus and the image display apparatus.

  An image display method that is one aspect of the present invention is an image display method in which an information providing device provides information to an image display device, and the plurality of image display devices display an image based on the information. The information providing device generates additional information indicating the additional image added to the presentation image and associated with the state of the presentation image, and the additional image is generated based on the additional information. The added presentation image is transmitted to the image display device capable of displaying, and the image display device receives the additional information from the information providing device, accepts a selection regarding the state, and displays the presentation image. On the basis of the presentation data indicating the above and the additional information according to the selection. It generates the presentation image on which the image is added, and displaying the presentation image.

  According to the present invention, the information providing apparatus or the like transmits the additional information associated with the state of the presentation image to the image display apparatus capable of displaying the presentation image to which the additional image is added based on the additional information. By doing this, it is possible to provide information capable of displaying past additional images. Further, according to the present invention, the image display device can generate and display a presentation image to which an additional image is added in a state in accordance with the selection, and thus can display a past additional image.

  The information generation unit may generate the additional information based on an operation history related to the change of the additional image. According to this, since the information providing apparatus or the like can provide the additional information in a state in which the change of the additional image is reflected, the image display apparatus can display an image reflecting the change.

  Further, the information generation unit may generate state information indicating the state based on an operation history related to the state change. According to this, since the information providing device or the like can generate additional information in a state in which the change of the state is reflected and provide the additional information according to the state, the image display device reflects the change. Displayed images can be displayed.

  The information providing apparatus may include a providing side receiving unit that receives an operation, and an operation history generating unit that generates the operation history according to the operation received by the providing side receiving unit. According to this, since the information providing apparatus or the like can generate the latest operation history, the latest additional information corresponding to the operation history can be provided to the image display apparatus.

It is a figure which shows the image display condition in a 1st Example. It is a functional block diagram of the projector in a 1st Example. FIG. 2 is a hardware block diagram of the projector in the first embodiment. It is a functional block diagram of PC in a 1st Example. It is a flowchart which shows the image projection procedure of the projector in a 1st Example. It is a flowchart which shows the image display procedure of PC in a 1st Example. It is a figure which shows an example of the presentation image at the predetermined time in a 1st Example. It is a figure which shows an example of the presentation image in the time before the predetermined time in a 1st Example.

  Hereinafter, an embodiment in which the present invention is applied to an image display system using a projector and a PC will be described with reference to the drawings. In addition, the Example shown below does not limit the content of the invention described in the claim at all. In addition, all the configurations shown in the following embodiments are not necessarily essential as means for solving the invention described in the claims.

(First embodiment)
FIG. 1 is a diagram illustrating an image display state in the first embodiment. Here, it is assumed that a plurality of PCs (image display apparatuses) 200-1 to 200-3 and the projector 100 are connected wirelessly via the access point 300 in the classroom. The projector 100 is a short focus type, and projects the presentation image 20 onto the screen 10 while being attached to the wall with the metal fitting 30. The teacher selects a desired icon from the menu image 22 on which a plurality of icons are displayed with the electronic pen 50 and operates the electronic pen 50 to add characters, lines, and the like to the presentation image 20 projected on the screen 10. Draw an image. The projector 100 captures the screen 10 to generate an operation history of the electronic pen 50 related to a change in the display state and a change in the additional image, and generates information indicating the additional image based on the operation history in association with the state. Information is distributed to the PC 200. The PC 200 can display an image including an additional image based on the information. Next, functional blocks of the projector 100 and the PC 200 having such functions will be described.

  FIG. 2 is a functional block diagram of the projector 100 according to the first embodiment. The projector 100 includes an information providing apparatus 102 that generates a presentation image 20 and distributes information to the PC 200, and a projection unit 190 that projects the presentation image 20. The information providing apparatus 102 includes a providing-side communication unit 110 having a wireless communication function, a providing-side storage unit 120, an operation history generating unit 130, an information generating unit 140, and a providing-side receiving unit 150 having an imaging function. And an image generating unit 160 on the providing side. The storage unit 120 also includes presentation data 122 for generating the presentation image 20 and the menu image 22, an operation history 124 generated by the operation history generation unit 130, additional information 126 generated by the information generation unit 140, and state information. 128 and the like are stored.

  The projector 100 may function as each of these units using the following hardware. FIG. 3 is a hardware block diagram of the projector 100 according to the first embodiment. For example, the communication unit 110 is the wireless communication unit 910, the storage unit 120 is the RAM 920, the flash ROM 922, the operation history generation unit 130, the information generation unit 140 is the CPU 930, the reception unit 150 is the CMOS sensor 950, and the image generation unit 160. The image processing circuit 960 and the like, and the projection unit 190 may be a lamp driving circuit 990, a lamp 991, an illumination optical system 992, a liquid crystal driving circuit 993, a liquid crystal light valve 994, a lens 995, and the like.

  Next, functional blocks of the PC 200 will be described. FIG. 4 is a functional block diagram of the PC 200 in the first embodiment. The PC 200 includes a display-side communication unit 210 having a wireless communication function, a display-side storage unit 220, a control unit 230, a display-side image generation unit 260, and a display unit 290. The storage unit 220 also stores presentation data 222 for generating a presentation image that does not include the menu image 22, additional information 226 received by the communication unit 210, and the like. Since the hardware configuration of the PC 200 is general, the description thereof is omitted.

  Next, a procedure for projecting the presentation image 20 and the like in the projector 100 and the PC 200 will be described. FIG. 5 is a flowchart showing an image projection procedure of the projector 100 in the first embodiment. The accepting unit 150 images the screen 10 every predetermined time (for example, 1 second). The operation history generation unit 130 determines whether there is a writing operation by detecting the position of the infrared light of the electronic pen 50 based on the imaging information (step S1), and if there is a writing operation, based on the imaging information. The operation history 124 is updated (step S2). For example, the operation history generation unit 130 adds information indicating an icon (for example, drawing, erasing, scrolling, etc.) selected in accordance with an icon selection operation in the menu image 22 to the operation history 124, and the electronic pen 50. Information indicating the position of the electronic pen 50 (for example, the position in the captured image, the position on the liquid crystal panel, the relative position from the upper left position of the page, etc.) is added to the operation history 124.

  If there is a writing operation, the information generation unit 140 updates the additional information 126 indicating the additional image in association with the current state based on the operation history 124 and the state information 128 (step S3). For example, if the electronic pen 50 is moved in a state where an icon indicating the drawing of a straight line is selected, the information generating unit 140 determines the type of the straight line (color, line thickness, etc.) and the start point of the straight line. Information indicating the end point is added to the additional information 126.

  Further, the operation history generation unit 130 determines whether or not a scroll operation (for example, page turning operation, page returning operation, etc.) has been performed based on the icon selection operation in the menu image 22 described above (step S4). If there is, the operation history 124 is updated to indicate that there has been a scroll operation (step S5).

  If there is a scroll operation, the information generation unit 140 updates the state information 128 indicating the state (for example, page number) of the presentation image 20 based on the presentation data 122 and the operation history 124 (step S6). For example, the information generation unit 140 updates the status information 128 to indicate that there are 7 pages if a page 6 operation is in progress while a document of 6 pages is being projected, and 5 if there is a page return operation. The status information 128 is updated to indicate that it is a page.

  The image generation unit 160 generates and projects the presentation image 20 based on the presentation data 122, the additional information 126, and the state information 128 (step S7). Communication unit 110 transmits additional information 126 to PC 200 via access point 300 (step S8). The projector 100 determines whether or not there is an end instruction based on the information from the reception unit 150 (step S9). If there is no end instruction, the processing of steps S1 to S9 is continued, and if there is an end instruction, the process ends. To do. Here, it is assumed that the communication unit 110 transmits the additional information 126 every predetermined time (for example, 1 second).

  Next, a presentation image display procedure on the PC 200 will be described. FIG. 6 is a flowchart showing an image display procedure of the PC 200 in the first embodiment. The communication unit 210 receives the additional information 126 from the projector 100 via the access point 300 (step P1), and the control unit 230 updates the additional information 226 according to the additional information 126 (step P2). As described above, the additional information 126 and 226 is associated with the state of the presentation image 20 when the additional information 126 is generated.

  Based on the information from the reception unit 250, the control unit 230 determines whether the user of the PC 200 has performed a selection operation for a page to be displayed (step P3). When there is the selection operation, the image generation unit 260 generates a presentation image based on the additional information 226 corresponding to the selection operation and the presentation data 222 in accordance with a command from the control unit 230, and the display unit 290. Displays the presentation image (step P4).

  On the other hand, when there is no selection operation, the image generation unit 260 generates a presentation image based on the latest additional information 226 and the presentation data 222, and the display unit 290 displays the presentation image (step P5). .

  FIG. 7 is a diagram illustrating an example of the presentation image 400 at a predetermined point in the first embodiment. FIG. 8 is a diagram illustrating an example of the presentation image 401 at a time point before a predetermined time point in the first embodiment. For example, in the case of Step P5, the latest presentation image 400 is displayed. The presentation image 400 is material on the 22nd page, and an additional image 420 added by operating the electronic pen 50 is displayed in addition to the material image 410 showing a bar graph. For example, when there is a selection operation for the 21st page in step P4, the presentation image 401 for the 21st page is displayed. The presentation image 401 is a material on the 21st page, and an additional image 421 added by operating the electronic pen 50 is displayed in addition to the material image 411 showing a pie chart.

  Note that the data indicating the document images 410 and 411 is associated with the page number in advance as presentation data 222 and stored in the storage unit 220, and the data indicating the additional images 420 and 421 is in the state (page number or the like) as additional information 226. And stored in the storage unit 220.

  As described above, according to this embodiment, the projector 100 uses the additional information 126 associated with the state of the presentation image 20 as the presentation images 400 and 401 to which the additional images 420 and 421 are added based on the additional information 126. Can be provided to the PC 200 capable of displaying the information, the information capable of displaying the past additional image 421 can be provided. Further, according to the present embodiment, the PC 200 can generate and display the presentation image 401 to which the additional image 421 is added in a state corresponding to the selection, and thus can display the past additional image 421. . Thereby, a user of the PC 200 (for example, a student or the like) can confirm past writing even when the presentation image 20 of the next page is projected without confirming the content written by the teacher. In addition, it is possible to appropriately cope with forgetting to take notes.

  Further, for example, in the case of a method for distributing a captured image of the screen 10 by a camera or a method for distributing an image obtained by capturing an image being projected, unnecessary information such as the menu image 22 and the electronic pen 50 may be included. In addition, since it is an image, the amount of data during distribution also increases. On the other hand, according to the method of the present embodiment, only the additional information 126 is distributed, so unnecessary information such as the menu image 22 is not included, and the data amount is small.

  In addition, according to the present embodiment, the projector 100 can provide the additional information 126 in a state in which changes in the additional images 420 and 421 and changes in the state are reflected. Presentation images 400 and 401 reflecting the change can be displayed. Further, according to the present embodiment, since the projector 100 can generate the latest operation history 124, the latest additional information 126 corresponding to the latest operation history 124 can be provided to the PC 200.

(Other examples)
In addition, application of this invention is not limited to the Example mentioned above, A deformation | transformation is possible. For example, in the above-described embodiment, the projector 100 distributes the additional information 126 at regular time intervals (real time). However, the additional information 126 may be distributed only when an instruction from the user of the projector 100 is given, or the presentation is performed. The additional information 126 may be distributed only when the state of the image 20 is updated (for example, a page change or the like), or the additional information 126 may be distributed only when an instruction from the user of the PC 200 is given.

  Moreover, the state mentioned above is not limited to a page, For example, the display position (for example, upper left position etc.) by the scroll in the unit of less than 1 page etc. may be sufficient. Further, the image generation unit 260 may generate a thumbnail image based on the presentation data 222 and generate the presentation images 400 and 401 according to the user's selection in a state where the thumbnail image is displayed.

  In the above-described embodiment, the presentation data 122 is stored in the projector 100. However, for example, the presentation data 122 is stored in a PC or a portable information storage medium used by the teacher, and the projector 100 stores the presentation data. The presentation image 20 may be projected based on 122. Similarly, the presentation data 222 may be stored in a portable information storage medium or the like.

  In the above-described embodiment, the reception unit 150 detects the indication position of the electronic pen 50 by imaging. For example, the reception unit 150 detects the indication position of the electronic pen 50 by receiving infrared light or the like from the electronic pen 50. Alternatively, the indicated position may be detected by a pressure-sensitive method or an electrostatic method. Further, the additional images 420 and 421 are not limited to images added by the electronic pen 50, and may be, for example, an image showing writing with an ink pen, chalk, or the like, an image showing a locus with a pen, a finger, or the like.

  Further, the control unit 230 may add information indicating the writing content to the additional information 226 based on the information indicating the writing content by the user of the PC 200 received by the receiving unit 250. According to this, for example, the PC 200 can display a presentation image including the content added uniquely by the student in addition to the content added by the teacher according to the instruction of the student.

  An apparatus capable of mounting the information providing apparatus 102 is not limited to the projector 100, and is a portable information terminal or notebook that accepts handwritten input by a large display having a function of accepting handwritten input on a presentation screen, a whiteboard, an electrostatic method, or the like. It may be a display device such as a mold PC. Further, the image display device is not limited to the PC 200, and may be a mobile phone, a portable information terminal, or the like, for example. The distribution method is not limited to wireless distribution, may be wired distribution, is not limited to distribution in the same room, and may be distribution to a remote place.

  Further, in the above-described embodiment, the single focus type projector 100 fixed to the wall via the metal fitting 30 is used. However, a normal front projection projector and a rear projection projector that are used on the floor or suspended from the ceiling are used. May be used. When used on the floor or the like, the operation history 124 may be updated by drawing characters or the like with a mouse or the like connected to the projector.

  The computer included in the projector 100 may function as the information generation unit 140 by reading a program stored in the information storage medium. The computer included in the PC 200 may function as the image generation unit 260 or the like by reading a program stored in the information storage medium. As such an information storage medium, for example, a CD-ROM, DVD-ROM, ROM, RAM, HDD, or the like can be applied.

  The projector 100 is not limited to a liquid crystal projector (transmission type, reflection type such as LCOS), and may be a projector using a digital micromirror device, for example. The projection unit 190 may employ a self-light emitting element including a solid light source such as an organic EL element, a silicon light emitting element, a laser diode, and an LED instead of the lamp. Further, the function of the projector 100 may be distributed to a plurality of apparatuses (for example, a PC and a projector, a server that functions as the information providing apparatus 102, a projector that does not have the function of the information providing apparatus 102, and the like).

  10 screen, 20, 400, 401 presentation image, 22 menu image, 50 electronic pen, 100 projector, 102 information providing device, 110 communication unit (providing side communication unit), 120 storage unit (providing side storage unit), 122, 222 Presentation data, 124 operation history, 126, 226 additional information, 128 status information, 130 operation history generation unit, 140 information generation unit, 150 reception unit (providing side reception unit), 160 image generation unit (providing side image generation unit), 190 projection unit, 200 PC (image display device), 210 communication unit (display side communication unit), 220 storage unit (display side storage unit), 230 control unit, 250 reception unit (display side reception unit), 260 image generation unit (Display-side image generation unit) 290 Display unit 300 Access point 420 42 Additional image, 910 wireless communication unit, 920 RAM, 922 flash ROM, 930 CPU, 950 CMOS sensor, 960 image processing circuit, 990 lamp driving circuit, 991 lamp, 992 illumination optical system, 993 liquid crystal driving circuit, 994 liquid crystal light valve, 995 lens

Claims (8)

An information generation unit that indicates an additional image added to the presentation image and generates additional information associated with the state of the presentation image;
A providing-side communication unit that transmits the additional information to an image display device capable of displaying the presentation image to which the additional image is added based on the additional information;
An information providing device including: The information providing apparatus according to claim 1,
The information generation unit generates the additional information based on an operation history related to the change of the additional image.
Information providing device. In the information provision apparatus of Claim 1 or Claim 2,
The information generation unit generates state information indicating the state based on an operation history related to the state change.
Information providing device. In the information provision apparatus of any one of Claim 2 or Claim 3,
Providing side accepting part for accepting operation;
An operation history generation unit that generates the operation history in response to the operation received by the provider side reception unit;
An information providing device including: The information providing device according to any one of claims 1 to 4,
A projection unit for projecting the presentation image;
Including projector. A display-side communication unit that receives additional information indicating an additional image associated with the state of the presentation image;
A display-side receiving unit that receives a selection regarding the state;
A display-side image generation unit that generates the presentation image to which the additional image is added in a state according to the selection, based on the presentation data indicating the presentation image and the additional information according to the selection;
A display unit for displaying the presentation image;
An image display device. The information providing device according to any one of claims 1 to 4,
The image display device according to claim 6;
Including image display system. An information providing device provides information to an image display device, and the plurality of image display devices display an image based on the information,
The information providing apparatus includes:
An additional image added to the presentation image, and generating additional information associated with the state of the presentation image;
Transmitting the additional information to the image display device capable of displaying the presentation image to which the additional image is added based on the additional information;
The image display device includes:
Receiving the additional information from the information providing device;
Accepts selections about the state,
Based on the presentation data indicating the presentation image and the additional information according to the selection, the presentation image with the additional image added in a state according to the selection is generated,
Display the presentation image,
Image display method.

Images