JP2011126064A - Display system, control method for display system, and projector - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display system capable of easily capturing and storing information displayed on a whiteboard or the like. <P>SOLUTION: This display system 100 permits the exchange of projection image data or write-in image data between a projector 10 and an electronic blackboard device 30 and allows a data composing part 11c serving as an image composing part, to obtain composite image data by composing the projection image data and write-in image data. A write-in image displayed on a board surface 41 of the electronic blackboard device 30 can thereby be easily incorporated and stored as it is. At this time, since the electronic blackboard device 30 need not be photographed, the projector 10 can be mechanically simplified. Further, if the composite image data is projected by the projector 10, a composite image displayed on the electronic blackboard device 30 can be reproduced as it is, and the state of the stored composite image is easily confirmed. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a display system including a projector and an input board, a control method for the display system, and a projector.

  A ruler line or the like of a template registered in advance on a whiteboard can be projected by a projector, and attributes such as the thickness and color of the ruled line can be edited using a key input unit provided in the projector (Patent Document 1). . In this projector, a whiteboard on which an image is projected can be taken, and the image can be sent to a computer for storage.

JP 2004-198858 A

  However, in the projector as described above, when a table is completed by writing characters with a ruled line projected, when the projection is stopped, only the written character string remains and the table cannot be recorded. Note that in the method of photographing a whiteboard, a camera is required, the projector is mechanically complicated, and it is not easy to maintain image quality. In addition, in the method of photographing the whiteboard in this way, the photographed image is transferred to the computer, so it is not easy to check the image state on the spot.

  SUMMARY An advantage of some aspects of the invention is that it provides a display system that can easily capture and save information displayed on a whiteboard or the like.

  It is another object of the present invention to provide a display system control method as described above and a projector incorporated in the display system as described above.

  In order to solve the above problems, a display system according to the present invention is provided in a projector and projects a video projection unit that projects an image corresponding to projection image data, and an input board that reads an image written on a plate surface. A board reading unit that acquires write image data, a communication unit that enables at least one of transmission of projection image data from the projector to the input board, and transmission of write image data from the input board to the projector, And an image composition unit that obtains composite image data by combining the projection image data and the write image data.

  According to the display system, the projection image data or the write image data can be exchanged between the projector and the input board, and the image synthesis unit, that is, the data synthesis unit, synthesizes the projection image data and the write image data. Thus, the composite image data is obtained, so that the image displayed on the input board can be simply captured and stored as it is, and the image quality of the image data can be easily maintained. At this time, since it is not necessary to photograph the input board separately, the projector can be mechanically simplified. Furthermore, if the image corresponding to the composite image data is projected by the projector, the composite image displayed on the input board can be reproduced as it is, and the state of the stored composite image can be easily confirmed.

  In a specific aspect of the present invention, in the display system, the image composition unit preferentially writes the write image data and combines the write image data and the projection image data. In this case, it is possible to prevent the written image data from being damaged by the projection image data, and the projection image data should be displayed in the background.

  In yet another aspect of the present invention, a data adjustment unit is further provided that aligns the projection image data and the writing image data before combining them. In this case, the file format, the image size, and the like of the projection image data and the write image data can be easily combined with each other in advance.

  In still another aspect of the invention, the projector includes an image processing unit that corrects misalignment of the projection image data projected onto the plate surface of the input board by the video projection unit. In this case, it is possible to project an image that fits properly on the plate surface of the input board, and to prevent positional deviation between the projected image data and the written image data. That is, it is possible to prevent the projection image from being projected in a state of being displaced with respect to the input board. The positional deviation of the projected image means that the image is projected with a deviation from the reference area on the plate surface, and includes not only a simple shift but also a projection magnification deviation, a trapezoidal distortion, and the like.

  In yet another aspect of the present invention, the projector further includes a correction sensor that enables detection of a position relative to the projector by an alignment mark arranged on the input board, and the image processing unit displays the detection result of the correction sensor. Based on this, the misalignment correction process is performed on the projection image data. Thereby, it is possible to prevent the positional deviation between the projected image data and the written image data more reliably, and to generate composite image data that more accurately reproduces the image displayed on the input board.

  In still another aspect of the present invention, the composite image data combined by the image combining unit is transmitted from one of the projector and the input board to the other. In this case, the composite image data can be used by both the projector and the input board. For example, it is possible to project an image corresponding to the composite image data synthesized by the input board by the projector and print an image corresponding to the composite image data synthesized by the projector by the input board.

  In yet another aspect of the present invention, the input board includes a printer capable of printing write image data or composite image data. In this case, the composite image data can be easily output and stored tangibly.

  A display system control method according to the present invention is a display system control method that includes a projector and an input board, and projects an image onto the plate surface of the input board by the projector, and is provided on the plate surface of the input board by the projector. The projected image data projected and the write image data written on the plate surface of the input board are synthesized.

  According to the above control method, the projection image data projected on the board surface of the input board by the projector is combined with the write image data obtained by reading the image written on the board surface of the input board by the board reading unit. The image displayed on the input board can be easily captured and saved as it is. At this time, since it is not necessary to photograph the input board separately, the projector can be mechanically simplified.

  The projector according to the present invention includes: a video projection unit that projects an image corresponding to the projection image data; an input board that reads the image written on the plate surface and acquires the write image data; A receiving unit that receives one of the combined image data obtained by combining the image data and the written image data.

  According to the above projector, the receiving unit receives either one of the write image data and the composite image data. Therefore, when the write image data is received, the projector combines the projection image data and the write image data. Thus, the composite image data can be obtained, and when the composite image data is received, the composite image data can be stored or a composite image based on the composite image data can be projected.

It is a figure which shows the external appearance of the display system of 1st Embodiment. It is a block diagram which shows the structure of the display system of 1st Embodiment. (A), (B) is a figure explaining the flow of the process performed with a projector and an electronic blackboard apparatus. (A) illustrates the display state of the plate surface being projected by the projector, (B) illustrates the display state of the plate surface after additional writing is performed, (C) The display state of the plate surface when the projection by the projector is stopped will be exemplified. (A) visually illustrates projection image data corresponding to the projection pattern, (B) visually illustrates write image data corresponding to the write pattern, and (C) illustrates projection image data. And (D) exemplify a composite image printed by the printer. (A), (B) is a figure explaining the flow of the process performed with a projector and an electronic blackboard apparatus. It is a figure explaining the flow of the process for the projection of the synthesized image by a projector. (A) visually illustrates the composite image data processed by the projector, and (B) illustrates the display state of the composite image by the projection of the projector. It is a figure explaining the flow of the process for the projection of the synthesized image performed with a projector. (A), (B) is a figure explaining the flow of operation | movement by the display system of 2nd Embodiment.

[First Embodiment]
Hereinafter, a display system according to a first embodiment of the present invention will be described in detail with reference to the drawings.

[A. Appearance of display system)
A display system 100 illustrated in FIG. 1 is installed in, for example, a conference room or a classroom, and includes a projector 10 and an electronic blackboard device 30. The projector 10 is disposed so as to face the electronic blackboard device 30, and projects various images on the plate surface 41 of the electronic blackboard device 30 based on image data held inside or image data captured from outside. It can be carried out. The electronic blackboard device 30 is an input board, and can write an image of a desired character, symbol, figure or the like on the plate surface 41 with a marker pen, and can write a written image read from the plate surface 41 on a sheet 71. Can be printed on. The projector 10 and the electronic blackboard device 30 are connected to each other via a communication cable 51 so that image data and the like can be transmitted and received.

[B. Projector structure in the display system)
As shown in FIG. 2, the projector 10 includes a control unit 11, a storage unit 12, a key input processing unit 13, an input selection unit 14, an image processing unit 15, a video output unit 16, and a video projection unit 17. The communication unit 18, the correction sensor 21, and the power supply unit 22 are provided.

  The control unit 11 controls the entire function of the projector 10. That is, the control unit 11 is communicably connected to the storage unit 12, the key input processing unit 13, the input selection unit 14, the image processing unit 15, the communication unit 18, the correction sensor 21, the power supply unit 22, and the like. Information is taken in from these parts, or a control signal or the like is sent to these parts to control the operation state. Specifically, the control unit 11 functions as a data adjustment unit 11a, a data request unit 11b, a data synthesis unit (image synthesis unit) 11c, a synthesis projection processing unit 11d, and the like. Details of these functional units will be described later.

  The storage unit 12 holds programs, data, and the like necessary for operating the projector 10. The storage unit 12 also stores a projection image and the like to be projected on the video projection unit 17. In addition to the image data held by the storage unit 12 itself, for example, image signals or image data captured from the outside via the input selection unit 14, image data captured from the electronic blackboard device 30 via the communication unit 18, etc. Can be stored.

  The key input processing unit 13 is for inputting a user instruction, and has a key operation unit 28 (see FIG. 1) including a plurality of operation keys such as a movement key and a determination key. A display can also be attached. A remote control light receiving unit 25 is provided along with the key input processing unit 13 so that a command signal can be received remotely from the remote control 26 by radio. The input selection unit 14 is for selecting which of the notebook computer or other external device (not shown) connected to the connector 27 is to receive the image signal.

  The image processing unit 15 can perform various corrections including color correction, shift correction, magnification correction, distortion correction, and the like on an image signal or image data input from the outside via the input selection unit 14 or the communication unit 18. it can. Further, the image processing unit 15 generates an image signal for displaying character information or the like from the image data extracted from the storage unit 12 based on a command from the control unit 11 instead of or superimposing the image signal from the outside. be able to. The video output unit 16 causes the video projection unit 17 to project an image based on the image signal after image processing output from the image processing unit 15. The video projection unit 17 includes, for example, an illuminating device, liquid crystal light valves for RGB colors, a combining prism, a projection lens, and the like. A color image is displayed on the plate surface 41 of the electronic blackboard device 30. The video projection unit 17 is not limited to the liquid crystal type, and various types such as a digital micromirror device method, an LCOS method, a GLV method, and a CRT method can be used.

  The communication unit 18 is an interface circuit that enables communication with the electronic blackboard device 30 and other external devices via, for example, the communication cable 51. From the projector 10 side, for example, the projection image data that is the basis of the image projected on the plate surface 41 of the electronic blackboard device 30 in FIG. 1 or the electronic blackboard device 30 is remotely instructed to perform reading operation, printing operation, and the like. The command that will be sent. Note that the communication unit 18 can be an interface circuit for USB, for example, and a USB cable can be connected as the communication cable 51. The communication unit 18 may be an interface circuit that enables communication in an ad hoc mode of a wireless LAN. In this case, peer-to-peer connection with the electronic blackboard device 30 can be performed. Further, the communication unit 18 may be an interface circuit connected to a wired LAN or the like.

  The correction sensor 21 includes, for example, an imaging system, an image sensor, and the like, and can detect coordinates of the four alignment marks AM arranged on the plate surface 41 of the electronic blackboard device 30 of FIG. To. Based on the coordinates detected by the correction sensor 21, the direction, posture, distance, etc., that is, the relative position of the rectangular display area surrounded by the alignment mark AM on the plate surface 41 with respect to the projector 10 can be known. Specifically, the control unit 11 determines correction parameters necessary for coordinate conversion including shift correction, magnification correction, distortion correction, and the like for image data to be projected based on the detection result of the correction sensor 21. The image processing unit 15 performs a misalignment correction process for correcting the misalignment on the image data to be projected based on the correction parameter. As a result, it is possible to project an image having no distortion that falls within the rectangular reference region surrounded by the four alignment marks AM on the plate surface 41. The image projected on the plate surface 41 is displayed in a partial area that is slightly smaller than the reference area, for example, but the frame of such a projected image can be matched with the reference area, or The frame of the projected image can be protruded from the reference area.

  The power supply unit 22 operates under the control of the control unit 11 and supplies power to each unit of the projector 10.

[C. The structure of the electronic blackboard device in the display system)
As shown in FIG. 2, the electronic blackboard device 30 includes a control unit 31, a storage unit 32, a key input processing unit 33, a board reading unit 34, a drive unit 35, a printer 36, a communication unit 38, And a power supply unit 39.

  The control unit 31 controls the entire function of the electronic blackboard device 30. That is, the control unit 31 is communicably connected to the storage unit 32, the key input processing unit 33, the board reading unit 34, the drive unit 35, the printer 36, the communication unit 38, the power supply unit 39, and the like. Information is taken in, or a control signal or the like is sent to these parts to control the operation state. Specifically, the control unit 31 functions as a data request unit 31a, a data composition unit (image composition unit) 31b, and the like. Details of these functional units will be described later.

  The storage unit 32 holds programs, data, and the like necessary for operating the electronic blackboard device 30. The storage unit 32 stores image data obtained by reading a written image on the plate surface 41 read through the board reading unit 34 or the like. The storage unit 12 can also store image data captured from the projector 10 via the communication unit 18, for example.

  The key input processing unit 33 is for inputting a user instruction, and has a key operation unit 48 (see FIG. 1) including a plurality of operation keys such as a movement key and a determination key, and a display as a UI. is doing.

  Although detailed description is omitted, the board reading unit 34 includes a detection unit 34a having an imaging optical system, a line sensor, a sensor drive circuit, and the like, and an illumination unit 34b that illuminates a location detected by the detection unit 34a. The drive unit 35 moves the board reading unit 34 that is supported by the rail unit 42 provided on the upper portion of the frame unit illustrated in FIG. 1 and extends in the vertical direction in the horizontal direction parallel to the rail unit 42. For example, if the moving speed of the board reading unit 34 by the drive unit 35 is constant, the image information detected by the board reading unit 34 is accumulated over time, thereby corresponding to the written image written on the plate surface 41. Two-dimensional image data can be acquired.

  The printer 36 performs printing based on various image data stored in the storage unit 32. Specifically, the printer 36 can print an image obtained by copying a written image on the plate surface 41 detected by the board reading unit 34 or the like. The printer 36 can also print an external image corresponding to the image data input from the projector 10 via the communication unit 38. Note that the image data stored in the storage unit 32 includes composite image data obtained by combining image data corresponding to the written image on the plate surface 41 and image data corresponding to the image projected by the projector 10. The printer 36 can also print a composite image corresponding to such composite image data.

  The communication unit 38 is an interface circuit that enables communication with the projector 10 and other external devices via, for example, the communication cable 51. From the electronic blackboard device 30 side, for example, written image data obtained by reading an image written on the plate surface 41 of the electronic blackboard device 30 in FIG. 1 is transmitted. The communication unit 38 can be, for example, an interface circuit for USB, and a USB cable can be connected as the communication cable 51. The communication unit 18 may be an interface circuit that enables communication in a wireless LAN ad hoc mode. In this case, peer-to-peer connection with the projector 10 can be performed. Further, the communication unit 18 may be an interface circuit connected to a wired LAN or the like.

  The power supply unit 39 operates under the control of the control unit 31 and supplies power to each unit of the electronic blackboard device 30.

[D. First Operation: Data Transmission / Reception and Composite Printing]
With reference to FIGS. 3A and 3B, transmission / reception of data performed between the projector 10 and the electronic blackboard device 30, and composition and printing of images performed in the electronic blackboard device 30 will be described.

  First, the operation on the projector 10 side will be described with reference to FIG. Here, a connection is established between the projector 10 and the electronic blackboard device 30 via the communication cable 51, and information including data and commands can be exchanged.

  The control unit 11 of the projector 10 periodically checks whether there is a data request for requesting transmission of projection image data from the electronic blackboard device 30 via the communication unit 18 (step S11). In the description of the processing in step S11 shown in the figure, the abbreviation “WB” means an electronic blackboard device. If the control unit 11 determines that there is a data request via the communication unit 18 (step S11: Y), the control unit 11 executes a job in response to the data request. That is, the control unit 11 temporarily stores the original image data that is currently being projected and that has not been subjected to the positional deviation correction processing in the projection image area 12a of the storage unit 12 as projection image data ( Step S12). Next, as the processing of the data adjustment unit 11a, the control unit 11 matches the projection image data stored in the projection image area 12a of the storage unit 12 with the writing image data detected by the electronic blackboard device 30. (Step S13). Here, the projection image data that has been converted to match the written image data is referred to as adjusted image data. The adjusted image data is obtained by changing the original projection image data with respect to the file format, image size, and the like, and has a file format, image size, and the like that match the written image data read by the electronic blackboard device 30. ing. Then, the control part 11 transmits this adjustment image data to the electronic blackboard apparatus 30 via the communication parts 18 and 38 (step S14).

  The operation on the electronic blackboard device 30 side will be described with reference to FIG. The control unit 31 of the electronic blackboard device 30 requests the projector 10 to transmit projection image data as a process of the data request unit 31a, for example, when the user operates a composite print key constituting the key input processing unit 33. A data request command to be transmitted is transmitted (step S21). The control unit 31 checks whether or not the adjustment image data corresponding to the projection image data is returned from the projector 10 (step S22), and determines that the adjustment image data is returned from the projector 10 (step S22). : Y), the received adjustment image data is written in the storage unit 32 as projection image data, and the storage unit 32 stores the written adjustment image data, that is, the projection image data in the projection image area 32a (step S23). Next, the control unit 31 operates the board reading unit 34 and the like to acquire write image data obtained by reading the write image written on the plate surface 41 and writes the write image data in the storage unit 32. The written image data thus written is stored in the written image area 32b (step S24). Next, the control unit 31 stores the projection image data stored in the projection image region 32a of the storage unit 32 and the write image region 32b of the storage unit 32 as processing of the image composition unit, that is, the data composition unit 31b. Image processing is performed to generate combined image data by combining the written image data with the written image data, and this is written in the storage unit 32. The storage unit 32 stores the written combined image data in the combined image region 32c (step S25). ). Thereafter, the control unit 31 reads out the composite image data stored in the composite image area 32c of the storage unit 32, transmits the composite image data to the printer 36, and causes the printer 36 to print a composite image corresponding to the composite image data (step S26). The image processing for generating the composite image data in step S25, that is, the image composition processing is performed by, for example, overwriting the writing image data on the projection image data. At this time, at least for the writing image data to be prioritized, it is necessary to previously perform data processing for cutting out only the image portion of the main body in which characters, figures, and the like are written from the background image to make the background transparent. Although it is possible to overwrite the writing image data by overwriting the writing image data, in this case, for at least priority projection image data, only the image portion of the main body where the display target exists is cut out from the background image. Therefore, it is necessary to perform data processing for making the background transparent. The image compositing process is not limited to giving priority to any one of the projection image data and the written image data, and various methods such as blending can be used.

  4 (A) to 4 (C) show the state of the plate surface 41 of the electronic blackboard device 30, and particularly FIG. 4 (A) shows the display state of the plate surface 41 being projected by the projector 10. That is, the projection image is illustrated. In this case, the image portion PI of the main body constituting the projection image projected on the plate surface 41 is a ruled line, and information generated by the image processing unit 15 operating under the control of the control unit 11 or This is information provided from an external notebook computer via the connector 27. The projection image including the image portion PI in FIG. 4A is generated based on the projection image data D1 having the projection pattern PP shown in FIG. The projection image data D1 is stored in the projection image region 32a of the storage unit 32 as it is or after being processed so as to facilitate the image composition processing. FIG. 4B illustrates a display state of the plate surface 41 after the user performs writing on the plate surface 41 with a marker pen, that is, a written image. In this case, the image portion WI of the main body constituting the writing image displayed on the plate surface 41 is a character or a numerical value written so as to be embedded in the ruled line which is the image portion PI constituting the projection image. . The writing image including the image portion WI in FIG. 4B is read by the board reading unit 34 and the like, and converted into writing image data D2 having the writing pattern RP shown in FIG. The write image data D2 is stored in the write image area 32b of the storage unit 32. FIG. 4C is a diagram for reference, and shows a case where projection by the projector 10 is stopped. In this case, the image displayed on the plate surface 41 is only a written image including the image portion WI.

  FIG. 5C visually shows composite image data D3 obtained by synthesizing the projection image data D1 visually exemplified in FIG. 5A and the write image data D2 visually exemplified in FIG. 5B. It is illustrative. The composite image data D3 is stored in the composite image area 32c of the storage unit 32 under the control of the control unit 31 of the electronic blackboard device 30. Note that FIG. 5D illustrates a composite image CI that is actually printed by the printer 36 based on the composite image data D3 illustrated in FIG.

[E. Second Operation: Data Transmission / Reception and Synthesis]
With reference to FIGS. 6A and 6B, data transmission / reception performed between the projector 10 and the electronic blackboard device 30 and image synthesis performed by the projector 10 will be described.

  First, the operation on the projector 10 side will be described with reference to FIG. The control unit 11 of the projector 10 transmits write image data to the electronic blackboard device 30 as processing of the data request unit 11b, for example, when the user operates a composite storage key constituting the key input processing unit 13. A command for requesting data is transmitted (step S31). The control unit 11 checks whether or not the writing image data is returned from the electronic blackboard device 30 (step S32), and the writing image data is transmitted from the electronic blackboard device 30 via the communication unit 18 as a receiving unit. If it is determined that a reply has been received (step S32: Y), the received write image data is written into the storage unit 12, and the storage unit 12 stores the written image data thus written in the write image area 12b. (Step S33). Next, the control unit 11 stores the original image data that is currently being projected and has not been subjected to the positional deviation correction processing in the projection image area 12a of the storage unit 12 as projection image data (step S34). ). Next, the control unit 11 converts the projection image data stored in the writing image area 12b of the storage unit 12 into writing image data matched with the projection image data on the projector 10 side as processing of the data adjustment unit 11a. (Step S35). Here, the written image data that has been converted to match the projection image data is referred to as adjusted image data. The adjusted image data is obtained by changing the original writing image data with respect to the file format, the image size, and the like, and has a file format, an image size, and the like that match the projection image data projected by the projector 10. Yes. Thereafter, the control unit 11 performs processing of the image composition unit, that is, the data composition unit 11c, so that the projection image data stored in the projection image region 12a of the storage unit 12 and the document stored in the write image region 12b of the storage unit 12 are processed. Image processing is performed to generate combined image data by combining the embedded image data with the embedded image data, and this is written in the storage unit 12, and the storage unit 12 stores the written combined image data in the combined image region 12c (step S36). . Note that the composite image data stored in step S36 is obtained by the same processing as in step S25 of FIG. In other words, the composite image data is generally obtained by image processing that superimposes both image data. However, if there is an overlap between the projected image and the written image, such overlap is separated and, for example, either one is given priority. And so on.

  The operation on the electronic blackboard device 30 side will be described with reference to FIG. The control unit 31 of the electronic blackboard device 30 periodically checks whether or not there has been a data request for requesting transmission of writing image data from the projector 10 via the communication unit 38 (step S41). In the illustrated description of the process in step S41, the abbreviation “PJ” means a projector. If the control unit 31 determines that there is a data request via the communication unit 38 (step S41: Y), the control unit 31 executes a job in response to the data request. That is, the control unit 31 operates the board reading unit 34 and the like to acquire write image data obtained by reading the write image written on the plate surface 41 and writes the write image data in the storage unit 32. The written image data thus written is stored in the write image area 32b (step S42). Thereafter, the control unit 31 transmits the written image data to the projector 10 via the communication units 38 and 18 (step S43).

[F. Third operation: projection of composite image]
The composite image projection performed by the projector 10 will be described with reference to FIG. For example, when the user displays a menu screen using the key input processing unit 13 and selects composite image projection, the control unit 11 of the projector 10 starts the composite image projection processing.

  First, the control unit 11 selects a composite image selection menu stored in the storage unit 12 as image data to be given to the image processing unit 15, and a menu image corresponding to the video projection unit 17 via the image processing unit 15 or the like. Is projected (step S51). The user uses the key input processing unit 13 to select and determine which composite image data stored in the storage unit 12 is to be projected. When the user determines specific composite image data (step S52: Y), the control unit 11 designates the selected / determined composite image data in the storage unit 12 and causes the image processing unit 15 to transfer the combined image data to the image processing unit. 15 projects the composite image data designated by the video projection unit 17, that is, the composite image (step S53). Note that the image processing unit 15 performs a misalignment correction process based on the correction parameter, and the composite image projected on the plate surface 41 is a rectangular shape surrounded by four alignment marks AM on the plate surface 41. The image has no distortion that fits within the reference area.

  FIG. 8A corresponds to FIG. 5C, but visually illustrates composite image data D <b> 4 synthesized by the projector 10 instead of the electronic blackboard device 30. The composite image data D4 is a combination of the projection image data similar to the projection image data D1 in FIG. 5A and the write image data similar to the write image data D2 in FIG. 5B. . FIG. 8B illustrates a display state when a composite image is projected onto the plate surface 41 by the projector 10. On the plate surface 41, a composite image CP corresponding to the composite image data D4, that is, a projection image including the image portion PI of FIG. 4A and a writing image including the image portion WI of FIG. A composite image synthesized in terms of data is projected.

[G. Other operations: Ruled line projection]
Hereinafter, an example of the projection operation of the original image before the synthesis by the projector 10 will be described with reference to FIG. The control unit 11 of the projector 10 starts the ruled line display process when, for example, the user displays the menu screen using the key input processing unit 13 and selects the ruled line display.

  In the ruled line display process, the control unit 11 confirms the detection result of the correction sensor 21 and confirms whether or not the image processing unit 15 has performed the misalignment correction process properly (step S61). When the correction process is not properly performed, the control unit 11 uses the detection result of the correction sensor 21 to determine new correction parameters necessary for proper shift correction, magnification correction, distortion correction, and the like. Then, the positional deviation correction processing by the image processing unit 15 is updated to be executed based on the new correction parameter (step S62). When the projector 10 is fixedly attached to the ceiling or the like, it is not necessary to check whether or not the above-described misalignment correction processing is appropriate. In this case, for example, when installing the projector 10, the installer adjusts the correction parameter of the misalignment correction process by the image processing unit 15 so that the projected image is aligned with the screen, and the control unit 11 always uses the correction parameter. Sets an operation mode for performing misalignment correction processing. Further, even if the projector 10 is a portable type, the confirmation of whether or not the above-described misregistration correction processing is appropriate can be limited only when the image is first projected after the power is turned on, for example.

  Thereafter, the control unit 11 selects a ruled line image selection menu stored in the storage unit 12 as image data to be given to the image processing unit 15, and a menu image corresponding to the video projection unit 17 via the image processing unit 15 or the like. Is projected (step S63). The user uses the key input processing unit 13 to select and decide which ruled line stored in the storage unit 12 is to be projected. When the user determines a specific ruled line (step S64: Y), the control unit 11 designates the selected and determined ruled line pattern in the storage unit 12 and transfers it to the image processing unit 15, and the image processing unit 15 Then, the ruled line pattern designated, that is, the ruled line image is projected to the video projection unit 17 (step S65).

  As is apparent from the above description, in the display system 100 of the present embodiment, it is possible to exchange projection image data or written image data between the projector 10 and the electronic blackboard device 30, and data that is an image composition unit Since the combining unit 11c combines the projection image data and the written image data to obtain combined image data, the combined image displayed on the plate surface 41 of the electronic blackboard device 30 can be easily captured and stored as it is. At this time, since it is not necessary to photograph the electronic blackboard device 30, the projector 10 can be mechanically simplified, and the image quality of the composite image data can be easily maintained. Furthermore, if the projector 10 projects a composite image corresponding to the composite image data, the composite image displayed on the electronic blackboard device 30 can be reproduced as it is, and the state of the stored composite image can be easily confirmed. .

[Second Embodiment]
Hereinafter, the display system according to the second embodiment will be described in detail. Note that the display system of the second embodiment is a modification of the display system of the first embodiment, and parts that are not particularly described are the same as those of the display system of the first embodiment.

  FIG. 10A shows processing in the projector 10 in which the processing in FIG. 6A is changed. As shown in the figure, the control unit 11 of the projector 10 stores the composite image data in the storage unit 12 (step S36), and then uses the composite image data stored in the storage unit 12 as an electronic blackboard as a process of the data adjustment unit 11a. The image data is converted into adjusted image data matched with the writing image data detected by the apparatus 30 (step S137), and the adjusted image data is converted into composite image data for the electronic blackboard apparatus 30 via the communication units 18 and 38. It transmits to the apparatus 30 (step S138). Note that the composite image data stored in step S36 is obtained in the same manner as in steps S33 to S36 in FIG. In other words, the composite image data is generally obtained by image processing that superimposes both image data. However, if there is an overlap between the projected image and the written image, such overlap is separated and, for example, either one is given priority. And so on. The adjustment image data prepared by the data adjustment unit 11a is obtained by changing the original writing image data with respect to the file format, the image size, and the like, and a file format that matches the projection image data projected by the projector 10. It has an image size and the like, and is aligned with the projection image data.

  FIG. 10B shows processing in the electronic blackboard device 30 in which the processing in FIG. 6B is changed. As shown in the figure, after transmitting the writing image data (step S43), the control unit 31 of the electronic blackboard device 30 checks whether or not the adjustment image data corresponding to the composite image data is returned from the projector 10. When it is determined that the adjustment image data is returned from the projector 10 (step S122: Y), the received adjustment image data is written as composite image data in the storage unit 32, and the storage unit 32 The written composite image data is stored in the composite image area 32c (step S125). Thereafter, the control unit 31 reads out the composite image data stored in the composite image area 32c of the storage unit 32, transmits the composite image data to the printer 36, and causes the printer 36 to print a composite image corresponding to the composite image data (step S126). In the description of the process in step S41 of FIG. 10B, the abbreviation “PJ” means a projector.

  In the above operation, the composite image data is created by the projector 10, but the composite image data can also be created by the electronic blackboard device 30. In this case, the projector 10 receives the composite image data from the electronic blackboard device 30 via the communication unit 18 as a receiving unit.

[Other modifications]
Although the present invention has been described based on the above embodiments, the present invention is not limited to the above embodiments, and can be implemented in various modes without departing from the gist thereof. Such modifications are also possible.

  In the above embodiment, the case where the input board is the electronic blackboard device 30 has been described. However, the input board is not limited to the electronic blackboard device 30 and is a board that can be converted into image data by a user writing information such as characters by handwriting. Thus, various devices having a screen capable of projecting an image by the projector 10 can be provided.

  Further, the electronic blackboard device 30 is not limited to the one that moves the board reading unit 34, and the plate surface 41 is constituted by a sheet, and the image data can be read by the fixed board reading unit 34 while scrolling the sheet. . Further, the electronic blackboard device 30 may include a pressure-sensitive board reading unit that detects writing pressure instead of the optical board reading unit 34.

  The projector 10 is not limited to storing a plurality of composite image data in the composite image area 12c of the storage unit 12, but can store the composite image data acquired immediately before.

  Further, when storing a plurality of composite image data in the composite image area 12c of the storage unit 12, the projector 10 can project an image corresponding to a combination of a plurality of composite image data in a thumbnail shape.

  The projector 10 is not limited to projecting a ruled line as a projection image on the plate surface 41 of the electronic blackboard device 30, but can project various figures as a projection image. That is, various graphic data can be prepared as projection image data, and such graphic data can be image data captured from the outside via the connector 27 and the input selection unit 14.

  In the above-described embodiment, the write image data read by the board reading unit 34 or the like is not limited to the pixel type, and may be converted into character data by OCR or the like and the character data pattern rearranged on the screen. it can. Further, the write image data read by the board reading unit 34 or the like is not limited to monochrome, and can be in color.

  In the above-described embodiment, the data adjustment unit 11a of the control unit 11 performs adjustment to match the projection image data and the writing image data. Such adjustment is performed by changing the number of pixels of the projection image data and the writing image data. It is not limited to the decrease, and includes those that maintain or increase the number of pixels of the projection image data and the write image data.

  In the above embodiment, the control unit 11 determines correction parameters necessary for coordinate conversion including shift correction, magnification correction, distortion correction, and the like for image data to be projected based on the detection result of the correction sensor 21. However, the detection principle of the correction sensor 21 can be various, and for example, it is possible to detect the alignment mark AM temporarily projected on the plate surface 41 and determine a correction parameter.

  In the above embodiment, the connection between the projector 10 and the electronic blackboard device 30 is not limited to the illustrated example, and various connections that can transmit and receive image data and the like can be made.

  In the above embodiment, the composite image data created by the projector 10 and the electronic blackboard device 30 is not only exchanged between the projector 10 and the electronic blackboard device 30, but can be output to an external device. For example, if an external device such as a computer is connected to the communication unit 18 of the projector 10, the composite image data as described above can be output from the projector 10 to the external device. Further, if an external device such as a computer is connected to the communication unit 38 of the electronic blackboard device 30, the composite image data as described above can be output from the electronic blackboard device 30 to the external device. The communication units 18 and 38 can be configured to include a dedicated communication port for the projector 10 or the electronic blackboard device 30 and a general-purpose communication port for an external device.

  DESCRIPTION OF SYMBOLS 10 ... Projector, 11 ... Control part, 11a ... Data adjustment part, 11b ... Data request part, 11c ... Data composition part, 11d ... Composition projection processing part, 12 ... Memory | storage part, 12a ... Projection image area, 12b ... Write image Area, 12c ... composite image area, 13 ... key input processing section, 15 ... image processing section, 16 ... video output section, 17 ... video projection section, 18 ... communication section, 21 ... correction sensor, 28 ... key operation section, DESCRIPTION OF SYMBOLS 30 ... Electronic blackboard apparatus 31 ... Control part, 31a ... Data request part, 31b ... Data composition part, 32 ... Storage part, 32a ... Projection image area, 32b ... Write image area, 32c ... Composite image area, 33 ... Key Input processing unit 34 ... Board reading unit 36 ... Printer 38 ... Communication unit 41 ... Plate surface 100 ... Image display system 51 ... Communication cable AM ... alignment mark

Claims (9)

A video projection unit that is provided in the projector and projects an image corresponding to the projection image data;
A board reading unit that is provided on the input board and reads the image written on the plate surface to acquire the written image data;
A communication unit that enables at least one of transmission of the projection image data from the projector to the input board and transmission of the write image data from the input board to the projector;
An image composition unit that obtains composite image data by combining the projection image data and the writing image data;
A display system comprising:   The display system according to claim 1, wherein the image composition unit preferentially composes the write image data and the projection image data with respect to the write image data.   3. The display system according to claim 1, further comprising a data adjustment unit configured to match the projection image data and the writing image data before synthesizing the projection image data and the writing image data.   4. The projector according to claim 1, wherein the projector includes an image processing unit that performs a positional deviation correction process on the projection image data projected on the plate surface of the input board by the video projection unit. The display system according to any one of the above.   The projector further includes a correction sensor that enables detection of a position relative to the projector by an alignment mark arranged on the input board, and the image processing unit projects a projected image based on a detection result of the correction sensor. The display system according to claim 4, wherein a positional deviation correction process is performed on the data.   The display system according to any one of claims 1 to 5, wherein the composite image data combined by the image combining unit is transmitted from one of the projector and the input board to the other.   The display system according to any one of claims 1 to 6, wherein the input board includes a printer capable of printing the writing image data or the composite image data. A control method for a display system comprising a projector and an input board, and projecting an image onto the plate surface of the input board by the projector,
A display system control method for combining projection image data projected on a board surface of an input board by a projector and written image data obtained by reading an image written on the board surface of the input board by a board reading unit. A video projection unit for projecting an image corresponding to the projection image data;
From the input board that reads the image written on the plate surface and obtains the written image data, the written image data and the synthesized image data obtained by synthesizing the projected image data and the written image data A receiving unit for receiving one of them,
A projector comprising:

Images