JP2007094661A - Presentation control device and presentation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily make a presentation using an existing projector and optical pointer as they are even when each individual brings a notebook type personal computer to make the presentation. <P>SOLUTION: A presentation image G from a first notebook type personal computer 11 is projected to a screen 12 by the projector 13. In this state, a projected image 14 is photographed by a camera part 15 and monitor-displayed on a display part 16 of the notebook type personal computer 11, and four angles a, b, c, d of a projection range 14 of the monitor-displayed presentation image G are specified by a user to acquire a coordinate region of the projection range 14 and to store it in a memory 22 of a presentation control device 10. Also on a second connected notebook type personal computer 11 onward, not to mention the first connected notebook type personal computer 11, position coordinates P (X, Y) indicated by a laser pointer 18 are detected within the projection range 14 based on the projection range coordinates a, b, c, d of the presentation image G stored in the presentation control device 10, and processing corresponding to the contents indicated by the pointer P is appropriately carried out. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a presentation control apparatus and a presentation system for supporting a presentation using, for example, a projection image by a projector.

  When a presentation is performed using a document image created by a personal computer, presentation image data (presentation image) created and recorded by the personal computer is converted into an optical image by a projector and projected onto a screen.

  When such a presentation is actually performed, for example, it is generally performed while pointing to an arbitrary position on the screen on which the presentation image is projected using a laser pointer using a visible light laser. ing.

  On the other hand, when performing a page advance or enlarged display of a presentation image, a key operation or a mouse operation is required on the personal computer side from which the presentation image is output.

  Therefore, conventionally, a camera built in the projector for taking a projected image on the screen is connected to the personal computer that is the output of the presentation image, and the indicated position of the laser pointer is detected by analyzing the taken image with the personal computer. A first device that processes and outputs a presentation image according to a position is considered (for example, see Patent Document 1).

  Also, a projected image on the screen specified by the laser beam from the laser pointer is captured by the camera, the moving state of the laser pointer on the projected image captured by this camera is detected, and the presentation image output source as mouse operation data A second device that transmits to the personal computer is also considered (see, for example, Patent Document 2).

Furthermore, a third apparatus is also conceivable in which a projected image on a screen is captured by a camera built in the projector, and commands such as page feed and page return of a presentation image are transmitted to a personal computer (for example, see Patent Document 3). ).
JP 07-129322 A JP-A-10-091344 JP-A-10-326151

  In the first device and the third device that support the conventional presentation, since the camera that captures the projected image on the screen is integrated with the projector, there is a problem that the existing projector cannot be used as it is. In the second apparatus, an existing projector can be used as it is because it is provided separately from the projector. However, every time a connection is made to a personal computer of a different presenter who makes a presentation, the laser on the screen is used. There is a problem that the initial setting for correctly analyzing the pointer has to be reset.

  The present invention has been made in view of such a problem, and even when each individual brings a personal computer and makes a presentation, it is possible to easily make a presentation by using an existing projector and an optical pointer as they are. It is an object to provide a presentation control apparatus and a presentation system.

  The presentation control device according to claim 1 is a presentation control device connected to a personal computer in a presentation system that projects an image output from a personal computer by a projector, and captures a projection screen projected by the projector. Photographing means, PC control program storage means for storing a PC control program for controlling the connected personal computer, and PC control program stored by the PC control program storage means upon connection of the personal computer Transfer start control means for transferring and starting the PC to the personal computer, and for starting transfer of the PC control program to the personal computer by the program transfer start control means A projection range information storage unit that stores information on a projection range based on a photographed image of the projection screen received from the personal computer. The projection range information stored in the projection range information storage unit is stored in the projection range information storage unit. A pointer obtained from a photographed image of a projection screen photographed by the photographing means as a reference is detected.

  The presentation control device according to claim 2 is the presentation control device according to claim 1, wherein the control program for PC projects a connected personal computer by a projection range information storage unit of the presentation control device. If the information is not stored, the captured image of the projection screen captured by the imaging unit is captured and displayed on the display unit, and the captured image displayed on the display unit by the captured image display control unit Projection range information transmission storage control means for transmitting and storing the projection range information instructed in accordance with the user operation to the presentation control apparatus, and the projection range information stored by the projection range information storage means of the presentation control apparatus. Projected image taken by the photographing means as a reference Pointer detection means for detecting the pointer obtained from the captured image, it is characterized in that to function as an output image control means for controlling the image to be output to the projector in accordance with the pointer information detected by the pointer detection unit.

  The presentation control apparatus according to claim 3, wherein the pointer detection unit projects the projection image based on the projection range information stored in the projection range information storage unit. A position detection unit for detecting the position of the pointer within the range, and a command corresponding to the operation of the pointer within the projection range of the projection image based on the projection range information stored by the projection range information storage unit And a command analysis means.

  According to the presentation control apparatus of the first aspect of the present invention, when a personal computer that outputs an image is connected to the projector, the PC control program stored in the PC control program storage means is transferred to the personal computer. Is activated. Then, in response to the activation of the transfer of the PC control program to the personal computer, information on the projection range based on the photographed image on the projector projection screen by the photographing means is received from the personal computer and stored. Since the pointer obtained from the photographed image on the projector projection screen is detected based on the information, for example, information on the projection range based on the photographed image on the projector projection screen is stored when the first personal computer is connected. For example, when a second or subsequent personal computer is connected, a pointer such as a laser pointer can be detected based on the information of the projection range of the projector projection screen that has already been stored.

  According to the presentation control device of the second aspect of the present invention, when the PC control program is transferred and activated to the connected personal computer in the presentation control device of the first aspect, the presentation control device When the projection range information is not stored in the projection range information storage unit, a captured image of the projection screen imaged by the imaging unit is captured and displayed on the display unit, and a user operation is performed based on the displayed captured image. The information of the projection range instructed according to is transmitted to the presentation control device and stored. Then, on the basis of the projection range information stored in the projection range information storage unit of the presentation control device, a pointer obtained from the captured image of the projection screen imaged by the imaging unit is detected, and the detected pointer information Since the image output to the projector is controlled according to the presentation control device, even if a separate personal computer is connected for each individual to give a presentation, when the second and subsequent personal computers are connected, the presentation control device A pointer such as a laser pointer can be detected on the basis of the information on the projection range of the projector projection screen that has already been stored, and the presentation image can be controlled in accordance with the detected state of the pointer.

  According to the presentation control device according to claim 3 of the present invention, in the presentation control device according to claim 2, the pointer detection means is based on the projection range information stored in the projection range information storage means. The position of the pointer within the projection range of the projection image is detected, and the command corresponding to the operation of the pointer within the projection range of the projection image is analyzed, so that pointer enhancement on the presentation image currently being output Image composition control, presentation image switching control, and the like can be executed.

  Therefore, according to the present invention, even when each individual brings a personal computer and makes a presentation, the presentation control device and the presentation system can easily make a presentation by using the existing projector and the optical pointer as they are. Can provide.

  Embodiments of the present invention will be described below with reference to the drawings.

(First embodiment)
FIG. 1 is a diagram showing an external configuration of a presentation system incorporating a presentation control apparatus 10 according to an embodiment of the present invention.

  FIG. 2 is a diagram showing a connection configuration of a presentation system in which the presentation control apparatus 10 is incorporated.

  The presentation control device 10 is connected to a notebook personal computer (notebook PC) 11 that is an output source of presentation image data. Presentation image data output from the notebook PC 11 is converted into an optical image G by the projector 13 and projected onto the screen 12.

  The presentation control apparatus 10 includes a CCD camera unit 15 for photographing an image (G) projected as the projection range 14 on the screen 12, and is initialized when the first notebook PC 11 is connected. A notebook PC pointer control program (PCP) 24 for causing the notebook PC 11 to execute processing and analysis processing of the designated position P and pointer modulation state by the laser pointer 18 when connected to each notebook PC 11. I remember it.

  The projected image (G) on the screen 12 photographed by the camera unit 15 of the presentation control apparatus 10 is transmitted to the notebook PC 11. For example, in the initial setting process in which the first notebook PC 11 is connected, the notebook PC 11. According to the notebook PC pointer control program (PCP) 24 transferred to, the captured image is displayed on the monitor 16 of the notebook PC 11 on the monitor.

  Here, the imaging range 17 of the projection image G on the screen 13 by the camera unit 15 may be a range in which the projection range 14 of the projection image G is sufficiently contained, and it is not always necessary to match the imaging range 17 with the projection range 14. Therefore, the setting operation of the shooting direction by the camera unit 15 can be easily performed.

  On the screen 12 on which the presentation image G is projected and displayed, an arbitrary position is indicated by the laser pointer 18 along with the presentation, and the designated position P of the laser pointer 18 on the image G by the visible light laser is the camera unit. 15 is captured along with the imaging of the projection image G by 15, is included in the captured image corresponding to the imaging range 17, and is transferred to the connected notebook PC 11.

  Further, on the display screen of the display unit 16 of the notebook PC 11 to which the presentation control device 10 is connected, for example, a transparent touch panel unit 19 is provided to be overlapped, and an indication position corresponding to a touch operation by the user on the display screen is provided. It is detected as a coordinate position. Even when the touch panel unit 19 is not provided on the display unit 16 of the notebook PC 11, the designated position coordinates are detected in response to a click operation with the mouse cursor on the display screen in the display unit 16.

  In addition, the presentation control apparatus 10 includes a user I / F unit 20 such as a key / button for performing power ON / OFF setting, switching of a photographing function by the camera unit 15, and the first notebook PC 11. Parameter for defining the projection range 14 of the presentation image G by the projector 13 acquired according to the initial setting process according to the notebook computer pointer control program (PCP) 24 transferred to the notebook PC 11 when A memory unit 22 is provided for storing and holding (projection range instruction position 22a) and a correction parameter (projection monitor display correction parameter 22b) of a captured image.

  That is, in such a presentation control apparatus 10, in the initial setting process state in which the first notebook PC 11 is connected and the notebook personal computer pointer control program (PCP) 24 is transferred to the notebook PC 11 and executed, the camera unit The projected image G on the screen 12 photographed by 15 is displayed on the display unit 16 of the notebook PC 11 on the monitor. Then, on the display screen of the projection image G displayed on the monitor 16 on the display unit 16, for example, as shown in FIG. 1, the four corners of the projection image G within the imaging range 17 by the camera unit 15, that is, the projection When the user designates and operates the four corner points a, b, c, and d in the range 14, the coordinates a (x1, y1), b (x2, y2), four corners on the projection range (image G) 14 c (x3, y3) and d (x4, y4) are respectively detected by the touch panel unit 19, and based on this, the coordinate values in the XY directions in the entire area on the projection range (image G) 14, that is, from the notebook PC 11 The coordinate values (X, Y) relating to the image area for presentation that is output and projected on the screen 12 by the projector 13 are managed.

  FIG. 3 is a block diagram showing a configuration of an electronic circuit of the presentation control apparatus 10.

  The electronic circuit of the presentation control apparatus 10 is controlled by a main controller (CPU) 21 so that the operation of each part of the circuit is controlled. The control program is stored in advance in the ROM in the memory unit 22. The control program stored in advance in the ROM in the memory unit 22 is mainly a main processing program that controls the overall operation of the presentation control apparatus 10, and when the notebook PC 11 is connected, a notebook personal computer pointer control program (PCP). ) A PC connection setting processing program for sending 24 to the connection destination PC 11 is stored. Note that the memory unit 22 has two types of parameters 22a and 22b for correctly analyzing the pointer pointing position P on the screen 12, which is acquired in the initial setting process associated with the connection of the first notebook PC 11 as described above. A RAM for storing and holding is also provided.

  The main controller (CPU) 21 is connected to the memory unit 22, the camera unit 15, the user I / F unit 20, and the notebook computer pointer control program (PCP) 24 memory 24M. A PC-I / F unit 23 for performing input / output control is connected.

  FIG. 4 is secured in the notebook PC memory 25 in accordance with the initial setting process according to the notebook personal computer pointer control program (PCP) 24 when the presentation control apparatus 10 and the first notebook PC 11 are connected. It is a figure which shows the structure of various data memories.

  Along with the initial setting process according to the notebook computer pointer control program (PCP) 24, the memory unit 25 in the notebook PC 11 includes a PCP memory 25P for storing the notebook computer pointer control program (PCP) 24 and presentation images. Memory 25a, projection state captured image memory 25b, projection range indication position memory 25c, projection monitor display correction parameter memory 25d, projection monitor display correction image memory 25e, pointer detection coordinate memory 25f, analysis command memory 25g, pointer emphasis composite image memory A working memory for temporarily storing various data such as 25h is provided.

  The presentation image memory 25 a stores presentation image data (G) to be transferred from the notebook PC 11 and output to the projector 13.

  In the projection state photographed image memory 25b, projection image data on the screen 12 photographed and transferred by the camera unit 15 of the presentation control apparatus 10 is stored.

  In the projection range instruction position memory 25c, the user instruction operation of the four points a, b, c, d corresponding to the projection range 14 in the monitor display state of the projection image G on the display unit 16 in the initial setting mode. Accordingly, each coordinate data a (x1, y1), b (x2, y2), c (x3, y3), d (x4, y4) detected by the touch panel 19 (or mouse cursor click operation) is stored. .

  In the projection monitor display correction parameter memory 25d, the projection image G displayed on the monitor 16 as a trapezoidal image is displayed in accordance with the installation position of the camera unit 15 of the presentation control device 10 with respect to the screen 12, the shooting angle of view, and the like. When shooting distortion such as being displayed occurs, the four-point coordinates a (x1, y1), b (x2, y2), c (x3) corresponding to the projection range 14 stored in the projection range indication position memory 25c. , y3) and d (x4, y4), distortion correction parameters for projection monitor display are calculated and stored in accordance with the image distortion amount calculated based on d (x4, y4). The correction parameters for the projection monitor display include a calibration correction parameter for correcting distortion of the subject in accordance with the lens performance of the camera unit 15 and a gamma correction parameter for correcting brightness distortion. These correction parameters are set based on the table data described in advance in the pointer control program (PCP) 24 for the notebook personal computer.

  The projection monitor display corrected image memory 25e stores the projection image G after distortion correction according to the distortion correction parameters for projection monitor display stored in the projection monitor display correction parameter memory 25d.

  In the pointer detection coordinate memory 25f, four-point coordinates a (x1, y1), b (x2, y2), c (x3, y3), d corresponding to the projection range 14 stored in the projection range indication position memory 25c are stored. The designated position coordinates P (X, Y) by the laser pointer 18 calculated based on the XY coordinates of the area surrounded by (x4, y4) is stored.

  In the analysis command memory 25g, the modulation pattern of the indication light by the laser pointer 18 with respect to the projection image G on the screen 12 is reflected in the projection image data that is updated and stored while being captured in the projection state captured image memory 25b. Analysis is performed by detecting the incident pattern, and a command code (such as a page feed / page return command of a presentation image) corresponding to the instruction light modulation pattern is stored.

  The pointer emphasis composite image memory 25h lowers the image brightness of the small area around the position P indicated by the laser pointer 18 in the presentation image (25a) projected on the screen 12 by the projector 13 by image synthesis. Then, mask image data M (see FIG. 10) for emphasizing and displaying the indication position P by the laser pointer 18 is stored.

  The designated position data a (x1, y1), b (x2, y2), c (x3, y3), d (x4, y4) of the projection range 14 stored in the projection range designated position memory 25c, and The distortion correction parameters for projection monitor display stored in the projection monitor display correction parameter memory 25 d are transmitted to the presentation control device 10 and stored and held in the corresponding memory areas 22 a and 22 b in the memory 22.

  Next, the operation of the presentation system incorporating the presentation control apparatus 10 having the above configuration will be described.

  FIG. 5 is a flowchart showing a notebook PC connection process accompanying the connection between the presentation control apparatus 10 and the notebook PC 11.

  When it is determined that the notebook PC 11 is connected to the presentation control device 10 (step A1), the notebook computer pointer control program (PCP) 24 stored in advance in the memory 24M is transferred to the notebook PC 11 and written into the PCP memory 25P. At the same time (step A2), the notebook personal computer pointer control program (PCP) 24 is started (step A3).

  FIG. 6 is a flowchart showing a startup process based on the notebook personal computer pointer control program (PCP) 24 transferred from the presentation control apparatus 10 to the notebook PC 11.

  When the notebook personal computer pointer control program (PCP) 24 transferred to the connected notebook PC 11 is started, first, two kinds of effective pointers for correctly analyzing the pointer indication position P in the memory 22 on the presentation control apparatus 10 side are displayed. It is determined whether or not the parameters (projection range instruction position 22a, projection monitor display correction parameter 22b) have already been stored (step B1).

  If it is determined that no valid parameter is stored in the memory 22 on the presentation control apparatus 10 side (step B1 (NO)), the process proceeds to an initial setting process, and the camera unit 15 of the presentation control apparatus 10 The presentation image (captured image) G photographed by the above is received by the notebook PC 11 (step B2) and displayed on the monitor 16 (step B3).

  Then, for the projection image G displayed on the monitor by the display unit 16, as shown in FIG. 1, for the four points a, b, c, d of the projection range 14, arrows j, k As shown in FIG. 4, when an instruction is made by a touch operation or a mouse cursor click operation, the coordinates of the four point indicated positions of the projection range 14 on the monitor display are detected, and a (x1, y1), b (x2, y2 ), C (x3, y3), d (x4, y4) are stored in the projection range indicating position memory 25c (step B4).

  Then, when there is a shooting distortion such as the projection image G displayed on the monitor 16 displayed on the display unit 16 as a trapezoidal image, it corresponds to the projection range 14 stored in the projection range indication position memory 25c. Distortion correction parameters for projection monitor display according to the image distortion amount calculated based on the four-point coordinates a (x1, y1), b (x2, y2), c (x3, y3), d (x4, y4) Is calculated and stored in the projection monitor display correction parameter memory 25d (step B5).

  At this time, calibration correction parameters and gamma correction parameters are also acquired and stored based on table data described in advance in the notebook computer pointer control program (PCP) 24.

  Then, the four-point coordinates a (x1, y1), b (x2, y2), c (x3, y3), d (x4, y4) which are the projection position designated position data stored in the projection range designated position memory 25c. ) And various distortion correction parameters stored in the projection monitor display correction parameter memory 25d are transferred to the presentation control device 10 and stored in the corresponding memories 22a and 22b (step B6).

  When the initial setting process is performed when the first notebook PC 11 is connected in this way, the process proceeds to the process of detecting the pointer indication position accompanying the presentation in FIG. 7 (step BS).

  FIG. 7 is a flowchart showing a pointer indication position detection process based on the notebook personal computer pointer control program (PCP) 24 transferred from the presentation control apparatus 10 to the notebook PC 11.

  FIG. 8 is a diagram illustrating a presentation image G that is captured by the camera unit 15 of the presentation control apparatus 10 and stored in the projection state captured image memory 25 b of the notebook PC 11 and displayed on the display unit 16.

  When the pointer indication position detection process associated with this presentation is activated, presentation image data G stored in the presentation image memory 25a of the notebook PC 11 is output to the projector 13, converted into an optical image, and projected onto the screen 12. In the displayed state, a photographed image on the screen 12 photographed by the camera unit 15 of the presentation control apparatus 10 is captured (step S1).

  Then, for the presentation image G captured and captured by the camera unit 15 of the presentation control apparatus 10, the projection monitor display is calculated in advance with the initial setting process and stored in the projection monitor display correction parameter memory 25d. The distortion correction parameters are read out, and the captured image distortion being captured is corrected and stored in the projection monitor display corrected image memory 25e (step S2).

  As a result, the projected image (presentation image G) on the screen 12 captured by the presentation control device 10 and captured by the notebook PC 11 is corrected without distortion regardless of the installation position, angle of view setting, and lens characteristics of the camera unit 15. The

  On the other hand, four-point coordinates a (x1, y1) defining the projection range 14 stored in the projection range indication position memory 25c for the projection image captured and captured by the camera unit 15 and stored in the projection state captured image memory 25b. ), B (x2, y2), c (x3, y3), and d (x4, y4), pixels having pixel data exceeding a predetermined threshold from among the pixel data of the image data in the projection range 14 The position is retrieved (step S3), and is determined by the four-point coordinates a (x1, y1), b (x2, y2), c (x3, y3), and d (x4, y4) of the retrieved pixel position. The XY coordinate value within the projection range 14 is calculated as the indicated position P (X, Y) by the laser pointer 18 and stored in the pointer detection coordinate value memory 25f (step S4).

  Thus, the four-point coordinates a (x1, y1), b (x2) according to the user designation can be obtained without matching the shooting range 17 by the camera unit 15 with the projection range 14 of the presentation image G projected on the screen 12. , y2), c (x3, y3), and d (x4, y4), the designated position coordinates P (X, Y) by the laser pointer 18 within the projection range 14 can be accurately detected.

  Thus, when the designated position coordinate P (X, Y) by the laser pointer 18 within the projection range 14 of the presentation image G on the screen 12 is detected, the laser by the laser pointer 18 is changed according to the change in the pixel data of the designated position coordinate P. A light modulation pattern is detected (step S5).

  FIG. 9 is a diagram showing the contents of commands corresponding to each modulation pattern of the laser beam by the laser pointer 18 that can be detected from the projection image on the screen 12 photographed by the presentation control apparatus 10.

  That is, according to the change of “1” and “0” of the pixel data corresponding to the designated position coordinate P (X, Y) by the laser pointer 18 in the captured projection image range (14) detected in the steps S3 and S4. The modulation pattern of the laser beam is detected (step S5), and the presence / absence of a command to the presentation control by the laser pointer 18 according to the presence / absence of the comparison match with the modulation pattern for each command as shown in FIG. The contents are determined (step S6).

  Here, when it is determined that there is a page feed command or a page return command in accordance with an instruction operation by the laser pointer 18 for the projection image (14) on the screen 12, the current projection display is performed according to the page control command. Presentation image page feed control and page return control are performed (steps S6 to S7).

  Thereby, not only the designated position coordinates P (X, Y) by the laser pointer 18 with respect to the presentation image G (25a) projected on the screen 12 by the projector 13 can be easily detected, but also the laser light output by the laser pointer 18 The control command according to the modulation pattern can be detected, and page feed control and page return control of the presentation image G (25a) can be easily executed by the notebook PC 11 that is the output source of the image G. .

  In the command determination process by detecting the modulation pattern of the laser beam by the laser pointer 18, the designated position coordinate P (X, Y) by the laser pointer 18 is the projection range 14 (or shooting range 17) of the presentation image G. If it is out of the range, the command determination process by detecting the modulation pattern of the laser beam is reset at that time.

  On the other hand, when it is determined that there is no command in accordance with an instruction operation by the laser pointer 18 for the projection image (14) on the screen 12, the designated position coordinates within the photographic projection image range (14) by the laser pointer 18 are determined. An image (pointer emphasizing synthesized image 25h) for emphasizing the point of the designated position coordinate P in correspondence with P (X, Y) is synthesized (step S8).

  FIG. 10 shows a pointer emphasis composite image corresponding to the laser pointer instruction position P for the presentation image (projected image 25a) on the notebook PC 11 in accordance with the notebook personal computer pointer control program (PCP) 24 from the presentation control device 10. It is a figure which shows the synthetic | combination process state of (25h).

  That is, the pointer emphasizing composite image (25h) is mask image data M for reducing the image brightness of a certain small area of the presentation image (25a) at a certain rate, and as shown in FIG. As shown in FIG. 10A, the presentation image (25a) being projected and displayed by 13 is associated with the detected position coordinate P (X, Y) by the laser pointer 18 as shown in FIG. The mask image data M as shown in FIG. 10C is synthesized as a composite image 25ah as shown in FIG. 10D, and is output to the projector 13 and projected onto the screen 12 as shown in FIG. Thus, the point of the designated position coordinate P by the laser pointer 18 in the image projection range 14 is highlighted.

  Thereafter, the first presentation by the first notebook PC 11 connected to the presentation control apparatus 10 is terminated and disconnected, and the second notebook PC 11 is connected to the presentation control apparatus 10 for the second presentation. Is connected to the second notebook PC 11 in the same manner, the notebook computer pointer control program (PCP) 24 is transferred from the presentation control device 10 and started in accordance with the notebook PC connection process in FIG. Steps A1 to A3).

  Then, in accordance with the start-up process based on the notebook personal computer pointer control program (PCP) 24 on the notebook PC 11 side in FIG. 6, two types for correctly analyzing the pointer indication position P in the memory 22 on the presentation control apparatus 10 side are shown. When it is determined whether or not valid parameters (projection range instruction position 22a, projection monitor display correction parameter 22b) have already been stored (step B1), initial setting processing associated with the connection of the first notebook PC 11 When it is determined that the effective parameters acquired by the above are stored and stored (step B1 (YES)), the parameters are stored and stored in the projection monitor display correction parameter memory 22a in the memory 22 of the presentation control apparatus 10. Distortion correction parameters for projection monitor display, and Four-point coordinates a (x1, y1), b (x2, y2), c (x3, y3), d (x4, y4) that define the projection range 14 stored and stored in the projection range indication position memory 22b in the memory 22 Is read and stored in the second notebook PC 11 and stored in the projection range indication position memory 25c and the projection monitor display correction parameter memory 25d (step B1 → B7).

  7 is connected to the presentation control apparatus 10 in the pointer indication position detection process (step BS) in FIG. 7 at the time of the presentation, accompanying the connection with the first notebook PC 11. Indication of distortion correction parameters and projection range for projection monitor display read from the memory 22 (22a, 22b) of the presentation control device 10 in step B7 without performing the necessary initial setting processing (steps B2 to B6). Using each parameter information consisting of position coordinates a (x1, y1), b (x2, y2), c (x3, y3), d (x4, y4), correction of the projected image (step S2) and pointer indication Detection of the position P (X, Y) (steps S3 to S5) and its command analysis processing (steps S6 to S8) can be easily performed.

  Therefore, according to the presentation system in which the presentation control device 10 having the above-described configuration is incorporated, the projection image on the screen 12 in a state where the presentation image G output from the first notebook PC 11 is projected onto the screen 12 by the projector 13. (14) is photographed by the camera unit 15 and displayed on the monitor 16 of the notebook PC 11, and the four corners [a (x1, y1), b (x2) of the projection range 14 of the presentation image G displayed on the monitor are displayed. , y2), c (x3, y3), d (x4, y4)] by the user, a coordinate area corresponding to the image projection range 14 is acquired and stored in the memory 22 of the presentation control apparatus 10 as well. Let The projection range coordinates [a (x1) of the presentation image G stored and stored in the memory 22 of the presentation control apparatus 10 are applied not only to the first connected notebook PC 11 but also to the second and subsequent connected notebook PCs 11. , y1), b (x2, y2), c (x3, y3), d (x4, y4)] for each pixel data within the projection range 14 determined based on the predetermined threshold value. A certain position is detected as the designated position coordinates P (X, Y) by the laser pointer 18 so that command analysis processing corresponding to the modulation pattern of the pointer (P), highlighting processing of the pointer designated position P, and the like are appropriately performed. Therefore, even when the presentation is performed by reconnecting to different notebook PCs 11..., The same projector 13 and optical pointer 18 are connected to the second and subsequent units without requiring the initial setting process. It is possible to easily perform the presentation by using remains.

  In the presentation control apparatus 10 of the first embodiment, the projection unit 14 corresponds to the projection range 14 from the projection image (G) on the screen 12 that is captured by the camera unit 15 and displayed on the connected notebook PC 11. In order to acquire the coordinate area, the projection range 14 of the projection image (G) on the captured image displayed on the monitor is instructed by the user, so that the projection range is based on the designated position detection signal on the display screen. 14, the coordinate information corresponding to 14 is acquired. However, as will be described in the second embodiment, an initial setting-dedicated image 14 </ b> G having the same image size as the presentation image G and having the entire area black is used as the projector 13. And projecting the projection state on the screen 12 by the camera unit 15 of the presentation control device 10. From elaborate captured image data, may obtain the coordinate range corresponding to the black image 14G through the edge detection processing of the black-and-white image as coordinate information of the projection area 14.

(Second Embodiment)
FIG. 11 is a flowchart showing a program startup initial setting process of the second embodiment by the notebook personal computer pointer control program (PCP) 24 transferred from the presentation control device 10 to the connected notebook PC 11.

  FIG. 12 is a diagram showing a projected state photographed image obtained by photographing the dedicated image 14G projected on the screen 12 by the camera unit 15 in accordance with the program starting initial setting process of the second embodiment of the presentation control apparatus 10.

  That is, the program startup initial setting process of the second embodiment in FIG. 11 is executed in place of steps B2 to B4 in the program startup initial setting process of the first embodiment in FIG. Before projecting the presentation image G of the PC 11 onto the screen 12 by the projector 13, first, the projector 13 projects the initial setting-dedicated image 14 </ b> G having the same image size as the presentation image G and the entire region black onto the screen 12. Are displayed (step B2a).

  Then, a captured image of the black image 14G for initial setting projected on the screen 12 captured by the camera unit 15 of the presentation control device 10 is received and captured, and stored in the projected state captured image memory 25b (step B3a). .

  Here, for example, as shown in FIG. 12, in the captured image (imaging range 17) in a state where the black image 14G is projected, the black pixel region (projection range 14) within the white pixel region (imaging range 17). ) Edge detection processing, and the four coordinates a (x1, y1), b (x2, y2), c (x3, y3), d of the projection range 14 corresponding to the black image 14G subjected to the edge detection processing. (x4, y4) is acquired and stored in the projection range indicating position memory 25c (step B4a).

  Then, as in the first embodiment, a correction parameter is calculated according to the distortion amount of the captured image, stored in the projection monitor display correction parameter memory 25d (step B5), and stored in the projection range instruction position memory 25c. The projection monitor display correction parameter memory 25d together with the four-point coordinates a (x1, y1), b (x2, y2), c (x3, y3), and d (x4, y4) that are the designated position data of the projected range. The various stored distortion correction parameters are read out, transferred to the presentation control device 10, and stored and saved in the corresponding memories 22a and 22b (step B6).

  Therefore, according to the program startup initial setting process of the second embodiment by the notebook personal computer pointer control program (PCP) 24 transferred from the presentation control device 10 to the connected notebook PC 11, the camera unit of the presentation control device 10. 15 and having the same image size as that of the presentation image G without any work for the user to instruct and operate the projection range 14 of the presentation image G on the screen 12 displayed on the monitor 15 of the display unit 15 of the notebook PC 11. Coordinate information of the image projection range 14 can be easily obtained simply by projecting and displaying the image 14G dedicated to the initial setting in the area black on the screen 12 and photographing and capturing it with the camera unit 15.

  In the presentation control apparatus 10 of the first embodiment, the notebook personal computer pointer control program (PCP) 24 is transferred to the connected notebook PC 11 and activated when the notebook PC 11 is connected. As described with reference to FIG. 7, all processing steps of the program start process (steps B1 to B7) and the pointer pointing position detection process (steps BS (S1 to S8)) associated therewith are performed. However, as described in the next third embodiment, some processing steps of the pointer indication position detection processing (steps BS (S1 to S8)) are performed on the presentation control device 10 side. It is good also as a structure performed by.

(Third embodiment)
FIG. 13 is a flowchart showing a start-up process based on the notebook personal computer pointer control program (PCP) 24 transferred from the presentation control apparatus 10 to the notebook PC 11 according to the third embodiment of the present invention.

  FIG. 14 is a flowchart showing laser pointer processing on the connected notebook PC 11 side based on the notebook personal computer pointer control program (PCP) 24 by the presentation control apparatus 10 according to the third embodiment of the present invention.

  FIG. 15 is a flowchart showing laser pointer processing on the presentation control apparatus 10 side by the presentation control apparatus 10 according to the third embodiment of the present invention.

  That is, in the notebook computer pointer control program (PCP) 24 by the presentation control apparatus 10 of the third embodiment, the laser pointer processing (step BS ′) after the startup processing (steps B1 to B6) in FIG. 15, it is divided into laser pointer processing (steps AS1 to AS4a) on the presentation control apparatus 10 side and laser pointer processing (steps 4b to S8) on the connected notebook PC 11 side as shown in FIG. The configuration is to be executed.

  That is, as shown in the laser pointer process on the presentation control apparatus 10 side in FIG. 15, the captured image (17) of the projection image G (14) by the camera unit 15 is stored in the memory 22 (22a) during the initial setting process. Image correction processing based on image distortion correction parameters (steps AS1, AS2) and projection range instruction position coordinates a (x1, y1), b (x2, y2), c stored in the memory 22 (22b) Processing (step AS3, AS4) for detecting the pointer indication position coordinate P (X, Y) based on (x3, y3) and d (x4, y4), and the detected pointer indication position coordinate P as the connected notebook PC 11 The process (step AS4a) to be transmitted to the presentation side is executed on the presentation control apparatus 10 side.

  Then, as shown in FIG. 14, in the laser pointer process on the connected notebook PC 11 side, the pointer indication position coordinate P detected and transmitted by the laser pointer process on the presentation control apparatus 10 side is acquired (step S4b), Similarly to the laser pointer process (see FIG. 7) in the first embodiment, the pointer modulation state detection process (step S5), the command determination process (step S6), and the control process (step S6) of the presentation image G according to the command S7), or a synthesis process (step S8) of the mask image M corresponding to the pointer instruction position coordinate P is executed.

  In the third embodiment, a correction parameter calculation acquisition process (step B5) for captured image distortion in the initial setting process (steps B1 to B6) at the time of starting the program is also executed on the presentation control apparatus 10 side and connected. The memory 22 (22a, 22b) together with the parameters of the projection range indication position coordinates a (x1, y1), b (x2, y2), c (x3, y3), d (x4, y4) detected and transmitted from the notebook PC 11 side It is good also as a structure stored in ().

(Fourth embodiment)
FIG. 16 is a flowchart showing laser pointer processing on the presentation control apparatus 10 side by the presentation control apparatus 10 according to the fourth embodiment of the present invention.

  FIG. 17 is a flowchart showing laser pointer processing on the connected notebook PC 11 side based on the notebook personal computer pointer control program (PCP) 24 by the presentation control apparatus 10 according to the fourth embodiment of the present invention.

  That is, in the presentation control apparatus 10 of the fourth embodiment, laser pointer processing (on the presentation apparatus 10 side) is performed as compared with the presentation control apparatus 10 of the third embodiment described with reference to FIGS. In FIG. 16), further, pointer modulation state detection processing (step AS5), command determination processing (step AS6), transmission processing of the presentation image G according to the command to the connected notebook PC 11 (step AS7), Alternatively, a process of transmitting a signal for instructing the mask image composition process corresponding to the pointer instruction position coordinate P to the connected notebook PC 11 (step AS8).

  For this reason, as shown in FIG. 17, in the laser pointer process on the connected notebook PC 11 side, the control execution contents or pointer indication position of the presentation image G transmitted by the laser pointer process (FIG. 16) on the presentation apparatus 10 side. A mask image synthesis process instruction signal corresponding to the coordinate P is received and acquired (step S9), and a control execution process such as page feed of the presentation image G or a synthesis execution process of the mask image M to the pointer instruction position P is performed (step S9). Step S10).

(Fifth embodiment)
In the presentation control apparatus 10 of the fifth embodiment, the initial setting process at the time of starting the program connected to the first notebook PC 11 is performed in cooperation with both the connected notebook PC 11 side and the presentation control apparatus 10 side. The configuration.

  FIG. 18 is a flowchart showing a program startup process on the presentation control apparatus 10 side by the presentation control apparatus 10 according to the fifth embodiment of the present invention.

  FIG. 19 is a flowchart showing a startup process based on the notebook personal computer pointer control program (PCP) 24 transferred from the presentation control apparatus 10 to the notebook PC 11 according to the fifth embodiment of the present invention.

  That is, when the first notebook PC 11 is connected to the presentation control apparatus 10 and the startup process on the presentation apparatus 10 side in FIG. 18 and the startup process on the connected notebook PC 11 side in FIG. In any of these processes, it is determined that no valid parameter for pointer analysis is stored and stored in the memory 22 (22a, 22b) in the presentation control apparatus 10 (step AA1 (NO) / B1 (NO)). Move on to setting process.

  Then, a photographed image obtained by photographing the projection image G on the screen 12 is transmitted to the connected notebook PC 11 by the camera unit 15 of the presentation control apparatus 10 (step AA2), and the photographed image of the received projection image G is received by the notebook PC 11. It is displayed on the display unit 16 (steps B2 and B3). Based on the captured image of the projection image G displayed on the display unit 16, the designated position coordinates a (x1, y1), b (x2, y2), c (x3, y3) of the projection range according to the user operation , D (x4, y4) are acquired (step B4), the designated position coordinates a (x1, y1), b (x2, y2), c (x3, y3), d (x4, y4) of this projection range ) Is transmitted to the presentation control apparatus 10 (step B4a).

  The presentation control device 10 receives the designated position coordinates a (x1, y1), b (x2, y2), c (x3, y3), and d (x4, y4) of the projection range transmitted from the connected notebook PC 11. Then (step AA3), correction parameters corresponding to the distortion of the captured image are calculated (step AB5) and stored in the corresponding memories (projection range instruction position 22a, captured image correction parameter 22b) in the memory unit 22, respectively. Saved (step AB6).

  Thereby, in the presentation control apparatus 10, the designated position coordinates of the projection range are acquired from the notebook PC 11 by transmitting the captured image (17) of the screen projection image (14) photographed by the camera unit 15 to the connected notebook PC 11. At the same time, together with image correction parameters such as captured image distortion, it is stored and saved in the memory unit 22 as parameter data for pointer analysis.

  After the initial position setting process at the time of starting the program associated with the connection of the first notebook PC 11 has obtained the projection position indication position and the captured image correction parameter, the description has been given with reference to FIGS. 16 and 17. Similarly to the fourth embodiment, the laser pointer process (step AS (AS1 to AS8)) on the presentation control apparatus 10 side and the laser pointer process (step BS ′ (S9 to S10)) on the connected notebook PC 11 side are executed. Thus, the control process for the presentation image G according to the command in the pointer modulation state or the synthesis process for the pointer enhancement image M corresponding to the pointer instruction position P is executed.

  Therefore, as described in the presentation control device 10 of the third to fifth embodiments, at least in response to a user operation from the captured image (17) in the initial setting process at the time of starting the program accompanying the connection of the first notebook PC 11. The process of acquiring the designated position coordinates of the projection range (14) and the subsequent process of controlling the presentation image G according to the command in the pointer modulation state or the composition process of the pointer enhancement image M corresponding to the pointer designated position P If it is performed on the connected notebook PC 11 side, other processing, that is, correction parameter acquisition processing according to the distortion of the captured image, projection range (indicated position coordinate) parameters, and captured image correction parameters in the presentation control device 10 are performed. Memory storage processing, correction processing of captured images using each parameter, and pointer indication position Detection processing of P, for the command analysis process of the pointer modulation states may be performed on either side of the side or presentation control apparatus 10 of the connection note PC 11.

  In each embodiment of the presentation control device 10, a photograph taken by the camera unit 15 in a state where the presentation image G from the notebook PC 11 connected to the presentation control device 10 is projected and displayed on the screen 12 by the projector 13. By acquiring and storing parameters for defining the projection range (14) based on the image (17) and parameters for correcting image distortion, etc., even when another notebook PC 11. Although the configuration is such that the pointing position coordinate P by the pointer 18 can be accurately detected and grasped, a presentation image G dedicated for initial setting is output from the presentation control device 10 itself to the projector 13 and projected onto the screen 12, for example, a notebook for presentation Before connecting the PC11 It may be configured to be capable keep pre-spoofing the initial configuration in preparation of Zen venue.

  The present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the scope of the invention when it is practiced. Further, each of the embodiments includes inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in each embodiment or some constituent features are combined, the problems described in the column of the problem to be solved by the invention can be solved. When the effects described in the column of the effect of the invention can be obtained, a configuration in which these constituent elements are deleted or combined can be extracted as an invention.

The figure which shows the external appearance structure of the presentation system incorporating the presentation control apparatus 10 which concerns on embodiment of this invention. 2 is a diagram showing a connection configuration of a presentation system in which the presentation control apparatus 10 is incorporated. FIG. FIG. 2 is a block diagram showing a configuration of an electronic circuit of the presentation control apparatus 10. Various data memories secured in the notebook PC memory 25 in accordance with the initial setting process according to the notebook personal computer pointer control program (PCP) 24 when the presentation control apparatus 10 and the first notebook PC 11 are connected. The figure which shows a structure. 6 is a flowchart showing a notebook PC connection process associated with the connection between the presentation control apparatus 10 and the notebook PC 11. 7 is a flowchart showing processing at startup based on a notebook personal computer pointer control program (PCP) 24 transferred from the presentation control device 10 to the notebook PC 11; 7 is a flowchart showing pointer indication position detection processing based on a notebook personal computer pointer control program (PCP) 24 transferred from the presentation control device 10 to the notebook PC 11. The figure which shows the presentation image G image | photographed with the camera part 15 of the said presentation control apparatus 10, and memorize | stored in the projection state picked-up image memory 25b of notebook PC11, and displayed on the display part 16. FIG. FIG. 5 is a view showing the contents of commands corresponding to each modulation pattern of laser light by a laser pointer 18 that can be detected from a projection image on a screen 12 photographed by the presentation control device 10. The pointer emphasis composite image (25h) corresponding to the laser pointer instruction position P with respect to the presentation image (projected image 25a) on the notebook PC 11 according to the notebook personal computer pointer control program (PCP) 24 from the presentation control device 10 is shown. The figure which shows a synthetic | combination process state. 9 is a flowchart showing a program startup initial setting process of the second embodiment by a notebook personal computer pointer control program (PCP) 24 transferred from the presentation control apparatus 10 to a connected notebook PC 11; The figure which shows the projection state picked-up image which image | photographed the exclusive image 14G projected on the screen 12 with the initial setting process at the time of the program starting of 2nd Embodiment of the said presentation control apparatus 10 with the camera part 15. FIG. The flowchart which shows the process at the time of starting based on the pointer control program (PCP) 24 for notebook computers transferred to the notebook PC 11 from the presentation control apparatus 10 of 3rd Embodiment of this invention. The flowchart which shows the laser pointer process in the connection notebook PC11 side based on the pointer control program (PCP) 24 for notebook computers by the presentation control apparatus 10 of 3rd Embodiment of this invention. The flowchart which shows the laser pointer process by the said presentation control apparatus 10 side by the presentation control apparatus 10 of 3rd Embodiment of this invention. The flowchart which shows the laser pointer process by the said presentation control apparatus 10 side by the presentation control apparatus 10 of 4th Embodiment of this invention. The flowchart which shows the laser pointer process in the connection notebook PC11 side based on the pointer control program (PCP) 24 for notebook computers by the presentation control apparatus 10 of 4th Embodiment of this invention. The flowchart which shows the process at the time of the program starting by the said presentation control apparatus 10 side by the presentation control apparatus 10 of 5th Embodiment of this invention. The flowchart which shows the process at the time of starting based on the pointer control program (PCP) 24 for notebook computers transferred from the presentation control apparatus 10 of 5th Embodiment of this invention to notebook PC11.

Explanation of symbols

10: Presentation control device 11: Notebook personal computer (notebook PC)
DESCRIPTION OF SYMBOLS 12 ... Screen 13 ... Projector 14 ... Projection range 14G ... Black image only for initial setting 15 ... Camera part 16 ... Display part 17 ... Imaging (photographing) range 18 ... Laser pointer 19 ... Touch panel 20 ... User I / F part 21 ... Main Controller (CPU)
22 ... Memory part 23 ... PC I / F part 24 ... Pointer control program (PCP) for notebook personal computer
24M ... PCP memory 25 ... Notebook PC memory 25P ... Transferd PCP memory 25a ... Presentation image memory 25b ... Projection state photographed image memory 25c (22a) ... Projection range indication position memory 25d (22b) ... Projection monitor display correction parameter Memory 25e ... Projection monitor display correction image memory 25f ... Pointer detection coordinate memory 25g ... Analysis command memory 25h ... Pointer emphasis composite image memory P ... Laser pointer indication position M ... Mask image data

Claims (4)

A presentation control device connected to the personal computer by a presentation system that projects an image output from the personal computer by a projector,
Photographing means for photographing the projection screen projected by the projector;
PC control program storage means for storing a PC control program for controlling the connected personal computer;
A program transfer start control means for transferring the PC control program stored in the PC control program storage means to the personal computer and starting it in connection with the connection of the personal computer;
Projection range information storage means for storing information on the projection range based on the photographed image of the projection screen received from the personal computer in response to the transfer activation of the PC control program to the personal computer by the program transfer activation control means And
A presentation control apparatus for detecting a pointer obtained from a photographed image of a projection screen photographed by the photographing means on the basis of information on a projection range stored by the projection range information storage means. The PC control program stores a connected personal computer.
A captured image display control unit that captures a captured image of a projection screen captured by the imaging unit and displays the captured image on a display unit when projection range information is not stored by the projection range information storage unit of the presentation control device;
Projection range information transmission storage control means for transmitting and storing information of the projection range instructed according to the user operation based on the photographed image displayed on the display unit by the photographed image display control means,
Pointer detection means for detecting a pointer obtained from a photographed image of the projection screen photographed by the photographing means on the basis of the projection range information stored by the projection range information storage means of the presentation control device;
Output image control means for controlling an image to be output to the projector according to the pointer information detected by the pointer detection means;
The presentation control apparatus according to claim 1, wherein the presentation control apparatus is made to function as: The pointer detection means includes
Position detection means for detecting the position of the pointer within the projection range of the projection image based on the projection range information stored by the projection range information storage means;
Command analysis means for analyzing a command corresponding to the operation of the pointer in the projection range of the projection image based on the projection range information stored by the projection range information storage means;
The presentation control apparatus according to claim 2, further comprising: A presentation system comprising a personal computer, a projector that projects an image output from the personal computer onto a screen, and a presentation control device connected to the personal computer,
The presentation control device includes:
Photographing means for photographing the projection screen projected by the projector;
PC control program storage means for storing a PC control program for controlling the connected personal computer;
A program transfer start control means for transferring the PC control program stored in the PC control program storage means to the personal computer and starting it in connection with the connection of the personal computer;
Projection range information storage means for storing information on the projection range based on the photographed image of the projection screen received from the personal computer in response to the transfer activation of the PC control program to the personal computer by the program transfer activation control means And
The personal computer is
According to the PC control program transferred and activated by the program transfer activation control means of the presentation control device, when the projection range information is not stored by the projection range information storage means of the presentation control device, the image is photographed by the photographing means. Captured image display control means for capturing the captured image of the projected screen and displaying it on the display unit;
Projection range information transmission storage control means for transmitting and storing information on the projection range instructed according to the user operation based on the photographed image displayed on the display unit by the photographed image display control means,
Pointer detection means for detecting a pointer obtained from a photographed image of the projection screen photographed by the photographing means on the basis of information on the projection range stored by the projection range information storage means of the presentation control device;
Output image control means for controlling an image to be output to the projector in accordance with the pointer information detected by the pointer detection means,
A presentation system characterized by this.

Images