JP2006099504A - Automatic penlight control system for electronic pen with penlight, and penlight control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an automatic control system for automatically controlling the on/off of a penlight function as necessary concerning an electronic pen apparatus including both an electronic pen function and the penlight function. <P>SOLUTION: The electronic pen apparatus 1 comprises an electronic pen part 2; a penlight part 3; and a CCD camera part 4. The CCD camera part 4 periodically images a direction which is indicated by the tip end of the electronic pen apparatus 1 and transmits image data D3 to an analysis controller 5. The image analyzing part 7 of the analysis controller 5 analyzes the image data, estimates whether the four sides of a screen 11 appear in the image data or not, and recognizes the center of the lens of the CCD camera part 4 in the four sides. When it is estimated that the four sides appear and the center of the lens appear inside parts which are estimated as the four sides, an electronic pen apparatus control part 8 transmits an instruction signal D4, which indicates an effect that the penlight part 3 is turned on, to the electronic pen apparatus 1. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an electronic pen device having both an electronic pen function for inputting coordinates to a tablet and an instruction penlight function.

In recent years, in places like presentations and meetings, together with image display devices such as projectors, devices that input coordinates using a pointing device such as a tablet, images projected by the projector and characters handwritten on the spot A method of projecting images and figures on a screen is also widespread. In this system, a presenter makes a presentation while writing characters and figures on a tablet using an electronic pen device as a pointing device (see, for example, Patent Document 1). On the other hand, when a presentation is performed using a projector or the like, a method in which a presenter indicates characters and figures projected on a screen using a pen-light for screen instruction is widely used. And when making a presentation using an electronic pen and a penlight, the presenter makes a presentation while switching between physically separate electronic pen devices and penlight devices, or has both an electronic pen function and a penlight function. Using this device, the function will be announced while switching by pressing the function switching button for the electronic pen function and the pen light function.
Japanese Patent Application No. 7-159512

  However, in the method described in the above-mentioned patent document, when using physically separate electronic pen device and penlight device, an inexperienced presenter is troubled when changing the electronic pen device and penlight device. On the other hand, when using an apparatus having both an electronic pen function and a penlight function, an unfamiliar presenter often makes an operation mistake such as forgetting to press the function switching button. These situations can lead to longer presentation times due to the operation of the presenter, and distracting the presenter's ability to concentrate on the content of the presentation, resulting in a decline in the quality of the presentation.

  In view of such circumstances, an object of the present invention is to provide a penlight with an electronic pen with a penlight that can be used easily and reliably even by a person unfamiliar with the combined use and switching processing of an electronic pen and a penlight. An object is to provide an automatic control system and a penlight automatic control method.

  The present invention picks up an electronic pen unit that touch-inputs the position coordinates and a penlight unit that irradiates a light beam in one direction and a one-way image through a lens. An electronic pen device provided with an imaging unit for the pen body, an image analysis unit for analyzing image data captured by the imaging unit, and an electronic pen device for controlling the electronic pen device based on the analysis result of the image analysis unit A storage unit that stores shape information that is an apparent shape of the projection surface of an image projector having a substantially rectangular projection surface for projecting various images. And whether the image data captured by the imaging unit is collated with the shape information stored in the storage means, and whether there are four sides of the peripheral portion of the projection plane in the image data. The electronic pen device control unit, the electronic pen device control unit of the electronic pen device when the four side estimation unit estimates that all four sides of the peripheral portion of the projection plane is present in the image data This is achieved by a penlight automatic control system for an electronic pen with a penlight having a penlight control means for turning on the penlight section.

  Then, the imaging unit captures the direction of the tip of the pen body unit and sends the image data to the analysis control device. The image analysis unit of the analysis control device collates the shape information stored in the storage unit with the image data to obtain the image data. When the four-side estimator determines that all four edges of the peripheral edge of the projection surface exist inside the penlight, the penlight controller turns on the penlight so that the tip of the pen body is in the direction of the image projector The penlight can be turned on only when the penlight function is required.

  In addition, the above-described problems of the present invention include an electronic pen unit that touch-inputs the position coordinates to a tablet having a display unit that specifies position coordinates input by contact, a penlight unit that irradiates a light beam in one direction, and a one-way direction. Stores shape information that is an apparent shape of the projection surface of an electronic pen device that has an imaging unit that captures an image through a lens in a pen body unit and an image projector that has a substantially rectangular projection surface for projecting various images. In a penlight automatic control method in a penlight automatic control system for an electronic pen with a penlight, which includes a storage unit and an analysis control device that controls the electronic pen device, the imaging unit captures an image, and image data is obtained. A first step of transmitting to the analysis control device; and a second step of extracting a straight line from the image data in the analysis control device; A third step of forming an extension line obtained by extending the extracted straight line in both end directions to form a plurality of straight lines and a quadrilateral surrounded by the extension lines; and matching the quadrilateral with the shape information And when the result of the matching is that it is estimated that all four sides of the peripheral portion of the projection surface are present in the image data, the analysis control device turns on the penlight unit of the electronic pen unit. In addition, when it is estimated that all four sides of the peripheral edge of the projection surface do not exist in the image data, the analysis control device performs a fifth step of turning off the penlight unit of the electronic pen unit. This is accomplished by having a penlight automatic control method.

  Then, the quadrilateral formed based on the straight line extracted from the image data is matched with the shape information that is the apparent shape of the projection surface of the image projector, and all the four sides of the peripheral portion of the projection surface are included in the image data. By turning on the penlight unit only when it exists, the on / off control of the penlight unit based on the shape information can be reliably performed.

  According to the present invention, the electronic pen device has both the function of the electronic pen and the function of the penlight, and the system automatically detects that the tip of the pen main body indicates the screen direction, and the penlight. Since the section is turned on, the electronic pen function and the penlight function can be used properly by automatic control, reducing the burden on the presenter.

Hereinafter, an embodiment according to the present invention will be described with reference to the drawings.
FIG. 1 is a control block diagram of a penlight automatic control system for an electronic pen with a penlight according to the present invention. This penlight automatic control system 1 </ b> A includes an electronic pen device 1, an analysis control device 5, and a tablet 10.

  The electronic pen device 1 includes an electronic pen unit 2 as a pointing device for inputting coordinates to a display of a computer terminal, a penlight unit 3 that emits electronic light in one direction, and a CCD camera unit 4 that is a small imaging device. I have. The electronic pen unit 2, the penlight unit 3, and the CCD camera unit 4 are respectively an electronic pen control unit 2b, a penlight control unit 3b, and a CCD camera that are operated by a CPU (not shown) built in the electronic pen device 1. The operation is controlled by the control unit 4e.

  FIG. 2 shows an overall view of the electronic pen device 1. The pen main body 1a of the electronic pen device 1 is formed in an elongated shape having a size that can be easily gripped like a pen. Then, on the tip side of the pen main body 1a, a contact portion 2a that constitutes the electronic pen portion 2, a light irradiation portion 3a that constitutes the penlight portion 3, and a lens 4a that constitutes the CCD camera portion 4 are close to each other. Is provided. The contact portion 2a is provided at a tip portion protruding greatly in a conical shape on the tip side of the pen body portion 1a, and radiates electromagnetic waves by electromagnetic induction action of a coil and a capacitor (not shown) built in the pen body portion 1a. The coordinates are input by touching the display 10a of the tablet 10 shown in FIG.

  On the other hand, the light irradiating unit 3a is a laser beam irradiator, and emits a laser beam in a substantially one-point direction indicated by the tip of the pen body 1a when turned on.

  The lens 4a condenses light in the direction of the tip of the pen body 1a. As shown in FIG. 2, inside the pen main body 1a, there is a zoom 4b that changes the imaging magnification in the light condensing direction of the lens 4a, and an image sensor 4c that forms an image condensed by the lens 4a. Is provided. The imaging element portion 4c has pixels formed by light receiving elements such as photodiodes on the surface thereof arranged in a matrix. Among these pixels, a pixel that receives light incident on the optical axis of the lens 4a is a reference as a central information portion. It is formed as a pixel 4d. The image data D3 captured by the CCD camera unit 4 is compressed and encoded by a method such as JPEG, and is transmitted (D3) to the analysis control device 5 as shown in FIG.

  In this embodiment, the light irradiation unit 3a and the lens 4a are provided at the tip of the pen body 1a. However, the laser beam irradiation direction of the light irradiation unit 3a and the condensing direction of the lens 4a are the same. If it exists, the light irradiation part 3a and the lens 4a may not necessarily be provided in the middle of the pen body part 1a, but in the middle part.

  The analysis control device 5 is a computer program and is built in a computer terminal such as a personal computer, and communicates signals with the electronic pen device 1 and a tablet 10 described later, and controls the functions of the electronic pen device 1. As shown in FIG. 1, the analysis control device 5 includes an image input unit 6, an image analysis unit 7, an electronic pen device control unit 8, and an image output unit 9.

  The image input unit 6 receives the encoded image data D3 from the CCD camera unit 4 of the electronic pen device 1, and the image input unit 6 decodes the image data D3 and sends it to the image analysis unit 7. Supply. Note that the image data D3 may be transmitted to the tablet 10 to be described later. In this case, the image data D3 is not decoded and is supplied to the image output unit 9 without being encoded.

  The image analysis unit 7 performs various analysis processes for switching the functions of the electronic pen unit 2 and the penlight unit 3. FIG. 3 shows a control block diagram inside the image analysis unit 7. As shown in this figure, the image analysis unit 7 includes a four-side estimation unit 7a, a center information recognition unit 7b, a position information calculation unit 7c, and a storage unit 7d.

  The four side estimation unit 7a estimates whether or not the four sides of the screen 11 exist in the image data D3 captured by the CCD camera unit 4. The screen 11 is provided in front of an image projection body (for example, a cloth curtain or a large liquid crystal display device) for displaying an image projected by an image projection device such as a projector, and has a substantially rectangular peripheral shape. It is a display part. The center information recognition unit 7b recognizes the presence of the reference pixel 4d in the image data D3 captured by the CCD camera unit 4. Then, the position information calculation unit 7 c calculates the positional relationship between an operator 9 (to be described later) holding the electronic pen device 1 and the screen 11. The storage unit 7d is various writable recording media, and stores size information of the screen 11, peripheral shape information, and the like. Note that the four-side estimation unit 7a estimates the four sides, the center information recognition unit 7b recognizes the reference pixel 4d, the positional information calculation unit 7c calculates the positional relationship, and the storage unit 7d acquires the size information and the peripheral shape information. The method will be described later.

  In addition, the electronic pen device control unit 8 controls the function of the electronic pen device 1 upon receiving a signal processed and output by the image analysis unit 7. FIG. 3 shows a control block diagram inside the electronic pen device controller 8. The electronic pen device control unit 8 includes a magnification control unit 8a and a penlight control unit 8b. The magnification control unit 8a outputs a command signal for changing the imaging magnification of the zoom unit 4b based on the analysis information of the four-side estimation unit 7a and the position information calculation unit 7c. In addition, the penlight control unit 8 b outputs a command signal for turning on or off the penlight unit 3 to the electronic pen device 1. As shown in FIG. 1, the command signal D4 from the magnification control unit 8a and the penlight control unit 8b is supplied to the electronic pen device 1.

  Further, as shown in FIG. 1, the image output unit 9 receives the supply of the image data D3 input to the image input unit 6 and outputs it as image data D5. Then, the image data D5 is supplied to the tablet 10.

  FIG. 4 shows an overall view of the tablet 10. The tablet 10 is a device for writing handwritten characters or figures on an image projected by a projector (not shown), and the display 10a provided on the surface is composed of a flat liquid crystal panel or a TFT panel. An image display panel 10b having a display function and a coordinate input unit 10c formed by a group of antennas stretched in the vertical and horizontal directions are provided inside the image display panel 10a. The coordinate input unit 10c detects the coordinates touched by the contact unit 2a, for example, by detecting the radio field intensity distribution in the vertical and horizontal directions on the surface of the display 10a. And the tablet 10 recognizes the locus | trajectory which the contact part 2a of the electronic pen apparatus 1 moved on the display 10a by coordinate input, and draws a character, a line, etc. electronically.

  FIG. 5 is a flowchart of initial setting of the penlight automatic control system 1A. Hereinafter, a system initial setting method in the penlight automatic control system according to the present embodiment will be described with reference to FIG.

  First, the presenter 12 using the penlight automatic control system 1A inputs the horizontal size and vertical size of the screen 11 on the screen size input screen displayed on the display 10a of the tablet 10 (step S1). A schematic diagram of the screen size input screen 13 is shown in FIG. In this figure, in the horizontal size input unit 15 and vertical size input unit 16 shown in the vicinity of the upper edge and the right edge of the pseudo screen 14 displayed at the center of the screen, the presenter 12 has the width and height of the screen 11. Enter the numerical information of the text. The size of the screen 11 input to the horizontal size input unit 15 and the vertical size input unit 16 is transmitted to the analysis control device 5 and recorded as size information in the storage unit 7d of the image analysis unit 7 (step S2).

  Next, the presenter 12 uses the CCD camera unit 4 of the electronic pen device 1 to capture an image of the screen 11 from the position where the presenter 12 actually makes a presentation (step S3). Next, the image data D3 imaged by the CCD camera unit 4 is transmitted to the tablet 10 via the analysis control device 5, and the image is displayed on the display 10a (step S4).

  Next, the presenter 12 checks whether all four sides of the screen 11 are displayed on the display 10 a of the tablet 10. If a part or all of the four sides protrude from the display 10a, the zoom unit 4b of the CCD camera unit 4 is adjusted and the screen 11 is imaged again (step S5). FIG. 7 is a schematic diagram showing a state where an image captured by the CCD camera unit 4 is displayed on the display 10 a of the tablet 10. As shown in this figure, the apparent shape of the screen 11 differs from the original substantially rectangular shape depending on the distance, angle and height between the presenter 12 and the screen 11. Then, the adjustment and imaging of the zoom unit 4b in the CCD camera unit 4 are repeated until all four sides of the screen 11 are displayed on the display 10a.

  Next, when all four sides of the screen 11 are displayed on the display 10a, the presenter 12 traces the four sides of the peripheral edge of the screen 11 in the image displayed on the display 10a with the contact portion 2a of the electronic pen device 1. (Step S6). The locus traced by the contact portion 2a is read as coordinates by the coordinate input portion 10c of the display 10a, and the shape obtained by tracing the apparent shape seen from the CCD camera portion 4 of the screen 11 is analyzed by the tablet 10 as shape information. Send to part 7.

  Next, the position information calculation unit 7c of the image analysis unit 7 calculates the positional relationship between the electronic pen device 1 held by the presenter 12 and the screen 11 based on the size information and the shape information (step S7). Specifically, the size information of the screen 11 stored in step S2 is compared with the quadrilateral as the shape information read by the coordinate input unit 10c in step S6, and the screen 11 looks like a quadrilateral as the shape information. The three-dimensional distance, the degree of rotation, the degree of movement, and the like are derived using a geometric transformation method such as perspective transformation, and distance information and angle information between the screen 11 and the electronic pen device 1 held by the presenter 12 And relative height position information is calculated.

  Next, the magnification control unit 8a of the electronic pen device control unit 8 finely adjusts the zoom unit 4b of the CCD camera unit 4 to focus the image of the screen 11 formed on the image sensor unit 4c of the CCD camera unit 4 ( Step S8). Then, the shape information transmitted from the tablet 10 in step S6 is stored in the storage unit 7d of the image analysis unit 7 (step S9).

  In this way, the CCD camera unit 4 obtains shape information from the apparent shape of the image of the screen 11 taken from the position where the presenter 12 makes a presentation, and stores it in the storage unit 7d, thereby turning on the penlight unit 3. A judgment material for automatic control of off / off can be acquired. Further, by acquiring the dimension information of the screen 11 and further calculating the position information, angle information, and height information of the presenter 12 with respect to the screen 11, the on / off control of the penlight unit 3 is converted into shape information. Therefore, it is possible to obtain a determination material for more accurately performing control based on the above. Further, after the shape information is acquired, the magnification control unit 8a adjusts the zoom of the CCD camera unit 4 so that the CCD camera unit 4 is caused by a deviation in the standing position of the presenter 12 at the initial setting and after the setting. The focus shift can be adjusted.

  FIG. 8 is a flowchart of the on / off control of the penlight unit 3 by the penlight automatic control system 1A according to the present invention. Hereinafter, a processing procedure of on / off control of the penlight unit 3 in the present embodiment will be described with reference to FIG.

  First, when the presenter 12 makes a presentation using a projector (not shown), when the electronic pen device 1 is connected to the analysis control device 5 and the analysis control device 5 is in an operating state, the electronic pen device control unit 8 The pen light control unit 8b activates the electronic pen unit 2 of the electronic pen device 1. In this state, the CCD camera unit 4 periodically takes an image obtained through the lens 4a (step P1). The CCD camera unit 4 transmits the captured image to the analysis control device 5 as image data D3. The analysis control device 5 inputs the image data D3 to the image analysis unit 7 via the image input unit 6.

  Then, the image analysis unit 7 performs the following analysis. First, the four-side estimation unit 7a extracts four-side candidate lines that are straight line groups that are candidates for the four sides of the peripheral edge of the screen 11 from the image data D3 (step P2). Specifically, for example, in general, the screen 11 uses the feature that the inside is white and the peripheral portion is black, and reads the value (density value) of the RGB signal for each pixel of the image data acquired in step P1. Extraction is performed using a method of extracting the white portion and the black portion, or a method of extracting edge information (contour information) by emphasizing the high-frequency components of the entire image data acquired in step P1.

  FIG. 10 is a schematic diagram showing a state in which four-side candidate lines that are candidates for the four sides of the screen 11 are extracted from the image data D3 in step P2. This figure shows a state in which a plurality of straight lines in the vertical and horizontal directions are extracted as the four-side candidate lines 17 in the screen data D3 acquired by the image sensor unit 4c.

  Next, the four-side estimation unit 7a forms an extension line that is a straight line obtained by extending all the four-side candidate lines 17 in both end directions. FIG. 11 is a schematic diagram showing a state in which a plurality of extension lines 18 of the four-side candidate lines 17 are formed in the screen data D3 acquired by the image element unit 4c. Here, the part displayed with a thick line is the original four-sided candidate line 17, and the thin line part in the both ends of the thick line is the extension line 18. In this figure, each of the one line formed from the four-side candidate line 17 and the extension line 18 is formed to have a length slightly shorter than the size of one side in the vertical and horizontal directions of the peripheral edge of the image pickup device portion 4c. A plurality of quadrilaterals surrounded by the quadrilateral candidate lines 17 and the extension lines 18 are formed.

  Next, the formed quadrilateral is matched with the shape information stored in the storage unit 7d in step S9 (step P3). Matching is performed based on the positional relationship of the other three vertices when the quadrangle to be compared with the shape information read from the storage unit 7d is used with one vertex as an axis.

  The specific processing procedure of this matching is shown in the flowchart of FIG. That is, first, one vertex of a quadrilateral to be matched (hereinafter referred to as “target quadrilateral”) is selected as an axis (step P11). Next, the lengths of the four sides are obtained (step P12). Next, the length ratio between the two opposing sides is calculated (step P13). Next, it is determined whether the length of the side is not significantly different from the shape information stored in step S9 (step P14). Specifically, the upper limit threshold and the lower limit threshold are set in the ratio when comparing the length of each of the four sides of the shape information with the four sides of the quadrilateral to be matched, and the ratio exceeds the upper limit threshold, It is determined whether or not one side that falls below the lower threshold is included.

  If there is no side exceeding the threshold as a result of the determination, then the length ratio between the two opposite sides of the shape information stored in step S9 and the two opposite sides of the target quadrilateral By comparing the length ratios of the two, it is determined whether or not the likelihood of both length ratios does not exceed a predetermined threshold (step P15). As a result of the determination, if the likelihood of the length ratio does not exceed the threshold value, then the upper threshold values provided respectively for the four vertex angles of the shape information and the four vertex angles of the target quadrilateral It is determined whether or not the lower threshold value is exceeded (step P16).

  If the result of the determination is that there is no vertex in the target quadrilateral whose angle exceeds the threshold value, the target quadrilateral is selected as the estimated screen periphery, and the part surrounded by this estimated screen periphery is estimated. A screen image is set (step P17).

  When there is even one edge that exceeds the threshold value at Step P14, when the length ratio exceeds the likelihood at Step P15, or when there is even one vertex whose angle exceeds the threshold value at Step P16 In this case, the range surrounded by the target quadrilateral is excluded as not being an estimated screen image (step P18). If there are a plurality of quadrilaterals in which all values exceed the threshold (step P19), a portion surrounded by the union of those quadrilaterals is extracted as an estimated screen image (step P20). . The examination from step P11 to step P20 is performed for all target quadrilaterals (step P21).

  Here, the change in the apparent shape of the screen 11 as seen from the position of the presenter as the presenter 12 is moving, the greater the distance between the presenter 12 and the screen 11, the greater the rate of change. As the rate of change decreases. Therefore, when setting the threshold values used in steps P14, P15, and P16, the distance information acquired in step S7 is used, and if the distance between the screen 11 and the electronic pen device 1 held by the presenter 12 is short, the likelihood is high. The threshold value is set so that the width of the threshold value becomes smaller, and the threshold value is appropriately set so that the likelihood width increases as the distance increases. The threshold value associated with the distance information is calculated by a function depending on the distance, or by referring to a table in which the threshold value for each distance is recorded.

  In addition, when selecting a quadrilateral that is extremely large compared to the shape information, extremely small quadrilateral, or a quadrilateral that is greatly different from the shape information is assumed to be less accurate before matching. As a result, the number of matching operations is reduced, the amount of calculation is reduced, and the processing speed can be increased.

  FIG. 12 is a schematic diagram showing a state in which the estimated screen image 19 specified by the four-side estimator 7a is displayed in the image data D3. In this figure, the quadrilateral abcd and quadrilateral efgh are quadrilaterals that exceeded the threshold in all likelihood judgments, and the union of these two quadrilaterals (range indicated by the mesh line) is estimated It shows that the screen image 19 is formed.

  Then, when the processing from step P11 to step P21 ends, the penlight lighting control processing shown in FIG. 8 is continued. First, after the estimated screen image 19 is obtained, the four-side estimation determining unit 7a checks whether all four sides of the estimated screen image 19 are present in the image data D3 (step P4). When it is determined that all four sides are present in the image data D3, the center information recognition unit 7b recognizes the presence of the reference pixel 4d of the CCD camera unit 4 in the image data D3, and this reference pixel 4d. Is present in the estimated screen image 19 (step P5). In the schematic diagram of the image data D3 shown in FIG. 12, there is data indicating the center pixel 4d at the substantially central portion of the image data obtained by the image stored in the image sensor section 4c, and the center pixel is inside the estimation screen 19. Indicates the existing state. Then, as shown in FIG. 12, when it is determined in step P5 that the reference pixel 4d is inside the estimated screen image 19, the penlight control unit 8b instructs the penlight unit 3 to turn on. , The light irradiation unit 3a is turned on, and the screen 11 is irradiated with laser light (step P6). On the other hand, in step P4, at least some of the four sides in the estimated screen image 19 do not exist in the image data D3 (that is, some of the sides or part of the sides protrude from the image data D3). When it is determined that the reference pixel 4d is outside the portion determined to be the four sides of the estimated screen image 19 in step P5, the penlight control unit 8b turns off the penlight unit 3. Is issued, and the light irradiating unit 3a is turned off (step P7). Then, the processing from step P1 to step P6 is periodically repeated (step P8).

  As described above, in the penlight automatic control system 1A according to the present invention, the CCD camera unit 4 captures an image in the direction indicated by the tip of the pen main body unit 1a, and the image data of the image is analyzed by the analysis control device 5. The penlight unit 3 is analyzed only when the analysis unit 7 analyzes the image data in the direction indicated by the tip of the pen body 1a and the image analysis unit 7 estimates that all four sides of the peripheral portion of the screen 11 are present. By turning on, it is possible to realize automatic control of the penlight that turns on the penlight unit 3 only at the timing when the penlight function is required when the tip of the pen body 1a points in the direction of the screen 11. Further, the image analysis unit 7 further turns on the pen light unit 3 only when the reference pixel 4d indicating the center position of the lens 4a of the CCD camera unit 4 exists in the estimated screen image 19, thereby It is possible to more reliably determine the timing when the penlight function is required in automatic light control.

  Further, the quadrilateral formed based on the straight line extracted from the image data D3 is matched with the shape information which is the apparent shape of the screen 11, and all the four sides of the peripheral portion of the screen 11 are present in the image data D3. By turning on the penlight unit 3 only when it is to be performed, the on / off control of the penlight unit 3 can be reliably performed based on the shape information of the screen 11.

  In the above-described embodiment, the image projector 11 is a screen. However, it may be a projector that can project an image and specify the size of four sides, such as a whiteboard.

  In the above embodiment, the coordinate input unit is formed as the display 10a of the tablet 10. However, the present invention is not limited to this. For example, the coordinates are input by an electronic pen device such as a digitizer or an electronic blackboard, and characters and lines are input. It can also be realized by other coordinate input devices that can input.

  Furthermore, in the automatic control of the above embodiment, when extracting the information estimated as the four sides of the screen, the RGB image data is used as it is and the RGB density value is used or edge enhancement is performed. However, the present invention is not limited to this. For example, a method for estimating the four sides based on the size of luminance information by converting to another color system such as a YUV color system, or a monochrome density value by converting to a monochrome image. Alternatively, the four sides may be estimated after the color system is converted by preprocessing, such as a method of estimating the four sides from the first.

It is a control block diagram of the penlight automatic control system according to the present invention. It is a schematic diagram of the electronic pen apparatus in a penlight automatic control system same as the above. The control block diagram inside an electronic pen apparatus control part in a penlight automatic control system same as the above is shown. It is a schematic diagram of the tablet in a penlight automatic control system same as the above. It is a flowchart of the initial setting of a penlight automatic control system same as the above. It is a schematic diagram of the screen size input screen in a penlight automatic control system same as the above. In the penlight automatic control system, the image captured by the CCD camera unit is displayed on the display of the tablet. It is a flowchart of on / off control of a penlight part in the same penlight automatic control system. It is a flowchart which shows the specific process sequence of matching in a penlight automatic control system same as the above. It is a schematic diagram of the state which extracted the four-side candidate line used as the candidate of the four sides of a screen by the image analysis of a penlight automatic control system same as the above. It is a schematic diagram of the state by which the extended line of the four-side candidate line was formed by the image analysis of a penlight automatic control system same as the above. It is a schematic diagram of the state by which the presumed screen image was specified and displayed by the image analysis of a penlight automatic control system same as the above.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Electronic pen apparatus, 1a ... Pen main-body part, 2 ... Electronic pen part, 3 ... Pen light part, 4 ... CCD camera part (imaging part), 4a ... Lens, 4d ... Reference | standard pixel (center information part), 5 ... Analysis control device, 6 ... image input unit, 7 ... image analysis unit, 7a ... four side estimation unit, 7b ... center information recognition unit, 7c ... position information calculation unit, 7d ... storage unit, 8 ... electronic pen device control unit, 8a Magnification control unit, 8b Pen light control unit, 10 Tablet, 10a Display unit, 10c Coordinate input unit, 11 Screen (image display unit), 12 Presenter, D3, D5 Image data

Claims (6)

An electronic pen unit for touch-inputting the position coordinates to a tablet having a display unit for specifying position coordinates input by contact, a penlight unit for irradiating a light beam in one direction, and an imaging unit for capturing an image in one direction through a lens An electronic pen device provided in the pen body,
An image analysis unit that analyzes image data captured by the imaging unit, and an analysis control device that includes an electronic pen device control unit that controls the electronic pen device based on an analysis result of the image analysis unit,
The image analysis unit
Storage means for storing shape information which is an apparent shape of the projection surface of an image projector having a substantially rectangular projection surface for projecting various images;
Four-side estimation means for collating image data picked up by the image pickup section with the shape information stored in the storage means and estimating whether or not there are four sides of the projection surface in the image data. And
The electronic pen device control unit is a penlight control unit that turns on the penlight unit of the electronic pen device when the four-side estimation unit estimates that all four sides of the projection surface are present in the image data. A penlight automatic control system for an electronic pen with a penlight. The image analysis unit further includes center information recognition means for recognizing presence of a center information unit indicating a center position of the lens of the imaging unit in the image data,
The penlight control unit further turns on the penlight unit of the electronic pen device when the center information recognized by the center information recognition unit is within the range estimated by the four-side estimation unit as the projection plane. The penlight automatic control system of the electronic pen with a penlight of Claim 1 characterized by the above-mentioned. Furthermore, the tablet having a display unit for specifying the position coordinates input by the electronic pen unit and displaying the image data captured by the imaging unit,
The shape information is acquired based on coordinate information input to the display unit by the electronic pen unit based on the projection plane of the image display body that is captured by the imaging unit and displayed on the display unit. The penlight automatic control system of the electronic pen with a penlight of Claim 1 or 2 characterized by these. The imaging unit has a zoom unit that changes an imaging magnification,
4. The penlight-attached device according to claim 1, wherein the electronic pen device control unit includes a magnification control unit that operates the zoom unit to change an imaging magnification of the imaging unit. 5. Electronic pen light automatic control system. An electronic pen unit for touch-inputting the position coordinates to a tablet having a display unit for specifying position coordinates input by contact, a penlight unit for irradiating a light beam in one direction, and an imaging unit for capturing an image in one direction through a lens An electronic pen device provided in a pen main body, and a storage unit for storing shape information that is an apparent shape of the projection surface of an image projector having a substantially rectangular projection surface for projecting various images. In a penlight automatic control method in a penlight automatic control system of an electronic pen with a penlight provided with an analysis control device for controlling
A first step in which the imaging unit captures an image and transmits image data to the analysis control device;
A second step of extracting a straight line from the image data in the analysis control device;
A third step of forming a quadrilateral surrounded by a plurality of the straight lines and the extension lines by forming an extension line obtained by extending the extracted straight lines in both end directions;
A fourth step of matching the quadrilateral with the shape information;
As a result of the matching, when it is estimated that all four sides of the peripheral edge of the projection surface are present in the image data, the analysis control device turns on the penlight unit of the electronic pen unit, When it is estimated that some or all of the four sides of the peripheral portion do not exist in the image data, the analysis control device includes a fifth step of turning off the penlight unit of the electronic pen unit. A penlight automatic control method characterized by. Furthermore, it has a sixth step of confirming whether or not there is a center information part indicating the center position of the lens in the four sides of the estimated peripheral edge of the projection surface,
In place of the fifth step, when it is estimated that all the four sides are present in the image data as a result of the matching, and it is confirmed that the central information part exists inside the estimated four sides, When the pen light part of the electronic pen part is turned on and it is estimated that some or all of the four sides do not exist in the image data, or the central information part does not exist inside the estimated four sides 6. The penlight automatic control method according to claim 5, further comprising: a seventh step of turning off the penlight unit of the electronic pen unit.

Images