JP2012221060A - Installation supporting method for retroreflective material in portable electronic blackboard system and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To propose a mechanism for supporting mounting a retroreflective material at a correct position in order to realize a portable electronic blackboard system.SOLUTION: It is made possible to notify a user of an error in arrangement based on arrangement information on a retroreflective material detected by a position detection device. For example, it is presented on a screen as an arrangement image corresponding to an actual arrangement form by the user. In addition, for example, a determination result about the presence/absence of a gap on an arrangement by a system is presented to the user.

Description

  The present invention relates to a method for supporting the installation of a retroreflective material by a user and a computer program for realizing the function when the electronic blackboard system is configured with a portable position detection unit and a retroreflective material.

  In recent years, handwriting input recognition systems using electronic pens, fingers and other input objects have become widespread. As this type of handwritten input recognition system, a tablet-type input device and an electronic blackboard system (Interactive White Board: IWB) are known.

  Various types of devices have been put to practical use in the electronic blackboard system. For example, some display devices use a plasma display panel (PDP), a liquid crystal display (LCD), a projector, or the like. In addition, as an operation input detection method, there is a method using an infrared method, a touch panel method, an electromagnetic induction method, or the like.

  As an object used for input (hereinafter referred to as “input object”), a human body (hand or finger), a stylus pen, an electronic pen, or the like is used according to an operation input detection method.

  When the electronic blackboard system is used, characters and figures can be drawn on the display screen by the same operation as drawing with chalk on the blackboard. Specifically, the position detection device detects the position of the input object on the operation input surface, the calculation device processes the detection information, and the processing result is reflected on the display screen of the display device. Thus, basically, the handwriting of the input object is displayed as it is on the display screen.

  The infrared electronic blackboard system detects the presence of an obstacle based on whether or not the projected infrared ray is blocked, and specifies the coordinates of the obstacle based on the detection result. In addition, for the detection of coordinates, it is essential that the entire coordinate detection surface is irradiated with infrared rays without gaps. Therefore, when this type of electronic blackboard system is configured to be portable, it is important to spread infrared rays over the entire coordinate detection surface without any gaps. If there is a position where infrared rays do not reach, the input object at that position cannot be detected, or it is erroneously detected as if the input object was found even if there was no input object.

  In order to spread infrared rays without gaps, it is necessary to notify the user of areas and states where infrared rays have not reached and guide the user so that the retroreflective material can be correctly installed.

  As a result of earnest examination of the above problems, the present inventor has invented a method and a program for supporting appropriate installation of a portable retroreflective material by a user. Here, one invention relates to a function of presenting, on a screen, arrangement information of retroreflective material detected by a position detection device as an arrangement image image corresponding to an actual arrangement mode by a user. Moreover, one invention relates to the function which determines the presence or absence of the clearance gap on arrangement | positioning from the arrangement | positioning information of the retroreflective material which the position detection apparatus detected, and shows the said determination result to a user.

  According to one invention, it can be shown to a user through the arrangement image corresponding to an actual arrangement mode how a retroreflection material which a user arranged is detected by a position detection device. For this reason, the user can visually understand an installation error and can correct a problematic arrangement position while confirming the image.

  Moreover, according to one invention, the user can receive the determination result with respect to the presence or absence of the clearance gap on the arrangement | positioning of a retroreflection material from a system. Thereby, the user can correct the arrangement of the problematic retroreflecting material according to the determination result.

  Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

The figure which shows the conceptual structure of the electronic blackboard system which concerns on an infrared system. The figure which shows the cross-sectional structure of the electronic blackboard system which concerns on an infrared system. The figure which shows the conceptual structure of a portable electronic blackboard system. The figure explaining the imaging result (captured image) by a position detection apparatus. The flowchart explaining the outline | summary of the attachment assistance procedure of the portable part in an electronic blackboard system. The flowchart explaining an example of the process sequence which assists attachment of a retroreflection material. The figure explaining the example of a screen shown to a user, and the creation principle. The flowchart explaining the other process sequence which assists attachment of a retroreflection material. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The flowchart explaining the other process sequence which assists attachment of a retroreflection material. The figure explaining the determination principle of a clearance gap. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The flowchart explaining the other process sequence which assists attachment of a retroreflection material. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The flowchart explaining the other process sequence which assists attachment of a retroreflection material. The figure explaining the calculation principle of a screen size. The figure explaining the calculation principle of length per pixel. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user. The figure which shows the other example of a screen shown to a user.

  Hereinafter, based on the drawings, an example of a case in which the present invention is applied to an electronic blackboard system will be described. Note that each of the exemplary embodiments described below is an example, and the present invention is well-known to a system realized by combining arbitrary functions described in this specification, and some configurations and functions described in this specification. The system replaced by this technology is also included. In addition, the function executed in the embodiment described later will be described as being realized as a program executed on a computer (computer). However, part or all of the program may be realized through hardware.

(Basic configuration of electronic blackboard system)
FIG. 1 shows a configuration example of an electronic blackboard system according to the embodiment. The electronic blackboard system according to the embodiment includes a projection surface 101, a position detection device 102, a display screen projection device 104, a control computer 105, a keyboard 106 and a display device 107 attached thereto, and a retroreflective material 108. .

  As described above, in this embodiment, an electronic blackboard system that projects an operation screen from the display screen projection device 104 onto the surface of a screen or the like will be described. However, the display format of the operation screen is arbitrary, and a liquid crystal display, an organic EL display, or other flat panel displays may be used.

  The position detection device 102 includes a light source that can radiate infrared rays radially along the surface of the projection surface 101 and an image sensor that captures infrared light reflected by the retroreflecting material 108. The retroreflective material 108 is basically a tape-like member that constitutes a reflective surface by arranging a number of special microstructures that can reflect incident light in the same direction as the incident direction. In the case of this embodiment, the retroreflecting material 108 is attached so as to surround the lower side, the left side, and the right side of the projection plane 101. Note that the reflection surface (tape surface) on which the microstructures are arranged is arranged perpendicular to the projection surface 101.

  In the electronic blackboard system of FIG. 1, two position detection devices 102 are used to detect the coordinate point of the input object using the principle of triangulation. In the case of this embodiment, the two position detection devices 102 are attached near the left and right center of the upper side of the projection plane 101. However, as long as the positional relationship enables triangulation, the attachment positions of the two position detection devices 102 are arbitrary. The position detection device 102 has an imaging angle of approximately 180 degrees, and includes the entire lower side, left side, and right side of the projection plane 101 in the imaging range.

  FIG. 2 shows a cross-sectional configuration of the electronic board system according to the embodiment. It can be seen that the infrared rays 22 emitted from the light source of the position detection device 102 are incident on the reflecting surface of the retroreflecting material 108 and reflected in the incident direction. The image sensor of the position detection device 102 images this reflected light beam. The surface 24 of the electronic board system and the optical path of the infrared ray 22 are arranged in parallel. For this reason, the image sensor images the reflection surface of the retroreflecting material 108 as a white region (bright region) and images an area other than the reflection surface as a black region (dark region). When an input object such as a finger is positioned at or near the surface 24 of the electronic board system, the infrared rays 22 are blocked. For this reason, the state in which the infrared ray 22 is blocked by the input object is imaged by the image sensor 21 as a black region (dark region).

(Configuration of portable electronic blackboard system)
FIG. 3 shows a configuration example of a portable electronic blackboard system. In FIG. 3, parts corresponding to those in FIG. The types of devices and parts constituting the portable electronic blackboard system are the same as the types of devices and parts of the electronic blackboard system shown in FIG. However, in the case of a portable electronic blackboard system, the position detection unit 301 and the retroreflecting material 308 on which two position detection devices 302 are mounted are portable members, and the positional relationship between these members and the projection surface 101 is determined in advance It is not fixed. For this reason, in the case of a portable electronic blackboard system, the user himself attaches the position detection unit 301 and the retroreflecting material 308 according to the usage mode.

  For mounting the position detection unit 301 and the retroreflecting material 308 on the mounting surface, a magnet, a double-sided tape, a screw, a locking tool, or the like is used. Thus, the attachment mode to the attachment surface is assumed not only to be detachable but also to a fixed case. By attaching these components to an arbitrary wall surface or whiteboard, an electronic blackboard system with a high degree of freedom in installation can be constructed.

  Note that the retroreflecting material 308 may have the same length as each side constituting the projection plane 101. However, this will impair the ease of transportation. Therefore, the case of FIG. 3 represents a case where each side is constituted by two retroreflective members 108 in consideration of ease of transportation. Note that the retroreflecting material 308 constituting each side may have one type or a plurality of sizes. Further, the retroreflecting material 308 is not limited to the case where the length of the reflecting surface is fixed, but may be one that can change the length of the reflecting surface.

  In this embodiment, the position detection unit 301 calculates the coordinate position of the input object from the captured image captured by the pair of left and right position detection devices 302 using a calculation device (not shown), and outputs it to the control computer 305. Further, the position detection unit 301 outputs a captured image of the pair of left and right position detection devices 302 to the control computer.

(Captured image)
FIG. 4 shows a captured image of the retroreflecting material 308 captured by the position detection device 302 of the portable electronic blackboard system. As described above, the imaging angle of the position detection device 302 is almost 180 degrees. Therefore, the position detection device 302 can image all the retroreflective materials located on the left side, the lower side, and the right side of the projection surface 101 at a time. A black belt portion in FIG. 4 corresponds to the imaging range 401 of the position detection device 302.

  The white belt portion of the imaging range 401 represents an image obtained by imaging the reflection surface of each retroreflecting material 308. In FIG. 4, the images corresponding to the individual retroreflecting materials 308 are deformed instead of being rectangular, because the retroreflecting material 308 is imaged thinly in direct proportion to the distance from the position detection device 302. is there. In other words, the retroreflecting material 308 located near the position detection device 302 is imaged thickly.

  For this reason, the images picked up by the pair of left and right position detection devices 302 are not exactly the same, and are slightly different depending on the attachment position. However, in FIG. 4, the difference is omitted, and an image captured when only one position detection device 302 is arranged at the center of the upper side is shown as a representative image.

  By the way, in FIG. 4, it draws so that there may be some clearance gap between the retroreflection material 308 in each edge | side, or the retroreflection material 308 between each edge | side. These gaps are shown to explain that each side is composed of a plurality of retroreflective members 308. In actual usage, it is necessary to install these gaps so as not to leave these gaps. There is.

  In addition, in the imaging range 401 of FIG. 4, the reflected light corresponding to each retroreflecting material 308 is imaged as an independent white band, but when the retroreflecting material 308 is correctly installed, the imaging is performed. Only one white band is imaged within the range 401.

(Supporting function for mounting portable parts)
Next, a description will be given of a mounting support function for a portable member mounted on the control computer 305. As described above, the position detection unit 301 and the retroreflecting material 308 are portable, and the user installs them. At this time, the position of the input object cannot be detected correctly unless the detection area by infrared rays can be stretched without a gap. Specifically, as shown in FIG. 4, if there are a plurality of white bands in the imaging range of the image sensor, the position of the input object cannot be detected correctly.

  Therefore, a program for supporting correct attachment of the movable member by the user (hereinafter referred to as “attachment support program”) is installed in the control computer 305 according to the embodiment. FIG. 5 shows an outline of the processing procedure of the program. The program is activated through an operation input from the user. In addition, the support for attaching the movable part by the user is executed through display of a support screen on the projection plane 101 and the display device 107.

  First, the attachment support program executes processing 501 for guiding the attachment position of the position detection unit 301. In the processing 501, the attachment support program displays a screen for guiding the attachment position so that the position detection unit 301 is disposed at a position slightly closer to the center of the upper side of the projection plane 101 and slightly outside the upper side. For example, when the support screen is projected onto the projection plane 101, an area where the position detection unit 301 is to be actually attached is indicated as a frame line or a colored area, or a guidance screen illustrating the attachment area is displayed. In addition, the attachment support program may be equipped with a function for presenting the attachment position by text or voice.

  When the attachment of the position detection unit 301 is completed, the attachment support program executes processing 502 for guiding the portable retroreflecting material 308 to the correct attachment position. For example, when the support screen is projected on the projection plane 101, an area where the retroreflecting material 308 is actually attached is presented by a frame line or a colored area. In the processing 502, several processing functions are provided to assist the user in attaching the retroreflecting material 308. Specific examples will be described below. Note that the attachment support program described later is repeatedly executed while the retroreflecting material 308 is attached.

  It is assumed that the control computer 305 always receives captured image data from the position detection unit 301 in order for the attachment support program according to a specific example described later to provide a predetermined function.

(Specific example 1)
FIG. 6 shows an example of the processing procedure of the attachment support program executed in processing 502.
6 acquires an image corresponding to the imaging range 711 (FIG. 7) of the image sensor (process 601). As described above, the imaging angle of the image sensor is approximately 180 degrees. Accordingly, the band-shaped imaging range 711 includes all the reflection surface images of the retroreflecting material 308 located on the left side, the lower side, and the right side of the projection surface 101.

  Next, the attachment support program transforms the captured image so as to match the actual arrangement of the retroreflecting material 308 (processing 602). Here, the attachment support program uses the aspect ratio of the resolution of the computer screen projected onto the projection plane 101 and executes the deformation process of the captured image. In general, the aspect ratio of the resolution (the number of horizontal pixels 702 and the number of vertical pixels 701) of the computer screen is given as 4: 3, 16: 9, or 16:10. The attachment support program acquires the resolution information from the control computer 305. However, the aspect ratio of the resolution may be acquired in an interactive manner from the user who installs the portable electronic blackboard system.

  In the case of this embodiment, the acquired resolution is assumed to be horizontal 4: vertical 3. In this case, the attachment support program divides the imaging range 711 into three areas of 3: 4: 3 in the longitudinal direction. At this time, the three regions correspond to the left side image, the lower side image, and the right side image in order from the left side. In the process 602, the attachment support program generates a support screen 712 in which the three areas are deformed so as to match the actual arrangement of the retroreflecting material 308 as shown in the upper part of FIG. It is assumed that the attachment support program knows information about how many retroreflective members 308 are arranged on each side. For example, it is assumed that this information is given in advance through an interactive form with the user.

  Thereafter, the attachment support program displays the generated support screen 712 on the screen of the projection plane 101 or the display device 107 (process 603). The user who has seen the support screen 712 shown in FIG. 7 has a gap at the joint between the two retroreflective members 308 constituting each side, the joint between the lower side and the left side (lower left corner), and the lower side and the right side. It is possible to visually recognize that there is a gap at the joint (lower right corner).

  At this time, the images of the three areas constituting the support screen 712 are cut out from the output image of the image sensor constituting the position detection device 302. Therefore, the user can objectively determine whether or not there is a gap between the two retroreflective members 308 attached to the attachment surface. In the case of FIG. 7, the user can determine that each side and each corner should be close to each other.

  In FIG. 7, black bands (dark regions) also exist in portions corresponding to both ends of the imaging range 711 (that is, the upper ends of the left side and the right side). Naturally, even if an input object exists on the infrared optical path that irradiates this region, the presence or absence of the input object cannot be detected by the electronic blackboard system. However, if the user does not intentionally use this non-detection area, there are few practical problems unlike the gaps in other area portions.

  As described above, the user can objectively determine whether or not the portable member is attached to the correct position for detecting the input object by the electronic blackboard system. In addition, the support screen 712 is presented to the user as an arrangement image image modified so as to match the actual arrangement mode of the retroreflecting material 308, not the imaging screen itself of the image sensor. For this reason, even a user who does not have specialized knowledge can easily recognize the position and size of the gap. In addition, regarding the positional deviation of the retroreflecting material 308 over time, the user can easily grasp the problem location. For this reason, continuous maintenance by the user himself / herself is also possible.

(Specific example 2)
FIG. 8 shows an example of the processing procedure of the attachment support program executed in processing 502.
Also in the case of the attachment support program shown in FIG. 8, first, an image corresponding to the imaging range 711 (FIG. 7) of the image sensor is acquired (processing 801).

  Next, the attachment support program acquires the attachment position information of the retroreflecting material 308 from the captured image (processing 802). At this time, the attachment support program refers to, for example, information regarding the aspect ratio of the resolution of the computer screen and the number of retroreflective members 308 constituting each side. In this case, the attachment support program recognizes the lower side image, the left side image, and the right side image from the captured image, and associates them with the number information of the retroreflective material 308 existing in each image, so that the retroreflective material 308 on each side. Determine the mounting position.

  Thereafter, the attachment support program generates an arrangement image image so as to match the actual arrangement of the retroreflecting material 308 based on the acquired attachment position information (processing 803). This processing is a processing operation for facilitating intuitive understanding by the user, as in the case of the first specific example.

  However, in the case of this specific example, an arrangement image is generated in order to make it easier for the user to understand. The captured image of the image sensor is information itself used in the position detection process of the input object, and is the most accurate information in that sense. However, in consideration of presenting to a general user, an image that can more intuitively imagine the arrangement relationship is considered desirable.

  In the case of this specific example, the attachment support program detects the positional relationship of the retroreflecting material 308 by, for example, associating the white belt portion in the captured image with the length information of the retroreflecting material 308. For example, when the retroreflective material 308 has a fixed length, the length of the white belt portion should be given by a natural multiple of the retroreflective material 308.

  Further, even when the length of the retroreflective material 308 can be varied, if the length of the white belt portion exceeds the maximum variable length of the retroreflective material 308 and exceeds twice the shortest length, It can be detected that the white belt portion corresponds to the arrangement of the two retroreflective members 308. The conditions used to accurately determine the arrangement of the retroreflecting material 308 need to be determined according to the dimensions and usage conditions of the retroreflecting material 308 used.

  Thereafter, the attachment support program displays the generated arrangement image on the screen of the projection plane 101 or the display device 107 (processing 804).

  9 to 12 show display examples of the support screen 911. FIG. FIG. 9 and FIG. 10 are examples in which the arrangement positions of the individual retroreflecting materials 308 are represented by one block 901. Of course, the arrangement of the block 901 on the support screen 911 is performed in association with the actual attachment position of the retroreflecting material 308 by the user. The user who has seen the support screen 911 in FIG. 9 can determine that the two retroreflective members 308 are arranged without gaps. On the other hand, in the case of the support screen 911 in FIG. 10, the user can check the gap 902 between the two retroreflective members 308 constituting the right side. For this reason, the user can easily confirm that there is a problem in the attachment of the right side.

  FIG. 11 and FIG. 12 are examples in which the arrangement positions of the individual retroreflecting materials 308 are represented by photographic images 921 of the retroreflecting materials 308 that are actually used. In FIGS. 11 and 12, a photographic image 922 corresponding to the position detection unit 301 is also displayed. FIG. 11 is an example in which there is a gap 923 near the center of the right side, and FIG. 12 is an example in which there is a gap 923 at the upper end of the left side. In this case, it is necessary to register or select the photographic images 921 and 922 to be used in advance. In this way, the external shape of the retroreflecting material 308 that is actually arranged is displayed on the support screen 911 as it is, so that the user can more intuitively grasp the location of the gap.

(Specific example 3)
FIG. 13 shows an example of the processing procedure of the attachment support program executed in processing 502.
Also in the case of the attachment support program shown in FIG. 13, first, an image corresponding to the imaging range 711 (FIG. 7) of the image sensor is acquired (process 1301).

  Next, the attachment support program acquires the attachment position information of the retroreflecting material 308 from the captured image (processing 1302). Also in this case, the attachment support program refers to information regarding the aspect ratio of the resolution of the computer screen, the number of retroreflective members 308 constituting each side, and the like.

  Thereafter, the attachment support program determines whether or not there is a gap appearing in the imaging range 711 (process 1303). FIG. 14 shows the determination principle of the gap by the installation support program. FIG. 14 is an enlarged view of a part of an image within the imaging range 1401 of the image sensor. The square in the figure represents one pixel. In the figure, the pixel 1402 where the reflected light from the reflecting surface of the retroreflective material 308 enters is expressed in white, and the region where the retroreflective material 308 does not exist (including the gap 1403) is expressed in black.

  In the case of this embodiment, the attachment support program observes one pixel row extending in the longitudinal direction of the captured image, and determines whether or not there is a pixel expressed in black for each pixel. If even one pixel expressed in black is detected, the position is determined as the gap 1403. Note that the continuous number of pixels expressed in black corresponds to the width of the gap.

  When the determination of the gap is completed, the attachment support program displays the determination result as character information on the screen of the projection surface 101 or the display device 107 (processing 1304).

  FIG. 15 shows a display example of the support screen 1511. FIG. 15 shows an example of displaying as a message 1512 which position the installation support program determines that a gap exists. In this way, by specifically displaying the gap portion through the character information, the user can pay attention to the retroreflecting material 308 located on the right side and adjust the attachment position. Although FIG. 15 represents only the side where the gap exists, it may be expressed by specifying the position of the gap more specifically.

  In the case of FIG. 15, only the characters are displayed on the support screen 1511. However, the support screen described in specific example 1 and specific example 2 and the character information may be displayed in combination. 16 and 17 show examples of combinations with the specific examples. A support screen 1611 illustrated in FIG. 16 is a diagram in which the captured image according to the first specific example and the message 1512 are combined. Thus, by combining with character information, it becomes easier to confirm a region with a gap as compared with the case where only a captured image is displayed. Also, the support screen 1711 illustrated in FIG. 17 is a diagram in which the arrangement image image according to the second specific example and the message 1512 are combined. Again, by combining with character information, it becomes easier to confirm a region with a gap as compared with the case where only the arrangement image is displayed.

(Specific example 4)
FIG. 18 shows an example of the processing procedure of the attachment support program executed in processing 502.
Also in the case of the attachment support program shown in FIG. 18, first, an image corresponding to the imaging range 711 (FIG. 7) of the image sensor is acquired (process 1801).

  Next, the attachment support program acquires the attachment position information of the retroreflecting material 308 from the captured image (processing 1802). Here, the attachment support program also refers to information regarding the aspect ratio of the resolution of the computer screen, the number of retroreflective members 308 constituting each side, and the like.

  Thereafter, the attachment support program determines whether or not there is a gap appearing in the imaging range 711 (process 1803). The gap determination method by the attachment support program is the same as the processing 1303 (FIG. 13) described above.

  When the determination of the gap is completed, the attachment support program generates an arrangement image image generated so as to match the actual arrangement of the retroreflecting material 308 and reflects the determination result of the gap in the arrangement image image. The image is displayed on the screen (process 1804).

  FIG. 19 shows a display example of the support screen 1911. This support screen 1911 is an example in which the position of the detected gap is indicated by a broken line block 1912 for the arrangement image corresponding to the specific example 2. In the case of FIG. 19, it is shown that there is a gap in the upper left corner. Further, the size of the gap to be filled can also be expressed by the size of the broken line block 1912.

  However, the display by the broken line block 1912 may be difficult to visually recognize on the screen when the gap is small. When the size of the gap is small, the support screen 2011 shown in FIG. 20 or the support screen 2111 shown in FIG. 21 may be used. The support screen 2011 is a display form in which the range of the gap is indicated by an arrow (bidirectional arrow) 2012, and the support screen 2111 is a display form in which the position of the gap is indicated by an arrow 2112 as a pinpoint.

  In addition, the block 901 representing the retroreflective material 308 having a problem in the side or arrangement including the gap can be expressed by a color difference. In the support screen 2211 shown in FIG. 22, the left side, the lower side, and the right side are each represented by one block, the lower side and the right side without a gap are represented by, for example, a blue block 2212, and the left side with a gap is represented by, for example, a red block 2213. Express. In this way, the user can easily confirm a side having a gap by expressing the color difference. However, if the expression by color coding is performed in units of sides, it is difficult to know whether there is a problem in attaching one of the retroreflective members 308 constituting each side or both. Therefore, as shown in the support screen 2311 shown in FIG. 23, only the block 2313 corresponding to the retroreflecting material 308 having a problem in the mounting position is given a red color or other colors that attract attention, and the other blocks 2312 are colored blue. You may attach. In this way, if the coloring range is in units of blocks, the adjustment target of the attachment position can be clarified.

(Specific example 5)
FIG. 24 shows an example of the processing procedure of the attachment support program executed in processing 502.
Also in the case of the attachment support program shown in FIG. 24, first, an image corresponding to the imaging range 711 (FIG. 7) of the image sensor is acquired (process 2401).

  Next, the attachment support program acquires the attachment position information of the retroreflecting material 308 from the captured image (processing 2402). Here, the attachment support program also refers to information regarding the aspect ratio of the resolution of the computer screen, the number of retroreflective members 308 constituting each side, and the like.

  Thereafter, the attachment support program determines whether or not there is a gap appearing in the imaging range 711 (FIG. 7) (processing 2403). The gap determination method by the attachment support program is the same as the processing 1303 (FIG. 13) described above.

  When the position of the gap is confirmed, the attachment support program calculates the distance (length) of the gap that appears in the imaging range 711 (process 2404). A method for calculating the distance by the attachment support program will be described with reference to FIGS. 25 and 26.

  First, as shown in FIG. 25, the attachment support program calculates the distance to the retroreflecting material 308 disposed on the lower side of the projection plane 101 based on the captured image of the image sensor. As described above, in the imaging range 2501, the light reflected by the reflecting surface of the retroreflecting material 308 is imaged in the form of a white band. FIG. 25 shows a state in which the two retroreflective members 308 arranged on each side are arranged apart from each other as in the case of FIG. For this reason, six white bands appear in the imaging range 2501.

  Here, when the retroreflecting material 308 is disposed at a position separated by a predetermined reference distance, the attachment support program determines how much the thickness (number of pixels) of the white band is detected. Suppose you know. The value is stored in a storage area (not shown).

  Here, the attachment support program compares the thickness of the white band appearing in the left and right center portion 2502 of the imaging range 2501 with the thickness of the reference distance stored in the storage area, so that the position detection unit 301 moves downward. The distance to the arranged retroreflecting material 308 is calculated. Here, when the reference distance is 1 m, it is assumed that the white band appearing in the left and right central portion 2502 is imaged with 10 pixels.

  In this case, if the thickness of the white band of the right and left central portion 2502 actually measured is 5 pixels, the attachment support program will go from the position detection unit 301 to the retroreflecting material 308 disposed on the lower side. Is determined to be 2 m. This is because the number of pixels at the time of measurement is half of the number of pixels at the reference distance.

  On the other hand, if the thickness of the white band of the right and left central portion 2502 actually measured is 20 pixels, the attachment support program determines that the distance from the position detection unit 301 to the retroreflecting material 308 disposed on the lower side is 0. It is determined that the distance is 5 m. This is because the number of pixels at the time of measurement is twice the number of pixels at the reference distance.

  Note that a plurality of retroreflective members 308 are generally disposed on the lower side of the projection plane 101. For this reason, there is a possibility that a gap is also included in the left and right central portion 2502. In this case, there is a possibility that a white band does not exist in the left and right central portion 2502 set in advance. Therefore, the average thickness of the white band corresponding to the left and right central portion 2502 may be used as a measurement value, or a portion considered to be a gap may be omitted in advance from the thickness calculation target. By adopting such a device, the calculation accuracy of the distance by the attachment support program can be increased.

  Now, the distance calculated by the attachment support program corresponds to the vertical distance 2602 in FIG. The attachment support program uses this vertical distance 2602 to calculate the left side length 2603, the lower side length 2604, and the right side length 2605 of the screen 2601. Here, it is utilized that the vertical distance 2602 is the same as the left side length 2603 and the right side length 2605. The attachment support program also uses the aspect ratio of the resolution of the computer screen. As described above, in the case of a general computer screen, the aspect ratio of the resolution (the number of horizontal pixels 702 and the number of vertical pixels 701) is given as 4: 3, 16: 9, or 16:10. Of course, even when an aspect ratio other than this is used, the attachment support program can know the aspect ratio.

  Here, it is assumed that the acquired resolution is, for example, horizontal 4: vertical 3. In this case, the attachment support program shows that the number of pixels of the left side image in the imaging range 711 and the ratio of the number of pixels of the right side image and the number of pixels of the lower side image are given by 3: 4. Thereby, even when one white band is imaged without any gap in the imaging range 711, the boundary position between the left and right sides and the lower side can be determined.

  Here, when the vertical distance 2602 is applied to the aspect ratio of the screen, the attachment support program can calculate the unknown lower side length 2604 of the screen. As a result, the length (= left side length 2603 + bottom side length 2604 + right side length 2605) corresponding to the imaging range 711 is known. Since the number of pixels in the longitudinal direction of the imaging range 711 is known, the distance corresponding to one pixel can be determined by dividing the calculated length of the imaging range 711 by the number of pixels. As described above, the attachment support program acquires the width of the gap as the number of pixels. Therefore, the attachment support program can calculate the distance (length) of the gap by multiplying the number of pixels giving the width of the gap by the distance per unit pixel.

  When the gap distance is calculated, the attachment support program displays the determination result as character information on the projection plane 101 or the screen of the display device 107 (processing 2405).

  FIG. 27 shows a display example of the support screen 2711. FIG. 27 shows an example in which a message 2712 is displayed as to which position the cm of the gap exists at which position is determined by the attachment support program. This display shows that the user has a 5 cm gap on the right side described in the message 2712. The display example in FIG. 27 is intended for a large gap, so it is difficult to understand the advantage of knowing the distance, but when the gap is small, such as several millimeters, more accurate information is given to the user. Can do. Also in this case, the position of the gap may be more specifically specified to express the length of the gap.

  In the case of FIG. 27, only characters are displayed on the support screen 2711. However, the support screen described in specific example 1 and specific example 2 may be combined with character information. 28 to 30 show examples of combinations with specific examples. A support screen 2811 illustrated in FIG. 28 is a combination of the captured image and the message 2812 according to the first specific example. Thus, by combining with character information, it becomes easier to confirm a region with a gap as compared with the case where only a captured image is displayed. Further, the support screen 2911 shown in FIG. 29 is a diagram in which the arrangement image image according to the specific example 2 and the message 2912 are combined. Again, by combining with character information, it becomes easier to confirm a region with a gap as compared with the case where only the arrangement image is displayed. In addition, the support screen 3011 illustrated in FIG. 30 is a diagram in which a screen displaying the photographic image 921 of the retroreflective material 308 and the photographic image 922 corresponding to the position detection unit 302 in the specific example 2 and the message 3012 are combined. . Again, by combining with character information, it becomes easier to confirm a region with a gap as compared with the case where only the arrangement image is displayed.

(Other examples)
In addition, this invention is not limited to the form example mentioned above, Various modifications are included. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Moreover, it is possible to replace a part of a certain form example with the structure of another form example, and it is also possible to add the structure of another form example to the structure of a certain form example. Moreover, it is also possible to add, delete, or replace another structure with respect to a part of structure of each form example.

  Moreover, you may implement | achieve some or all of each structure, a function, a process part, a process means, etc. which were mentioned above as an integrated circuit or other hardware, for example. Each of the above-described configurations, functions, and the like may be realized by the processor interpreting and executing a program that realizes each function. That is, it may be realized as software. Information such as programs, tables, and files for realizing each function can be stored in a memory, a hard disk, a storage device such as an SSD (Solid State Drive), or a storage medium such as an IC card, an SD card, or a DVD.

  Control lines and information lines indicate what is considered necessary for the description, and do not represent all control lines and information lines necessary for the product. In practice, it can be considered that almost all components are connected to each other.

DESCRIPTION OF SYMBOLS 101 ... Projection surface, 102 ... Position detection apparatus, 104 ... Display screen projection apparatus, 105 ... Control computer, 106 ... Keyboard, 107 ... Display apparatus, 108 ... Retroreflective material, 301 ... Position detection unit, 302 ... Position detection 305 ... control computer, 308 ... retroreflective material, 401 ... imaging range, 711 ... imaging range, 712 ... support screen, 901 ... block, 902 ... gap, 911 ... support screen, 921, 922 ... photographic image, 923: Gap, 1401 ... Imaging range, 1402 ... Pixel, 1403 ... Gap, 1511 ... Support screen, 1512 ... Message, 1611 ... Support screen, 1711 ... Support screen, 1911 ... Support screen, 1912 ... Broken line block, 2011 ... Support screen 2111 ... support screen, 2012 ... arrow, 2112 ... arrow, 2211 ... support screen 2212 ... Block, 2213 ... Block, 2311 ... Support screen, 2312 ... Block, 2313 ... Block, 2501 ... Imaging range, 2502 ... Left and right center range, 2601 ... Screen, 2602 ... Vertical distance, 2603 ... Left side length, 2604 ... Bottom side Length, 2605 ... right side length, 2711 ... support screen, 2712 ... message, 2811 ... support screen, 2812 ... message, 2911 ... support screen, 2912 ... message, 3011 ... support screen, 3012 ... message.

Claims (15)

Position detection having an optical unit capable of illuminating the entire reflection surface of a plurality of retroreflective members disposed on at least three sides surrounding the coordinate detection surface, and two image sensors each including at least the three sides in the imaging range A computer that constitutes an electronic blackboard system in which the unit and the plurality of retroreflecting materials are all portable,
Processing to acquire a captured image of the image sensor;
Based on the acquired captured image, a process of generating an arrangement image image associated with the actual arrangement of the plurality of retroreflecting materials;
A program that executes the process of displaying the generated layout image on the display screen. The program according to claim 1,
The arrangement image image is an image obtained by deforming the captured image. The program according to claim 1,
The arrangement image image is an image in which a block image representing each retroreflective material is arranged at an arrangement position of each retroreflective material obtained through signal processing of the captured image. The program according to claim 1,
The arrangement image image is an image in which a photographic image of each retroreflective material is arranged at an arrangement position of each retroreflective material obtained through signal processing of the captured image. Position detection having an optical unit capable of illuminating the entire reflection surface of a plurality of retroreflective members disposed on at least three sides surrounding the coordinate detection surface, and two image sensors each including at least the three sides in the imaging range A computer that constitutes an electronic blackboard system in which the unit and the plurality of retroreflecting materials are all portable,
Processing to acquire a captured image of the image sensor;
A process for determining whether or not there is a gap in the arrangement of the plurality of retroreflecting materials based on the captured image;
A program that executes the process of displaying the judgment result on the display screen. The program according to claim 5,
A program for displaying the determination result as character information. The program according to claim 6,
The determination result is expressed by a specific numerical value of the gap distance. The program according to claim 5,
Based on the acquired captured image, a process of generating an arrangement image image associated with the actual arrangement of the plurality of retroreflecting materials;
A program for displaying the determination result together with the arrangement image. The program according to claim 8, wherein
The arrangement image image is an image obtained by deforming the captured image. The program according to claim 8, wherein
The arrangement image image is an image in which a photographic image of each retroreflective material is arranged at an arrangement position of each retroreflective material obtained through signal processing of the captured image. The program according to claim 8, wherein
The arrangement image image is an image in which a block image representing each retroreflective material is arranged at an arrangement position of each retroreflective material obtained through signal processing of the captured image. The program according to claim 8, wherein
The program according to claim 1, wherein the determination result is expressed in different colors between a mounting position having a gap and a mounting position having no gap. The program according to claim 8, wherein
The determination result is expressed by an arrow designating a position having a gap. Position detection having an optical unit capable of illuminating the entire reflection surface of a plurality of retroreflective members disposed on at least three sides surrounding the coordinate detection surface, and two image sensors each including at least the three sides in the imaging range In a method for supporting the installation of the retroreflective material in an electronic blackboard system in which the unit and the plurality of retroreflective materials are all portable,
Processing for obtaining a captured image from the image sensor;
Based on the acquired captured image, a process of generating an arrangement image image associated with the actual arrangement of the plurality of retroreflecting materials;
And a process of displaying the generated arrangement image on the display screen. Position detection having an optical unit capable of illuminating the entire reflection surface of a plurality of retroreflective members disposed on at least three sides surrounding the coordinate detection surface, and two image sensors each including at least the three sides in the imaging range In a method for supporting the installation of the retroreflective material in the electronic blackboard system in which the unit and the plurality of retroreflective materials are all portable,
Processing to acquire a captured image of the image sensor;
A process for determining whether or not there is a gap in the arrangement of the plurality of retroreflecting materials based on the captured image;
And a process of displaying the determination result on the display screen.

Images