JP2013045324A - Display device, control method of the same and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device allowing a displayed figure to be easily deformed with intuitive operation, and a control method of the display device.SOLUTION: A display device comprises: a projection optical system for displaying a video screen on a projection surface 4; a tool information detector for, in a polygonal tool 3e in which a plurality of members are coupled to one another via movable coupling portions, detecting positional information of a plurality of detection points arranged at individual ones of the plurality of members or at the coupling portions of the polygonal tool 3e; and a controller that determines a deformed state of the polygonal tool 3e on the basis of the positional information detected at individual ones of the plurality of detection points and causes a polygonal object 65 corresponding to the deformed state of the polygonal tool 3e to be displayed.

Description

  The present invention relates to a display device that displays a video screen on a display surface and performs display control of the video screen in accordance with an operation on the display surface, a control method for the display device, and a program.

  Conventionally, as a display device of this type, a number of sensors that detect the locus of characters or the like written on the writing surface of an electronic blackboard with a writing instrument, and characters written on the writing surface based on image data of the locus detected by this sensor And a recognition means for recognizing figures, a command execution means for editing characters and figures recognized according to editing commands, and a projection display means for displaying the edited characters and figures on a writing surface are known. (See Patent Document 1). In this display device, editing commands such as erasing, moving, copying, and calling are prepared, and characters and figures are erased, moved, and copied by command execution means in accordance with editing commands input with a writing instrument.

JP-A-5-330289

  By the way, in a school or the like, there is a case where a shape of a line and a point is deformed to teach the nature thereof, such as a lesson of an inner corner of a triangle or a lesson of a polygon. In the class, when the conventional display device is used, the figure cannot be deformed. Therefore, it is necessary to write the figure before the deformation and the figure after the deformation separately, and there is a problem that the operation is complicated. On the other hand, it is conceivable to install an editing command for deforming a figure. However, this increases the number of editing commands using a writing instrument, resulting in a complicated operation.

  An object of the present invention is to provide a display device, a display device control method, and a program capable of easily deforming a displayed figure by an intuitive operation.

  The display device according to the present invention includes a display unit that displays a video screen on a display surface, and a multi-joint tool in which a plurality of members are connected via a movable connection unit. And a position information detecting unit that detects position information of a plurality of detection points arranged in the position.

  In this case, a deformation state determination unit that determines the deformation state of the articulated tool based on the detected position information of each detection point, and a display control unit that displays an object corresponding to the deformation state of the articulated tool It is preferable to provide.

  The display device control method of the present invention is a display device control method for displaying a video screen on a display surface, in which the display device is connected to a plurality of members via a movable connecting portion. Based on the position information detection step for detecting the position information of a plurality of detection points arranged on each member or each movable connecting portion of the articulated tool and the position information of each detected detection point, the deformation state of the articulated tool is determined. A deforming state determining step for determining and a display control step for displaying an object corresponding to the deformed state of the articulated tool on the video screen are executed.

  According to these configurations, the articulated tool is deformed in order to detect positional information of a plurality of detection points arranged on each member or each movable connecting portion and reflect the deformed state of the articulated tool on the object on the video screen. It is possible to easily deform an object (figure) by an intuitive operation. For example, a polygonal object can be deformed by deforming a polygonal articulated tool.

  In the above display device, it is preferable that the plurality of detection points have different identification information, and the position information detection unit detects the position information of each detection point together with the identification information of each detection point.

  According to this configuration, since each detection point can be identified, the deformation state of the articulated tool can be more strictly determined, and the object in the deformation state intended by the user can be displayed.

  In the above display device, it is preferable that the plurality of detection points are arranged one by one on the plurality of members.

  According to this configuration, the position of each member can be detected and the positional relationship of each member can be determined accurately. Therefore, when the positional relationship of each member after deformation is to be shown as an object, the deformation The positional relationship of each member at the time can be strictly reflected in the object. Further, when the detection point is displayed as a point object, the positional relationship of each member can be displayed with the point object.

  In the display device described above, it is preferable that the plurality of detection points are arranged one by one at each movable connecting portion.

  In this case, at least one member of the plurality of members is a member having one end connected to the movable connecting portion and the other end being a free end, and the plurality of detection points are each movable connecting portion and each free end. It is preferable that they are arranged one by one.

  According to these configurations, the position of each movable connecting portion can be detected, and the positional relationship between each movable connecting portion can be determined strictly. The deformation state can be accurately reflected on the object. Further, when the detection point is displayed as a point object, it becomes an object similar to the articulated tool, so that it is easy to display an object in a deformed state intended by the user.

  In these cases, the object is preferably composed of each point object corresponding to each detection point and each line object connecting the point objects of the adjacent detection points.

  According to this configuration, it is possible to display the figure in an easy-to-see manner by configuring the object with the point object and the line object.

  In this case, the display control unit can change the size of the object, the color of the object, the line type of the line object, or the type of the point of the point object in response to the operation of the operator arranged on the articulated tool. preferable.

  According to this configuration, the mode of the object can be changed by an operation on the articulated tool.

  In this case, the display surface is preferably a projection surface, and the display unit preferably projects a video screen on the projection surface.

  According to this configuration, the object can be displayed on a screen, a wall, or a whiteboard. That is, an electronic blackboard (interactive whiteboard) can be used as a display device.

  A program according to the present invention causes a computer to execute each step in the above-described display device control method.

  According to this configuration, each step in the above-described display device control method can be executed simply by installing this program.

It is a schematic diagram of the projector system which concerns on embodiment. It is a control block diagram of a projector system. It is the figure which showed each input tool. It is explanatory drawing for demonstrating the display control based on operation of each input tool. It is the figure which showed the modification of the articulated tool.

  Hereinafter, a display device, a display device control method, and a program according to an embodiment of the present invention will be described with reference to the accompanying drawings. In this embodiment, a projector system including a projector as a display device as a constituent element is illustrated. As shown in FIGS. 1 and 2, the projector system 1 includes a projector (display device) 2 that projects a video screen on a projection surface (display surface) 4, and a plurality of types of inputs for performing operations on the projection surface 4. And tool 3. That is, the projector system 1 has a function as an electronic blackboard (interactive whiteboard).

  As shown in FIG. 3, the input tool 3 is a tool for performing a drawing operation for drawing on the video screen and a display operation for displaying a specific object on the video screen facing the projection surface 4. The multiple types of input tools 3 include a pen tool 3a (electronic pen), a triangle ruler tool 3b, a protractor tool 3c, a compass tool 3d, and a polygon tool (articulated tool) 3e. In addition, the structure provided with two or more of each of these input tools 3 may be sufficient. In addition, each input tool 3 is provided with one or more modulation reflection sections 11, and the arrangement position of the modulation reflection section 11 becomes each detection point for detecting the position information of each input tool 3. Each modulation reflection unit 11 reflects the infrared light emitted from the projector 2 to the projector 2 side while modulating the infrared light into a specific pattern. On the other hand, although details will be described later, the projector 2 detects the position information of each detection point in each input tool 3 by receiving the modulated and reflected infrared rays. In addition, the modulation reflection unit 11 uses, as the specific pattern, an identification signal for identifying each input tool 3 and each detection point, and operators (an attribute change button 12 and an attribute change dial 14 described later) on the input tool 3. By modulating to a pattern including an operation signal indicating the operation content, the projector 2 can detect identification information and operation information.

  The pen tool 3a has a shape similar to that of a pen, and includes a modulation reflection unit 11 disposed at a tip portion and an attribute change button 12 disposed on a side surface. That is, the detection point of the pen tool 3a is arranged at the tip portion. And drawing operation with respect to a projection screen is performed by operation which moves the front-end | tip part of the pen tool 3a on the projection surface 4. FIG. In addition, by pressing the attribute change button 12, the color and thickness of the line to be drawn (line object 61) can be changed.

  The triangular ruler tool 3b has a shape similar to that of the triangular ruler, and is provided with two modulation reflecting portions 11 disposed at spaced positions, a handle 13 disposed on the surface of the main body, and a handle 13. And two attribute change dials 14 provided. That is, the detection points of the triangle ruler tool 3b are arranged at two spaced locations on the main body. Then, by causing the main body of the triangle ruler tool 3 b to face the projection surface 4, a display operation for displaying a triangle ruler object (a triangle ruler object 62 described later) on the video screen is performed. Further, by operating each attribute change dial 14, the color and size of the triangle ruler object to be displayed can be changed.

  The protractor tool 3c has a shape similar to that of the protractor, and is disposed on the two modulation reflectors 11 disposed at spaced positions, a handle 13 disposed on the surface of the main body, and the handle 13. Two attribute change dials 14. That is, the detection points of the protractor tool 3c are arranged at two spaced locations on the main body. A display operation for displaying a protractor object (a protractor object 63 described later) on the video screen is performed by causing the main body of the protractor tool 3 c to face the projection surface 4. Further, by operating each attribute change dial 14, the color and size of the protractor object to be displayed can be changed. In addition, it is preferable that the attribute change dial 14 for changing the color of the object in the triangle ruler tool 3b and the protractor tool 3c is accompanied by a click feeling when changing the attribute.

  The compass tool 3d has a shape similar to that of the compass and includes two modulation reflection portions 11 disposed at the tip portions of the two legs. That is, the detection point of the compass tool 3d is arranged at the tip of the two legs. Then, by applying the tip of one leg to the projection surface 4 and rotating it without moving it, the other leg is moved along the rotation path, thereby performing an arc or circle drawing operation on the video screen. Similar to the compass, the compass tool 3d can freely change the opening angle of the two legs, and can draw a circle of any size.

  The polygonal tool 3e is formed by connecting a plurality of members 21 via a movable connecting portion 22 to form a polygon, and a plurality of modulation reflecting portions 11 arranged one by one on each movable connecting portion 22, and a plurality of members And two attribute change buttons (operators) 12 disposed on any one of the members 21. In other words, the detection points of the polygonal tool 3e are arranged one by one in each movable connecting portion 22. Then, by causing the polygonal tool 3e to face the projection surface 4, a display operation for displaying a polygonal object (a polygonal object 65 described later) on the video screen is performed. Although details will be described later, the polygonal object is a figure composed of lines and points. By pressing each attribute change button 12, the color and thickness of the polygonal object can be changed.

  As shown in FIG. 2, the projector 2 includes a signal input unit 31, a tool information detection unit (position information detection unit) 32, a projection optical system (display unit) 33, and a control unit 34 that performs overall control thereof. It has. The deformation state determination unit and the display control unit referred to in the claims are configured by the control unit 34.

  The signal input unit 31 inputs image data from an external device 41 such as a PC (Personal Computer), a USB memory, or a compact flash (registered trademark). In this case, the signal input unit 31 includes a USB port and a memory card slot (not shown). In the present embodiment, image data is input from the external device 41 via the signal input unit 31, but an image signal may be input from a video device such as a video recorder or a DVD player. In this case, the signal input unit 31 includes an HDMI terminal, an S video terminal, a video terminal, and the like.

  The tool information detection unit 32 detects position information and identification information of each detection point in each input tool 3 based on the infrared light modulated and reflected by the modulation reflection unit 11 and detects operation information of each input tool 3. . Specifically, the tool information detection unit 32 includes an infrared irradiation unit 42 that irradiates the projection surface 4 with infrared rays, and an infrared reception unit 43 that receives the infrared rays modulated and reflected by the respective modulation reflection units 11 of the input tool 3. The position information of each detection point is detected based on the infrared rays reflected from each detection point. Further, by receiving infrared light modulated into a specific pattern including an identification signal and an operation signal, the input tool 3 based on the identification signal and the identification information of each detection point and the operation information of the input tool 3 based on the operation signal are detected. To do. The position information is coordinate information of the position of the detection point on the projection surface 4. The identification information is information for identifying each input tool 3 and each detection point. Therefore, each detection point has different identification information. The operation information is information indicating the operation content of the operation on the input tool 3 (attribute change button 12 or attribute change dial 14). Since the tool information detection unit 32 detects the identification information of each detection point together with the position information of each detection point, the control unit 34 can identify which detection point information the detected position information is. it can.

  The projection optical system 33 projects an image on the projection surface 4, and includes a light source lamp 51, a liquid crystal light valve 52, a projection lens 53, a lamp driving unit 54, and a light valve driving unit 55.

  As the light source lamp 51, a halogen lamp, a metal halide lamp, or a high-pressure mercury lamp can be applied. Further, instead of the light source lamp 51, a solid light source such as a laser or an LED may be used. The liquid crystal light valve 52 is composed of a liquid crystal panel or the like in which liquid crystal is sealed between a pair of transparent substrates, and a transparent electrode capable of applying a driving voltage to each liquid crystal region is provided on the inner surface of each transparent substrate. Pixels are formed in a matrix. The lamp driving unit 54 turns on the light source lamp 51 based on a lighting command from the control unit 34. The light valve driving unit 55 sets the light transmittance of each pixel by applying a driving voltage corresponding to the image data to each pixel of the liquid crystal light valve 52.

  With the above configuration, in the projection optical system 33, the illumination light emitted from the light source lamp 51 is modulated by being transmitted through the liquid crystal light valve 52. The modulated image light is combined for each pixel by a light combining optical system (not shown) (such as a dichroic prism), and is projected onto the projection surface 4 by the projection lens 53.

  The controller 34 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The CPU is a central processing unit that performs various arithmetic processes, and performs overall control of the projector 2 by inputting and outputting signals to and from each unit. The ROM stores a control program and control data used for the CPU to perform various arithmetic processes. The ROM also stores an OS (Operating System) that is basic software. The RAM is used as a work area when the CPU performs various arithmetic processes. In the present embodiment, display control of the video screen based on the operation of the input tool 3 is particularly performed.

  Here, with reference to FIG. 4, the display control based on the operation of each input tool 3 will be described in the order of the pen tool 3a, the triangle ruler tool 3b, the protractor tool 3c, the compass tool 3d, and the polygon tool 3e. Each input tool 3 is assigned identification information that is different between the input tools 3. Based on the identification information detected by the tool information detection unit 32 by the control unit 34, the type (pen tool) of the input tool 3 is assigned. 3a, triangular ruler tool 3b, etc.).

  In the display control for the pen tool 3a, the projector 2 receives infrared rays from the modulation reflection unit 11 of the pen tool 3a as needed by the tool information detection unit 32, and detects position information and identification information of the detection point, and operation information. And the control part 34 discriminate | determines the movement locus | trajectory of the detection point on the projection surface 4 based on the positional information on the detected detection point. When the movement locus is determined, the line object 61 is displayed on the video screen corresponding to the determined movement locus (see FIG. 4A). At this time, the color and thickness of the line object 61 are changed based on the operation information. That is, as the attribute change button 12 is pressed, the color and thickness of the line object 61 are changed by the control unit 34.

  In the display control for the triangle ruler tool 3b, the projector 2 receives infrared rays from the two modulation reflectors 11 of the triangle ruler tool 3b at any time by the tool information detection unit 32, and the position information and identification information of each detection point. And operation information is detected. Then, the control unit 34 determines the position of the triangular ruler tool 3b on the projection surface 4 and the rotation angle from the initial posture on the basis of the detected position information for each detection. When the position and the rotation angle are determined, an object indicating a triangle ruler (hereinafter, a triangle ruler object 62) is displayed at a position on the video screen corresponding to the determined position, and the video screen corresponding to the determined rotation angle. The image is rotated upward (see FIG. 4B). At this time, the color and size of the triangular ruler object 62 are changed based on the operation information. That is, the color and size of the triangular ruler object 62 are changed by the control unit 34 in accordance with the operation of the attribute change dial 14.

  In the display control for the protractor tool 3c, the projector 2 receives infrared rays from the two modulation reflectors 11 of the protractor tool 3c at any time by the tool information detection unit 32, and the position information and identification information of each detection point, and Detect operation information. Then, the control unit 34 determines the position of the protractor tool 3c on the projection surface 4 and the rotation angle from the initial posture on the basis of the detected position information for each detection. When the position and the rotation angle are determined, an object indicating the protractor (hereinafter referred to as the protractor object 63) is displayed at a position on the video screen corresponding to the determined position, and on the video screen corresponding to the determined rotation angle. The display is rotated (see FIG. 4C). At this time, the color and size of the protractor object 63 are changed based on the operation information. That is, the color and size of the protractor object 63 are changed by the control unit 34 in accordance with the operation of the attribute change dial 14.

  In the display control for the compass tool 3d, the projector 2 receives the infrared rays from the two modulation reflectors 11 of the compass tool 3d as needed by the tool information detection unit 32, and the position information and identification information of each detection point, and Detect operation information. Then, the control unit 34 determines a drawing operation for drawing an arc or a circle by the compass tool 3d based on the detected position information. The drawing operation is an operation in which the detection point on the fulcrum side is moved without moving the detection point on the fulcrum side, and the drawing operation is performed based on the position change of each detection point. In addition, the fulcrum position of the drawing operation and the drawing start position and drawing end position of the drawing operation are determined based on the position information of each detection point before and after the operation. When these are discriminated, a circle or arc line object 64 is displayed on the video screen corresponding to the discriminated drawing operation (see FIG. 4D).

  In the display control for the polygonal tool 3e, the projector 2 receives the infrared rays from the respective modulation reflection units 11 of the polygonal tool 3e at any time by the tool information detection unit 32, and the position information and identification information of each detection point, and Operation information is detected (position information detection step). The control unit 34 discriminates the deformation state of the polygon tool 3e and the position of the polygon tool 3e on the projection surface 4 based on the detected position information and identification information of each detection point for each detection. To do. That is, the deformation state is determined based on the positional relationship between the detection points (deformation state determination step). When the position and the deformation state are determined, an object corresponding to the determined deformation state of the polygon tool 3e (hereinafter, polygon object 65) is displayed at a position on the video screen corresponding to the determined position (display control step: (Refer FIG.4 (e)). The polygon object 65 is composed of point objects 65a corresponding to the respective detection points and line objects 65b connecting the point objects 65a of the adjacent detection points. That is, the point object 65a is displayed at a position on the video screen corresponding to the determined position of each detection point, and the line object 65b connecting these point objects 65a is displayed based on the identification information of each detection point. At this time, the size and color of the polygonal object 65 are changed based on the operation information. That is, as the attribute change button 12 is pressed, the color and size of the polygonal object 65 are changed by the control unit 34.

  According to the configuration described above, the polygonal object 65 (graphic) can be intuitively changed by simply deforming the polygonal tool 3e in order to reflect the deformation state of the polygonal tool 3e on the polygonal object 65 on the video screen. Can be easily deformed by simple operation.

  The plurality of detection points have different identification information, and each detection point can be identified by detecting the position information of the plurality of detection points together with the identification information of each detection point. The deformation state of the tool 3e can be determined more precisely, and the object in the deformation state intended by the user can be displayed.

  Furthermore, the position of each movable connecting part 22 can be detected by arranging a plurality of detection points one by one on each movable connecting part 22, and the positional relationship of each movable connecting part 22 can be determined strictly. Therefore, the deformation state can be strictly reflected in the polygonal object 65. Further, when the detection point is displayed as the point object 65a, the object is similar to the polygonal tool 3e, so that it is easy to display an object in a deformed state intended by the user.

  Furthermore, by configuring the polygon object 65 with the point object 65a and the line object 65b, the figure can be displayed in an easy-to-see manner.

  Further, the control unit 34 receives the operation of the attribute change button 12 arranged on the polygon tool 3e, and changes the size and color of the polygon object 65, so that the operation on the polygon tool 3e The mode (appearance) of the square object 65 can be changed. In addition to the size and color of the polygon object 65, the line type (line color and thickness) of the line object 65b and the point type (point color and size) of the point object 65a are changed. May be.

  In the present embodiment, the polygonal tool 3e in which both ends are connected and formed into a ring shape is applied to the present invention as an articulated tool in which a plurality of members 21 are connected via the movable connecting portion 22, but both ends are provided. The tool 3f (see FIG. 5A) may be applied to the present invention. In such a case, the two members 21 at both ends become members 21 having one end connected to the movable connecting portion 22 and the other end as a free end, and the detection points are also arranged one by one at the free end. Is preferred. The shape of the articulated tool is not limited to these, and may be, for example, a branched tree structure.

  Further, in the present embodiment, in the polygonal tool 3e (multi-joint tool), a plurality of detection points are arranged in each movable connecting portion 22, but the plurality of detection points are assigned to each member. 21 may be arranged one by one (see FIG. 5B). Since the position of each member 21 can be detected and the positional relationship of each member 21 can be determined strictly, the positional relationship of each member 21 when deformed can be accurately reflected in the object. . Further, when the detection point is displayed as the point object 65a, the positional relationship of each member 21 can be displayed by the point object 65a.

  In this embodiment, the polygonal object 65 is displayed for use in a polygon lesson. However, the constellation object corresponding to the deformed state of the articulated tool is used for the constellation lesson. May be configured to display.

  Further, in the present embodiment, the configuration is such that infrared rays are modulated and reflected at each detection point, and this is received to detect the position information and identification information of each detection point. However, each detection point is identified by image recognition. A configuration may be adopted in which position information and identification information of detection points on the projection surface 4 are detected by arranging possible marks and recognizing the marks with a camera. Further, when the board surface of the whiteboard is the projection surface 4, the entire board surface may function as a sensor to detect the position information and identification information of each detection point.

  Furthermore, in the present embodiment, the present invention is applied to the projector 2 that projects a video screen on the projection surface 4, but the present invention may be applied to a display device (monitor) that displays a video screen. In such a case, the display surface referred to in the claims is not the display device itself, but the portion of the surface that displays the video screen of the display device.

  2: Projector, 3e: Articulated tool, 4: Projection plane, 12: Attribute change button, 21: Member, 22: Movable connection part, 32: Tool information detection part, 33: Projection optical system, 34: Control part, 65 : Polygon object, 65a: Each point object, 65b: Each line object

Claims (11)

A display unit for displaying a video screen on the display surface;
In a multi-joint tool in which a plurality of members are connected via a movable connection part, a position information detection unit for detecting position information of a plurality of detection points arranged on each member of the multi-joint tool or each of the movable connection parts; ,
A display device comprising: A deformation state determination unit for determining a deformation state of the articulated tool based on the detected position information of each detection point;
The display device according to claim 1, further comprising: a display control unit that displays an object corresponding to a deformation state of the articulated tool. The plurality of detection points have different identification information,
The display device according to claim 2, wherein the position information detection unit detects position information of each detection point together with identification information of each detection point.   The display device according to claim 2, wherein the plurality of detection points are arranged one by one on the plurality of members.   4. The display device according to claim 2, wherein the plurality of detection points are arranged one by one in each movable connecting portion. 5. At least one member of the plurality of members is a member having one end connected to the movable connecting portion and the other end being a free end,
The display device according to claim 5, wherein the plurality of detection points are arranged one at each of the movable connecting portions and the free ends.   The said object is comprised by each point object corresponding to each said detection point, and each line object which connects the said point objects of each said adjacent detection point, The any one of Claim 2 thru | or 6 characterized by the above-mentioned. The display device according to claim 1.   The display control unit changes the size of the object, the color of the object, the line type of the line object, or the type of the point of the point object in response to an operation of an operator disposed on the articulated tool. The display device according to claim 7. The display surface is a projection surface;
The display device according to claim 1, wherein the display unit projects the video screen onto the projection surface. A control method of a display device that displays a video screen on a display surface,
The display device
In a multi-joint tool in which a plurality of members are connected via a movable connecting portion, a position information detecting step of detecting position information of a plurality of detection points arranged on each member of the multi-joint tool or each movable connecting portion; ,
A deformation state determination step for determining a deformation state of the articulated tool based on the detected position information of each detection point;
And a display control step of displaying an object corresponding to the deformation state of the articulated tool on the video screen.   The program for making a computer perform each step in the control method of the display apparatus of Claim 10.

Images