JP2016186524A - Display system, display device, information processing device, and control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent a plurality of image objects from being displayed on a display surface when the operation mode has changed.SOLUTION: An information processing device includes: drawing means that does not draw a screen including a line according to the locus of a position of an indication body included in information transmitted from a display device and an image object for changing the attribute of the line if the operation mode is a first mode, and draws the screen if the operation mode is a second mode; supply means that supplies to the display device, a video signal for displaying the screen on the display device; and erasing means that erases the image object from the screen when having received an instruction to change the operation mode from the second mode to the first mode from the display device.SELECTED DRAWING: Figure 1

Description

  The present invention relates to control of display of an image object in a display system that performs different processing in a first mode and a second mode.

  There is known a display device that displays an image corresponding to a position designated by an indicator on a display surface. For example, Patent Document 1 describes a projector that projects an image corresponding to a position designated by a pointer (finger or pen device) on an image supplied from a video supply device (PC). In Patent Document 1, a projector projects a toolbar image for performing an operation for specifying an operation mode on a projection surface.

JP 2011-203830 A

  In the technique described in Patent Document 1, when an image supplied from the video supply device to the projector includes an image object such as a toolbar image for changing the attribute of the image according to the locus of the indicator, the projection plane Will display both the tool bar image of the video supply device and the tool bar image of the projector, which may be confusing for users operating on the projection surface.

  The present invention provides a technique for preventing a plurality of image objects from being displayed on a display surface when an operation mode is switched in a display system that performs different processing in a first mode and a second mode.

The present invention includes a display device and an information processing device, the display device displaying a screen according to a video signal supplied from the information processing device on a display surface, and an instruction on the display surface When the detection mode for detecting the position of the body and the operation mode is the first mode, a line corresponding to the locus of the position of the indicator detected by the detection means, and a first attribute for changing the attribute of the line When the first drawing means for drawing one image object on the display surface and the operation mode is the second mode, information indicating the position of the indicator detected by the detection means is transmitted to the information processing apparatus. A first transmission unit; and a second transmission unit configured to transmit a command for switching the operation mode to the information processing apparatus when an input of an instruction to switch the operation mode is received. A second rendering unit for rendering a screen including a line corresponding to a locus of a position included in the information transmitted from the display device, and a second image object for changing an attribute of the line; Supply means for supplying a video signal for displaying a screen on the display device to the display device, and an instruction for switching the operation mode from the second mode to the first mode are received from the display device. A display system comprising: erasing means for erasing the second image object from the screen.
According to this display system, when the operation mode is switched from the second mode to the first mode, both the first image object and the second image object are displayed on the display surface, thereby preventing the user from being confused.

In a preferred aspect, the display device has first storage means for storing information indicating a position of the second image object on the screen, and the display means changes the operation mode from the second mode to the first mode. When the input of the instruction for switching to the mode is accepted, the first image object is displayed at a position indicated by the information stored in the first storage unit on the screen.
According to this display system, it is possible to prevent the position of the displayed image object from changing when the operation mode is switched from the second mode to the first mode.

In another preferred aspect, the information processing apparatus includes a third transmission unit configured to transmit information indicating the changed position to the display device when an input of an instruction to change the position of the second image object is received. It is characterized by having.
According to this display system, even when the position of the second image object is changed, the first image object is displayed at the changed position.

In another preferable aspect, the display device includes a second storage unit that stores the attribute for each of a plurality of indicators, and the detection unit detects the positions of the plurality of indicators, The drawing unit draws the attribute line stored in the second storage unit for the indicator whose position is detected by the detecting unit, and the information processing apparatus stores the attribute for each of the plurality of indicators. Third storage means, and synchronization means for synchronizing the attribute stored in the second storage means with the attribute stored in the third storage means, wherein the second drawing means is controlled by the detection means. An attribute line stored in the third storage unit is drawn for the indicator whose position is detected.
According to this display system, the operation for changing the line attribute performed before the operation mode is changed is reflected even after the operation mode is changed.

According to the present invention, there is provided display means for displaying a screen according to a video signal supplied from the information processing apparatus on a display surface, detection means for detecting the position of the indicator on the display surface, and an operation mode of the first mode. If so, a drawing unit for drawing a line corresponding to the locus of the position of the indicator detected by the detection unit and a first image object for changing the attribute of the line on the display surface, and the operation When the mode is the second mode, the first transmission unit that transmits the information indicating the position of the indicator detected by the detection unit to the information processing apparatus and the input of the instruction to switch the operation mode are accepted. A second transmission unit configured to transmit a command for switching the operation mode to the information processing apparatus, and the display unit is configured to display the previous mode when the operation mode is the second mode. Displaying the screen including the second image object for changing the line attribute, and displaying the screen not including the second image object when the operation mode is the first mode. A characteristic display device is provided.
According to this display device, when the operation mode is switched from the second mode to the first mode, both the first image object and the second image object are displayed on the display surface, thereby preventing the user from being confused.

The present invention also includes a line corresponding to the locus of the position of the indicator included in the information transmitted from the display device and an image object for changing the attribute of the line when the operation mode is the first mode. When the screen is not drawn and the operation mode is the second mode, drawing means for drawing the screen, and supply means for supplying the display device with a video signal for displaying the screen on the display device And an erasing unit for erasing the image object from the screen when an instruction for switching the operation mode from the second mode to the first mode is received from the display device.
According to this information processing apparatus, it is possible to prevent a video signal indicating a screen including an image object from being supplied to the display device when the operation mode is switched from the second mode to the first mode.

The present invention is also a method for controlling a display system having a display device and an information processing device, wherein the display device displays a screen according to a video signal supplied from the information processing device on a display surface; Detecting the position of the indicator on the display surface, and changing the line according to the detected locus of the indicator and the attribute of the line when the operation mode is the first mode. Drawing the first image object on the display surface, transmitting the information indicating the detected position of the indicator to the information processing apparatus when the operation mode is the second mode, and the operation A step of transmitting an instruction for switching the operation mode to the information processing apparatus when an input of an instruction to switch the mode is accepted, the information processing apparatus includes: A step of drawing a screen including a line corresponding to a locus of a position included in the information transmitted from the display device and a second image object for changing the attribute of the line; and the operation mode as the second mode. When a command for switching to the first mode is received from the display device, the control method includes: erasing the second image object from the screen.
According to this control method, when the operation mode is switched from the second mode to the first mode, both the first image object and the second image object are displayed on the display surface, and the user is prevented from being confused.

The figure which shows the function structure of the display system 1 which concerns on one Embodiment. The figure which illustrates the hardware constitutions of the display apparatus. The figure which illustrates the hardware constitutions of the information processing apparatus. The figure which shows the outline | summary of interactive mode. The figure which shows the outline | summary of PC mode. The figure which shows the projection surface concerning a comparative example. The flowchart which shows operation | movement of a display system. The figure which illustrates the projection surface concerning embodiment. FIG. 5 is another diagram illustrating a projection surface according to the embodiment. The figure which shows the function structure of the display system 1 which concerns on a modification.

1. Configuration FIG. 1 is a diagram illustrating a functional configuration of a display system 1 according to an embodiment. The display system 1 includes a display device 10, a pointer 20, and an information processing device 30. The display device 10 is a device that displays an image supplied from the information processing device 30 on a display surface. The information processing device 30 is a device that supplies video to the display device 10. In this example, the information processing apparatus 30 is a general-purpose personal computer and has a function of operating an application program.

  The indicator 20 is a device that indicates a position on the display surface. The display device 10 performs processing according to the position indicated by the indicator 20. In this example, the processing according to the instructed position differs depending on the operation mode of the display device 10.

  The display device 10 includes a display unit 11, a detection unit 12, a drawing unit 13, a transmission unit 14, a transmission unit 15, and a storage unit 16.

  The display unit 11 displays a screen according to the video signal supplied from the information processing apparatus 30 on the display surface. Specifically, the display unit 11 displays a screen of an application program running on the information processing apparatus 30 on the display surface. The application program screen refers to a screen generated in the information processing apparatus 30 as the application program is executed. For example, in the case of a multi-window GUI (Graphical User Interface), a desktop screen including an active application program window. The whole thing. The display surface is a surface on which an image is displayed. For example, when the display device 10 is a projector, it is a screen or a wall surface, and when the display device 10 is a liquid crystal display, it is a liquid crystal panel.

  The detection means 12 detects the position of the indicator 20 on the display surface (hereinafter simply referred to as “the position of the indicator 20”). In this example, the detection unit 12 detects an event including the position of the indicator 20. The indicator 20 is used by the user to designate a position on the display surface, and is, for example, an electronic pen or the user's own finger. The detection unit 12 includes, for example, a camera that images the display surface, and determines the position of the indicator 20 by the shape or color of the indicator 20 or the light emission of a light emitter (for example, an infrared light emitting diode) provided on the indicator 20. Detect. The detection means 12 may detect the position of the indicator 20 by a pressure sensor or an electrostatic sensor provided on the display surface. The detection means 12 recognizes the type of event, for example, from the light emission pattern of the light emitter.

  Events related to the indicator 20 include, for example, a pen down event and a pen up event. The pen down event is an event indicating that the indicator 20 is in contact with the display surface. The pen down event includes information (for example, coordinates) indicating the position where the indicator 20 is in contact with the display surface. The pen-up event indicates that the indicator 20 that has been in contact with the display surface has left the display surface. The pen-up event includes information indicating a position at which contact is detected last before the indicator 20 that has been in contact with the display surface before leaving the display surface.

  The drawing unit 13 is a function that is enabled when the operation mode of the display device 10 is the first mode, and is a line (that is, a handwritten image) corresponding to the locus of the position of the indicator 20 detected by the detection unit 12. And the 1st image object for changing the attribute of the said line is drawn on a display surface. The first image object is a toolbar in which a plurality of operation menus such as icons and buttons are arranged, for example, to change line attributes according to the locus of the position of the indicator 20. In this example, the drawing unit 13 draws a line according to the locus of the position of the indicator 20 while the pen-down event is continuously detected. More specifically, the drawing means 13 draws a line according to the position from when the pen-down event is detected for the first time until the pen-up event is detected from the position where the pen-down event is detected for the first time.

  The transmission unit 14 is a function that is enabled when the operation mode of the display device 10 is the second mode, and transmits information indicating the position of the indicator 20 detected by the detection unit 12 to the information processing device 30. The drawing unit 13 may not draw a line corresponding to the locus of the position of the indicator 20 detected during the second mode, or may draw only when a specific condition is satisfied. Good.

  The transmission means 15 transmits a command for switching the operation mode (hereinafter referred to as “switching command”) to the information processing apparatus 30. In the display system 1, the operation mode of the display device 10 and the operation mode of the information processing device 30 are synchronized with each other. The transmission unit 15 transmits a switching command to the information processing apparatus 30 when an input of an instruction to switch the operation mode (hereinafter referred to as “switching instruction”) is received.

  The storage unit 16 stores information indicating the position of the second image object on the screen according to the video signal supplied from the information processing apparatus 30. The second image object is a toolbar in which a plurality of operation menus such as icons and buttons are arranged in order to change the attribute of the line according to the locus of the position of the indicator 20.

  The information processing apparatus 30 includes an execution unit 31, a video supply unit 32, a reception unit 33, a drawing unit 34, a reception unit 35, an erasing unit 36, and a transmission unit 37. The execution unit 31 executes an application program (for example, drawing software described later). The video supply means 32 supplies video to the display device 10. In this example, the video supply unit 32 supplies a screen of an application program being executed by the execution unit 31.

  The receiving unit 33 is a function that is enabled when the operation mode of the information processing device 30 is the second mode, and receives information indicating the position of the indicator 20 from the display device 10. The receiving unit 33 does not receive information indicating the position of the indicator 20 when the operation mode of the information processing apparatus 30 is the first mode.

  The drawing unit 34 is a function that is enabled when the operation mode of the information processing device 30 is the second mode, and a line (that is, a handwritten image) corresponding to information transmitted from the display device 10 and an attribute of the line. A screen including the second image object for changing the image is drawn. In this example, the drawing unit 34 draws a line according to the locus of the position of the indicator 20 while the pen-down event is continuously detected. More specifically, the drawing unit 34 draws a line in accordance with the position from when the pen-down event is detected for the first time after the pen-down event is not detected until the pen-up event is detected.

  The receiving unit 35 receives the switching command transmitted from the display device 10. When the switching command for switching the operation mode of the information processing device 30 from the second mode to the first mode is received from the display device 10, the erasing unit 36 erases the second image object from the screen.

  When the input of an instruction to change the position of the second image object is received, the transmission unit 37 transmits information indicating the changed position to the display device 10.

  FIG. 2 is a diagram illustrating a hardware configuration of the display device 10. The display device 10 includes a central processing unit (CPU) 100, a read only memory (ROM) 101, a random access memory (RAM) 102, an IF unit 103, an image processing circuit 104, a projection unit 105, an operation panel 106, and a camera 107. Have.

  The CPU 100 is a control device that controls each unit of the display device 10. The ROM 101 is a non-volatile storage device that stores various programs and data. The RAM 102 is a volatile storage device that stores data, and functions as a work area when the CPU 100 executes processing.

  The IF unit 103 is an interface that mediates exchange of signals or data with an external device (for example, the information processing device 30). The IF unit 103 has various terminals (for example, a VGA terminal, a USB terminal, a wired LAN interface, an S terminal, an RCA terminal, and an HDMI (High-Definition Multimedia Interface: registered trademark) terminal for exchanging signals or data with an external device. , Microphone terminal, etc.) and a wireless LAN interface. These terminals may include a video output terminal in addition to the video input terminal.

  The image processing circuit 104 performs predetermined image processing (for example, size change, keystone correction, etc.) on the input video signal.

  The projection unit 105 projects an image on a projection surface such as a screen or a wall surface in accordance with a video signal subjected to image processing. The projection unit 105 includes a light source, a light modulator, and an optical system (all not shown). The light source includes a lamp such as a high-pressure mercury lamp, a halogen lamp, or a metal halide lamp, or a solid light source such as an LED (Light Emitting Diode) or a laser diode, and a drive circuit thereof. An optical modulator is a device that modulates light emitted from a light source in accordance with a video signal, and includes, for example, a liquid crystal panel or a DMD (Digital Mirror Device) and a drive circuit thereof. The liquid crystal panel may be either a transmission type or a reflection type. The optical system includes an element that projects light modulated by the light modulator onto a screen, and includes, for example, a mirror, a lens, and a prism. A light source and a light modulator may be provided for each color component.

  The operation panel 106 is an input device for a user to input an instruction to the display device 10 and includes, for example, a keypad, buttons, or a touch panel.

  The camera 107 is a camera for specifying the position of the indicator 20. In this example, the indicator 20 includes a light emitter (for example, an infrared light emitting diode), a pressure sensor, and a control circuit (all not shown) at the pen tip. When the pressure sensor detects that the pen tip has touched an object (such as a projection surface), the control circuit causes the light emitter to emit light with a predetermined light emission pattern. The camera 107 is an infrared camera and takes an image of the projection plane. The CPU 100 identifies the position of the indicator 20 and the corresponding event from the image captured by the camera 107.

  In this example, the projection unit 105 is an example of the display unit 11. The projection surface is the display surface. The camera 107 and the CPU 100 are an example of the detection unit 12. The CPU 100 is an example of the drawing unit 13. The IF unit 103 is an example of the transmission unit 14 and the transmission unit 15. The RAM 102 is an example of the storage unit 16.

  FIG. 3 is a diagram illustrating a hardware configuration of the information processing apparatus 30. The information processing apparatus 30 is, for example, a general-purpose personal computer, and includes hardware elements such as a CPU 300, a ROM 301, a RAM 302, an IF unit 303, a storage unit 304, and a display unit 305.

  The CPU 300 is a control device that controls each unit of the information processing device 30. The ROM 301 is a nonvolatile storage device that stores various programs and data. The RAM 302 is a volatile storage device that stores data, and functions as a work area when the CPU 300 executes processing.

  The IF unit 303 is an interface that mediates exchange of signals or data with an external device (for example, the display device 10). The IF unit 303 includes various terminals and a wireless LAN interface for exchanging signals or data with an external device.

  The storage unit 304 is a nonvolatile storage device that stores data, programs, and the like, and includes, for example, a flash ROM, an SSD (Solid State Drive), or an HDD (Hard Disk Drive). The storage unit 304 stores an operating system (OS) and application programs (for example, a program that sequentially displays slides of a presentation).

  The display unit 305 includes a display device such as a liquid crystal display or an organic EL (Electroluminescence) display, and displays information under the control of the CPU 300.

  In the information processing apparatus 30, the CPU 300 is an example of the execution unit 31, the drawing unit 34, and the erasing unit 36, and the IF unit 303 is an example of the video supply unit 32, the reception unit 33, the reception unit 35, and the transmission unit 37.

2. Outline of Operation Mode Here, the operation mode of the display system 1 (the display device 10 and the information processing device 30) will be described. In this example, the operation modes of the display system 1 include an interactive mode (an example of a first mode) and a PC mode (an example of a second mode).

  FIG. 4 is a diagram showing an outline of the interactive mode. In the interactive mode, the display device 10 can be used like a whiteboard or an electronic blackboard. The interactive mode is an operation mode in which the display device 10 draws a line (hereinafter referred to as “handwritten image”) corresponding to the locus of the indicator 20. The display device 10 can display an image obtained by superimposing a handwritten image on the video supplied from the video supply device. For example, the display device 10 can display a handwritten image (in this case, annotation or memo) superimposed on the screen of the drawing software executed by the information processing device 30. In the example of FIG. 4, the handwritten image IM1 is displayed on the screen SC along with the trajectory that the user moves while touching (contacting) the indicator 20 with the projection surface. In the interactive mode, the display device 10 displays the toolbar T1 (an example of the first image object) on the video supplied from the video supply device. The toolbar T1 is used, for example, for performing an operation of switching the attribute of a line (for example, the type, color, or thickness of the line) drawn according to the locus of the indicator 20. The display position of the toolbar T1 can be changed by an operation using the user's indicator 20.

  FIG. 5 is a diagram showing an outline of the PC mode. In the PC mode, the indicator 20 can be used as a pointing device of the information processing apparatus 30. In the PC mode, the display device 10 transmits information indicating an event including a position (coordinates) on the projection surface of the indicator 20 to the information processing device 30. The device driver of the information processing apparatus 30 converts information transmitted from the display apparatus 10 into mouse operation information and delivers it to the OS. In the present embodiment, drawing software is installed in the information processing apparatus 30, and the drawing software draws a handwritten image according to information indicating the position of the indicator 20 supplied from the display device 10. In the example of FIG. 5, the drawing software draws the handwritten image IM2 on the screen along with the trajectory that the user moves while touching the projection body 20 on the projection surface. As described above, even in the PC mode, as long as the drawing software is activated, it is possible to draw a handwritten image as in the interactive mode. However, the interactive mode and the PC mode are different in that the main body for drawing a handwritten image is the display device 10 or the information processing device 30. The drawing software displays the toolbar T2 on the screen. The toolbar T2 is used, for example, for performing an operation of switching the attribute of a line drawn according to the locus of the indicator 20. Note that the display position of the toolbar T2 can be changed by an operation using the user's indicator 20.

  For example, the interactive mode and the PC mode are selectively used depending on whether or not the user directly writes a handwritten image on the screen of the drawing software. Specifically, when the user does not want to write the handwritten image directly on the screen of the drawing software, the user draws the handwritten image using the interactive mode. On the other hand, when it is desired to directly write a handwritten image on the screen of the drawing software, the user draws the handwritten image using the PC mode. Switching between the interactive mode and the PC mode is performed according to a user instruction via a switching button (not shown) displayed on the screen by the function of the display device 10, for example.

  The drawing software is provided by, for example, the same company that provides the display device 10, and the GUI may be very similar. In this case, the user who uses the display system 1 may not be conscious of whether he is drawing in the interactive mode or whether the drawing software is activated in the PC mode. Therefore, the following problems may occur. In the following, a case where the drawing software is activated in the information processing apparatus 30 will be described unless otherwise specified.

  FIG. 6 is a diagram illustrating a projection surface according to a comparative example. FIG. 6 shows a projection plane when the user switches the operation mode of the display system 1 from the PC mode to the interactive mode. The display device 10 continuously projects the screen of the drawing software operating on the information processing device 30 even after the operation mode is switched to the interactive mode. In this example, the drawing software screen includes a toolbar T2. The display device 10 also displays the toolbar T1 so as to overlap the drawing software screen. Therefore, in the example of FIG. 6, the tool bar T1 of the display device 10 and the tool bar T2 of the drawing software are displayed on the projection plane. When a plurality of toolbars are displayed on the projection surface in this manner, it is difficult to distinguish whether each toolbar is a drawing software toolbar or a toolbar of the display device 10, which is inconvenient for the user. For example, if the user forgets that the operation mode is the interactive mode and touches the tool bar T2 with the indicator 20, the tool bar T2 is not active, and thus a line (or point) contrary to the user's intention is drawn. The present embodiment prevents such inconvenience from occurring when the operation mode is switched.

3. Operation FIG. 7 is a flowchart showing an operation according to an embodiment of the display system 1. The flow in FIG. 7 is started in a state where the display system 1 is operating in the PC mode, and is repeatedly performed while the display device 10 and the information processing device 30 are powered on. In the following description, software may be described as the subject of processing, but this is because the hardware resource (CPU or the like) executing this software is another hardware resource (memory or communication interface or the like). ) And work together. In the PC mode, the CPU 100 of the display device 10 transmits information indicating the position of the indicator 20 to the information processing device 30. The drawing software of the information processing device 30 draws a handwritten image corresponding to the information transmitted from the display device 10 on the screen. A toolbar T2 is displayed on the projection surface.

  In step S1, the CPU 100 of the display device 10 determines whether or not a switching instruction for switching the operation mode of the display system 1 from the PC mode to the interactive mode is input. The switching instruction is input when the user touches a switching button (not shown) displayed on the screen by the function of the display device 10 with the indicator 20, for example. If it is determined that a switching instruction has been input (S1: YES), the CPU 100 proceeds to step S2. When it is determined that no switching instruction is input (S1: NO), the CPU 100 waits for processing until a switching instruction is input.

  In step S <b> 2, the CPU 100 transmits to the information processing apparatus 30 a switching command for switching the operation mode from the PC mode to the interactive mode. In step S3, the drawing software of the information processing apparatus 30 deletes the toolbar T2 from the screen. In step S4, the CPU 300 switches the operation mode of the information processing apparatus 30 from the PC mode to the interactive mode. When switching to the interactive mode, the drawing software stops drawing the handwritten image.

  In step S <b> 5, the CPU 100 of the display device 10 displays the toolbar T <b> 1 so as to overlap the drawing software screen supplied from the information processing device 30. In the PC mode, the drawing software of the information processing apparatus 30 transmits information indicating the display position of the toolbar T2 on the drawing software screen (hereinafter referred to as “position information I2”) to the display device 10. For example, when an instruction to change the display position of the toolbar T2 is input, the drawing software of the information processing device 30 transmits position information I2 indicating the changed display position to the display device 10. In another example, the drawing software of the information processing device 30 transmits the position information I2 to the display device 10 when a switching command for switching the operation mode from the PC mode to the interactive mode is received. The CPU 100 stores the position information I2 received from the information processing apparatus 30 in the RAM 102. In step S5, the CPU 100 refers to the position information I2 stored in the RAM 102 and displays the toolbar T1 at the same position as the display position of the toolbar T2.

  In step S6, the CPU 100 switches the operation mode of the display device 10 from the PC mode to the interactive mode. When the mode is switched to the interactive mode, the CPU 100 stops transmitting information indicating the position of the indicator 20 and starts drawing a handwritten image.

  FIG. 8 is a diagram exemplifying a projection plane after switching from the PC mode to the interactive mode. In the example of FIG. 8, the tool bar T1 of the display device 10 is displayed on the projection surface, and the tool bar T2 of the drawing software is not displayed. Thus, in this embodiment, when the operation mode is switched from the PC mode to the interactive mode, the toolbar T2 is deleted from the drawing software screen. Therefore, in the interactive mode, the inactive toolbar T2 is prevented from being displayed on the projection surface, and the user is prevented from operating the toolbar T2 by mistake. Further, since the toolbar T1 is displayed at the same position as the display position of the toolbar T2, the change of the display position performed on the toolbar T2 is also reflected on the toolbar T1.

  Refer to FIG. 7 again. In step S7, the CPU 100 of the display device 10 determines whether or not a switching instruction for switching the operation mode of the display system 1 from the interactive mode to the PC mode is input. When it is determined that a switching instruction has been input (S7: YES), the CPU 100 proceeds to step S8. When it is determined that the switching instruction has not been input (S7: NO), the CPU 100 waits for processing until the switching instruction is input.

  In step S <b> 8, the CPU 100 transmits to the information processing apparatus 30 a switching command for switching the operation mode from the interactive mode to the PC mode. In step S9, the CPU 100 deletes the tool bar T1 from the projection surface. In step S10, the CPU 100 switches the operation mode of the display device 10 from the interactive mode to the PC mode. When the mode is switched to the PC mode, the CPU 100 stops drawing the handwritten image and starts transmitting information indicating the position of the indicator 20.

  In step S11, the drawing software of the information processing apparatus 30 displays the toolbar T2 on the drawing software screen. In the interactive mode, the CPU 100 of the display device 10 transmits information indicating the display position of the toolbar T1 on the screen of the drawing software (hereinafter referred to as “position information I1”) to the information processing device 30. For example, when an instruction to change the display position of the toolbar T1 is input, the CPU 100 transmits position information I1 indicating the display position after the change to the information processing apparatus 30. In another example, the CPU 100 transmits the position information I1 to the information processing device 30 when a switching instruction for switching the operation mode from the interactive mode to the PC mode is input. The drawing software of the information processing device 30 stores the position information I1 received from the display device 10 in the RAM 302. In step S11, the drawing software of the information processing apparatus 30 refers to the position information I1 stored in the RAM 302 and displays the toolbar T2 at the same position as the display position of the toolbar T1.

  In step S12, the CPU 300 of the information processing device 30 switches the operation mode of the information processing device 30 from the interactive mode to the PC mode. When the mode is switched to the PC mode, the drawing software of the information processing apparatus 30 starts drawing a handwritten image.

  FIG. 9 is a diagram illustrating the projection surface after the interactive mode is switched to the PC mode. In the example of FIG. 9, the drawing software toolbar T2 is displayed on the projection surface, and the toolbar T1 of the display device 10 is not displayed. As described above, in the present embodiment, when the operation mode is switched from the interactive mode to the PC mode, the toolbar T1 is deleted from the projection surface. Therefore, in the PC mode, the inactive toolbar T1 is prevented from being displayed on the projection surface, and the user is prevented from operating the toolbar T1 by mistake. In addition, since the toolbar T2 is displayed at the same position as the display position of the toolbar T1, the change of the display position performed on the toolbar T1 is also reflected on the toolbar T2.

4). Modifications The present invention is not limited to the above-described embodiments, and various modifications can be made. Hereinafter, some modifications will be described. Two or more of the following modifications may be used in combination.

  The indicator 20 used in the display system 1 is not limited to one. In the display system 1, a plurality of indicators 20 may be used. In this case, for example, the plurality of indicators 20 emit light at different wavelengths, and the display device 10 distinguishes and detects the position of each of the plurality of indicators 20. Note that the display device 10 may detect the positions of the plurality of indicators 20 by distinguishing them from other elements such as the shape or color of the indicators 20.

  The operation of the display system 1 when the operation mode is switched is not limited to that described in the embodiment. In the display system 1, for example, an operation (hereinafter referred to as “switching operation”) for switching the attribute (for example, the type, color, or thickness of a line) of a line drawn according to the locus of a certain indicator 20 is a PC mode. When the operation mode is switched to the interactive mode (or the PC mode) after being performed in the (or interactive mode), the content of the switching operation is a line corresponding to the locus of the indicator 20 after the operation mode is switched. May be reflected when is drawn. For example, the operation mode is switched to the interactive mode after the user operates the toolbar T2 in the PC mode and performs a switching operation for switching the color of the line drawn according to the locus of the indicator 20 from black to red. In this case, a red line may be drawn according to the locus of the indicator 20 even in the interactive mode. In another example, the operation is performed after the user operates the toolbar T1 in the interactive mode and performs a switching operation for switching the thickness of the line drawn according to the locus of the indicator 20 from “thin” to “thick”. When the mode is switched to the PC mode, a “thick” line may be drawn according to the locus of the indicator 20 even in the PC mode.

  FIG. 10 is a diagram illustrating a functional configuration of the display system 1 according to the modification. 10, the display device 10 includes a storage unit 17 and a synchronization unit 18 in addition to the configuration shown in FIG. The storage unit 17 stores a line attribute corresponding to the locus of the position of the indicator 20 for each of the plurality of indicators 20. The storage unit 17 stores, for example, information indicating line attributes (hereinafter referred to as “attribute information”) in association with an identifier for identifying the indicator 20. In the interactive mode, the line attribute corresponding to the locus of the position of the indicator 20 is switched by the user operating the toolbar T1. The synchronization unit 18 synchronizes the attribute stored in the storage unit 17 and the attribute stored in the storage unit 38 described later. For example, when the attribute stored in the storage unit 17 is changed, the synchronization unit 18 transmits the changed attribute information to the information processing device 30, and synchronizes the attribute stored in the storage unit 17 and the storage unit 38. Let In another example, the synchronization unit 18 transmits the attribute information stored in the storage unit 17 to the information processing device 30 when a switching instruction for switching the operation mode from the interactive mode to the PC mode is input. And the attribute memorize | stored in the memory | storage means 38 is synchronized. In this example, the detection unit 12 detects the positions of the plurality of indicators 20 while distinguishing them. In addition, the drawing unit 13 draws the attribute line stored in the storage unit 17 for the indicator 20 whose position is detected by the detection unit 12. Specifically, the drawing unit 13 refers to the attribute information stored in the storage unit 17 in association with the identifier of the indicator 20 whose position is detected by the detection unit 12, and the attribute line indicated by the attribute information Draw. In FIG. 2, the RAM 102 is an example of the storage unit 17, and the CPU 100 is an example of the synchronization unit 18.

  10, the information processing apparatus 30 includes a storage unit 38 and a synchronization unit 39 in addition to the configuration shown in FIG. The storage unit 38 stores the line attribute corresponding to the locus of the position of the indicator 20 for each of the plurality of indicators 20. For example, the storage unit 38 stores the attribute information in a state associated with an identifier for identifying the indicator 20. In the PC mode, the line attribute corresponding to the locus of the position of the indicator 20 is switched by the user operating the toolbar T2. The synchronization unit 39 synchronizes the attribute stored in the storage unit 17 and the attribute stored in the storage unit 38. For example, when the attribute stored in the storage unit 38 is changed, the synchronization unit 39 transmits the changed attribute information to the display device 10 and synchronizes the attribute stored in the storage unit 17 and the storage unit 38. . In another example, the synchronization unit 39 transmits the attribute information stored in the storage unit 38 to the display device 10 when a switching command for switching the operation mode from the PC mode to the interactive mode is received. The attributes stored in the storage unit 38 are synchronized. In this example, the drawing unit 34 draws the attribute line stored in the storage unit 38 for the indicator 20 whose position is detected by the detection unit 12. Specifically, the drawing unit 34 refers to the attribute information stored in the storage unit 38 in association with the identifier of the indicator 20 whose position is detected by the detection unit 12, and the attribute line indicated by the attribute information Draw. In FIG. 3, the RAM 302 is an example of the storage unit 38, and the CPU 300 is an example of the synchronization unit 39.

  The method by which the detection unit 12 detects the position of the indicator 20 and the method for detecting an event related to the indicator 20 are not limited to those described in the embodiment. The display device 10 may specify the position of the indicator 20 by the shape or color of the indicator 20. In addition, the indicator 20 has a button in the grip portion of the housing, and when the user presses this button, a signal indicating a pen-down event may be output (in this case, the indicator 20 has a pen tip). May not have a pressure sensor). Alternatively, a light emitting element (such as a laser diode) and a light receiving element (such as a photodiode) are provided around the screen so that the beam covers the screen, and the position of the indicator 20 and the pen event are detected using signals from the light receiving element. May be.

  The display device 10 is not limited to a projector, and the hardware configuration is not limited to that illustrated in FIG. A direct-view display device such as a liquid crystal display or an organic EL display may be used. In this case, the display device has a touch screen, and detects an instructed position on the display surface by the touch screen.

  The indicator 20 is not limited to an electronic pen. It may be a stylus pen having a housing of a specific shape or color, or may be a user's finger.

  In the display system 1, the sharing of functions between the display device 10 and the information processing device 30 is not limited to that illustrated in FIG. Some of the functions in FIG. 1 may be omitted. In addition, at least a part of what is described as a function of the display device 10 in the embodiment may be mounted on the information processing device 30.

  The drawing software may be provided by a provider different from the provider that provides the display device 10.

DESCRIPTION OF SYMBOLS 1 ... Display system, 10 ... Display apparatus, 11 ... Display means, 12 ... Detection means, 13 ... Drawing means, 14 ... Transmission means, 15 ... Transmission means, 16 ... Storage means, 17 ... Storage means, 18 ... Synchronization means, DESCRIPTION OF SYMBOLS 31 ... Execution means, 32 ... Image supply means, 33 ... Reception means, 34 ... Drawing means, 35 ... Reception means, 36 ... Erase means, 37 ... Transmission means, 38 ... Storage means, 39 ... Synchronization means, 100 ... CPU, DESCRIPTION OF SYMBOLS 101 ... ROM, 102 ... RAM, 103 ... IF part, 104 ... Image processing circuit, 105 ... Projection unit, 106 ... Operation panel, 107 ... Camera, 300 ... CPU, 301 ... ROM, 302 ... RAM, 303 ... IF part, 304 ... Storage unit, 305 ... Display unit, 20 ... Indicator

Claims (7)

A display device and an information processing device;
The display device
Display means for displaying a screen according to a video signal supplied from the information processing apparatus on a display surface;
Detecting means for detecting the position of the indicator on the display surface;
When the operation mode is the first mode, a line corresponding to the locus of the position of the indicator detected by the detection unit and a first image object for changing the attribute of the line are drawn on the display surface. First drawing means;
When the operation mode is the second mode, first transmission means for transmitting information indicating the position of the indicator detected by the detection means to the information processing apparatus;
Second input means for transmitting an instruction for switching the operation mode to the information processing apparatus when an input of an instruction to switch the operation mode is received;
The information processing apparatus includes:
Second drawing means for drawing a screen including a line corresponding to a locus of a position included in the information transmitted from the display device and a second image object for changing the attribute of the line;
Supply means for supplying the display device with a video signal for displaying the screen on the display device;
A display system comprising: an erasing unit that erases the second image object from the screen when a command for switching the operation mode from the second mode to the first mode is received from the display device. The display device
First storage means for storing information indicating a position of the second image object on the screen;
When the input of an instruction for switching the operation mode from the second mode to the first mode is accepted, the display means is located at a position indicated by information stored in the first storage means on the screen. The display system according to claim 1, wherein one image object is displayed. The information processing apparatus includes:
3. The transmission device according to claim 2, further comprising a third transmission unit configured to transmit information indicating the position after the change to the display device when an input of an instruction to change the position of the second image object is received. Display system. The display device
Second storage means for storing the attribute for each of a plurality of indicators;
The detection means detects the positions of the plurality of indicators,
The first drawing means draws the attribute line stored in the second storage means for the indicator whose position is detected by the detection means;
The information processing apparatus includes:
Third storage means for storing the attribute for each of the plurality of indicators;
Synchronization means for synchronizing the attribute stored in the second storage means and the attribute stored in the third storage means;
The said 2nd drawing means draws the line of the attribute memorize | stored in the said 3rd memory | storage means about the indicator in which the position was detected by the said detection means. Display system described. Display means for displaying a screen according to a video signal supplied from the information processing device on a display surface;
Detecting means for detecting the position of the indicator on the display surface;
When the operation mode is the first mode, a line corresponding to the locus of the position of the indicator detected by the detection unit and a first image object for changing the attribute of the line are drawn on the display surface. Drawing means;
When the operation mode is the second mode, first transmission means for transmitting information indicating the position of the indicator detected by the detection means to the information processing apparatus;
Second input means for transmitting an instruction for switching the operation mode to the information processing apparatus when an input of an instruction to switch the operation mode is received;
When the operation mode is the second mode, the display unit displays the screen including a second image object for changing the line attribute, and the operation mode is the first mode. And displaying the screen that does not include the second image object. When the operation mode is the first mode, a screen including a line corresponding to the locus of the position of the indicator included in the information transmitted from the display device and an image object for changing the attribute of the line is not drawn. When the operation mode is the second mode, a drawing means for drawing the screen;
Supply means for supplying the display device with a video signal for displaying the screen on the display device;
An information processing apparatus comprising: an erasing unit that erases the image object from the screen when a command for switching the operation mode from the second mode to the first mode is received from the display device. A control method of a display system having a display device and an information processing device,
The display device
Displaying a screen according to a video signal supplied from the information processing apparatus on a display surface;
Detecting the position of the indicator on the display surface;
When the operation mode is the first mode, drawing a line corresponding to the detected locus of the indicator and a first image object for changing the attribute of the line on the display surface;
When the operation mode is the second mode, transmitting information indicating the detected position of the indicator to the information processing apparatus;
A step of transmitting an instruction for switching the operation mode to the information processing apparatus when an input of an instruction to switch the operation mode is received;
The information processing apparatus is
Rendering a screen including a line corresponding to a locus of a position included in the information transmitted from the display device, and a second image object for changing the attribute of the line;
And a step of erasing the second image object from the screen when a command for switching the operation mode from the second mode to the first mode is received from the display device.

Images