JP2015148845A - Display control device, display device, display system, program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce the time and effort for operations.SOLUTION: A display system (10) comprises a touch pen (200), and an electronic white board (100) that performs drawing processing with the touch pen (200). The electronic white board (100) includes a display section (100A) and a controller (100C). The controller (100C) includes a display control section (50b) that displays a pallet image (700) for setting the functions of the touch pen (200) on the display section (100A). When the touch pen (200) shifts from a normal operation state to a dormant state due to continuation of the unoperated state of the touch pen (200), the display control section (50b) deletes the pallet image (700) from the display section (100A).

Description

  The present invention relates to a display system that performs drawing processing using an electronic pen (touch pen).

  In recent years, a so-called optical touch panel device that includes a plurality of light emitting elements and light receiving elements corresponding to these light emitting elements and detects the position of a light shielding object on a display surface has become widespread.

  The optical touch panel is arranged with a plurality of light emitting elements arranged in the horizontal direction (X-axis direction) and the vertical direction (Y-axis direction) along the edge of the rectangular display surface, and in a position facing the light emitting elements. A plurality of light receiving elements.

  The light emitted from each light emitting element travels along the display surface and is received by the light receiving elements at the opposing positions. When the user performs a touch operation on a predetermined position on the display surface using a finger or a pen (that is, when pointing to the predetermined position), a light receiving element that cannot receive light due to light being blocked is generated. The optical touch panel identifies the position of the light receiving element that cannot receive light among the light receiving elements arranged in the X-axis direction and the Y-axis direction, and thereby the position of the user's finger or pen (light-blocking object) on the display surface. Are detected (that is, the coordinates of the position pointed to by the user are detected). Thus, the process of emitting light from each light emitting element and detecting the coordinates of the light shielding object based on the output of each light receiving element is referred to as “scanning”.

  In addition, when the position pointed to by the user moves continuously (when the user moves the finger or pen), the optical touch panel indicates to the user by storing the history of the position of the light shielding object. It is possible to perform a process of displaying an image showing characters or lines on the display panel following the indicated position. The process of displaying characters or lines following the position pointed to by the user is referred to as “drawing”.

  As the touch panel, there are a resistive film type, a capacitance type, an electromagnetic induction type and the like in addition to the optical type described above.

  The touch panel as described above is provided with a function of setting the color, thickness, and density of a line to be drawn when drawing on a display surface, for example, as shown in Patent Document 1. Patent Document 1 discloses a television including a plasma display panel provided with an electromagnetic induction type touch panel, and a stylus pen provided with a mode change switch and a pallet change switch. In the television of Patent Document 1, when the input of the mode switching signal is confirmed, simple guidance is displayed on the upper part of the plasma display panel, and a canvas image made up of a uniform solid image is displayed on the other parts. Is done. Further, when the input of the palette switching signal is detected in a state where the canvas image is displayed, the palette image is displayed. In the palette image, a plurality of rectangular color samples are shown for each of the pen color and the background color. By bringing the tip of the stylus pen into contact with each color sample, the pen color or background color can be switched to the same color as the color sample brought into contact with the tip of the stylus pen.

JP 2006-293149 A (released on October 26, 2006)

  According to the technique of Patent Literature 1, when a pallet image is displayed, a part of the display area is occupied by the pallet image, and the display area can be effectively used while the drawing process using the stylus pen is not performed. Will be disturbed. Therefore, after displaying the pallet image, it is desirable to delete the pallet image from the display unit while the stylus pen is not used. However, an operation for deleting the pallet image is required, which is troublesome.

  It is an object of the present invention to provide a display control device, a display device, a display system, a program, and a recording medium that require less labor than the prior art.

  In order to solve the above problems, according to one embodiment of the present invention, in a display control device that controls a display device that performs drawing processing using an electronic pen, a setting image for setting the function of the electronic pen is displayed on the display device. Setting image display means to be displayed, and the setting image display means causes the setting image to be displayed from the display device when the electronic pen shifts from a normal operation state to a sleep state due to a state in which the electronic pen is not operated. It is characterized by erasing.

  According to an aspect of the present invention, when the user does not operate the electronic pen and the electronic pen enters a sleep state, the setting image is automatically deleted, thereby reducing the operation time. The effect that it is done.

1 is a schematic diagram illustrating an external configuration of a display system according to Embodiment 1. FIG. It is a functional block diagram of the electronic whiteboard contained in a display system. It is the schematic which shows the external appearance structure of a touch-panel part. It is a functional block diagram of a touch pen. 4 is a timing chart showing a transition from a normal operation state to a dormant state and a transition from a dormant state to a normal operation state. It is explanatory drawing which showed the display state of the display part of a normal operation state, and the display state of the display part of a dormant state. It is the figure which showed the example of a display of a palette image. It is the figure which showed the example of a display of a palette image, Comprising: It is the figure which showed the example of a display different from the example of a display of FIG. 7A. It is the figure which showed the example of a display of a palette image, Comprising: It is the figure which showed the example of a display different from the example of a display of FIG. 7A or FIG. 7B.

Embodiment 1
A display system according to an embodiment of the present invention will be described below with reference to the drawings.

  FIG. 1 is a schematic diagram showing an external configuration of a display system 10 of the present embodiment. As shown in FIG. 1, the display system 10 includes an electronic whiteboard (electronic blackboard) 100 and a touch pen (electronic pen) 200.

  The electronic whiteboard 100 is a display device having a touch panel function, and includes a display unit 100A, a touch panel unit 100B, and a controller 100C. The display unit 100A is connected to the controller 100C via HDMI (registered trademark: High-Definition Multimedia Interface), and the touch panel unit 100B is connected to the controller 100C via USB (Universal Serial Bus).

  The display unit 100A is, for example, an LCD (Liquid Crystal Display) or an EL (Electroluminescence) panel. The display unit 100A displays an image of image data (video data) transmitted from the controller 100C.

  The touch panel unit 100B is a so-called infrared shielding (optical type) touch panel disposed around the display screen of the display unit 100A. That is, when a light shielding object (such as the touch pen 200 or the tip of a user's finger) touches or approaches the display screen of the display unit 100A, the touch panel unit 100B detects a coordinate value (position information) indicating the position of the light shielding object. It is a device to do. Hereinafter, the configuration of the touch panel unit 100B will be described in detail based on FIG. 2 and FIG.

  FIG. 2 is a block diagram of the electronic whiteboard 100, and FIG. 3 is a schematic diagram showing an external configuration of the touch panel unit 100B.

  As illustrated in FIG. 2, the touch panel unit 100 </ b> B includes an information processing unit 1, a ROM 2, a RAM 3, an I / F unit 5, a communication unit 6, and a scanning unit 9.

  The information processing unit 1 is an arithmetic processing unit including a CPU (Central Processing Unit) and the like, and performs various control processes and various arithmetic processes by loading a control program stored in the ROM 2 onto the RAM 3 and executing it. Is.

  The information processing unit 1 includes a control unit 1a and a coordinate value detection unit 1b. The control unit 1a controls various hardware of the touch panel unit 100B, controls communication between the touch panel unit 100B and the touch pen 200, and controls communication between the touch panel unit 100B and the controller 100C. The coordinate value detection unit 1b obtains the coordinate value of the light shielding object on the display screen of the display unit 100A.

  A ROM (Read Only Memory) 2 is a storage device that stores a program used in the information processing unit 1. A RAM (Random Access Memory) 3 is a storage device that temporarily stores the above-described program and various data generated by executing the program. The information processing unit 1 can read out the data in the RAM 3 regardless of the storage order, the storage position, or the like.

  The I / F unit 5 is a communication interface for performing communication with the controller 100C.

  The communication unit 6 is a communication interface for transmitting and receiving information to and from the touch pen 200. The communication method with the touch pen 200 may be either wired or wireless. In the case of wireless, Bluetooth (registered trademark), ZigBee (registered trademark), or any other wireless method can be used.

  The scanning unit 9 scans infrared light (hereinafter referred to as “infrared light”) along the display screen of the display unit 100A. As shown in FIG. 2, the scanning unit 9 includes a light emitting unit 91, a light receiving unit 92, a light emitting address decoder 93A, a light receiving address decoder 93B, and an A / D (Analog to Digital) converter 94. Yes.

  As shown in FIG. 3, the light emitting unit 91 has a plurality of light emitting elements 911, and the light receiving unit 92 has a plurality of light receiving elements 921. Each light emitting element 911 is a light emitting diode (LED) that emits infrared light, and each light receiving element 921 is a photodiode that receives infrared light and outputs an intensity signal indicating a light receiving level.

  Specifically, as shown in FIG. 3, the plurality of light emitting elements 911... Constituting the light emitting unit 91 are arranged in a line on the lower side and the right side of the bezel (frame) surrounding the display unit 100A. The plurality of light receiving elements 921... Constituting the light receiving unit 92 are arranged in a line on the upper side and the left side of the bezel.

  The plurality of light emitting elements 911 on the right side (right side) of the bezel are provided so that the optical paths of infrared light emitted from each of the light emitting elements 911 are parallel to each other along the display screen. The light emitting elements 911... On the lower side (lower side) of the bezel are also provided so that the optical paths of the infrared light emitted from each of the light emitting elements are parallel to each other along the display screen. Further, as shown in FIG. 3, the right side (right side) light emitting elements 911 that emit infrared light in the x-axis direction (horizontal direction) and the infrared light in the y-axis direction (vertical direction). The light paths of the light emitting elements 911... On the lower side (lower side) to be emitted are orthogonal to (intersect) each other.

  3, the same number of light receiving elements 921 as the plurality of light emitting elements 911 on the right side (right side) of the bezel are arranged on the left side (left side) of the bezel. As shown in FIG. 3, each light receiving element 921 on the left side of the bezel is arranged to face each light emitting element 911 on the right side of the bezel so as to receive light from each light emitting element 911 on the right side of the bezel. The Furthermore, as shown in FIG. 3, the same number of light receiving elements 921 as the plurality of light emitting elements 911 on the lower side (lower side) of the bezel are arranged on the upper side (upper side) of the bezel. As shown in FIG. 3, each light receiving element 921 on the upper side of the bezel is arranged to face each light emitting element 911 on the lower side of the bezel so as to receive light from each light emitting element 911 on the lower side of the bezel. The

  In addition, the light emitting unit 91 has a multiplexer (not shown), each of the light emitting elements 911 is connected to the multiplexer, and the light receiving unit 92 also has a multiplexer (not shown), and each of the light receiving elements 921 is Connected to the multiplexer.

  The light emitting address decoder 93A in FIG. 2 transmits a signal for selecting the light emitting element 911 to emit light to the light emitting unit 91 based on the light emission instruction signal sent from the control unit 1a. The light receiving address decoder 93B transmits a signal for selecting the light receiving element 921 corresponding to the light emitting element 911 to emit light to the light receiving unit 92 based on the light reception instruction signal transmitted from the control unit 1a. The A / D converter 94 is a conversion unit that converts an analog signal from the light receiving unit 92 used for detection of light blockage into a digital signal.

  Next, the details of the scanning process in the scanning unit 9 will be described in detail. The control unit 1a outputs a light emission instruction signal for causing each light emitting element 911 of the light emitting unit 91 to emit light to the light emission address decoder 93A, and also receives a light reception instruction signal for causing each light receiving element 921 of the light receiving unit 92 to receive light. To the address decoder 93B.

  The light emitting address decoder 93 </ b> A outputs a signal for selecting the light emitting element 911 to emit light among all the light emitting elements 911 of the light emitting unit 91 to the light emitting unit 91. The light receiving address decoder 93 </ b> B outputs a signal for selecting the light receiving element 921 corresponding to the light emitting element 911 to emit light among all the light receiving elements 921 of the light receiving unit 92 to the light receiving unit 92. Accordingly, the light emitting element 911 selected by the light emitting address decoder 93A emits infrared light, and the light receiving element 921 corresponding to the light emitting element 911 receives infrared light. At this time, the light receiving element 921 outputs an intensity signal indicating the intensity of the received infrared light as a voltage value to the A / D converter 94. The A / D converter 94 converts the intensity signal from an analog signal into, for example, an 8-bit digital signal, and outputs the converted intensity signal to the coordinate value detection unit 1b.

  As described above, the scanning unit 9 emits light one by one from one end to the other end of the light emitting unit 91 on the lower side of the bezel (frame) surrounding the display unit 100A and from one end to the other end of the right side of the bezel. The element 911 is made to emit light sequentially. Accordingly, the coordinate value detection unit 1b acquires intensity signals from all the light receiving elements 921.

  Based on the intensity signal from the scanning unit 9, the coordinate value detection unit 1b obtains the coordinate value of a light shielding object (such as the touch pen 200 or the user's finger) on the display screen of the display unit 100A. Specifically, the coordinate value detection unit 1b calculates the amount of light received by each light receiving element 921 based on the intensity signal acquired from each light receiving element 921. The coordinate value detection unit 1b determines that the light path of the infrared light is not shielded for the light receiving element 921 in which the amount of received light exceeds a predetermined threshold. On the other hand, the coordinate value detection unit 1b determines that the light path of the infrared light is shielded for the light receiving element 921 whose light reception amount is equal to or less than the threshold value. The coordinate value detection unit 1b specifies the light receiving element 921 where the optical path of the infrared light is shielded, and obtains the coordinate value of the light shielding object on the display screen of the display unit 100A based on the specified position of the light receiving element 921. (Generate). The control unit 1a transmits the coordinate value (coordinate data) obtained by the coordinate value detection unit 1b to the controller 100C via the I / F unit 5.

  Next, the touch pen 200 will be described. The touch pen 200 transmits, to the touch panel unit 100B, exercise information indicating the amount of exercise that occurs when the touch pen 200 moves and pressure information that indicates the pressure (load) generated when the pen tip is pressed. Thereby, on the electronic whiteboard 100 side, the momentum and the writing pressure when the touch pen 200 is operated by the user can be recognized.

  FIG. 4 is a block diagram illustrating a schematic configuration of the touch pen 200. As shown in FIG. 4, the touch pen 200 includes a writing pressure detection unit 201, a movement detection unit 202, a pen control unit 203, and a pen communication unit 204.

  The pen pressure detection unit 201 is a pressure sensor that outputs pressure information that is a value indicating the pressure (writing pressure) generated at the pen tip when the pen tip of the touch pen 200 is pressed. The writing pressure detection unit 201 transmits pressure information to the pen control unit 203. Note that the pen pressure detection unit 201 is activated only when the touch pen 200 is in a normal operation state (described later), and when the touch pen 200 is in a rest state (described later), the energization is interrupted and the operation state is not activated. It has become.

  The motion detection unit 202 is a motion sensor that outputs motion information indicating the amount of motion such as speed, acceleration, and angular velocity when the touch pen 200 moves. The motion detection unit 202 transmits motion information to the pen control unit 203. The motion detection unit 202 is activated when the touch pen 200 is in a normal operation state or a resting state. In addition, as a motion sensor, acceleration sensors, such as a capacitance type and a piezoresistive type, can be used, for example.

  The pen communication unit 204 is a communication interface for transmitting and receiving information to and from the touch panel unit 100B. The communication method with the touch panel unit 100B may be either wired or wireless. In the case of wireless, Bluetooth (registered trademark), ZigBee (registered trademark), or any other wireless method can be used.

  The pen control unit 203 is a block that performs control of communication with the touch panel unit 100B, operation control of each hardware of the touch pen 200, and the like.

  The pen control unit 203 uses the pressure information or motion information output from the writing pressure detection unit 201 or the motion detection unit 202 (both information when both information is output) for a predetermined first period (short period; For example, the transmission is continued to the touch panel unit 100B via the pen communication unit 204 at a frequency of 80 to 120 Hz.

  In addition, the pen control unit 203 performs control to switch the touch pen 200 between a normal operation state and a pause state.

  The normal operation state is a state in which the touch pen 200 continues to transmit at least one of pressure information or exercise information to the touch panel unit 100B in the first period, or a state in which regular communication described later is continued in the second period. Point to.

  The hibernation state (sleep state) is a state in which the power of the touch pen 200 is on but lower in power consumption than the normal operation state, and the touch pen 200 does not communicate with the touch panel unit 100B (power saving mode). ). In the normal operation state, the pen pressure detection unit 201, the movement detection unit 202, the pen control unit 203, and the pen communication unit 204 shown in FIG. 4 are all energized. Although the control unit 203 is energized, the energization of the writing pressure detection unit 201 and the pen communication unit 204 is interrupted (that is, the writing pressure detection unit 201 and the pen communication unit 204 are not operating).

  Next, the transition from the normal operation state to the hibernation state and the transition from the hibernation state to the normal operation state will be described with reference to FIG.

  In the normal operation state, the pen control unit 203 uses the pressure information or the motion information (both information when both information is output) output from the writing pressure detection unit 201 or the motion detection unit 202 as pen communication. Transmission is continued in the first cycle to the touch panel unit 100B via the unit 204 (see reference A in FIG. 5).

  Further, in the normal operation state, when neither the pressure information nor the motion information is output, the pen control unit 203 has a predetermined second period (for example, longer than the transmission period (first period) of pressure information or the like). Periodic communication is performed at a cycle of 1 second (see symbol B in FIG. 5). The information transmitted by the regular communication is information indicating a normal operation state, and may include information such as the remaining battery level.

  Further, when the state in which the pressure information and the motion information are not output continues for a predetermined time (a time longer than the second period: for example, 60 seconds), the pen control unit 203 causes the touch pen 200 to be in a sleep state from a normal operation state. (See symbol C in FIG. 5), and the regular communication is stopped. When the pen control unit 203 transitions from the normal operation state to the hibernation state, the pen control unit 203 transmits a pause notification to the touch panel unit 100B via the pen communication unit 204 as shown in FIG.

  Furthermore, when the movement information is output from the movement detection unit 202 while the touch pen 200 is in the resting state, the pen control unit 203 returns the writing pressure detection unit 201 and the pen communication unit 204 to the energized state, and the normal state is resumed from the resting state. Returning to the operating state, the exercise information is transmitted to the touch panel unit 100B.

  Information transmitted from the touch pen 200 to the touch panel unit 100B (the pressure information, the exercise information, the regular communication, and the suspension notification) is transmitted to the controller 100C by the control unit 1a of the touch panel unit 100B. .

  According to the above configuration, since exercise information and pressure information detected by the touch pen 200 are transmitted to the controller 100C side, the amount of exercise when the touch pen 200 is operated by the user on the controller 100C side. And the pen pressure can be recognized. Further, when the user leaves the touch pen 200 in the normal operation state and the time elapses (the state in which the user does not operate the touch pen continues), when the state in which the exercise information and the pressure information are not detected continues, When the movement information is output when the user moves from the normal operation state to the sleep state and the user moves the touch pen 200 in the sleep state, the normal operation state is returned from the sleep state.

  Moreover, since the above pen control part 203 is the structure which handles all the pressure information output from the pen pressure detection part 201, and the exercise | movement information output from the exercise | movement detection part 202 as effective data, other than user operation ( For example, there is a situation in which minute pressure information and motion information generated by, for example, simple vibration) are handled by the controller 100C as being caused by a user operation. Therefore, in order to suppress this situation, a threshold value is set for each of pressure information and exercise information, pressure information and exercise information above the threshold are treated as valid data, and pressure information and exercise information below the threshold value are invalid data. May be ignored. Specifically, the pen control unit 203 may perform processing as described below.

The pen control unit 203 compares the pressure information output from the writing pressure detection unit 201 with a threshold set for the pressure information, and extracts pressure information equal to or higher than the threshold as effective pressure information. Further, the pen control unit 203 compares the exercise information output from the exercise detection unit 202 with a threshold set for the exercise information, and extracts exercise information equal to or greater than the threshold as effective exercise information.
The pen control unit 203 continues to transmit effective pressure information or effective exercise information (both information when both information is extracted) to the touch panel unit 100B via the pen communication unit 204 in the first period.

  In the normal operation state, the pen control unit 203 performs the above-described regular communication when effective pressure information and effective exercise information are not extracted. Furthermore, when the state where the effective pressure information and the effective exercise information are not extracted continues for a predetermined time, the pen control unit 203 shifts the touch pen 200 from the normal operation state to the sleep state, and stops the regular communication. Further, when transitioning to the dormant state, the pen control unit 203 transmits a dormancy notification to the touch panel unit 100B via the pen communication unit 204. When the touch pen 200 extracts effective motion information while the touch pen 200 is in the resting state, the pen control unit 203 returns the writing pressure detection unit 201 and the pen communication unit 204 to the energized state, and makes a transition from the resting state to the normal operation state. The effective exercise information is transmitted to the touch panel unit 100B. According to the above embodiment, it is possible to suppress the controller 100C from recognizing minute pressure information and exercise information generated by other than user operation (for example, simple vibration) as exercise information and writing pressure information generated by the user operation. Further, according to the above embodiment, there is a situation in which the user enters the normal operation state while there is no user operation on the touch pen 200 during the pause state, or there is no user operation on the touch pen 200 during the normal operation state for a long period of time. It is possible to suppress a situation such as not being shifted to the hibernation state.

  Further, there are fluctuations in the output signals of the writing pressure detection unit (pressure sensor) 201 and the motion detection unit 202 (motion sensor) (for example, the output signal of the pressure sensor may not be linear). Therefore, the pen control unit 203 corrects (normalizes) the pressure information output from the writing pressure detection unit 201 and the motion information output from the motion detection unit 202, and then performs pressure information and Exercise information transmission processing, switching processing between a normal operation state and a rest state based on pressure information and exercise information, threshold processing for pressure information and exercise information, and the like may be performed.

  Next, the controller 100C will be described. The controller 100C is a display control device that controls the electronic whiteboard 100 (display control of the display unit 100A). As illustrated in FIG. 2, the controller 100 </ b> C includes an information processing unit 50, a storage unit 51, a RAM 52, and an I / F unit 53.

  The information processing unit 50 is an arithmetic processing unit composed of a CPU or the like, and by loading a control program stored in the storage unit 51 onto the RAM 52 and executing it, various control processes, various arithmetic processes, the touch panel unit 100B, Control of communication processing with the display unit 100A is performed.

  The storage unit 51 is a nonvolatile storage device such as a hard disk or a semiconductor memory, and stores programs and image data used by the information processing unit 50. The RAM 52 is a storage device that temporarily stores the above-described program and various data generated by executing the program. The I / F unit 53 is a communication interface for performing communication with the touch panel unit 100B and communication with the display unit 100A.

  As shown in FIG. 2, the information processing unit 50 includes a state determination unit 50a and a display control unit 50b.

  The state determination unit 50a is a block that determines the state of the touch pen 200 based on information obtained from the touch pen 200 transmitted via the touch panel unit 100B. The determination process of the state determination unit 50a will be described in detail below.

  The state determination unit 50a receives at least one of the pressure information and the exercise information in the first period (reference A in FIG. 5) or receives the periodic communication in the second period (reference in FIG. 5). B) A normal operation state is determined.

  And the state determination part 50a determines with the touch pen 200 having changed to the hibernation state from the normal operation state, when the hibernation notification is received.

  In addition, even when the state determination unit 50a has not received the suspension notification, any one of the pressure information, the exercise information, and the periodic communication after the regular communication is interrupted for a certain period (a period longer than the second period). If it is not received, it is determined that the touch pen 200 has shifted from the normal operation state to the hibernation state. This is because when the communication method between the touch panel unit 100B and the touch pen 200 is wireless, the touch panel unit 100B may miss the suspension notification, but even in that case, the transition to the suspension state is made depending on the presence or absence of communication from the touch pen 200. Can be estimated. FIG. 5 shows a chart when the transition to the hibernation state is estimated by the presence / absence of communication from the touch pen 200 although the touch panel unit 100B misses the hibernation notification.

  The state determination unit 50a determines that the touch pen 200 is in a resting state when there is no communication with the touch pen 200 after determining that the normal operation state has shifted to the resting state, and receives exercise information from the touch pen 200 in the resting state. Then, it is determined that the touch pen 200 has returned from the hibernation state to the normal operation state (reference D in FIG. 5).

  Next, the display control unit 50b will be described. The display control unit 50b performs control for displaying various image data stored in the storage unit 51 and images based on various applications on the display unit 100A.

  The display control unit (setting image display unit) 50b performs a drawing process based on the coordinate value transmitted from the touch panel unit 100B and the pressure information (writing pressure of the touch pen 200). Specifically, when the display control unit 50b detects that the pen tip of the touch pen 200 is moving in contact with the screen of the display unit 100A based on the coordinate value and the pressure information, the display control unit 50b displays a line corresponding to the locus of the pen tip. Control to display on the display unit 100A is performed.

  Furthermore, the display control unit 50b of the present embodiment displays a palette image 700 (see FIG. 6) for setting the function of the touch pen 200 on the display unit 100A. The thickness or color of the line drawn by the touch pen 200 is set by the palette image 700. That is, the palette image 700 shows a plurality of rectangles filled with a sample of the color of the drawable line, and a rectangle (inside the rectangle inside the rectangle, the sample of the drawable line of thickness is displayed. A plurality of rectangles with thickness samples are displayed. When the display control unit 50b detects that the user has touched the rectangle shown in the palette image 700 with the touch pen 200 based on the coordinate value and pressure information transmitted from the touch panel unit 100B, the display control unit 50b The color or thickness is changed to the same sample as the color or thickness shown in the touched rectangle.

  Here, when the pallet image 700 is always displayed on the display unit 100A when the touch pen 200 is not used, a part of the display area is occupied by the pallet image 700, and the display area is narrowed. (In other words, when the touch pen 200 is not used in the electronic whiteboard 100, it is assumed that the content displayed on the display unit 100A is shown to the viewer as much as possible. If 700 is superimposed, the display of the content is hindered). Therefore, it is desirable to delete the palette image 700 from the display unit 100A if a period in which the touch pen 200 is not used continues after the palette image 700 is displayed. However, the manual operation for deleting the palette image 700 each time is performed. When an operation (for example, switch switching of the touch pen 200) is necessary, it is troublesome.

  Therefore, when the state determination unit 50a detects that the touch pen 200 has shifted from the normal operation state to the hibernation state, the display control unit 50b according to the present embodiment displays the display unit 100A on the display unit 100A as illustrated in FIG. The palette image (setting image) 700 is erased. Then, when the state determination unit 50a detects that the touch pen 200 has returned from the pause state to the normal operation state, the display control unit 50b displays the palette image 700 on the display unit 100A again.

  As a result, when the state in which the touch pen 200 is not operated by the user continues and the touch pen 200 shifts to the resting state, the palette image 700 is automatically deleted (deleted without any user operation). ), And there is an effect that the operation time is reduced. Further, when the touch pen 200 returns from the paused state to the normal operation state, the palette image 700 is automatically displayed on the display unit 100A (to be displayed without any user operation), and the operation time is reduced. The effect that it is done.

  During the drawing process, the display control unit 50b, for example, 30 cm to the left of the location indicated by the touch pen 200 (when the location is outside the display area, the right side of the touch pen 200 is shown in FIG. 6. It is preferable that a palette image is displayed in (). Thus, the palette image 700 can be displayed at a position that does not interfere with the drawing process.

[Embodiment 2]
In the second embodiment, only differences from the first embodiment will be described. In the first embodiment, when the touch pen 200 returns from the rest state to the normal operation state, the palette image 700 is displayed again on the display unit 100A.

  In contrast, in the second embodiment, the display control unit 50b displays the display unit 100A when the touch pen 200 returns from the paused state to the normal operation state and a coordinate value is detected by the touch panel unit 100B. The palette image is displayed again. That is, in the second embodiment, when the touch pen 200 simply returns from the paused state to the normal operation state, the display unit 100A does not display the palette image 700 again, returns from the paused state to the normal operation state, and When position information (coordinate values) indicating the position indicated by the touch pen 200 in the display screen is detected by the touch panel unit 100B, the palette image is displayed again on the display unit 100A. In addition, the display control part 50b can recognize that the coordinate value was detected in the touch panel part 100B with having received the coordinate value from the touch panel part 100B.

  According to the above embodiment, not only the touch pen 200 returns to the normal operation state, but also the palette image 700 is displayed after detecting that the position designation by the touch pen 200 has actually started. That is, the pallet image 700 is displayed not only when the touch pen 200 returns to the normal operation state but also when there is a high possibility that the pallet image 700 is actually used. Therefore, the accuracy of automatically displaying the pallet image 700 at the timing when the user needs to display the pallet image 700 can be increased.

  The display control unit 50b displays the pallet image unless the user inputs an instruction until the display unit 100A redisplays the pallet image and transitions from the normal operation state to the sleep state. Continue to let.

  The display control unit 50b returns to the normal operation state instead of displaying the pallet image 700 when the coordinate value (position information) of the touch pen 200 is detected by the touch panel unit 100B. In addition, the palette image 700 may be displayed when it is detected that the touch pen 200 touches the screen. That is, in this case, regardless of whether or not the coordinate value of the touch pen 200 is detected, the display control unit 50b returns to the normal operation state and displays the display unit according to the pressure information transmitted from the touch pen 200 via the touch panel unit 100B. When it is recognized that the screen of 100A and the touch pen 200 are in contact with each other, the palette image 700 is displayed.

[Embodiment 3]
In the third embodiment, only differences from the first and second embodiments will be described. In the first embodiment, when the touch pen 200 returns from the paused state to the normal operation state, the palette image is displayed again on the display unit 100A. In the second embodiment, the touch pen 200 returns from the paused state to the normal operation state. In addition, when coordinate values are detected by the touch panel unit 100B, a palette image is displayed again on the display unit 100A.

  On the other hand, in the third embodiment, the display control unit 50b is configured such that the touch pen 200 returns from the paused state to the normal operation state, the coordinate value is detected by the touch panel unit 100B, and the screen of the display unit 100A is displayed. And the touch pen 200 come into contact with each other, the palette image 700 is displayed again on the display unit 100A. Note that the display control unit 50b can recognize that the screen of the display unit 100A and the touch pen 200 are in contact with each other by pressure information transmitted from the touch pen 200 via the touch panel unit 100B.

  According to the above embodiment, not only the touch pen 200 returns to the normal operation state but also the pallet image 700 is displayed after it is detected that the position designation by the touch pen 200 actually touching the screen has started. It has become. That is, the pallet image 700 is displayed not only when the touch pen 200 returns to the normal operation state but also when there is a high possibility that the pallet image 700 is actually used. Therefore, the accuracy of automatically displaying the pallet image 700 at the timing when the user needs to display the pallet image 700 can be increased.

  The display control unit 50b displays the pallet image unless the user inputs an instruction until the display unit 100A redisplays the pallet image and transitions from the normal operation state to the sleep state. Continue to let.

[Embodiment 4]
Even if the touch pen 200 is in a normal operation state, the display control unit 50b may hide the palette image 700 while the drawing process is being performed. Thereby, it can suppress that the palette image 700 obstructs a drawing process.

  That is, since the drawing process and the setting process using the palette image 700 are not performed at the same time (usually, the setting process is performed immediately before the start of the drawing process), the palette image 700 is displayed during the drawing process. Rather, if the setting image is displayed during the drawing process, the drawable area in the display screen is reduced, and the palette image 700 hinders the drawing process. On the other hand, according to the present embodiment, since the palette image 700 is hidden while the drawing process is being performed, it is possible to suppress the palette image 700 from interfering with the drawing process.

  The display control unit 50b may determine whether or not the drawing process is being performed, for example, as described below. The display control unit 50b refers to the coordinate value information and the pressure information, and the movement distance of the pen tip of the touch pen 200 becomes a predetermined value or more while the contact state between the touch pen 200 and the screen continues for a predetermined time or more. It is determined that the drawing process is in progress. When the display control unit 50b determines that the drawing process is being performed, the display control unit 50b deletes the palette image 700 from the display unit 100A.

  Further, the display control unit 50b is configured not to display the palette image 700 not only during the drawing process with the touch pen 200 but also during the drawing process with other light shielding objects (such as a user's finger). Also good. In this case, the display control unit 50b may be configured to determine that the drawing process is being performed with reference to the coordinate value information when the moving distance of the light shielding object is equal to or greater than a predetermined value.

[Embodiment 5]
Further, unless switching between display and non-display of the palette image 700 can be performed by a user's instruction input, for example, when the user desires to display the palette image 700, the palette image 700 is not displayed. Or the user feels annoyed with the displayed palette image 700.

  Thus, in the present embodiment, the display control unit 50b switches between displaying and hiding the palette image 700 when the user performs a predetermined operation on the touch pen 200. That is, when the user performs a predetermined operation on the touch pen 200 while the pallet image 700 is displayed, the display control unit 50b deletes the pallet image 700, and the user operates the touch pen 200 while the pallet image 700 is not displayed. When a predetermined operation is performed on the display unit 50b, the display control unit 50b displays the palette image 700 on the display unit 100A. As a result, the palette image 700 can be displayed or erased by the user's own operation, thereby preventing the above-described inconveniences.

  In addition, as predetermined operation, operation of the switch button provided in the touch pen 200 is mentioned, for example. That is, when the switch button is operated, the touch pen 200 transmits an operation signal indicating that the button is operated to the touch panel unit 100B, and the touch panel unit 100B transmits the operation signal to the controller 100C. . The display control unit 50b of the controller 100C can detect that the operation of the switching button has been performed when the operation signal is received.

  Further, the predetermined operation may be an operation in which the user vibrates the touch pen 200 or the like. In this case, the display control unit 50b of the controller 100C determines whether or not the touch pen 200 is vibrated based on the exercise information sent from the touch pen 200 via the touch panel unit 100B (for example, in the pen control unit 203). Assuming that the threshold value to be compared with the acceleration in the threshold processing is 0.3 G, the display control unit 50 b is within a threshold time (for example, 0.5 seconds) after the acceleration exceeds the threshold value (0.3 G). Further, when an acceleration greater than a predetermined amount (for example, 2G) greater than the threshold is detected, and the threshold time (for example, 0.5 seconds) elapses from the time when the predetermined amount of acceleration is detected, the acceleration becomes the threshold (0). .3) If it is less than that, it is determined that a strong motion has been performed). According to such a configuration, display and non-display of the palette image 700 can be switched by a user operation without providing a switching button on the touch pen 200.

[Embodiment 6]
Further, when the touch pen 200 is in a resting state, there is a high probability that there is no light blocking object on the touch panel unit 100B, and if the scanning process is performed at the same frequency as in the normal operation state, wasteful power consumption occurs. Therefore, in the display system 10, when the touch pen 200 is in a resting state, the frequency of scanning processing by the scanning unit 9 is suppressed compared to when the touch pen 200 is in a normal operation state. Also good. Thereby, power saving can be achieved.

  Hereinafter, the configuration of the sixth embodiment will be described in detail. The control unit 1a of the touch panel unit 100B according to the present embodiment determines whether the touch pen 200 is in a normal operation state or a pause state based on information transmitted from the touch pen 200. Note that the determination method is the same as the determination method of the state determination unit of the controller 100C.

  Then, the control unit (scanning control unit) 1a causes the scanning unit 9 to suppress the frequency of scanning processing when the touch pen 200 is in the pause state, compared to when the touch pen 200 is in the normal operation state. .

  For example, the number of times of scanning processing per unit time is reduced in the pause state than in the normal operation state. In the present embodiment, since the scanning unit 9 is an infrared ray blocking method, the execution period of the optical scanning process by the scanning unit 9 is 200 Hz in the normal operation state and 50 Hz in the pause state. In addition, if the scanning unit 9 is a capacitance type, the scanning process execution cycle for detecting a change in capacitance may be set to 200 Hz in the normal operation state and 50 Hz in the pause state.

  Moreover, when the scanning part 9 is an infrared rays interruption system, you may decrease the number of sensing lines which perform an optical scan in the said idle state rather than the said normal operation state. For example, in the resting state, every other light emitting element 911 may emit light, and the number of sensing lines may be half that of the normal operating state.

  Further, when the touch pen 200 is in the pause state, the control unit 1a may be configured to inhibit the scanning unit 9 from executing the scanning process, thereby suppressing the frequency of the scanning process.

[Embodiment 7]
The display control unit 50b may improve the convenience of the palette image 700 by changing the display position of the palette image 700 according to the movement of the position pointed to by the touch pen 200.

  The display control unit 50b displays the palette image 700 so as to overlap the drawable area (drawing area) in the display unit 100A, and the drawing point (position pointed to by the touch pen 200) is, for example, 30 cm left (30 cm left). The palette image 700 may be moved so as to follow the right side of the drawing point when the position is outside the display region (see FIG. 7A).

  Further, the display control unit 50b displays the palette image 700 so as to overlap the drawing area in the display unit 100A, and a drawing point is detected at a position near the palette image 700 (for example, within 30 cm from the palette image 700). In this case, the pallet image 700 may be moved to the center of the drawing area that is divided into the left and right parts and the drawing is not performed (see FIG. 7B).

  Alternatively, when the drawing area is not the entire display area of the display unit 100A (for example, when the drawing area is only within the display window of the application software, or when the application software has a width of several centimeters outside the drawing area) Is used for displaying the palette image 700), the display control unit 50b moves the palette image 700 closer to the drawing point on the left side and the right side of the drawing area (see FIG. 7C).

  The display control unit 50b grasps the drawing point based on the coordinate value information sent from the touch panel unit 100B, and changes the display position of the palette image 700 according to the drawing point.

[Modification]
In the above embodiment, the writing pressure detection unit 201 of the touch pen 200 is a pressure sensor, but may be a switch that detects contact between the movable pen tip and the opposing object. For example, as shown in Japanese Patent Application Laid-Open No. 2005-190042, a mechanism including a movable pen tip and an optical switch (photo interrupter) may be used as the writing pressure detection unit 201.

  In the electronic whiteboard 100, the touch panel unit 100B may be removable.

  In the above embodiment, the controller 100C is configured to be connected to the display unit 100A and the touch panel unit 100B in a wired manner as external devices of the display unit 100A and the touch panel unit 100B. It may be a display control device provided inside unit 100A, or a display control device provided inside touch panel unit 100B. When the controller 100C is provided inside the touch panel unit 100B, when various types of information from the touch pen 200 are received by the I / F unit 5, the information is transmitted to the information processing unit 50 of the controller 100C.

  In the present embodiment, each unit of the information processing unit 50 is provided in the controller 100C. However, the information processing unit 50 is not particularly required to be provided in the controller 100C, and may be provided anywhere in the display system 10. For example, each unit of the information processing unit 50 may be provided inside the touch pen 200. In this case, the state determination unit 50a of the information processing unit 50 performs state determination based on information from the pen control unit 203, and the display control unit 50b of the information processing unit 50 determines a palette image based on the result of the state determination. An instruction signal indicating an erasure instruction or a display instruction of 700 is transmitted to the controller 100C via the touch panel unit 100B. Then, the controller of the controller 100C controls the erasure and display of the palette image 700 according to the instruction signal while displaying various images on the display unit 100A.

  In the present embodiment, each unit of the information processing unit 1 is provided in the touch panel unit 100B. However, the information processing unit 1 does not have to be particularly provided in the touch panel unit 100B, and may be provided anywhere in the display system 10. Good.

[Example of software implementation]
The information processing unit 50 of the controller 100C and the information processing unit 1 of the touch panel unit 100B may be realized by a logic circuit (hardware) formed in an integrated circuit (IC chip) or the like, or may be a CPU (Central Processing Unit). ) May be implemented by software.

  In the latter case, the controller 100C and the touch panel unit 100B include a CPU that executes instructions of a program that is software that realizes each function, and a ROM (Read Only) in which the program and various data are recorded so as to be readable by the computer (or CPU). Memory) or a storage device (these are referred to as “recording media”), a RAM (Random Access Memory) for expanding the program, and the like. And the objective of this invention is achieved when a computer (or CPU) reads the said program from the said recording medium and runs it. As the recording medium, a “non-temporary tangible medium” such as a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. The program may be supplied to the computer via an arbitrary transmission medium (such as a communication network or a broadcast wave) that can transmit the program. The present invention can also be realized in the form of a data signal embedded in a carrier wave in which the program is embodied by electronic transmission.

[Summary]
Aspect 1 of the present invention is a setting image for setting functions of the electronic pen in a display control device (controller 100C) that controls a display device (electronic whiteboard 100) that performs drawing processing with the electronic pen (touch pen 200). Setting image display means (display control unit 50b) for displaying (pallet image 700) on the display device. The setting image display means is configured so that the electronic pen is normally operated when the electronic pen is not operated. The set image is erased from the display device when the operation state shifts to the hibernation state.

  According to the first aspect of the present invention, when the state in which the user does not operate the electronic pen continues and the electronic pen shifts to the resting state, the setting image is automatically deleted, thereby reducing the operation time. The effect that it is done.

  In addition to the configuration of aspect 1, the display control device according to aspect 2 of the present invention displays the setting image on the display device when the electronic pen returns from the pause state to the normal operation state. It is characterized by making it.

  According to the second aspect of the present invention, when the electronic pen returns from the hibernation state to the normal operation state, the setting image is automatically displayed on the display device, thereby reducing an operation trouble. Play.

  In addition to the configuration of aspect 1, the display control device according to aspect 3 of the present invention includes: (1) the electronic pen returns from the rest state to the normal operation state; and When the position information indicating the position pointed to by the electronic pen is detected on the screen of the display device, the setting image is displayed on the display device.

  According to the third aspect of the present invention, not only the electronic pen returns to the normal operation state, but also the setting image is displayed after detecting that the position designation by the electronic pen has actually started. ing. That is, not only does the electronic pen return to the normal operation state, but the setting image is displayed after a situation where there is a high possibility that the setting image is actually used. Therefore, there is an effect that it is possible to increase the accuracy of automatically displaying the setting image at a timing when the user needs to display the setting image.

  In the display control device according to aspect 4 of the present invention, in addition to the configuration according to aspect 1, the setting image display means includes: (1) the electronic pen returns from the pause state to the normal operation state; and (2) the display device. Position information indicating a position pointed to by the electronic pen is detected, and (3) when the screen of the display device and the electronic pen are in contact with each other, the setting image is displayed on the display device. And

  According to the fourth aspect of the present invention, not only the electronic pen returns to the normal operation state but also the setting image is displayed after detecting that the position designation by the electronic pen touching the screen has started. It is supposed to let you. That is, not only the electronic pen returns to the normal operation state, but also the accuracy of automatically displaying the setting image at the timing when the user needs to display the setting image can be improved.

  Further, since the drawing process and the setting process using the setting image are not performed at the same time (normally, the setting process is performed immediately before the drawing process is started), the setting image is displayed during the drawing process. There is no inevitability. Rather, if the setting image is displayed during the drawing process, the drawable area occupied on the display screen is reduced, which hinders the drawing process.

  Therefore, in addition to the configuration of any one of the aspects 1 to 4, the display control device according to the aspect 5 of the present invention performs the drawing process even when the electronic pen is in the normal operation state. The setting image is not displayed while it is being displayed. Thereby, it can suppress that the said setting image obstructs the said drawing process.

  In addition, when the user wants to perform setting processing using the setting image, the setting image is not displayed, and the user feels annoying the displayed setting image. Inconvenience can occur.

  Therefore, in addition to the configuration of any one of the aspects 1 to 5, the display control device according to the aspect 6 of the present invention is configured so that the setting image display unit performs the setting when the user performs a predetermined operation on the electronic pen. It is characterized by switching between image display and non-display. As a result, the setting image can be displayed or erased by the user's own operation, and thus the above inconveniences can be prevented.

  According to a seventh aspect of the present invention, in a display device that performs drawing processing using an electronic pen, a display unit and a setting image display unit that displays a setting image for setting the function of the electronic pen on the display unit. And the setting image display means erases the setting image from the display unit when the electronic pen shifts from a normal operation state to a resting state due to a state in which the electronic pen is not operated. To do.

  Further, according to an aspect 8 of the present invention, in a display system including a display device and an electronic pen for performing a drawing process on the display unit of the display device, a setting image for setting the function of the electronic pen Is displayed on the display unit, and the setting image display unit is configured to switch the electronic pen from a normal operation state to a sleep state when the drawing process is not performed. The setting image is erased from the display unit.

  According to the aspect 7 or 8 of the present invention, when the state in which the user does not operate the electronic pen continues and the electronic pen shifts to the resting state, the setting image is automatically deleted. Has the effect of being reduced.

  In addition, the fact that the electronic pen is in a suspended state is highly likely that the drawing process has not been performed. In this case, too, if the scanning process is performed at the same frequency as when the drawing process is performed, it is useless. Power consumption.

  Therefore, in addition to the configuration of aspect 8, the display system according to aspect 9 of the present invention includes a scanning unit that performs a scanning process for generating position information indicating a position pointed to by the electronic pen on the screen of the display unit. When the electronic pen is in the resting state, the scanning control means (control unit 1a) causes the scanning unit to suppress the frequency of the scanning process compared to the case where the electronic pen is in the normal operation state. It is characterized by comprising. Thereby, power saving can be achieved.

  The display control devices according to aspects 1 to 6 of the present invention may be realized by a computer. In this case, the display control device is operated by the computer by causing the computer to operate as each unit included in the display control device. A program to be realized and a computer-readable recording medium on which the program is recorded also fall within the scope of the present invention.

  The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention. Furthermore, a new technical feature can be formed by combining the technical means disclosed in each embodiment.

  The present invention can be used in a display system that performs drawing processing using an electronic pen. The display device used in the display system may be a display device (display device having a touch panel function) capable of drawing processing using an electronic pen. For example, a white board (electronic blackboard), a tablet terminal, a personal computer, A game machine, a smart phone, various portable electronic devices, etc. are mentioned.

1a Control unit (scanning control means)
1b Coordinate value detection unit 9 Scanning unit 10 Display system 50a State determination unit 50b Display control unit (setting image display means)
100 Electronic whiteboard (display device)
100A Display unit 100B Touch panel unit 100C Controller (display control device)
200 Touch pen (electronic pen)
700 Palette image (setting image)

Claims (11)

In a display control device that controls a display device that performs drawing processing with an electronic pen,
Comprising setting image display means for displaying a setting image for setting the function of the electronic pen on the display device;
The setting image display means erases the setting image from the display device when the electronic pen shifts from a normal operation state to a sleep state due to a state in which the electronic pen is not operated. .   The display control device according to claim 1, wherein the setting image display unit displays the setting image on the display device when the electronic pen returns from the pause state to the normal operation state.   The setting image display means includes (1) position information indicating a position at which the electronic pen returns from the resting state to the normal operation state, and (2) a position indicated by the electronic pen on the screen of the display device. The display control apparatus according to claim 1, wherein when the image is detected, the setting image is displayed on the display apparatus.   The setting image display means detects (1) position information indicating a position indicated by the electronic pen on the screen of the display device, (1) the electronic pen returns from the rest state to the normal operation state. (3) The display control device according to claim 1, wherein when the screen of the display device and the electronic pen come into contact with each other, the setting image is displayed on the display device.   5. The setting image display unit hides the setting image while the drawing process is being performed even when the electronic pen is in the normal operation state. 6. The display control apparatus according to claim 1.   6. The setting image display unit according to claim 1, wherein when the user performs a predetermined operation on the electronic pen, the setting image display unit switches between display and non-display of the setting image. The display control apparatus described. In a display device that performs drawing processing with an electronic pen,
A display unit;
Setting image display means for displaying a setting image for setting the function of the electronic pen on the display unit;
The display device is characterized in that the setting image display means erases the setting image from the display unit when the electronic pen shifts from a normal operation state to a resting state due to a state in which the electronic pen is not operated. In a display system comprising a display device and an electronic pen for performing a drawing process on the display unit of the display device,
A setting image display means for displaying a setting image for setting the function of the electronic pen on the display unit;
The setting image display means erases the setting image from the display unit when the electronic pen shifts from a normal operation state to a pause state due to a state in which the drawing process is not performed. . A scanning unit that performs a scanning process for generating position information indicating a position pointed to by the electronic pen on the screen of the display unit;
When the electronic pen is in the resting state, the scanning unit includes a scanning control unit that suppresses the frequency of the scanning process compared to the case where the electronic pen is in the normal operation state. The display system according to claim 8, wherein the display system is characterized.   The program which functions a computer as each means of the display control apparatus of any one of Claims 1-6.   A computer-readable recording medium storing the program according to claim 10.

Images