JP2009169735A - Information processing display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information processing display device for displaying information so as not to interfere with an operation. <P>SOLUTION: This information processing display device is provided with a position sensor on a display screen, and configured to select a menu or a tool by a touch operation through an input pointer on the screen. When the tip of the input pointer is brought into contact with the screen, the position coordinates of the tip position and rear end position of the input pointer are acquired, and the menu or the tool is displayed so as not to interfere with an operation on the basis of the position coordinates. The two position information is used for determining the dominant hand of an operator and the direction of the tip of the input pointer. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an information processing display device, and more particularly to a technique for displaying information using a large display screen capable of touch input.

Electronic blackboard display systems that can be used for input on a touch panel used in meetings are expected to be used in conference rooms with a certain size, and the height is within the reach of human hands. The moving distance is not so much that it does not become an obstacle.
However, the display device is becoming larger, and when a large display device is installed in a large place such as a university lecture room or an international conference hall, the input position and the operation icon are separated. If so, there is a problem that the operability is deteriorated because it is necessary to move for the operation.

In order to solve this problem, in the technology of Patent Document 1, in an information processing apparatus including a display unit having a large screen comparable to an electronic blackboard and an input pen connected to the display unit, it is necessary for instruction selection near the input point. The processing command information is displayed, and when the locus is input by the input pen, the display position of the processing command information is changed and controlled based on the input of the locus.
JP-A-8-320755

  In Patent Document 1, processing command information is displayed in the vicinity of an input point (position separated by a predetermined distance), but even if the display position is changed depending on the direction of a continuously input locus, May get in the way.

  The present invention has been made in consideration of the above-described circumstances, and an object thereof is to provide an information processing display device capable of displaying processing command information at a position that does not interfere with operation.

In order to solve the above-described problems, an information processing display device of the present invention has the following configuration.
The information processing display device is an information processing display device that includes a position sensor on a display screen and is capable of selecting a menu or a tool by a touch operation with the input indicator on the screen, the tip of the input indicator When the touches the screen, the position coordinates of the front and rear end positions of the input indicator are acquired, and the menus and tools are displayed at positions that do not interfere with the operation based on these position coordinates. It is.

  Here, the menu is displayed on the dominant hand side of the operator determined based on the two position information, or the tool is displayed on the side opposite to the tip direction of the input indicator, thereby obstructing the operation. Do not become.

According to the present invention, the processing command information can be displayed at a position that does not interfere with the operation, so that the operability is improved.
For example, the display position of the processing command information is changed according to the dominant hand or the input direction, so that the operation is not disturbed.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.
As an embodiment, an information processing display device having a large display screen capable of touch input using a pen will be described as an example. In this information processing display device, the drawing pen tool operates in three types of states: (A) menu selection mode, (B) image input mode, and (C) image data editing mode.

(A) Menu selection mode:
When the operation of the drawing pen tool is started, the menu selection mode is set, a menu icon or a tool icon is displayed on the right or left end of the screen, and a normal input waiting state is entered.
For example, the menu / icon list 102 is displayed at the lower right of the screen as shown in FIG. 1A or at the upper left of the screen as shown in FIG.
However, if the input waiting time is long, the menu icons and tool icons 102 irrelevant to the display contents are deleted from the screen. For example, the menu icon and the tool icon 102 can be displayed again on the screen by touching (double-clicking) the screen with the pen 101 twice.

(B) Image input mode:
In this mode, after selecting a menu item representing a processing command in the menu / icon list, an input area is selected to input an image. For example, as shown in FIG. 2, the screen is touched with the pen 101 as shown in FIG. 2, the pen 101 is moved while being touched, and the line 103 written last by pen-up is written as an image.

(C) Image data editing mode:
This mode is used to select and edit an image displayed before editing, and is used for an additional writing correction process without erasing an image written in advance in the image input mode. In this case, a tool palette corresponding to the attribute of the selected image is displayed in the vicinity of the selected image.

  For example, in FIG. 3, when the line 103 is touched and selected with the pen 101, an area 104 including the line 103 is drawn, and a tool palette 105 for editing the line 103 is displayed near the area 104 (the pen tip). At a predetermined distance from the position).

The tool palette is displayed as illustrated in FIG.
(A) If the attribute of the selected image or the like is a line 106, the tool palette 107 is a palette composed of color / thickness / shape / start point / end point shape / effect, and the like.
(B) If the attribute of the selected image or the like is text 108, the tool palette 109 is a palette composed of color / font / size / effect.
(C) If the attribute of the selected image or the like is the graphic 110, the tool palette 111 is a palette including color / painting / pen type / eraser / trimming / tilting.

In the present invention, the display positions of the menu icon list and the tool palette are determined by the orientation of the pen.
When the operator is right-handed, the menu icon list 112 is displayed at the right end of the screen because the tip of the pen 101 is facing left as shown in FIG. In the case of left-handed, since the tip of the pen 101 is pointing rightward as shown in FIG. 5B, the menu / icon list 113 is displayed at the left end of the screen.

  As a result, the menu / icon list is displayed at the dominant hand position, so that the menu can be easily selected and the operability is improved.

When the tip of the pen 101 faces downward as shown in FIG. 6A, the tool palette 114 is displayed in the vicinity above the pen tip position. When the tip of the pen 101 is facing upward as shown in FIG. 6B, the tool palette 115 is displayed in the vicinity below the pen tip position.
Of course, the moving direction of the pen 101 may be detected and the tool palette may be displayed in the vicinity of the position opposite to the moving direction of the pen.

  As a result, the tool palette is displayed at a position opposite to the input direction, so that editing can be performed without being interrupted by the tool palette, and operability is improved.

Next, a hardware configuration of the information processing display device according to the present embodiment will be described.
FIG. 7 is a block diagram illustrating a hardware configuration of the information processing display device. In FIG. 7, the information processing display device 10 includes a position acquisition unit 11, a control unit 13, a display unit 14, and a storage unit 15. Yes.

  In the following description, the display device including the display unit 14 and the position acquisition unit 11 and the information processing device including the control unit 13 and the storage unit 15 are configured as an integrated device. May be configured as separate devices.

First, the position acquisition unit 11 will be described. In the present embodiment, the touch position is acquired by an electromagnetic induction method.
The display unit 14 is composed of a liquid crystal display or the like having a large display screen, and displays various data obtained as a result of execution by a control program and various application programs. Sense coils extended in the horizontal direction and the vertical direction are installed, with the horizontal direction being the X-axis direction and the vertical direction being the Y-axis direction.

The input indicator 20 is a bar-shaped indicating means (pointing device), and a tuning circuit including a coil and a capacitor is incorporated in the tip direction and two places behind it, and is transmitted by energizing the sense coil. The coil is tuned to the generated radio wave, and an induced voltage is generated in the tuning circuit.
Accordingly, when the tip of the input indicator 20 is brought into contact with the display unit 14, the sense coil is energized, resonates with the coil of the input indicator 20, an induced voltage is generated in the tuning circuit, and energization of the sense coil is stopped. The resonance with the sense coil is caused by the induced voltage remaining in the tuning circuit.
Due to this resonance, an induced voltage is generated in the sense coil, and the magnitude of the induced voltage is detected.

  Similarly, when the processing from energization to detection is performed for the other sense coils, the distribution of the induced voltage of the sense coil is obtained for each of the X-axis direction and the Y-axis direction, and the position of the peak voltage of these distributions is determined. If it calculates | requires, the X-coordinate value about two coils of the input indicator 20 will be calculated | required. Here, the position of the main peak voltage in the distribution corresponds to the coil closer to the tip of the input indicator 20, and the position of the second peak voltage is closer to the rear end of the input indicator 20. This position corresponds to the coil. The origin of the coordinates is the lower left corner of the display screen, the positive direction of the X axis is the right direction of the screen, and the positive direction of the Y axis is the upward direction of the screen.

Then, the coordinate value of the tip of the input indicator 20 is obtained from the coordinate position of the two coils and the distance from the tip of the input indicator 20 to the two coils.
In this way, in the position acquisition unit 11, when the input indicator 20 is touched on the display unit 14, the coordinate value of the tip of the input indicator 20 and the coordinate value of the coil provided in the rear part are sent to the control unit 13. Send.
Hereinafter, the coordinate value of the tip of the input indicator 20 is referred to as a first coordinate value, and the coordinate value of a coil provided in the rear portion is referred to as a second coordinate value. The first coordinate value and the second coordinate value are collectively referred to as position information.

  The control unit 13 includes, for example, a CPU (Central Processing Unit) and the like, and controls the entire apparatus 10 by executing a control program and various application programs stored in the storage unit 15.

  The storage unit 15 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk Drive), and the like. The storage unit 15 executes a control program executed by the control unit 13, various application programs, and these programs. It can also be used as a buffer for storing data used by or for temporarily generating data during the execution of these programs. For example, in this embodiment, the drawing pen tool is handled as an application program.

  FIG. 8 is a block diagram illustrating a control configuration of the control unit 13 according to the present embodiment. In FIG. 8, the control unit 13 includes a pen tip direction determination unit 21, a menu / pallet generation unit 22, and a process type determination unit 23. The drawing processing unit 24 and the display control unit 25 are included.

  When the position acquisition unit 11 acquires position information, the processing type determination unit 23 compares the position information (first coordinate value) with the display position of each icon in the menu list or tool list, and determines which menu or tool item. Is selected, the identifier of the selected menu or tool is acquired, and this identifier and position information (first coordinate value and second coordinate value) are connected to the menu / pallet via the control unit 13. The data is transmitted to the generation unit 22 and the drawing processing unit 24.

  Further, if the selected menu identifier is “edit”, the processing type determination unit 23 stores “image data editing mode” in the storage unit 15, and if the selected menu identifier is “input”, “ The “image input mode” is stored in the storage unit 15, and the “menu selection mode” is stored in the storage unit 15 when the “image data editing mode” or the “image input mode” is finished.

  In addition, when neither the menu item nor the tool item is selected, the processing type determination unit 23 compares the object coordinate information stored in the storage unit 15 with the position information (first coordinate value) and applies The type and position information (first coordinate value and second coordinate value) of the object to be transmitted are transmitted to the menu / pallet generation unit 22 and the drawing processing unit 24 via the control unit 13.

  Here, the storage unit 15 stores coordinate information of each object displayed on the display screen. This object stores the type of object (point, line, figure, image, text string, etc.), and coordinate information, thickness, color, and other attributes according to the type.

  Further, when the position information (first coordinate value) does not select a menu, tool, or object, the processing type determination unit 23 sends only the position information (first coordinate value and second coordinate value) to the control unit 13. To the menu / pallet generation unit 22 and the drawing processing unit 24.

The menu / pallet generation unit 22 first calls the pen tip direction determination unit 21.
The pen tip direction determination unit 21 acquires the orientation of the tip of the input indicator 20 based on the position information (first coordinate value and second coordinate value) passed from the menu / pallet generation unit 22 and outputs these.
Here, the left direction (right-handed) is when the X coordinate value of the first coordinate is smaller than the X coordinate value of the second coordinate.
On the other hand, rightward (left-handed) is when the X coordinate value of the first coordinate is larger than the X coordinate value of the second coordinate.
The downward direction is when the Y coordinate value of the first coordinate is smaller than the Y coordinate value of the second coordinate.
On the other hand, upward is when the Y coordinate value of the first coordinate is larger than the Y coordinate value of the second coordinate.

  The menu / pallet generation unit 22 determines the display position of the menu icon or tool palette based on the direction of the tip of the input indicator 20 passed from the pen tip direction determination unit 21 and the information passed from the processing type determination unit 23. The determined display position and display content are passed to the display control unit 25.

  When the type of the object is passed from the processing type determination unit 23, if the tip of the input indicator 20 is downward, the tool pallet determined from the type of object is a neighborhood above the tip position of the input indicator 20. When the tip of the input indicator 20 is upward, the tool palette determined from the type of object is displayed in the vicinity below the tip position of the input indicator 20 (see FIG. 6A). FIG. 6 (B)).

  As a result, the tool palette is displayed at a position opposite to the input direction (operation direction of operation), so that editing can be performed without being interrupted by the tool palette, and operability is improved.

When only the position information is passed from the processing type determination unit 23, if the direction of the tip of the input indicator 20 is leftward (operator is right-handed), a menu icon is displayed on the right end of the screen, and an input instruction is displayed. When the direction of the tip of the device 20 is rightward (operator is left-handed), the menu icon is transmitted to the display control unit 25 so as to be displayed at the left end of the screen.
As a result, the menu icon is displayed at the dominant hand side position, which makes it easier to select the menu and improves the operability.

  When the menu identifier is passed from the process type determination unit 23, nothing is passed to the display control unit 25.

  The drawing processing unit 24 is a processing unit that executes the drawing pen tool used in the present embodiment. According to the menu identifier, tool identifier, or position information of the input indicator 20 passed from the processing type determination unit 23, The function of the drawing pen tool is executed, and the resulting drawing data is passed to the display control unit 25.

  The display control unit 25 synthesizes the menu icon or tool palette passed from the menu / pallet generation unit 22 with the drawing data passed from the drawing processing unit 24 at the designated display position, and displays the display unit. 14 to display.

Next, the overall processing flow of the drawing pen tool used in this embodiment will be described with reference to the flowchart of FIG.
First, when the drawing pen tool is activated by the control unit 13, initial setting is performed (step S1). In this initial setting, the menu selection mode is set, and a palette for drawing and menu icons and tool icons necessary for the drawing operation are displayed.

  Thereafter, it waits until the position information of the input indicator 20 is sent from the position acquisition unit 11 and when the position information is sent (step S2 / YES), the processing type determination unit 23 causes the input indicator 20 to From the position information, the identifier of the designated menu, the type of the designated object, or neither is identified (step S3).

Next, the pen tip direction discriminating unit 21 discriminates the direction of the tip of the input indicator 20 from the position information (step S4).
The menu / pallet generation unit 22 determines the display position of the menu icon or tool palette according to the orientation of the tip of the input indicator 20 passed from the pen tip direction determination unit 21, and the determined display position and display content Is displayed on the display unit 14 by the display control unit 25 (step S5).

  Next, the drawing processing unit 24 executes the function of the drawing pen tool according to the menu identifier, the tool identifier, or the position information of the input indicator 20 passed from the processing type determination unit 23, and the result The drawing data is displayed on the display unit 14 by the display control unit 25 (step S6), and the process returns to step 2 to wait for the input indicator 20 to contact.

  With the above configuration, the menu icon and the tool palette can be displayed in a position that does not interfere with the operation according to the dominant hand or the input direction, so that the operability is improved.

In the above embodiment, menu icons and tool palettes common to the operator are displayed. However, each operator has different skills (skill level (beginner / intermediate / advanced person), etc.) and the menu to be used differs depending on the application.
Therefore, for each application, register menus and pallet display formats according to the skill and application of the operator in advance, identify the operator, and display the menu and pallet in a display format suitable for each operator. It may be.

For example, such personal setting is performed as follows.
First, the dialog illustrated in FIG. 10 is displayed, the operator's name, data for recognizing an individual, and the like are registered in the storage unit, the dialog illustrated in FIG. 11 is displayed, and items to be displayed on the menu and tool palette are displayed. Select and register in the storage unit corresponding to the operator.

When executing this application, when displaying a menu icon or a tool palette, the operator is identified and displayed with reference to a pre-registered display form.
For example, for identification of an operator, information for identifying an individual is stored in an RFID (Radio Frequency IDentification) tag, and an RFID tag attached to an input indicator or a card possessed by the operator is stored on an information processing display device. Do by identifying.

In addition, the display items are not set for each individual, but menus and tool / palette display items corresponding to the skill level (beginner, intermediate, advanced, etc.) are registered in the storage unit in advance.
When executing the application, when displaying the menu icon or the tool palette, the skill level of the operator is identified and displayed in advance with reference to a display form registered in advance.
For example, the skill level is identified by storing information identifying the skill level in an RFID tag, and identifying the RFID tag attached to the input indicator or card possessed by the operator with the information processing display device. Do.

In addition, the display items are not set for each individual or skill level, but menus and tool palettes corresponding to the fields and applications are registered in the storage unit in advance.
When executing this application, when displaying a menu icon or a tool palette, the field and application are identified and displayed with reference to a pre-registered display form.
For example, for identification of a field or application, information for identifying the field or application is stored in an RFID tag, and an RFID tag attached to an input indicator or card possessed by an operator is identified by an information processing display device. By doing.

  Also, if the field / use is determined by the installation location of the information processing display device, select the field / use by identifying the installation location of the information processing display device or specifying the installation location prior to use. It is also possible to register it in conjunction with personal settings and identify and select an operator.

In the above embodiment, the input indicator is provided with two tuning circuits, and the operator's dominant hand and the direction of the tip are determined by the electromagnetic induction method. However, the following may be used.
Equipped with electromagnetic dielectric sensors at the front and rear ends of the input indicator, and the display screen with an electromagnetic dielectric antenna, from the intensity of the magnetic field caused by these sensors close to the display screen, The distance between the front end and the display screen, the distance between the rear end and the display screen, and the coordinates of each point obtained by vertically projecting the front end and the rear end on the screen are determined and transmitted to the control unit 13.

In the pen tip direction determination unit 21, if the X coordinate value at the end of the smaller distance between the tip and the display screen and the distance between the rear end and the display screen is smaller than the X coordinate value at the other end, the left direction (Right-handed).
On the other hand, if the X coordinate value at the end of the smaller distance between the front end and the display screen and the distance between the rear end and the display screen is larger than the X coordinate value at the other end, it is determined to be rightward (left-handed). .

Further, the orientation of the dominant hand of the operator and the tip of the input indicator 20 may be determined as follows.
A sensor is provided at the rear end of the input indicator, and this sensor transmits the coordinates of the rear end point projected vertically on the screen to the control unit 13.

  The pen tip direction determination unit 21 compares the position information of the front end of the input indicator obtained from the position acquisition unit 11 with the position information of the rear end of the input indicator obtained from the sensor at the rear end of the input indicator. The orientation of the dominant hand of the operator and the tip of the input indicator 20 is determined.

If the X coordinate value at the front end is smaller than the X coordinate value at the rear end, it is determined to be leftward (right-handed). On the other hand, if the X-coordinate value at the front end is larger than the X-coordinate value at the rear end, it is determined to face right (left handed).
If the Y coordinate value at the front end is smaller than the Y coordinate value at the rear end, the input indicator is determined to face downward. On the other hand, if the Y coordinate value of the front end is larger than the Y coordinate value of the rear end, the input indicator is determined to be upward.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and corrections can be made without departing from the scope of the present invention. For example, a program for causing a computer to function as each unit (an angle determination unit, a processing type determination unit, a menu / pallet generation unit, a drawing processing unit, and a display control unit) of the information processing display device that constitutes the above-described embodiment, The object of the present invention is achieved by writing in advance on a recording medium, storing these programs recorded on the recording medium in a memory or a storage device provided in the apparatus, and executing the program. Needless to say.

In this case, the program itself read from the recording medium realizes the functions of the above-described embodiment, and the program and the recording medium recording the program also constitute the present invention.
In addition, the program includes a case where the functions of the above-described embodiment are realized by processing in cooperation with an operating system or another application program based on an instruction of the program.

  The program for realizing the functions of the above-described embodiments includes a disk system (for example, magnetic disk, optical disk, etc.), a card system (for example, memory card, optical card, etc.), and a semiconductor memory system (for example, ROM, nonvolatile memory). Etc.) and a recording medium of any form such as a tape system (for example, magnetic tape, cassette tape, etc.). Or you may make it receive the said program stored in the memory | storage device via the network directly from the server computer. In this case, the storage device of this server computer is also included in the recording medium of the present invention.

  As described above, by programming and distributing the functions of the above-described embodiment, the cost can be reduced, and the portability and versatility can be improved.

It is an example of a display screen in the menu selection mode. It is an example of a display screen in the image input mode. It is an example of a display screen in the image data editing mode. It is a figure explaining the difference in the palette display by a data attribute. It is the example of a menu display by the difference in the dominant hand. It is a figure explaining the difference in the display position of the tool palette by the up-down direction of a pen. It is a block diagram showing the hardware constitutions of an information processing display apparatus. It is a block diagram which shows the control structure of the control part which concerns on embodiment. It is a flowchart explaining the flow of the whole process of the drawing pen tool used by this embodiment. It is an example of a dialog for registering an operator. It is an example of a dialog for registering display items of menus and tool palettes.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Information processing display apparatus, 11 ... Position acquisition part, 13 ... Control part, 14 ... Display part, 15 ... Memory | storage part, 20 ... Input indicator, 21 ... Pen tip direction discrimination | determination part, 22 ... Menu / pallet production | generation part, 23 ... Processing type determination unit, 24 ... Drawing processing unit, 25 ... Display control unit, 101 ... Pen (input indicator), 102, 112,113 ... Menu / icon list, 103,106 ... Line, 104 ... Area, 105 , 107, 109, 111, 114, 115 ... tool palette, 108 ... text, 110 ... graphic.

Claims (3)

  In an information processing display device provided with a position sensor on a display screen and capable of selecting a menu or a tool by a touch operation with the input indicator on the screen, when the tip of the input indicator touches the screen An information processing display device that acquires position coordinates of the positions of the front end and the rear end of the input indicator and displays the menu and tool at positions that do not interfere with the operation based on these position coordinates .   The information processing display device according to claim 1, wherein an operator's dominant hand is determined based on the two pieces of position information, and the menu is displayed on the dominant hand side.   The information processing display device according to claim 1, wherein a direction of a tip of the input indicator is determined based on the two pieces of position information, and the tool is displayed on a side opposite to the direction of the tip. Information processing display device.

Images