JP6738450B2 - Display device and program - Google Patents

Description

The present invention relates to an input display device, and more particularly to an input display device capable of handwriting input with a pen equipped with an input device such as a touch panel and used in a horizontal or nearly horizontal state of the screen.

2. Description of the Related Art Conventionally, there is known a display device including an input device such as an electrostatic capacity touch panel that enables input by touch operation.

As a conventional technique, for example, in a table type display device, an infrared sensor is provided on a table to detect the position of the user, the infrared sensor detects the user, and an image is arranged corresponding to the detected user. Has been proposed (see Patent Document 1).

In addition, as another technique, in a rectangular information terminal device, sensors are provided at four corners, a sensor is brought into contact with a pen to determine an image display direction, and a screen divided after power is turned on. There has been proposed a method in which the display direction of an image is determined depending on which position in which the image is input (see Patent Document 2).

Further, in the information processing device, a plurality of sensors are arranged around a table provided with a screen to detect the position of the user, and the image is displayed in a direction connecting the detected user position and the pen input position. Has been proposed (see Patent Document 3).

JP 2001-350588 A JP, 11-175228, A JP 2000-163179 A

However, in the technique proposed in Patent Document 1, when there are a plurality of users around the table, it is not possible to determine which user performs the input. Therefore, in the case of a plurality of users, Has the problem that it cannot respond.

Further, in the technique proposed in Patent Document 2, it is necessary to touch the sensor on the information terminal device with the pen every time the input direction changes. Also, in the method of determining which position on the divided screen the input is, since the direction is determined after the power is turned on, it is difficult to change it in the middle, and the screen will rotate when you enter on the facing side. Since it is displayed, a situation occurs in which the user's position cannot be accurately detected.

Further, in the technique proposed in Patent Document 3, when there are a plurality of users, it is necessary to specify which user's pen has made the input. Needed to be associated.

The present invention has been made in view of the above-mentioned conventional problems, and it is possible to display a screen in a direction suitable for a user only by inputting information without performing a complicated operation, and visually confirming the display content. It is an object of the present invention to provide an input display device capable of improving the user-friendliness and the reusability of its display content.

In order to solve the above-mentioned problems, a display device of the present invention is a display screen for displaying an object, a storage unit for storing display information of a plurality of objects displayed on the display screen, and a user for the display screen. Input detection means for detecting a touch input and, when detecting a movement operation for a first object of the plurality of objects, display the first object at a predetermined user position on the display screen. And a display control unit that adjusts based on the display information of the second object and displays the second object together with the second object.

Further, the storage unit in the present invention stores the display directions of the plurality of objects as the display information, and the display control unit sets the display direction of the first object to be the display direction of the second object. If different, the first object is adjusted in the same direction as the display direction of the second object, and is displayed together with the second object.

Further, the storage means in the present invention further stores the display sizes of the plurality of objects as the display information, and the display control means determines that the display size of the first object is the display size of the second object. When different from the above, the first object is adjusted in the same orientation as the display size of the second object and displayed together with the second object.

Further, in the present invention, the display control means sets the first object to the same size as the display size of the second object displayed first in the forward direction with respect to the specified user position, It is characterized in that it is displayed in a direction that is a positive direction with respect to the specified user position.

Further, in the invention, it is characterized in that the display control means displays the first object in a state of being added to the second object.

Further, in the present invention, when the input of the first object and the second object is detected by the input detection means, the size of the input area and the input direction are compared based on the plurality of detected input information. Further, it is characterized by further comprising user position determining means for determining the position of the user who has input the first object and the second object with respect to the display screen.

Further, in the present invention, there are a first input determination means for determining whether the input information is input by a pen tip or an input with a hand, and the input with the pen tip and the input with a hand with respect to the plurality of input information. When it is determined whether the input by the tip and the input by the hand are in the area within a predetermined range, and it is determined that the input by the pen tip and the input by the hand are in the area within the predetermined range, the same user And a second input determining means for determining that the input is input by.

Further, the program of the present invention includes a storage step of storing display information of a plurality of objects displayed on the display screen in a computer mounted on a display device having a display screen for displaying the object, and a user for the display screen. An input detecting step of detecting a touch input of the first object, and displaying the first object to a pre-specified user position on the display screen when detecting a moving operation for the first object among the plurality of objects. A display control step of adjusting based on the display information of the second object being displayed and displaying the second object together with the second object.

According to the display device of the present invention, a display screen for displaying an object, a storage unit for storing display information of a plurality of objects displayed on the display screen, and an input detection for detecting a user's touch input on the display screen. And a second object displayed on the display screen at a pre-specified user position when a movement operation for the first object among the plurality of objects is detected. By providing a display control unit that adjusts based on display information and displays the second object together with the second object, the screen can be displayed in a direction suitable for the user, and the visibility of the display content and the display content can be improved. A display device capable of improving reusability can be provided.

1A is an example of an embodiment of the invention, in which FIG. 1A shows a position of a user who writes on the input display device according to the first embodiment of the present invention and a display direction of an image displayed on the input display screen Explanatory drawing which shows an example of a relationship, (b) is explanatory drawing which shows the state which a user writes in the display screen of the said input display device, (c) is the state which carried out the display control of the object input into the said display screen. FIG. (A) is a block diagram showing a configuration of the input display device, and (b) is a block diagram showing a function of a display direction control unit constituting the input display device. It is explanatory drawing which shows the relationship between the position of the user who writes (inputs) with respect to the said input display device, and the display direction of the image displayed on an input display screen. (A) is an explanatory view showing a case where the input area detected by the capacitance sensor included in the input display device is vertically long, and (b) shows a case where the input area detected by the capacitance sensor is horizontally long. It is an explanatory view shown. It is a flowchart figure which shows the procedure of the display control which displays the object input into the display screen of the said input display device. It is a flowchart figure which shows the procedure of the display direction control which displays the input object displayed on the display screen of the said input display device with respect to master setting. (A) is an explanatory view showing a state in which a plurality of users are writing on the display screen of the input display device according to the second embodiment of the present invention, and (b) shows the input object on the display screen. It is explanatory drawing which shows the controlled state. It is a flowchart figure which shows the procedure which determines the input direction of a user in the display screen of the said input display device. It is a flowchart figure which shows the procedure of the input process for every user who uses the said input display device. (A) is an explanatory view showing a state in which a plurality of users are writing on the display screen of the input display device according to the third embodiment of the present invention, and (b) is an enlarged view of an object input on the display screen. It is an explanatory view showing a state where display control is performed. It is a flowchart figure which shows the procedure which performs a scaling process with respect to the object input into the display screen of the said input display device. It is explanatory drawing which shows an example which arranged the image data of the object input in the said input display device as 2 value conversion data. It is explanatory drawing which shows the example which labeled the data of the said input character as binarization. FIG. 14 is an explanatory diagram showing an example in which the labeling result of FIG. 13 is subjected to rectangle processing. It is explanatory drawing which shows an example which labeled the said input character and extracted as a line. It is explanatory drawing which shows an example which performs brainstorming using the display screen of the input display apparatus which concerns on 4th Embodiment of this invention.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is an example of a mode for carrying out the invention, and (a) is a position of a user who writes on the input display device according to the first embodiment of the present invention and a display of an image displayed on the input display screen. Explanatory diagram showing an example of the relationship with the direction, (b) is an explanatory diagram showing a state in which the user is writing on the display screen of the input display device, (c) shows the input object on the display screen It is explanatory drawing which shows the controlled state.

As shown in FIGS. 1A to 1C, the input display device 1 according to the first embodiment includes a display screen 10 that displays information, and a touch panel (sensor) 2 that detects a user input on the display screen 10. In addition, the input display device 1 that includes the above and is capable of input operation using the pen 100 is characterized by including the characteristic configuration of the input display device according to the present invention.

The first embodiment is an example in which the input display device 1 is made to function as a conference table, and four users A to D are located in four directions around the input display device 1.

Here, the position of the user A who is the organizer of the conference is set to be specified as the master position (M). On the other hand, the positions of the users B to D who are the other attendees of the conference are set as slave positions (S). That is, in the input display device 1, the display control is performed so that the display screen 10 is in the forward direction with respect to the master position (M).

FIG. 1A shows a state in which none of the users A to D is performing input.
The display content 101 of the display screen 10 is displayed facing forward with respect to the user A who is the master.

FIG. 1B shows a state in which the user C has started input.
For example, while the user C is inputting, the display contents such as the object (drawing information) 102 and the input menu (menu image) 103 input in the input area of the display screen 10 face the user C in the normal direction. Is displayed.

When the user C completes the input, the object (drawing information) input by the user C and its display direction (input information) are saved. When the movement instruction is detected, the input object is moved based on the user instruction until the fingertip is released. After the movement is completed, if the master setting direction and the input object direction are different, the input object is controlled to be displayed in the forward direction with respect to the master position.

FIG. 1C shows a state in which after the movement instruction from the user C, the input object is controlled to be displayed rotated by 180 degrees so as to be oriented in the positive direction with respect to the master position. There is.

First, a characteristic configuration of the input display device 1 will be described with reference to a block diagram.
2A is a block diagram showing a configuration of the input display device according to the first embodiment, FIG. 2B is a block diagram showing a function of a display direction control unit constituting the input display device, and FIG. 3 is the input display device. Explanatory diagram showing the relationship between the position of the user who writes (input) to the device and the display direction of the image displayed on the input display screen. FIG. 4A shows the capacitance sensor included in the input display device. Is an explanatory view showing a case where the input area detected by the above is vertically long, and (b) is an explanatory view showing a case where the input area detected by the capacitance sensor is horizontally long.

As shown in FIG. 2A, the input display device 1 includes a display screen 10 including a touch panel 2 and a display unit 11, a sensor drive unit/capacity value reception unit 3, a display drive unit 9, and a control unit 12. I have it.

The touch panel 2 is composed of a capacitance sensor and has a function of detecting a plurality of inputs.

The control unit 12 is composed of a CPU, a ROM, and a RAM (not shown), and has a shape/touch determination unit (input information comparison unit) 4, a touch recognition processing unit 5, a user position determination unit 6, a display direction control unit (display direction switching). Part) 7 and the drawing information control part 8 are constructed.

The capacitance sensor that constitutes the touch panel 2 is a sensor that can detect the shape of an object by detecting the capacitance between an adjacent object from a plurality of lines arranged in a matrix on a plane. is there. The capacitance sensor can detect the capacitance at each position of 4096×2160, for example.

Here, as shown in FIG. 3, the coordinates are set with the upper left corner of the display screen 10 viewed from the user located in the third direction as (0, 0) and the lower right corner as (4095, 2159). The capacity is detected for each coordinate. The touch panel 2 is not limited to the capacitance type, and may be of any other type as long as it can capture the shape of an approaching object regardless of contact/non-contact.

The sensor driving unit/capacity value receiving unit 3 drives the touch panel (electrostatic capacity sensor) 2 and detects the electrostatic capacity value from the result. The sensor driving unit/capacity value receiving unit 3 sends the detected electrostatic capacitance value to the control unit 12.

The shape/touch determination section (comparison section) 4 of the control section 12 determines the shape of an object in proximity to the display screen 10 based on the capacitance value detected by the sensor drive section/capacity value reception section 3. Is. The shape of the object close to the screen corresponds to the shape of a continuous range having a capacitance indicating the proximity of the object. FIGS. 4A and 4B show the input area (continuous range) detected by the capacitance sensor.

The shape/touch determination unit 4 determines whether the detected object is a pen tip or a touch based on the size of the detected shape (input area) based on a plurality of input information detected by the touch panel 2. At the same time, the input direction (vertical direction or horizontal direction) is compared.

In addition, the touching with the hands is a phenomenon in which the belly of the hand touches the display screen 10.
Specifically, the shape/touch determination unit 4 compares, for example, the detected shape with a predetermined value A, and when the area of the detected shape is equal to or smaller than the predetermined value A, determines that the pen tip is the predetermined value A. If it is larger than that, it is determined to be a touch. Here, the predetermined value A is an upper limit value of the size assumed to be the pen tip.

The detected shape is, as shown in FIG. 4A, the minimum value (min x) of the X-axis value, the maximum value (max x), the minimum value (min y) and the maximum value (max y) of the Y-axis value. Based on the above, when the length in the Y-axis direction is longer than the length in the X-axis direction, it is determined to be vertically long, and the length in the Y-axis direction is longer than the length in the X-axis direction as shown in FIG. If it is short, it is determined to be landscape.

Then, the shape/touch determination unit 4 sends the determination result to the touch recognition processing unit 5 and the user position determination unit 6.

The touch recognition processing unit 5 determines the position of the pen tip based on the determination result of the shape/touch detection unit 4, performs the menu process if the position of the pen tip is the menu position, and performs the drawing process if it is not the menu position. To do.

The user position determination unit 6 determines the position of the input user with respect to the display screen 10 based on the determination result of the shape/touch determination unit 4. Details of the user position determination unit 6 will be described later. The user position determination unit 6 sends the determined result to the display direction control unit (display direction switching unit) 7.

The display direction control unit (display direction switching unit) 7 determines the display direction on the display screen 10 based on the result determined by the user position determination unit 6 and displays the input object. Here, the display of which the display direction is determined is the entire display content displayed on the display screen 10 or the menu display. The menu display corresponds to a part of the display content displayed on the screen.

Further, as shown in FIG. 2B, when the display direction control unit 7 shares the display screen 10 with a plurality of users as a characteristic configuration, the display direction control unit 7 specifies a master position (M ), the specific direction display function 71 for displaying the object input in the positive direction on the display screen 10 and the additionally input object in the positive direction with respect to the master position (M) are added. A specific direction additional display function 72 for displaying in a state is provided.

Furthermore, when a plurality of users share the display screen 10 and use the display direction control unit 7, when the users are inputting the display direction, the display direction control unit 7 is provided to the user who is inputting the display direction of the input object. The user direction display function 73 for switching to the positive direction, and the direction in which the input object is displayed after the input by the user is completed and the direction in which the object is in the positive direction with respect to the master position (M) specified in advance. If they are different, the user direction display switching function 74 is provided to display the input object so that it is in the forward direction with respect to the master position (M).

Further, when the display direction control unit 7 detects a movement instruction from the user who has completed the input, the display direction control unit 7 moves the input object based on the movement instruction from the user, and a master position (M) after the movement is completed. When the direction of the input object is different, the moving display switching function 76 is provided so as to display the object in the positive direction with respect to the master position (M).

The drawing information control unit (display switching unit, drawing unit) 8 includes a storage unit (not shown) inside, and the storage unit temporarily stores drawing information such as handwritten information and graph information. The menu information to be displayed in an overlapping manner is held in a separate layer.

Further, the drawing information control unit 8 stores the content to be displayed on the display unit 11 based on the menu process or the drawing process from the touch recognition processing unit 5 and the result of the determination of the display direction from the display direction control unit 7. The contents of the storage unit being operated are updated.

Further, when the drawing information control unit 8 is displayed in a state in which the additionally input drawing information is added in a direction that is the positive direction with respect to the master position (M), the drawing information control unit 8 and the additional input are displayed. It has a function to make the display size of objects to be the same.

Furthermore, the drawing information control unit 8 has a function of associating the input drawing information with the input user and displaying it in a display mode (color, font, size, etc.) that is different for each user.

The display drive unit 9 drives the display unit 11 based on the information stored in the storage unit provided in the drawing information control unit 8 and displays the information on the display unit 11.

The display unit 11 is for giving information to the user by displaying it on the display screen 10, and has a planar shape such as liquid crystal display or EL display. A touch panel 2 including an electrostatic capacity sensor is provided on the upper surface of the display unit 11 so as to overlap.

Next, a procedure of display control for displaying an object input on the display screen 10 in the input display device 1 of the first embodiment will be described according to a flowchart.
FIG. 5 is a flowchart showing a procedure of display control for displaying an object input on the display screen of the input display device according to the first embodiment.

When input of an object (drawing information) to the display screen 10 is started in the input display device 1, the user inputs the display screen 10 depending on whether or not the capacitance value detected by the capacitance sensor on the touch panel 2 changes. It is determined whether or not it has been broken (step S1).

When it is determined in step S1 that the user has input, the process proceeds to step S2, and the size of the input area is detected. Then, based on the size of the input area (the detected shape), it is determined whether or not the input is made by the pen tip (step S3). The determination of the size of the input area is represented by max x-min x and max y-min y of the detected range, as shown in FIGS.

On the other hand, if it is determined in step S1 that the user has not input, the process is repeated until the input is detected.

If it is determined in step S3 that the input is made by the pen tip (the area has a size equal to or smaller than a predetermined size), the process proceeds to step S4, and it is determined whether there is an input by hand. On the other hand, if it is determined that the input is not from the pen tip, the process returns to step S1 to continue detecting the input.

As the determination method in step S4, for example, when it is determined that the area is larger than the size of the area assumed as the pen tip, it is determined as a touch.

When it is determined in step S4 that there is an input by hand, the process proceeds to step S5, and it is determined whether or not the input exists in the area within the predetermined range. On the other hand, if it is determined in step S4 that there is no manual input, the process proceeds to step S11.

In step S5, it is determined whether or not the input of the pen tip determined in step S3 and the input with the hand determined in step S4 exist in an area within a predetermined range. That is, in step S5, it is determined whether the input with the pen tip and the input with the hand are for the same user.

If it is determined in step S5 that the pen tip input and the manual input are in the area within the predetermined range, the process proceeds to step S6, and it is determined whether or not there is a menu display instruction. On the other hand, if it is determined in step S5 that the pen tip input and the manual input do not exist in the area within the predetermined range, the process proceeds to step S11.

The menu display instruction method in step S6 can be solved by adopting a method such as operating a switch separately.
If it is determined in step S6 that the menu display instruction has been given, the process proceeds to step S7, and the shape of the manual input is determined. On the other hand, if it is determined in step S6 that there is no menu display instruction, the process proceeds to step S11.

In step S11, it is determined whether the input position of the pen tip is the menu display position. When it is determined in step S11 that the input position of the pen tip is the menu display position, the process proceeds to step S12, and it is determined whether the pen tip is UP.

In step S12, it is determined whether or not the pen tip has been updated, that is, whether or not pen input has been completed. If it is determined in step S12 that the pen tip has been updated, the process proceeds to step S13, and the menu item at the position where the pen tip has been updated is selected and executed.

When it is determined in step S12 that the pen tip has not been updated, the process returns to step S11.

On the other hand, in step S11, when it is determined that the input position of the pen tip is not the menu display position, the process proceeds to step S14, the process selected in the menu is executed as the input process, and the process proceeds to step S15 where the pen tip Is detected. Then, in step S16, it is determined whether or not the pen tip has been updated.

In step S16, it is determined that the pen input is completed by the UP of the pen tip.
When it is determined in step S16 that the pen tip has been updated, the process returns to step S1 and corresponds to the next input.

On the other hand, if it is determined in step S16 that the pen tip has not been updated, the process returns to step S14 and the process is repeated until the pen tip is updated.

Here, the process after step S7 (the process of the part surrounded by the two-dot chain line) is the process of determining the direction of the menu based on the input by the user and displaying it.

In step S7, as shown in FIGS. 4(a) and 4(b), max x-min is calculated using min x:max x and min y:max y with the hand detected in step S2.
x and max y-min y are calculated to determine which is longer.

When it is determined in step S7 that the touch is vertical, the process proceeds to step S8. On the other hand, if it is determined in step S7 that the hand is not vertically long, the process proceeds to step S17.

For example, when the shape of the hand is vertically long, it can be determined that the input is from the first direction or the third direction on the display screen 10, as shown in FIG. On the other hand, when the shape with the hand is horizontally long, it can be determined that the input is from the second direction or the fourth direction on the display screen 10.

In step S8, the direction in which the user is facing (the position of the user) is determined by comparing the Y-axis values of the center coordinates of the pen tip (small area) and the center coordinates of the touch (large area).

If it is determined in step S8 that the center coordinate of the pen tip is smaller than the center coordinate of the hand, the process proceeds to step S9. On the other hand, if it is determined in step S8 that the center coordinate of the pen tip is larger than the center coordinate of the hand, the process proceeds to step S10.

For example, as shown in FIG. 4A, the fact that the Y coordinate of the center coordinate of the pen tip is smaller than the Y coordinate of the center coordinate of the hand means that the input is performed from the third direction of the display screen 10, In S<b>9, the menu is displayed in the third direction of the display screen 10 and the user is set to be positioned in the third direction of the display screen 10.

The fact that the Y coordinate of the center coordinate of the touch is larger than the Y coordinate of the center coordinate of the pen tip means that the input is made from the first direction of the display screen 10, and in step S10, the first direction of the display screen 10 is performed. The menu is displayed toward, and the user sets it so as to be positioned in the first direction of the display screen 10.

Then, the process returns to step S1 and corresponds to the next input.

In step S17, the direction in which the user is facing (the user's position) is determined by comparing the X-axis values of the center coordinates of the pen tip (small area) and the center coordinates of the touch (large area).

If it is determined in step S17 that the center coordinate of the pen tip is larger than the center coordinate of the hand, the process proceeds to step S18. On the other hand, if it is determined in step S17 that the center coordinate of the pen tip is smaller than the center coordinate of the hand, the process proceeds to step S19.

For example, as shown in FIG. 4B, the fact that the X coordinate of the center coordinate of the pen tip is larger than the X coordinate of the center coordinate of the hand means that the input is performed from the fourth direction of the display screen 10, In S18, the menu is displayed in the fourth direction of the display screen 10 and the user is set to be positioned in the fourth direction of the display screen 10.

Further, the fact that the X coordinate of the center coordinate of the hand is smaller than the X coordinate of the center coordinate of the pen tip means that the input is made from the second direction of the display screen 10, and in step S19, the second direction of the display screen 10 is performed. The menu is displayed toward, and the user sets it so as to be positioned in the second direction of the display screen 10.
Then, the process returns to step S1 and corresponds to the next input.

In this way, as shown in FIG. 3, it is possible to control the direction in which the menu is displayed in accordance with the input user facing the display screen 10, set each user position, and associate it with the input object. Can be saved.

Next, the procedure of the display control for moving the input object and displaying it for the master setting based on the moving instruction from the user in the input display device 1 of the first embodiment will be described with reference to a flowchart.
FIG. 6 is a flow chart showing a procedure of display direction control for displaying the input object displayed on the display screen of the input display device of the first embodiment with respect to the master setting.

As shown in FIG. 6, when the display control of the object (drawing information) on the display screen 10 is started in the input display device 1 of the first embodiment, a movement instruction is given to the object input by the user. It is determined whether or not (step S101).

In step S101, if there is no movement instruction for the object input by the user, the process proceeds to step S104. On the other hand, in step S101, when the user inputs a movement instruction to the object, the process proceeds to step S102.

In step S102, the movement instruction from the user can be executed by detecting the movement instruction when the movement instruction is given in the menu processing in step S13 of FIG. 5 or when the same position is touched for a certain time. is there.

In step S102, the input object is moved based on the user's movement instruction, and the process proceeds to step S103.

In step S103, it is determined whether or not the pen tip has been updated, that is, whether or not pen input has been completed.

When it is determined in step S103 that the pen tip has not been updated, the process proceeds to step S102, and the movement of the input object is repeated.

On the other hand, if it is determined in step S103 that the pen tip has been updated, the process proceeds to step S104, and it is determined whether or not the direction set as the master and the direction of the input object are the same.

If it is determined in step S104 that the direction set as the master and the direction of the input object are the same, the process ends.

On the other hand, when it is determined in step S104 that the direction set as the master and the direction of the input object are different, the process proceeds to step S105, and the display control is performed so that the master position is in the positive direction.

The operation may be performed with the fingertip instead of the pen tip.

In step S105, the input object is additionally displayed at a position in the positive direction with respect to the master position. Specifically, as shown in FIG. 1B, the object 102 input by the user C on the display screen 10 is additionally displayed in a state of being rotated by 180 degrees as shown in FIG. 1C.

With the above-described configuration, according to the first embodiment, the input display device 1 has a function of detecting a plurality of inputs as the configuration of the touch panel 2, and further the configuration of the control unit 12 of the input display device 1. By including the shape/touch determination unit 4, the user position determination unit 6, and the display direction control unit 7, when the input display device 1 is shared and used by a plurality of users as a conference table, Since the position (direction) of each user can be specified and the object input to the display screen 10 can be displayed in the direction that is the positive direction with respect to the master position (M) specified in advance, the display screen 10 It is possible to improve the visibility of the display content displayed on the screen and to improve the reusability of the display content.

(Second embodiment)
Next, a second embodiment of the present invention will be described with reference to the drawings.
Note that, for convenience of description, configurations having the same functions as those in the first embodiment are denoted by the same reference numerals and description thereof will be omitted.
FIG. 7A is an explanatory diagram showing a state in which a plurality of users write on the display screen of the input display device according to the second embodiment of the present invention, and FIG. 7B is an object input on the display screen. Is an explanatory view showing a state in which the display control is performed, FIG. 8 is a flowchart showing a procedure for determining the input direction of the user on the display screen of the input display device, and FIG. 9 is an input process for each user who uses the input display device. It is a flowchart figure which shows a procedure.

In the first embodiment, when the input display device 1 is shared and used by a plurality of users as a conference table, a case where any user inputs on the display screen 10 has been described. When a plurality of users use the display screen 10 at the same time, as shown in FIGS. 7(a) and 7(b), the input is made in consideration of the positive direction with respect to the master position (M). It is characterized by performing display control so that an object can be additionally displayed.

FIG. 7A shows, for example, a state in which the user B and the user C have started inputting on the display screen 10 of the input display device 1. While the user B and the user C are inputting, the display contents of the screen such as the characters in the input area and the input menu are displayed in the forward direction with respect to the user B and the user C, respectively.

In FIG. 7B, the display control is performed so that the objects input by the users B and C are in the positive direction with respect to the master position (M).

Below, in the input display device 1 of the second embodiment, when a plurality of users use the display screen 10 at the same time, a flowchart of a display control procedure for setting the orientations of the plurality of users on the display screen 10. Follow along.

As shown in FIG. 8, when input of an object (drawing information) to the display screen 10 is started in the input display device 1, the display screen changes depending on whether or not the capacitance value detected by the capacitance sensor on the touch panel 2 changes. It is determined whether or not the user has input 10 (step S201).

When it is determined in step S201 that the user has input, the process proceeds to step S202, and the size of the input area is detected. On the other hand, if it is determined in step S1 that the user has not made an input, the process ends.

In step S202, the size (detected shape) of each input area is determined. The determination of the size of the input area is represented by max x-min x and max y-min y of the detected range, as shown in FIG. Then, the process proceeds to step S203.

In step S203, it is determined whether or not an area having a size equal to or smaller than a predetermined size, that is, an input of a pen tip is included, and when the area having a size equal to or smaller than the predetermined size is included, the number is counted. .. That is, in step S203, the number of pens used (the number of users) is counted. Then, the process proceeds to step S204.

In step S204, the numerical value counted in step S203 is set in the variable i. Then, the process proceeds to step S205.

In step S205, it is determined whether the variable i is 0. If it is determined in step S205 that the variable i is 0, it is determined that there is no area of a size to be processed, and the process is terminated. On the other hand, if it is determined in step S205 that the variable i is not 0, the process proceeds to step S206.

In step S206, it is determined whether there is a manual input. If it is determined in step S206 that there is a manual input, the process proceeds to step S207. On the other hand, when it is determined in step S206 that there is no manual input, the process proceeds to step S215.

As a determination method in step S206, for example, when it is determined that the input area is larger than the size of the area assumed as the pen tip, it is determined as a touch.

In step S207, it is determined whether the pen tip area determined in step S203 and the hand-touched area determined in step S206 are within a predetermined range. That is, in step S207, it is determined whether the input with the pen tip and the input with the hand are for the same user.

If it is determined in step S207 that the pen tip input and the manual input are within the predetermined range, the process proceeds to step S208. On the other hand, if it is determined in step S207 that the pen tip input and the manual input are not within the predetermined range, the process proceeds to step S215.

In step S208, as shown in FIGS. 4(a) and 4(b), max x-min x and max are calculated using min x:max x and min y:max y with the hand detected in step S202. Calculate y-min y to determine which is longer.

If it is determined in step S208 that the touch is vertical, the process proceeds to step S209. On the other hand, when it is determined in step S208 that the hand is not vertically long, the process proceeds to step S212.

For example, when the shape of the hand is vertically long, it can be determined that the input is from the first direction or the third direction on the display screen 10, as shown in FIG. On the other hand, when the shape with the hand is horizontally long, it can be determined that the input is from the second direction or the fourth direction on the display screen 10.

In step S209, the direction in which the user is facing (the position of the user) is determined by comparing the Y-axis values of the center coordinates of the pen tip (small area) and the center coordinates of the touch (large area).

If it is determined in step S209 that the center coordinate of the pen tip is smaller than the center coordinate of the hand, the process proceeds to step S210. On the other hand, if it is determined in step S209 that the center coordinate of the pen tip is larger than the center coordinate of the hand, the process proceeds to step S211.

For example, as shown in FIG. 3, the fact that the Y coordinate of the center coordinate of the pen tip is smaller than the Y coordinate of the center coordinate of the hand means that the user i is in the third direction of the display screen 10, and thus step S210. Then, the user i is set in the third direction of the display screen 10.

Further, the fact that the Y coordinate of the center coordinate of the hand is larger than the Y coordinate of the center coordinate of the pen tip indicates that the user i is in the first direction of the display screen 10. Therefore, in step S211, the user i is displayed on the display screen. Set in the first direction of 10.

In step S212, the direction in which the user is facing (the position of the user) is determined by comparing the X-axis values of the center coordinates of the pen tip (small area) and the center coordinates of the touch (large area).

When it is determined in step S212 that the center coordinate of the pen tip is larger than the center coordinate of the hand, the process proceeds to step S213. On the other hand, if it is determined in step S212 that the center coordinate of the pen tip is smaller than the center coordinate of the hand, the process proceeds to step S214.

For example, as shown in FIG. 3, the fact that the X coordinate of the center coordinate of the pen tip is larger than the X coordinate of the center coordinate of the hand means that the user i is in the fourth direction of the display screen 10, and thus step S213. In, the user i is set in the fourth direction.

Further, the fact that the X coordinate of the center coordinate of the hand is smaller than the X coordinate of the center coordinate of the pen tip indicates that the user i is in the second direction of the display screen 10. Therefore, in step S214, the user i is set to the second coordinate. Set to the direction.

Then, after the direction in which the user i is located is set, 1 is subtracted from the counted variable i to set the variable (step S215). Then, the process returns to step S205 and is repeated until the variable i becomes zero.
Thereby, the directions of a plurality of input users can be detected.

Next, in the input display device 1 of the second embodiment, a procedure of display control for displaying a menu on the display screen 10 will be described with reference to a flowchart.

In the input display device 1, when a plurality of users simultaneously use the display screen 10, as shown in FIG. 8, after performing display control for setting the orientations of the plurality of users on the display screen 10, As shown in FIG. 9, the process of displaying a menu on the display screen 10 is performed in parallel according to the number of users (i).

When the input display device 1 starts to input an object (drawing information) to the display screen 10, it is first determined whether or not a menu display is instructed (step S301).

If it is determined in step S301 that the menu display is not instructed, the process proceeds to step S302, and the input menu is displayed so as to be in the forward direction with respect to the direction of each user set in the process of FIG. Then, the process ends. On the other hand, when it is determined in step S301 that the menu display is instructed, the process proceeds to step S303.

In step S303, it is determined whether or not it is the menu display position. When it is determined in step S303 that the menu display position is reached, the process proceeds to step S304. On the other hand, if it is determined in step S303 that it is not the menu display position, the process proceeds to step S306.

In step S304, it is determined whether the pen tip has been UP. If it is determined in step S304 that the pen tip has been updated, the process proceeds to step S305.

In step S305, the menu item at the position where the pen tip is UP is selected and executed by detecting that the pen tip is UP.

On the other hand, if it is determined in step S304 that the pen tip has not been updated, the process returns to step S303 and the process is repeated until the pen tip is updated.

If it is determined in step S303 that the position is not the menu display position, the process selected in the input menu is executed as the input process in step S306, and the position of the pen tip is detected in step S307. Then, in step S308, it is determined whether or not the pen tip has been updated.

In step S308, it is determined that the pen input is completed by the UP of the pen tip. If it is determined in step S308 that the pen tip has been updated, the process ends.

On the other hand, if it is determined in step S308 that the pen tip has not been updated, the process returns to step S306 and the process is repeated until the pen tip is updated.

As a result, even when a plurality of input users request different processes, the respective processes are performed in parallel, and as a result, the menu can be displayed in an appropriate direction for the user inputs of a plurality of users. it can.

Next, in the second embodiment, a case where display control of an object input on the display screen 10 of the input display device 1 is performed will be described.

When controlling the display of the objects input by each user on the display screen 10 of the input display device 1, as shown in FIG. 9, the process of displaying the menu on the display screen 10 is performed in parallel according to the number of users (i). 6, the display control process for displaying the object input on the display screen 10 at the master position (M) is performed in parallel according to the number of users (i). ..

The processing content shown in FIG. 6 is the same as that in the first embodiment, and thus the description thereof is omitted.
By this processing, for example, FIG. 7A shows a state in which the user B and the user C have started inputting, and while the user B and the user C are inputting, characters in the input area, an input menu, etc. The display content of the screen is displayed in the forward direction with respect to each of user B and user C.

When the user B and the user C complete the input, the respective objects 102b and 102c input by the user B and the user C and their display directions are stored, and when a movement instruction is detected for each of them, the fingertips are moved. The input objects 102b and 102c are moved based on the instructions of the user B and the user C until they are separated.

After the movement is completed, if the master setting direction is different from the direction of the input objects 102b and 102c, the display is controlled so that the input object is in the forward direction with respect to the master position (M).

As shown in FIG. 7B, when the user B gives a movement instruction, the object B of the user B is rotated 90 degrees to the right so as to be in the forward direction with respect to the master position (M). Control is performed. In addition, when the movement instruction is given by the user C, display control is performed in which the object C of the user C is rotated 180 degrees and displayed.

With the above-described configuration, according to the second embodiment, when the input display device 1 is shared and used by a plurality of users as a conference table, even when a plurality of users simultaneously input, the display is performed. Since the objects input by the screen 10 can be displayed in addition to the objects input by a plurality of users in consideration that the objects are input in the positive direction with respect to the master position (M), the objects are displayed on the display screen 10. It is possible to improve the visibility of the displayed content and improve the reusability of the displayed content.

(Third Embodiment)
Next, a third embodiment of the present invention will be described with reference to the drawings.
Note that, for convenience of description, configurations having the same functions as those in the first embodiment are denoted by the same reference numerals, and description thereof will be omitted.
FIG. 10A is an explanatory diagram showing a state in which a plurality of users write on the display screen of the input display device according to the third embodiment of the present invention, and FIG. 10B is an object input on the display screen. FIG. 11 is an explanatory view showing a state in which display control is performed in an enlarged manner, FIG. 11 is a flowchart showing a procedure for performing scaling processing on an object input to the display screen of the input display device, and FIG. 12 is input in the input display device. FIG. 13 is an explanatory view showing an example in which image data of a rendered object is arranged as binarized data, FIG. 13 is an explanatory view showing an example in which the input character data is labeled as binarized, and FIG. 14 is a labeling in FIG. FIG. 15 is an explanatory view showing an example in which the result is subjected to a rectangular processing, and FIG. 15 is an explanatory view showing an example in which the input characters are labeled and extracted as a line.

The third embodiment is characterized in that the display direction control section 7 has a scaling function in addition to the function in the first embodiment described above. Thereby, it becomes possible to control the display by enlarging or reducing the object input on the display screen 10 of the input display device 1.

On the display screen 10 of the input display device 1, the size of the characters when handwriting input is different depending on the user, and therefore it may be very difficult to see the characters as they are. Therefore, in order to improve the visibility of the display content and the reusability of the display content, it is necessary to enlarge or reduce the object input by handwriting.

For example, as illustrated in FIG. 10A, when the handwritten input character 301 of the user A is smaller than the previously input object 300, a predetermined process (enlargement process here) is performed after the input is completed. Then, as shown in FIG. 10B, based on the set threshold value, scaling is performed so that the character 302 has the same size as other characters.

Hereinafter, in the input display device 1 according to the third embodiment, a procedure of display control for scaling and displaying an input object will be described with reference to a flowchart.

As shown in FIG. 11, when input of an object (drawing information) to the display screen 10 is started in the input display device 1, it is first determined whether or not handwriting input by the user is completed (step S401). ).

If it is determined in step 401 that the handwriting input by the user is not completed, the determination is repeated until the input is completed. On the other hand, if it is determined in step S401 that the user's handwriting input is completed, then the labeling process is executed (step S402).

In the labeling process in step S402, the content handwritten by the user is binarized, and the same number is assigned to pixels in which “1” is consecutive.

FIG. 12 shows an example of four connections in which the continuous portions in the vertical and horizontal directions of the binarized image are labeled with the same label. For example, if the binary data of the pixel of interest 310 is ([y][x]), the upper left data 311 is ([y-1][x-1]) and the upper data 312 is ([y-1][x]. ], the upper right data 313 becomes ([y−1][x+1]), the left data 314 becomes ([y][x−1]),.... Further, for example, an example in which the character "A" is labeled is as shown in FIG.

After the labeling process, the rectangularization process is performed (step S403).
The rectangularization process in step S403 is a process for obtaining a circumscribed quadrangle of pixel groups to which the same label is attached. FIG. 14 is an example of the result of rectangularizing the labeled character “a” in FIG. 13.

Then, in step S404, the center of gravity of each rectangle is obtained, and if the center of gravity of each rectangle is within a predetermined threshold value, a combining process of combining the rectangle groups is performed.
Then, in step S405, the labeled character 320 is extracted as a line, as shown in FIG.

Then, the number of extracted lines is set to "i" (step S406).
Then, the following processing is performed for the number of “i”, that is, the number of extracted rows.

First, in step S407, it is determined whether the extracted line is vertical writing. As a method of determining whether to write vertically or horizontally, as shown in FIG. 15, it is determined from the coordinates of the circumscribed rectangle in which the line is extracted. Regarding the coordinates of the circumscribed rectangle, the upper left is (X1, Y1) and the lower right is (X2, Y2).

And
If |X1-X2|>|Y1-Y2|
If |X1-X2|<|Y1-Y2|
Can be determined as

If it is determined in step S407 that the extracted line is vertical writing, the process proceeds to step S408, and the input object is scaled by the scaling factor: (threshold value 3/|X1-X2|).

For example, when the display is a 60-type FULL-HD, the pixel pitch is 0.692 mm. Therefore, when it is desired to display the actual character size (width) at about 50 mm, about 73 dots are required. Is set to 73.

Then, the process proceeds to step S409, and it is determined whether the width (|Y1-Y2|) of the extracted row is larger than the threshold value 4.

For example, when the display is a 60-inch display, the number of pixels in the vertical direction is 1080 dots. For example, when the display area is 80%, the pixel count is 864 dots (threshold value 4).

If it is determined in step S409 that the width (|Y1-Y2|) of the extracted row is larger than the threshold value 4, it means that the extracted row after scaling does not fit in one row. In step S410, the column is divided. Then, this determination is repeated.

On the other hand, when it is determined in step S409 that the width (|Y1-Y2|) of the extracted row is not larger than the threshold value 4, that is, when (|Y1-Y2|)≦threshold value 4, The process proceeds to step S411, 1 is subtracted from "i", and the process proceeds to step S412.

In step S412, it is determined whether "i" is 0. If it is determined in step S412 that "i" is 0, the scaling process ends. On the other hand, if it is determined in step S412 that "i" is not 0, the process returns to step S407 and the vertical writing determination is repeated.

If it is determined in step S407 that the extracted line is not vertical writing or horizontal writing, the process proceeds to step S413, and the input object is scaled by the scaling ratio: (threshold 1/|Y1-Y2|). It
Then, in step S414, it is determined whether or not the width (|X1-X2|) of the extracted row is larger than the threshold value 2.

The threshold value 2 set in step S414 is the same as the setting method of the threshold value 4 in vertical writing.

When it is determined in step S414 that the width (|X1-X2|) of the extracted row is larger than the threshold value 2, it means that the extracted row after scaling does not fit in one row. In step S415, the column is divided. Then, this determination is repeated.

On the other hand, when it is determined in step S414 that the width (|X1-X2|) of the extracted row is not larger than the threshold value 2, that is, when (|X1-X2|)≦threshold value 2, The process proceeds to step S411, 1 is subtracted from "i", and the process proceeds to step S412.

In step S412, it is determined whether "i" is 0. If it is determined in step S412 that "i" is 0, the scaling process ends. On the other hand, if it is determined in step S412 that "i" is not 0, the process returns to step S407 and the vertical writing determination is repeated.

As described above, according to the third embodiment, by providing the scaling function as the function of the display direction control unit 7, as shown in FIGS. 10A and 10B, the size of the handwritten character is input. Regardless of the size (large or small), it is possible to scale the handwritten input character to a preset size.

(Fourth Embodiment)
Next, a fourth embodiment of the present invention will be described with reference to the drawings.
Note that, for convenience of description, configurations having the same functions as those in the first embodiment are denoted by the same reference numerals and description thereof will be omitted.
FIG. 16 is an explanatory diagram showing an example of performing brainstorming using the display screen of the input display device according to the fourth embodiment of the present invention.

The fourth embodiment is capable of being used for brainstorming as an example other than displaying the objects input on the display screen 10 of the input display device 1 in a bulleted form as in the above-described embodiments. ..

In the fourth embodiment, for example, as shown in FIG. 16, with respect to the theme 401 of “exhibition success” issued by the user A specified at the master position (M), the users B to D have their own ideas. The result of handwriting input is displayed.

The objects 402b, 403c, 404d, etc. input by the users B to D are displayed corresponding to the user in the forward direction.

Since the input object and the user can be matched by the shape/touch determination unit 4 determining the touch shape, for example, it is possible to display=group the objects input by each user in accordance with the user's color. Is.

Note that the user may be determined by a sensor or the like, and the user may be associated with the character input.

As the processing after displaying the result of the brainstorming on the display screen 10, each object is moved or the position of the master user A is rotated so as to be in the normal direction according to a user instruction. It is also possible.

As described above, the present invention is not limited to the above-described embodiment, and various modifications can be made within the scope of the claims. It is obvious to those skilled in the art that various changes or modifications can be conceived within the scope of the claims, that is, appropriate changes are made without departing from the scope of the present invention. Embodiments obtained by combining technical means are also included in the technical scope of the present invention.

Further, as one aspect of the invention, there is provided a table-type input display device including a display screen for displaying information and a sensor for detecting a user's input on the display screen, which is capable of input operation using a pen,
The sensor has a function capable of detecting a plurality of inputs,
Based on a plurality of input information detected by the sensor, an input information comparison unit that compares the size of the input area and the input direction,
A user position determination unit that determines the position of the user with respect to the display screen based on the comparison result by the input information comparison unit;
A display direction switching unit that switches the display direction of the image information displayed on the display screen based on the determination result by the user position determination unit,
In the case where the display screen is shared by a plurality of users, the display direction switching unit has a function of displaying, on the display screen, drawing information input in a direction that is a positive direction with respect to a position of a user specified in advance. , A function of displaying the additionally input drawing information in a state in which it is added in a positive direction with respect to the position of the user specified in advance, and further inputting drawing information by one of one or more users After the completion, when the instruction to move the drawing information input by the user is detected, the function of moving the input drawing information based on the instruction of the user, and the completion of the movement of the drawing information by the user, If the direction in which the input drawing information is displayed is different from the direction that is the positive direction with respect to the position of the user specified in advance, the input drawing information is changed with respect to the position of the user specified in advance. It may be a table type input display device having a function of displaying in a positive direction.

At this time, a menu image related to the input operation is displayed on the display screen, and the display direction switching unit inputs the input drawing information and the display direction of the menu image when the user is inputting. The function of switching to the normal direction for the inside user, the direction in which the input drawing information is displayed after the input of the drawing information by the user is completed, and the normal position with respect to the position of the user specified in advance. When the orientation is different, the function of displaying the input drawing information so as to be in a positive direction with respect to the position of the user specified in advance may be provided.

At this time, a drawing unit that performs drawing display according to the drawing information input by the user detected by the sensor is provided, and the drawing unit includes a storage unit that stores the drawing information input by the user, It may be characterized in that a plurality of pieces of input information used by the display direction switching unit to determine the display direction is not used as the drawing input.

At this time, the drawing unit includes a drawing unit that performs drawing display according to the drawing information input by the user detected by the sensor, and the drawing unit includes a storage unit that stores the drawing information input by the user. After inputting the drawing information by the above, the input drawing information and the display direction are associated and stored in the storage unit, and may be used for display control of displaying the drawing information.

1 Input display device 2 Touch panel (capacitance sensor)
3 Sensor drive unit/Capacity value receiving unit 4 Shape/touch determination unit (input information comparison unit)
5 Touch recognition processing unit 6 User position determination unit 7 Display direction control unit (display direction switching unit)
8 Drawing Information Control Section 9 Display Driving Section 10 Display Screen 11 Display Section 12 Control Section 71 Specific Direction Display Function 72 Specific Direction Additional Display Function 73 User Direction Display Function 74 User Direction Display Switching Function 75 Moving Display Function 76 Moving Display Switching Function 101 Display contents 102, 102b, 102c, 300, 402b, 403c, 404d Object 100 Pen

Claims (7)

In a display device having a display screen for displaying an object,
Specific display control means for controlling the display screen to be displayed at the position of the first user specified in advance;
Storage means for storing display information of the first object displayed with respect to the position of the first user ;
Input detection means for detecting a touch input by a second user at a different position sharing the display screen with the first user ;
User display control means for displaying the second object touch-input by the second user with respect to the position of the second user,
When moving operation to the second object is detected, the second object, based on said display information of the first object displayed adjusted relative to the first user position, the first Moving display control means to be displayed in the state of being added to the object,
A display device comprising: The storage means stores, as the display information, display directions of the first object and the second object ,
When the display direction of the second object is different from the display direction of the first object, the movement display control means adjusts the second object to the same direction as the display direction of the first object, The display device according to claim 1, wherein the display is performed in a state of being added to the first object. The storage means further stores, as the display information, display sizes of the first object and the second object ,
When the display size of the second object is different from the display size of the first object, the movement display control means adjusts the second object to the same size as the display size of the first object, The display device according to claim 1 , wherein the display is performed in a state where the first object is added . When the input of the first object and the second object is detected by the input detection means, the size of the input area and the input direction are compared based on the plurality of detected input information, and the input screen is displayed on the display screen. the display device according to user position determining means, from claim 1, further comprising in any one of 3 to determine the position of the user input the first object and the second object. A first input determination means for determining whether the input is made by a pen tip or an input with respect to the plurality of input information;
There is an input by the pen tip and an input by the touch, it is determined whether the input by the pen tip and the input by the touch exist in an area within a predetermined range, and the input by the pen tip and the input by the touch are performed. Second input determining means for determining that the input is made by the same user when it is determined that the input is within the predetermined range.
The display device according to claim 4 , further comprising: The input display device according to any one of claims 1 to 5, further comprising drawing information control means for displaying the first object and the second object in different display modes. In a computer mounted on a display device having a display screen for displaying an object,
A specific display control step of controlling the display screen to be displayed at the position of the first user specified in advance;
A storage step of storing display information of the first object displayed with respect to the position of the first user ;
An input detection step of detecting a touch input by a second user at a different position sharing the display screen with the first user ;
A user display control step of displaying a second object touch-input by the second user with respect to the position of the second user;
When a moving operation for the second object is detected, the second object is adjusted based on display information of the first object displayed with respect to the position of the first user on the display screen, A moving display control step of displaying the added state to the first object,
A program characterized by realizing.

Images