JP2009116727A - Image input display - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image input display capable of enhancing the visibility of a portion shaded by a presenter in view from an audience, when the presenter performs input and output of information, using a large display screen capable of touch-input. <P>SOLUTION: This image input display provided with a position sensor on the display screen, and capable of operating screen display by a touch operation on the screen, sets automatically a view obstructed area on the display screen invisible from the audience by obstructed by an input person, generates another screen in a position visible from the audience, and displays a content of a display screen corresponding to the view obstructed area. A frame of surrounding a display area of the screen is added to each of the view obstructed area and the another screen, and the visibility for the input person and the audience is enhanced thereby. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image input display device, and more particularly to a technology for inputting and outputting information using a large display screen capable of touch input, for presentations, meetings, education, etc. explained to a plurality of people. It is suitable for use.

  A large display is connected to the monitor output terminal of a PC when transmitting and explaining information to multiple people, such as presentations, meetings, and education. There is an image input / output system that can input.

Patent Document 1 directly writes agenda contents in a free format on a large display screen using a direct input means (for example, a touch pen) in a meeting using a whiteboard, and all these agenda contents are recorded. There has been proposed an electronic conference system that can easily execute document management, distribution to participants, processing of contents, and the like after completion of the conference.
JP 2000-56747 A

When a presenter inputs directly on such a large display screen using the input means, when the presenter is positioned between the display screen and the audience, the audience may be prevented from viewing the display screen. In some cases, it is difficult to see the characters and figures being entered.
For this reason, when the presenter is explaining while inputting voice and direct input means, it is difficult for the audience to synchronize the voice and the display contents, which hinders understanding.

  The present invention has been made in consideration of the above circumstances, and is viewed from the audience when a presenter inputs and outputs information using a large display screen capable of touch input. An object of the present invention is to provide an image input display device that improves the visibility of a portion that is shaded by a presenter.

  In order to solve the above-described problems, an image input display device of the present invention includes a position sensor on a display screen, and an image input display device capable of screen display operation by touch operation on the screen. A visual obstruction area on the display screen that is blocked by the audience is automatically set, a separate screen is generated at a position that is visible to the audience, and the contents of the display screen corresponding to the visual obstruction area are displayed. It is displayed on a separate screen.

  The separate screen and the visual interference area may be added with a frame surrounding the display area of the screen, or may be different from the background color of the display screen to improve visibility.

  Further, the display period of the separate screen is a period from when the input person starts input to the visual interference area until the input is completed, or a state in which no input to the visual interference area continues, and As a period until a preset non-input time elapses, the blinking state of the separate screen is reduced to improve the visibility of the audience.

  Further, a plurality of candidates for the display position of the separate screen and a condition for selecting the display position of the separate screen from the plurality of candidates can be set in advance, and when the separate screen is generated, The display position of the separate screen is determined from the position and the selection condition so that the audience can see it as easily as possible.

  In addition, by making the separate screen movable, it is possible to show the audience the characters, figures, etc. behind the separate screen.

  According to the present invention, when a presenter is inputting and outputting information using a large display screen capable of touch input, the visibility of a portion behind the presenter as viewed from the audience is improved. be able to.

Embodiments according to the present invention will be described below with reference to the drawings.
As an embodiment, an image input display device having a large display screen having an interactive whiteboard function will be described as an example. This image input display device is a two-dimensional surface type device that displays the desktop of a computer. In the interactive whiteboard function,
(1) An editable mode in which a user performs writing on a surface of a character or figure and an editing operation of a displayed object (for example, a displayed window, character, figure or image) is input to a computer;
(2) An uneditable mode in which the originally displayed data is displayed as it is, and writing on the data is input to the computer, and
(3) Board OFF mode used as a computer display device,
Although it can be used as an electronic blackboard, it can be used as a more general-purpose interactive computer screen.
Possible uses for this interactive whiteboard function include school, business presentations, and collaborative work.

The display screen will be described using a horizontally long display screen, but may be a vertically long one.
As shown in FIG. 1, the entire area of the display screen is composed of a display screen area and a system area. Each area has a lower left corner as an origin, a right horizontal direction as a positive direction of the X axis, and a vertical upward direction. It is assumed that the XY coordinate system is regarded as the positive direction of the Y axis.
Here, it is assumed that the display screen area has a horizontal size Lx and a vertical size Ly. The unit of this size may be a pixel unit or an m unit.

  The system area is an area used for operation menus such as input mode selection, edit mode and input of parameters used by control programs and application programs, and operation instructions such as power ON / OFF, and is displayed in the lower right corner of the display screen. It shall be displayed. However, without providing the system area, a button or the like may be provided outside the screen of the information display device for operation. Further, the system area itself may be displayed in the display screen area as necessary.

<Embodiment 1>
First, an outline of operation on the display screen according to the first embodiment will be described.
For example, as shown in FIG. 2, a presenter (hereinafter also referred to as an input person) 102 writes characters, figures, etc. on a large display screen 101 using an instruction means (for example, an electronic pen, a finger, a stick, etc.) 103, Consider the case where one or more audiences 104 are watching it.

In this case, characters, graphics, and the like written in the area 105 are hidden behind the input person 102 from the position of the audience 104.
In this way, the case where there is a listener 104 who is hidden behind the input person 102 is detected, and the contents (characters, figures, etc.) displayed in the area 105 in the area 106 visible from the audience 104 are detected. ) Is displayed.
As a result, even if it is in the shadow of the input person and cannot be visually recognized, it is automatically displayed in a portion that is not in the shadow of the input person, so that the audience can confirm the display and the visibility is improved.

Next, a hardware configuration of the image input display device according to the first embodiment will be described.
FIG. 3 is a block diagram illustrating a hardware configuration of the image input display device according to the first embodiment. In FIG. 3, the image input display device 10 includes an image display unit 11, a position sensor 12, a main control unit 13, The storage unit 14 is included. The image input display device 10 will be described on the assumption that the display device including the image display unit 11 and the position sensor 12 and the information processing device including the main control unit 13 and the storage unit 14 are configured as an integrated device. However, these devices may be configured as separate devices.

  The storage unit 14 includes, for example, a RAM (Random Access Memory), a ROM (Read Only Memory), an HDD (Hard Disk Drive), and the like, and is executed by the main control unit 13, various application programs, and these programs. It can also be used as a buffer for storing data used by or for temporarily generating data during the execution of these programs. An example of the application program is an electronic blackboard system.

  The image display unit 11 includes a liquid crystal display having a large display screen, and displays data obtained as a result of execution by a control program and various application programs.

  The input unit 20 is an instruction unit (pointing device) capable of instructing the position (coordinate value) of the display screen. As this instruction means, for example, a human finger, a pencil, an electronic pen, a stick or the like can be considered.

  The position sensor 12 is provided on the display screen of the image display unit 11. For example, the position information including the contact position and the contact state of the input unit 20 is changed by the main control unit by an infrared sensor, pressure sensitivity, or capacitance change. 13 to send.

  Here, the contact state means “contact state” or “non-contact state”. The “contact state” is a state in which the input unit 20 remains in contact with the display screen, and the “non-contact state” is a click that has been contacted once, a double-click that has been contacted twice, The state where 20 is released.

The contact position is a coordinate value when the input unit 20 is in contact with the display screen or a coordinate value when the input unit 20 is not in contact, and is represented by a coordinate system of the display screen.
Further, when the input unit 20 remains in contact, the position sensor 12 monitors the contact state at a predetermined interval and sequentially transmits position information including the contact position and the contact state to the main control unit 13. .

The main control unit 13 is configured by, for example, a CPU (Central Processing Unit) and the like, and controls the entire apparatus 10 by executing a control program and various application programs stored in the storage unit 14.
This control program is a program that controls the entire apparatus, and includes an image output unit that outputs drawing commands and drawing results specified by the control program or application program to a display screen.

  Next, the control function configuration of the image input display device 10 according to the first embodiment will be described based on the block diagram of FIG. In the figure, the control function of the image input display device 10 includes a control unit 31, a visual interference area specifying unit 32, another screen generation unit 33, another screen disappearance unit 34, and an image output unit 35. Further, the screen management table 36 is used to operate these.

  The control unit 31 is configured as a part of the control program. Here, the control unit 31 controls the visual interference area specifying unit 32, the separate screen generation unit 33, the separate screen disappearance unit 34, and the image output unit 35, and executes the application program 40. It is for management.

  First, the screen management table 36 for managing various windows displayed on the display screen will be described. The screen management table 36 is recorded in the storage unit 14 and includes data items as illustrated in FIG.

Screen classification: Stores classification data indicating any of a display screen, an obstruction area, and another screen.
Display position: A coordinate value representing the position of the lower left corner of the screen (area) divided by the screen classification is stored. In the case of a display screen, it is fixed at the origin of the display screen, but in the case of a disturbing area, it is variable depending on the positional relationship between the input person and the audience. Is variable.
Screen size: The size of the screen (area) divided by the screen classification is stored as the width and height. Here, in the case of the display screen, the fixed width Lx and the height Ly, and in the case of the interference area, the width is variable depending on the positional relationship between the input person and the audience and the size of the input person's body. Let lx be the height ly. In the case of another screen, the size is the same as the size of the disturbing area, and the width is lx and the height is ly.

  Now, the control program and application program generate image data for the display screen by executing a drawing command, and output it to the main buffer memory secured in the storage unit 14.

Next, the image output unit 35 is called when the main buffer memory is updated or the screen management table 36 is updated.
If the display position of the disturbing area is not set in the screen management table 36, the image output unit 35 writes the image data in the main buffer memory to the image memory secured in the storage unit 14.

In addition, the image output unit 35, if the display position of the disturbing area is set in the screen management table 36, the disturbing area of the image data stored in the main buffer memory so that the disturbing area can be distinguished from the visible area. A frame is drawn on the screen and output to the display image buffer secured in the storage unit 14.
At the same time, the image data corresponding to the disturbing area is extracted from the main buffer memory, and is output to another screen buffer memory secured in the storage unit 14 as image data for another screen.

Then, the image output unit 35 synthesizes the image data of the display screen stored in the display screen buffer memory by overwriting the image data of the separate screen output to the separate screen buffer memory to the display position of the separate screen, and stores it. The data is written to the image memory secured in the unit 14.
In this way, when the image memory is rewritten, the image output unit 35 sends the contents of the rewritten image memory to the image display unit 11 to display the display screen and the images on the separate screen on the large display screen.

  The visual hindrance area specifying unit 32 determines whether or not there is an audience who is disturbed by the input person, and when there is such an audience, the coordinate position (position sensor 12) touched by the input part 20 is determined. It is checked whether or not the position information received by the control unit 31 is within the already set disturbance area. This existing disturbing area is obtained from the display position and size of the disturbing area in the screen management table 36.

If the coordinate position touched by the input unit 20 is not within the existing disturbing area, the area on the display screen that is prevented from being visually identified is specified, and the position and size of the disturbing area on the display screen are calculated. Thus, the information on the position and size of the disturbing area on the display screen and the presence of the obstruction is returned to the control unit 31. In this disturbing area, a portion that is shaded by the input person is a quadrilateral area, the position is the coordinate value of the lower left corner on the display screen, and the size is represented by the width and height of the disturbing area.
Further, when the coordinate position touched by the input unit 20 is within the existing disturbance area, information indicating that it is in the disturbance area is returned to the control unit 31.
Further, when there is no listener who is obstructed from visual recognition, information indicating no obstruction is returned to the control unit 31.

  Here, the condition parameter and the disturbing area for determining whether or not there is a listener who is disturbed in visual recognition are the distance between the audience and the image input display device 10, and the image input display device 10 viewed from the audience. The parameters can be determined by detecting the relative positions of the audience from the image input display device 10 or whether the vertical and horizontal angles are preset.

The separate screen generation unit 33 is activated by the control unit 31 and determines the display position and size of the separate screen from the display position and size (width and height) of the handed-off disturbance area, and enters the screen management table 36. Write and return the process to the control unit 31. Here, the separate screen is set, for example, at a screen position away from the display position of the disturbing area. For example, if the disturbing area is on the left side of the display screen, another screen is set on the upper right side of the display screen.
The actual display of another screen is performed by the image output unit 35 with reference to the screen management table 36 rewritten here.

  The separate screen disappearance unit 34 is activated by the control unit 31 to initialize the disturbing area of the screen management table 36 and the display position and size of the separate screen to indicate that there is no data, and to the control unit 31. Return processing. The actual display of the disturbing area and another screen is displayed by the image output unit 35 with reference to the screen management table 36 rewritten here.

  The control unit 31 controls whether or not to display another screen depending on whether or not there is an area where the audience is visually impaired. When inputting using the input unit 20, the input person brings the input unit 20 into contact with the display screen or releases it. For this reason, every time an input person inputs into the obstruction area, another screen is displayed in a blinking state on the display screen, which is very difficult to see.

In order to avoid this, in the first embodiment, another screen is displayed in the same place until a predetermined time elapses in the same disturbing area, and when the predetermined time elapses, the display of another screen is displayed. I try to stop it.
The flow of this process will be described using the flowchart of FIG.

The position information received from the position sensor 12 is acquired (step S1), the current time is acquired and temporarily stored (step S2).
The visual disturbance area specifying unit 32 is activated, and the contact coordinates in the acquired position information are passed (step S3).
When the information of “with interference” or “within interference region” is returned from the visual interference region specifying unit 32 (step S4 / YES), the process proceeds to step S5.
On the other hand, when “no interference” information is returned from the visual interference area specifying unit 32 (step S4 / NO), the process proceeds to step S10.

  When the “disturbance” information is returned from the visual interference area specifying unit 32 (step S5 / NO), if the disturbance start time has not yet been set (step S6 / “none”), the information is temporarily stored first. The stored time is stored in the disturbance start time (step S7), the separate screen generation unit 33 is activated, the display position and size of the separate screen are set (step S8), and the position information is passed to the application 40. (Step S13), the process ends.

  On the other hand, if the disturbance start time has already been set (step S6 / “Yes”), the separate screen generation unit 33 is activated, the display position and size of the separate screen are set (step S8), and the position information is set. The data is passed to the application 40 (step S13), and the process is terminated.

  On the other hand, when the information “in the disturbing area” is returned from the visual disturbing area specifying unit 32 (step S5 / YES), the temporarily stored time has passed a predetermined time from the disturbing start time. If so (step S9 / YES), the process proceeds to step S11. If the predetermined time has not yet elapsed (step S9 / NO), the process proceeds to step S13.

  When “no interference” information is returned from the visual interference area specifying unit 32 (step S4 / NO), if the interference start time has already been set (step S10 / “Yes”), the separate screen disappearing unit 34 is displayed. It starts, initializes another screen and the disturbance area (step S11), cancels the setting of the disturbance start time (step S12), passes the position information to the application 40 (step S13), and ends the process.

  If the disturbance start time has not yet been set (step S10 / “None”), the position information is passed to the application 40 (step S13), and the process is terminated.

  By configuring the first embodiment as described above, an input area that is behind the input person and cannot be visually recognized is automatically displayed in a portion that is not in the shadow of the input person. Can know.

  In Embodiment 1 described above, another screen for the same disturbing area is not erased until a predetermined time elapses. However, after determining that the input from the input unit 20 has stopped, the other screen is displayed. It may be made to disappear.

Further, in Embodiment 1 described above, the disturbing area 105 and the separate screen 106 are displayed as shown in FIG. 7, but when the input person 102 inputs to the disturbing area 105 with the instruction means 103, the separate screen 106 is displayed. If characters and figures are already displayed in the vicinity, it is difficult for the audience to distinguish whether the input is made by the input person or is already displayed.
Therefore, as illustrated in FIG. 8, blinking, changing the background color, adding a frame 107 as illustrated in FIG. 9, or combining them to make another screen different from the display screen display. .
Thereby, it becomes clear that it is a display of the part of the obstruction area which the other screen is inputting, and it can improve visibility to a listener.

Furthermore, in Embodiment 1 above, since the boundary between the disturbing area and the display screen is unclear, the larger the screen display is, the larger the angle of the input person from the input person to another screen becomes. It is difficult to know that the input person has created a disturbing area and which part is the disturbing area.
In order to solve this, as in the case of the separate screen, as illustrated in FIG. 10, the frame 108 is also displayed for the display of the disturbing area.
Thereby, since the input person can clearly recognize which part on the display screen the disturbing area is, the visibility can be improved not only for the audience but also for the input person.

In order to display such a frame, background color, or blinking for the disturbing area or another screen, as shown in FIG. 11, display attributes are stored in a screen separate from the disturbing area in the screen management table 36. Keep it. This display attribute is composed of a combination of framed, background color, blinking, and the like.
Then, the image output unit 35 refers to the screen management table 36 and generates an image suitable for the display attribute for the disturbing area and the other screen.

<Embodiment 2>
In the second embodiment, the timing at which another screen disappears is performed according to an instruction from the input person. For this reason, in the second embodiment, as illustrated in FIG. 12, an input end button is provided in the frame of the disturbing area. FIG. 12A shows the entire display screen, and FIG. 12B is an enlarged view of the frame of the disturbing area.
This frame 108 is provided with an input end button 109. When the input person presses the input end button 109 when the input to the disturbing area 105 is completed, the display of the separate screen 106 is ended.

In the second embodiment and the above-described embodiment, the hardware configuration is the same as that in FIG. 3 and the control function configuration is the same as that in FIG. 4, but only the control unit 31 that performs another screen termination processing. Is different.
The control unit 31 performs processing according to the flow shown in the flowchart of FIG.

The position information received from the position sensor 12 is acquired (step S21), and when it is determined that the acquired position information is that the input end button has been pressed (step S22 / YES), the process proceeds to step S28.
On the other hand, when the input end button has not been pressed (step S22 / NO), the visual recognition disturbance area specifying unit 32 is activated and the contact coordinates of the acquired position information are passed (step S23).
When the information “There is interference” or “In the interference area” is returned from the visual interference area specifying unit 32 (step S24 / YES), the process proceeds to step S25.
On the other hand, when the “no interference” information is returned from the visual interference area specifying unit 32 (step S24 / NO), the process proceeds to step S28.

When the “disturbance” information is returned from the visual interference area specifying unit 32 (step S25 / NO), the separate screen generation unit 33 is activated to set the display position and size of the separate screen (step S26). Then, the position information is passed to the application 40 (step S27), and the process is terminated.
On the other hand, when the “interfering area” information is returned from the visual interference area specifying unit 32 (step S25 / YES), the position information is passed to the application 40 (step S27), and the process is terminated.

When the input end button is pressed (step S22 / YES), the screen management table 36 is referred to, and if a disturbing area is set (step S28 / “Yes”), the separate screen disappearance unit 34 is activated. Then, the separate screen and the disturbing area are initialized (step S29), the position information is passed to the application 40 (step S27), and the process is terminated.
If the interference area has not been set yet (step S28 / “None”), the position information is passed to the application 40 (step S27), and the process is terminated.

  In the second embodiment, the input end button is provided on the frame of the disturbing area. However, the present invention is not limited to this, and a series of movements of the input operation of the input unit 20 may be analyzed to determine the input end. (Input by so-called gesture operation) A method of simply providing a physical switch in the input unit 20 and transmitting the signal to the control unit 31 may be used.

<Embodiment 3>
In the first and second embodiments described above, another screen is displayed at a predetermined position. In the third embodiment, in addition to the functions of the first and second embodiments described above, the display position of another screen can be set by the input person.
Therefore, since the hardware configuration and control function configuration of the third embodiment are the same as those described in the first and second embodiments, only additions and differences will be described below.

First, an outline of an operation method when the input person sets the display position of another screen will be described.
The input person presses a setting button provided in the system area of the display screen of the image input display device before giving a presentation to the audience.
In the image input display device, as illustrated in FIG. 14, a reduced screen 201 of the display screen is displayed in the vicinity of the input person, and at least one reduced frame 202 of another screen is displayed on the reduced screen 201.

The size of the reduced screen 201 is not particularly limited as long as one or more reduced frames 202 of another screen are displayed and the input unit 20 can be moved.
In addition, the reduction frame 202 of another screen is displayed at a position in the upper right corner of the reduction screen 201 (can be set as appropriate), and the size of the reduction frame 202 is also a size that can be moved using the input unit 20. There is no particular limitation.

The place where the input person drags and releases the reduction frame 202 of another screen using the input unit 20 (reduction frames 203 to 206) is determined as the display position of the other screen. The display position of the separate screen is obtained by converting the coordinate value of the lower left corner of the reduction frame into the coordinate value of the display screen.
When you want to set multiple display positions on different screens, you can press the repeat button provided in the system area of the display screen of the image input display device to display a new reduced frame on the separate screen. The display position of a new separate screen is determined by the same operation.

Then, when setting and registering the determined display position of one or more different screens, a registration button provided in the system area of the display screen of the image input display device is pressed.
In the image input display device, the determined display positions of one or more different screens are recorded.

Next, the control function configuration of the third embodiment will be described.
FIG. 15 is a block diagram illustrating a control function configuration of the image input display device according to the third embodiment. In FIG. 15, the control function of the image input display device 10 includes a control unit 31, a visual interference area specifying unit 32, and another control function. The screen generation unit 33, the separate screen disappearance unit 34, the image output unit 35, and the separate screen display position setting unit 37 are configured. In order to operate these, the screen management table 36 and the separate screen display position table 38 are used. 15, the same functions as those in FIG. 4 are denoted by the same reference numerals.

When detecting that the setting button has been pressed based on the position information from the position sensor 12, the separate screen display position setting unit 37 displays a reduced screen of the display screen in the vicinity of the input person.
The vicinity of the input person can be calculated as the same coordinate value as the display position of the disturbing area stored in the screen management table 36 or as a coordinate value moved by a predetermined distance.

  The size of the reduced screen is not particularly limited as long as one or more reduced frames on another screen can be displayed and the moving operation can be performed using the input unit 20. Further, on this reduced screen, at least one reduced frame of another screen is displayed, the position of the reduced frame is the upper right corner of the reduced screen, and the size is also a size that can be moved using the input unit 20. If it is, it will not specifically limit.

  When detecting that the input person has dragged and released the reduced frame of the separate screen using the input unit 20, the separate screen display position setting unit 37 determines the coordinate value of the lower left corner of the reduced frame displayed at the released position. It converts into the coordinate value of a display screen, and fixes this coordinate value as a display position of another screen.

  When detecting that the repeat button is pressed by the input person, the separate screen display position setting unit 37 displays a new reduced frame of the separate screen on the reduced screen of the display screen and detects the confirmation of the reduced frame. Wait until the registration button is pressed.

When the separate screen display position setting unit 37 detects that the repeat button has been pressed, the coordinate value of the lower left corner of the reduced frame displayed at the place where the drag is released is converted into the coordinate value of the display screen, as described above. The coordinate value is determined as the display position on another screen.
When the separate screen display position setting unit 37 detects the pressing of the registration button, the display position of one or more confirmed separate screens is recorded in the separate screen display position table 38.

The display position of another screen set in advance in this way is used by the separate screen generation unit 33 to determine the display position of the separate screen.
The separate screen generation unit 33 acquires the display position of the separate screen that displays the contents of the disturbing area from the separate screen display position table 38, and sets the size of the separate screen to be the same as the size of the disturbing area of the screen management table 36. Each is set in the screen management table 36.

  Here, when there are a plurality of display positions in the separate screen display position table 38, priorities are assigned in advance to the display positions of the separate screens, and the next candidate display position of this priority order is displayed. Or you may select by the following conditions (multiple selection is possible) set beforehand.

(1) A display position that does not overlap the area (interfering area) where the input person is inputting is set.
(2) A display position that does not overlap with an area where visibility is reduced as viewed from an audience around the input person.
(3) The display position is set so as to minimize the movement of the audience's line of sight.
(4) Display in a predetermined area so that the display position of another screen can be easily expected by the audience.
(5) Of the predetermined areas, an area close to the disturbing area is set as the display position.
(6) The display position where the area overwritten by displaying the character figure or the like already input is displayed as a separate screen is minimized. That is, the non-input part is preferentially set as the display position of another screen.

  However, when there is no display position that does not overlap with the disturbing area, the display position of another screen that does not overlap with the disturbing area is set on the image input display device side.

In order to set the selection conditions as described above in advance, before the input person makes a presentation to the audience, a selection condition setting button provided in the system area of the display screen of the image input display device is pressed.
When the image input display device detects the pressing of the selection condition setting button, the above selection conditions are displayed. When the conditions are selected and the pressing of the confirm button is detected, the selected conditions are stored in the storage unit 14. Keep it.
The separate screen generation unit 33 determines an appropriate display position of the separate screen based on the stored conditions.

  As shown in the third embodiment, when an input person makes a presentation, a determination is made based on a manuscript displayed in the presentation and writing, and a display position of another screen is set in advance, so that the audience can The contents displayed on the display screen are easy to see, and the input user is less burdened to set up another screen during the presentation.

<Embodiment 4>
In the above-described embodiment, once a separate screen is displayed, the separate screen cannot be moved, and therefore characters, graphics, and the like behind this separate screen cannot be described.
In the fourth embodiment, it is possible to move without erasing another screen once displayed.

For this purpose, as illustrated in FIG. 16, a frame 307 is displayed in the obstruction area 301, a movement button 308 is arranged in the frame 307, and the width of the frame 307 is a width that can be displayed by the movement button 308. .
When the input user presses the movement button 308, a reduced screen 301 of the display screen is displayed in the vicinity of the movement button 308 or in the vicinity of the input person. On the reduced screen 301, a reduced image of the display content on the display screen, a reduced area 302 of the disturbing area, and a reduced 303 of another screen are displayed.

  Then, by dragging the reduction 303 of the separate screen with the input unit 20, the display position of the separate screen is moved to the position of 305 or 306 so that the characters and figures 304 behind the reduction 303 of the separate screen can be seen. can do.

The hardware configuration of the fourth embodiment is the same as that of FIG. 3 described in the first, second, and third embodiments, and the control function configuration of the fourth embodiment is the configuration of the block diagram shown in FIG. .
In FIG. 17, the control function of the image input display device 10 includes a control unit 31, a visual interference area specifying unit 32, another screen generation unit 33, another screen disappearance unit 34, an image output unit 35, another screen display position setting unit 37, The screen display position moving unit 39 is included. In order to operate these, the screen management table 36 and the separate screen display position table 38 are used. In FIG. 17, the same functions as those in FIG. 15 are denoted by the same reference numerals.

When the separate screen display position moving unit 39 detects that the move button is pressed during the display period of the separate screen based on the position information from the position sensor 12, it displays a reduced screen of the display screen near the input person or Display in the vicinity of the move button.
The vicinity of the input person can be calculated as the same coordinate value as the display position of the disturbing area stored in the screen management table 36 or as a coordinate value moved by a predetermined distance.

The reduced screen of the display screen displays a reduced image of the content displayed on the display screen, a reduced area of the disturbing area, and a reduced frame of another screen that is currently displayed. At this time, the reduced area of the disturbing area is displayed so that the reduced screen of the display screen can be distinguished from the reduced frame of another screen.
Further, the size of the reduced screen is not particularly limited as long as one or more reduced frames of another screen can be displayed and the moving operation can be performed using the instruction unit. The reduction ratio of the reduction area of the disturbing area and the reduction frame of another screen is the same as the reduction ratio of the reduction screen of the display screen.

When the other screen display position moving unit 39 detects that the input person has dragged and released the reduction 303 of the other screen using the input unit 20, the lower left of the reduction 305 or 306 of the other screen closest to the released location. The coordinate value of the corner is converted into the coordinate value on the display screen, and this coordinate value is determined as the display position on another screen (see FIG. 16).
The separate screen display position moving unit 39 records the confirmed display position of the separate screen in the separate screen display position table 38.

  As described above, it is possible to move another screen to a non-input area where the input person intends or an area unnecessary for the current explanation, so that the audience can see the characters and figures behind the other screen. It becomes like this.

Alternatively, the separate screen display position moving unit 39 may be configured as follows.
When the separate screen display position moving unit 39 detects that the move button is pressed during the display period of the separate screen based on the position information from the position sensor 12, it displays a reduced screen of the display screen near the input person or Display in the vicinity of the move button.

  The reduced screen of the display screen includes a reduced image of the content displayed on the display screen, a reduced area of the disturbing area, and a reduced frame of another screen corresponding to a plurality of different screens stored in the separate screen display position table 38. Is displayed. At this time, the reduced area of the disturbing area is displayed so that the reduced screen of the display screen can be distinguished from the reduced frame of another screen. The reduction ratio of the reduction area of the disturbing area and the reduction frame of another screen is the same as the reduction ratio of the reduction screen of the display screen.

When the input person uses the input unit 20 to select a desired reduced frame of another screen from among a plurality of reduced frames, the separate screen display position moving unit 39 selects the lower left corner of the reduced frame. Is converted into a coordinate value on the display screen, and this coordinate value is determined as a display position on another screen (see FIG. 16).
The separate screen display position moving unit 39 records the confirmed display position of the separate screen in the separate screen display position table 38.

  As described above, since it is possible to easily select from the display positions of a plurality of different screens set in advance by the input person, the audience can see the characters and figures behind the different screens.

<Embodiment 5>
In the above-described embodiment, all input to the display screen is performed from an input unit such as a finger, and the position information is detected by the position sensor.
In the fifth embodiment, in addition to this position sensor, when the position on the display screen can be designated by another input device, a separate screen is displayed only for the input of position information from the position sensor, and other positions are displayed. Information input devices are not displayed on a separate screen.

  In the fifth embodiment, the position information input device will be described as a digitizer. However, when the position information is input, any input device that does not generate an invisible area behind the input person can be similarly applied. is there.

The hardware configuration of the fifth embodiment is the configuration illustrated in FIG. In FIG. 18, the same functions as those in FIG. 3 are denoted by the same reference numerals, and description of components having the same reference numerals is omitted.
The digitizer 15 transmits position information when the input unit 20 such as a stylus pen comes into contact to the main control unit 13.
This position information includes the identification of the device that has input the position information, the contact position of the input unit 20, and the contact status. The device distinction is information for distinguishing the digitizer or the position sensor. The contact position is obtained by converting the coordinate value on the digitizer to the coordinate value on the display screen.
In addition, the position sensor 12 transmits position information using the position sensor as the position sensor to which the position information is input to the main control unit 13.

The functional configuration of the fifth embodiment is the same as the functional configuration of the above-described embodiment.
When the position information as described above is received from the position sensor 12 or the digitizer 15, the control unit 31 refers to the classification of the input device for the position information. I do. Further, when the input device category is the digitizer 15, the position information is only handed over to the application 40.

  With the above configuration, even when an image input display device is capable of performing display output by a plurality of inputs, input using a separate screen is realized only when inputting on the display screen of the display input device itself. When using other input devices, there is no need to display unnecessary separate screens.

  Note that the present invention is not limited to the above-described embodiment, and various modifications and corrections can be made without departing from the scope of the present invention.

It is a figure explaining a display screen and a coordinate axis. It is a figure explaining the operation | movement outline | summary of the display screen of an image input display apparatus. 2 is a block diagram illustrating a hardware configuration of the image input display device according to the first embodiment. FIG. FIG. 3 is a block diagram illustrating a control function configuration of the image input display device according to the first embodiment. 4 is a data structure example of a screen management table in the first embodiment. 3 is a flowchart illustrating a processing procedure of a control unit according to the first embodiment. 6 is a display example of another screen in the first embodiment. 6 is a display example of another screen in the first embodiment. 6 is a display example of another screen in the first embodiment. 6 is a display example of a disturbing area in the first embodiment. 6 is another example of the data structure of the screen management table in the first embodiment. It is the example which showed the installation position of the input end button in Embodiment 2. 10 is a flowchart illustrating a processing procedure of a control unit according to the second embodiment. It is explanatory drawing when setting the display position of several another screen. It is a block diagram which shows the control function structure of the image input display apparatus which concerns on Embodiment 3. FIG. It is the example which showed the installation position of the movement button in Embodiment 4. FIG. 10 is a block diagram illustrating a control function configuration of an image input display device according to a fourth embodiment. FIG. 10 is a block diagram illustrating a hardware configuration of an image input display device according to a fifth embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Image input display apparatus, 11 ... Image display part, 12 ... Position sensor, 13 ... Main control part, 14 ... Memory | storage part, 15 ... Digitizer, 20 ... Input part, 31 ... Control part, 32 ... Visual interference area specifying part 33 ... Separate screen generating unit, 34 ... Separate screen disappearing unit, 35 ... Image output unit, 36 ... Screen management table, 37 ... Separate screen display position setting unit, 38 ... Separate screen display position table, 39 ... Separate screen display position Moving unit 40... Application 101 101 Large display screen 102 Input person 103 Instructing means (input unit) 104 Audience 105 Interference area 106 Other screen 107 107 Frame of another screen 108 ... frame of interference area, 109 ... input end button, 201 ... reduction screen, 202 to 206 ... reduction frame, 301 ... reduction screen, 301 ... interference area, 302 ... reduction area of interference area, 303, 305, 306 ... Reduction of the screen, 304 ... characters and figures hidden behind another window, 307 ... frame of interference area, 308 ... moving button.

Claims (7)

  In an image input display device provided with a position sensor on a display screen and capable of screen display operation by a touch operation on the screen, a visual interference area on the display screen which is blocked by an input person and cannot be seen by an audience is automatically displayed. An image input display device configured to set, generate a separate screen at a position visible from the audience, and display the content of the display screen corresponding to the visual interference area on the separate screen.   2. The image input display device according to claim 1, wherein the separate screen is added with a frame surrounding a display area of the screen or different from a background color of the display screen.   3. The image input display device according to claim 1, further comprising a frame surrounding the visual interference area.   4. The image input display device according to claim 1, wherein the display period of the separate screen is a period from when the input person starts input to the visual interference area until input is completed. An image input display device characterized by the above.   4. The image input display device according to claim 1, wherein a non-input state to the visual interference area continues for a display period of the separate screen, and a preset non-input time elapses. An image input display device characterized in that it is a period until the image is displayed.   The image input display device according to any one of claims 1 to 5, wherein a plurality of candidates for the display position of the separate screen and a condition for selecting the display position of the separate screen from the plurality of candidates can be set in advance. An image input display device, wherein when generating the separate screen, a display position of the separate screen is determined from the position of the visual interference area and the selection condition.   7. The image input display device according to claim 1, wherein the separate screen is movable.

Images