JP2016110349A - Information processing device, control method therefor, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To properly display a hand contact area displayed on a touch panel in stead of consistently displaying.SOLUTION: An information processing device includes a touch panel capable of receiving touch operation from a user. The device displays a hand contact area which is an area where a hand touches the touch panel on a predetermined position when it is determined that input operation to a touch panel is stopped. The device makes the displayed hand contact area non-displayed, when it is determined that a hand contact area disappeared from the touch panel.SELECTED DRAWING: Figure 14

Description

  The present invention relates to an information processing apparatus capable of inputting characters by a touch operation, a control method thereof, and a program.

  2. Description of the Related Art Conventionally, there is a terminal (hereinafter referred to as a tablet terminal) that includes a touch panel and can be operated by pressing a button on a display by a touch operation.

  The touch operation on the touch panel can be performed not only by one point but also by multi-touch, and for example, can be enlarged or reduced by a pinch-in / pinch-out operation using an index finger or thumb.

  In a terminal having such a touch panel, when the user performs a touch operation, the touched area is hidden by the user's finger and cannot be seen.

  Therefore, as shown in Patent Document 1 below, a mechanism is disclosed in which an area that is hidden by a touch operation is displayed in a different area from the touched area.

JP 2010-181940 A

  By the way, writing in a terminal having a touch panel as described above is performed in an educational facility such as a school.

  A user performs a touch operation on the touch panel using a pen. When the tablet terminal draws the line of the accepted touch operation on the touch panel, the user can write characters on the tablet terminal as if they were writing on paper.

  When a user performs a writing operation using a pen, a hand contact area is generated. The hand contact area is an area where a hand is placed on the touch panel in order to perform pen input. When the user is performing a writing operation, the user cannot see the characters written under the hand contact area because they are hidden by the hand.

  According to Patent Document 1 described above, a touched area (hand contact area) on the touch panel can be displayed in a different area from the touched area.

  However, in Patent Document 1 described above, the hand contact area is always displayed in a different area from the hand contact area, and there is a problem that the work area of the user is reduced.

  Accordingly, an object of the present invention is to provide a mechanism capable of appropriately displaying an area in contact with a display unit that can be touch-operated.

  An information processing apparatus according to the present invention is an information processing apparatus including a display unit that can accept an input by a user's touch operation, and includes an area information acquisition unit that acquires information on an area in contact with the display unit. Display control means for controlling display of the area information acquired by the area information acquisition means in a different area from the area in contact with the display section when input to the display section is stopped. It is characterized by providing.

  ADVANTAGE OF THE INVENTION According to this invention, it becomes possible to display appropriately the area | region which is contacting the display part in which touch operation is possible.

It is a block diagram which shows an example of the hardware constitutions in the information processing apparatus 100 of this invention. It is a functional block diagram in information processor 100 of the 1st and 2nd embodiments. It is a flowchart which shows the flow of a series of processes in the 1st Embodiment of this invention. It is a flowchart which shows an example of the partial image display process shown in FIG. It is a flowchart which shows the flow of a series of processes in the 2nd Embodiment of this invention. It is a figure which shows an example of the manual contact area | region table. 5 is a diagram illustrating an example of a touch coordinate table 700. FIG. 5 is a diagram illustrating an example of a partial image table 800. FIG. It is a figure which shows an example of the detection error information table. It is a figure which shows an example of the gaze coordinate table 1000. FIG. A partial image 1100 showing an image of a partial image. It is the hand contact area image 1200 which shows the image of a hand contact area. A writing image 1300 is an image in which the user writes on the information processing apparatus 100. It is the partial image display image 1400 which shows the image in which a partial image is displayed. This is a horizontal writing image 1500 that is an image for horizontal writing with the information processing apparatus 100 turned sideways. It is a line-of-sight image 1600 that displays a partial image according to the line-of-sight region in the second embodiment of the present invention. It is an example of the branch condition table 1700 used with the flowchart of FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a diagram illustrating a hardware configuration of the information processing apparatus 100. Note that the hardware configuration shown in FIG. 1 is merely an example.

  The information processing apparatus 100 is an apparatus that includes a touch panel. In the present embodiment, description will be made assuming a device such as a so-called smartphone or tablet terminal, but the present invention is not limited to this. A personal computer may be used as long as the device includes a touch panel.

  The CPU 101 comprehensively controls the memory and the controller via the system bus. The ROM 102 or the flash memory 114 stores a basic input / output system (BIOS) that is a control program of the CPU 101 and an operating system 200. Furthermore, various programs described below that are necessary for realizing the functions executed by the information processing apparatus 100 are stored.

  The RAM 103 functions as a main memory, work area, and the like for the CPU 101. The CPU 101 implements various operations by loading a program or the like necessary for execution of processing into the RAM 103 and executing the program.

  The display controller 104 controls display on a display device such as the display 110 (display unit). The display 110 is a liquid crystal display, for example. A touch panel 111 is provided on the surface of the display 110. The touch panel controller 105 controls detection of a touch operation on the touch panel 111. The touch panel controller 105 can also detect touch operations (hereinafter referred to as multi-touch) on a plurality of locations on the touch panel 111.

  The camera controller 106 controls photographing with the camera 112 (corresponding to the line-of-sight detection means). The camera 112 is a digital camera, and an image picked up by the control from the camera controller 106 is converted into digital data by the image pickup device. The camera 112 can capture still images and moving images. In order to acquire the distance between the user's face and the information processing apparatus 100, two cameras 112 are provided, and the distance from the information processing apparatus 100 can be measured based on the parallax of images acquired from the two cameras 112.

  The sensor controller 107 controls input from various sensors 113 included in the information processing apparatus 100. Various sensors exist in the sensor 113 of the information processing apparatus 100, such as an orientation sensor and an acceleration sensor.

  The network controller 108 is connected to and communicates with an external device via a network, and executes communication control processing on the network. For example, Internet communication using TCP / IP is possible.

  The flash memory controller 109 controls access to the flash memory 114 that stores a boot program, browser software, various applications, font data, user files, editing files, various data, and the like. In this embodiment, the flash memory is described, but a storage medium such as a hard disk, a flexible disk, or a card-type memory connected to a PCMCIA card slot via an adapter may be used.

  The CPU 101, each memory, and each controller described above are integrated into one chip 115. The information processing apparatus 100 is provided in the form of a so-called SoC (System on Chip).

  For example, the CPU 101 can perform display on the display 110 by executing outline font rasterization processing on a display information area in the RAM 103.

  Various programs and the like used by the information processing apparatus 100 of the present invention to execute various processes described later are recorded in the flash memory 114, and are executed by the CPU 101 by being loaded into the RAM 103 as necessary. is there. Further, definition files and various information tables used by the program according to the present invention are stored in the flash memory 114. The above is the hardware configuration in the present embodiment.

  FIG. 2 is a diagram illustrating an example of a functional block diagram of the information processing apparatus 100 according to the first embodiment of the present invention.

  As functional units of the information processing apparatus 100, a storage unit 201, a display control unit 202, and an operation detection unit 203 are provided. These are functional units that operate in the operating system 200.

  The storage unit 201 is a functional unit for storing, in the RAM 103 and the flash memory 114, information constituting various tables described later, various screens, information constituting image data generated by photographing with the camera 112, and the like. Add, update, and delete information as necessary. The same operation is performed when there is a request from the touch pen input application 210 described later.

  The display control unit 202 is a functional unit for controlling display on the display 110. When a display instruction such as a screen is issued from the display control unit 202, the display instruction is transmitted to the display 110 via the display controller 104. Upon receiving this instruction, the display 110 displays a screen or the like according to the instruction.

  The operation detection unit 203 is a functional unit for detecting a touch operation on the touch panel 111. The position of the touch operation on the touch panel 111, the number of touch operations, and the like can be detected. In addition, it is possible to detect the type of touch operation such as whether a writing action is performed on the touch panel 111 with a stick-shaped object such as a touch pen. Specifically, an area touched by the touch pen and a hand contact area by a contact with the hand holding the touch pen (a part corresponding to the side of the palm from the little finger to the wrist when the hand is held) Judging by the size, a touch within a predetermined range is accepted as a touch with a touch pen.

  Further, the information processing apparatus 100 is installed with a touch pen input application 210 that can operate in the operating system 200. The touch pen input application 210 includes an image data control unit 211, a display control instruction unit 212, an operation acquisition unit 213, a hand contact area acquisition unit 214, a display location specifying unit 215, and a display timing control unit 216.

  The touch pen input application 210 draws a trajectory if the touch on the touch panel 111 is a touch operation by the touch pen according to the content of the touch operation passed from the operation detection unit 203 to the operation acquisition unit 213. For example, an image (partial image) of an area corresponding to the hand contact area is copied and displayed in another area.

  The image data control unit 211 is a functional unit for executing processing on the image data stored in the storage unit 201. The image data indicates image data obtained by the user drawing with a touch pen. The image data control unit 211 can acquire and store image data.

  The display control instruction unit 212 is a functional unit for instructing the display control unit 202 to display a screen or the like displayed by the touch pen input application 210. The display control unit 202 displays a screen or the like according to an instruction from the display control instruction unit 212 on the display 110. For example, the locus of the touch operation with the touch pen is acquired from the operation acquisition unit 213, and the locus is drawn with a predetermined color. By doing so, it is possible for the user to perform composition on the touch panel by a touch operation with a touch pen. If the touch operation is a hand contact area that is greater than or equal to a certain area, an area corresponding to the hand contact area is cut from the screen shot of the display screen and displayed in another area.

  The operation acquisition unit 213 is a functional unit for acquiring the content of the touch operation detected by the operation detection unit 203.

  The hand contact area acquisition unit 214 is a functional unit for acquiring information on a hand contact area with respect to the touch panel 111.

  The display location specifying unit 215 is a functional unit that specifies a location for displaying the information (partial image) of the hand contact area acquired by the hand contact area acquiring unit 214. Specifically, the position for displaying the partial image is determined based on the branch condition table 1700 stored in the storage unit 201.

  The display timing control unit 216 displays the information of the hand contact area at the location specified by the display location specifying unit 215, such as when the writing operation by the touch pen is stopped or when the user's line of sight is facing the hand contact region. Is a functional unit for controlling The functional configuration in the present embodiment has been described above.

  FIG. 3 is a flowchart showing an example of a series of processes according to the first embodiment of the present invention. Note that the processing executed in each step is realized by the CPU 101 of the information processing apparatus 100 operating.

  In step S <b> 301, the CPU 101 of the information processing apparatus 100 determines whether or not a touch pen contact 1302 has been detected on the touch panel 111. Specifically, the area of the touch pen contact 1302 is stored in advance, and it is determined that the touch pen contact 1302 has been detected when there is one touch and the area of the touch pen contact 1302. If it is determined that the touch pen contact 1302 has been detected on the touch panel 111, the process proceeds to step S302. If it is determined that the touch pen contact 1302 has not been detected on the touch panel 111, the process waits until it is detected.

  In step S302, the CPU 101 of the information processing apparatus 100 causes the display 110 to display the locus of the touch pen detected in step S301 in black. The color of the locus drawing is not limited to this. For example, when the contact is larger than that of the touch pen, such as a hand contact area, the locus is not drawn. Thereby, even if a hand contact area | region contacts, there exists an effect that it is not drawn.

  In step S <b> 303, the CPU 101 of the information processing apparatus 100 determines whether a hand contact area has been detected on the touch panel 111. The hand contact area indicates an area where the hand touches the touch panel 111 in addition to the touch pen contact 1302 when the user performs a writing operation with the touch pen.

  A specific determination method stores a predetermined area in advance, and determines that a hand contact area is detected when an area that is one area and is larger than the predetermined area touches the touch panel 111. If it is determined that the hand contact area is detected on the touch panel 111, the process proceeds to step S303. If it is determined that the hand contact area is not detected, the process waits until the hand contact area is detected.

  In step S304, the CPU 101 of the information processing apparatus 100 acquires the touched coordinates and the hand contact area detected by the touch pen detected in steps S301 and S302, respectively. The acquired coordinates of the hand contact area are stored in the hand contact area table 600 shown in FIG. The hand contact area table 600 includes a first X coordinate 601, a first Y coordinate 602, a second X coordinate 603, and a second Y coordinate 604. As shown in the hand contact area image 1200 of FIG. 12, the points indicated by the first X coordinate 601 and the first Y coordinate 602 are the intersections of the upper end side and the left end side of the hand contact area 1201. The point indicated by the second X coordinate 603 and the second Y coordinate 604 is an intersection of the lower end side and the right end side of the hand contact area 1201. The rectangle indicated by these two points is an area corresponding to the hand contact area. On the other hand, the coordinates touched by the touch pen are stored in a touch coordinate table 700 shown in FIG. The touch coordinate table 700 stores the X coordinate 701 and the Y coordinate 702 of the touch pen contact coordinates detected in step S301.

  In step S305, the CPU 101 of the information processing apparatus 100 starts a timer count. Here, by starting to measure time, it is possible to determine later whether or not the touch pen has moved.

  In step S306, the CPU 101 of the information processing apparatus 100 determines whether or not a predetermined time has elapsed from the timer that started counting in step S305. In this embodiment, the predetermined time is 1 second, but is not limited to this. If it is determined that the timer count is 1 second or more, the process proceeds to step S306. If it is determined that the timer count is 1 second or less, the process waits until the timer count is 1 second or more.

  In step S307, the CPU 101 of the information processing apparatus 100 acquires the coordinates with which the touch pen contacts again. Here, by acquiring again the coordinates at which the touch pen is in contact with the touch panel 111, the touch pen contact 1302 is moving during the timer count, or the coordinates at which the touch pen is in contact cannot be acquired. It can be determined whether or not the touch pen contact 1302 disappears.

  In step S308, the CPU 101 of the information processing apparatus 100 compares the coordinates of the touch pen acquired in step S307 with the coordinates of the touch pen acquired in step S304, and the coordinates touched by the touch pen change while counting by the timer. It is determined whether or not the coordinates touched by the touch pen could not be acquired in step S307 (corresponding to determination means). If it is determined that the coordinates of the touch pen are not changed or there is no touch pen contact 1302, the process proceeds to step S309. If it is determined that there is a touch pen contact 1302 and the coordinates of the touch pen are changed, the process proceeds to step S313.

  If the coordinates of the touch pen are changing, it can be determined that the user's writing operation is not stopped and the writing is continuing smoothly, but if there is no change in the coordinates of the touch pen or the touch pen is being separated from the touch panel 111 If there is a hand contact area, the user's writing operation has stopped, and it can be said that the user is thinking about what to write. Therefore, when there is no movement of the coordinates of the touch pen or when there is a hand contact area while the touch pen is being separated from the touch panel 111, it is possible to refer to the user by displaying a partial image corresponding to the hand contact area. Furthermore, the display area of the display 110 can be saved by displaying only in a specific case without always displaying a partial image.

  In step S309, the CPU 101 of the information processing apparatus 100 acquires the display on the display 110 as image data (screen shot). The acquired image data is stored on the RAM 103.

  In step S310, the CPU 101 of the information processing apparatus 100 cuts out rectangular image data (corresponding to partial image / region information) indicated by the hand contact region table 600 from the screen shot acquired in step S309 (region information acquisition unit). Equivalent to The cut partial image is stored in the flash memory 114, and the stored file position and bibliographic information are stored in the partial image table 800 of FIG. The partial image table 800 stores an X coordinate 801 and a Y coordinate 802 that indicate the coordinates of the position where the partial image is to be displayed, and a storage location 803 that indicates the storage location of the partial image. The X coordinate 801 and the Y coordinate 802 are the coordinates of the position where the partial image is to be displayed, and the partial image is displayed around this coordinate (see the partial image image in FIG. 11). The method for determining the X coordinate 801 and the Y coordinate 802 will be described in detail later in the display position determination process. A storage location 803 indicates a location where the partial image is stored.

  In the present embodiment, the partial image is cut out and acquired from the screen shot, but this is an example and the present invention is not limited to this.

  In step S311, the CPU 101 of the information processing apparatus 100 determines whether there is a black pixel (information) in the partial image cut out in step S310 (corresponding to an information inclusion determination unit). Specifically, if there is a pixel whose RGB is (0, 0, 0), the process proceeds to step S312. If there is no pixel whose RGB is (0, 0, 0), the process proceeds to step S317.

  When there is no black pixel in the partial image, it can be determined that there is no information to be displayed in the hand contact area, and therefore the partial image display process is not performed in this embodiment. Thereby, there is an effect that a partial image which is not helpful to the user is not displayed. In this embodiment, whether or not there is information to be displayed in the hand contact area is determined by whether or not there is a black pixel. However, other colors may be used, and there may be colors other than white. Whether or not it may be determined. Moreover, you may determine whether black is more than a predetermined ratio.

  In step S312, the CPU 101 of the information processing apparatus 100 determines a position for displaying the partial image cut in step S310 and performs a partial image display process that is a process for displaying the position. Detailed processing will be described with reference to FIG.

  In step S313, the CPU 101 of the information processing apparatus 100 determines whether the hand contact area on the touch panel 111 has left. If it is determined that the hand contact area has left, the process proceeds to step S314. If it is not determined that the hand contact area has left, the process proceeds to step S317.

  In step S314, the CPU 101 of the information processing apparatus 100 displays a dotted line in the range of the hand contact area determined to be separated from the touch panel 111 in step S313 (the hand contact area acquired in step S304). For example, the image shown in FIG. FIG. 15 is a dotted line image 1500 that represents an image of a dotted line 1501 displayed when the hand contact area is separated from the touch panel 111. Thus, by displaying the hand contact area part away from the touch panel 111 with a dotted line, there is an effect that it is possible to identify from which part the displayed partial image 1502 is cut.

  In step S315, the CPU 101 of the information processing apparatus 100 waits for a predetermined time. In this embodiment, it is 1 second, but the present invention is not limited to this.

  In step S316, the CPU 101 of the information processing apparatus 100 controls to hide the dotted line 1501 and the partial image 1502. By not displaying, the display area of the display 110 can be appropriately secured.

  In step S317, the CPU 101 of the information processing apparatus 100 determines whether an instruction to end the touch pen input application 210 has been received from the user. Specifically, the determination is made based on whether or not pressing of an end button (not shown) is accepted. If it is determined that an end instruction has been received from the user, the series of processes is terminated. If it is determined that an end instruction has not been received from the user, the process returns to step S301, and input from the touch pen is received again.

  With the above series of processes, there is an effect that a partial image can be displayed at an appropriate timing when the user's writing operation is stopped.

  FIG. 4 is a flowchart showing the flow of display position determination processing in the first embodiment of the present invention.

  In step S <b> 401, the CPU 101 of the information processing apparatus 100 acquires the posture state of the information processing apparatus 100. The posture state refers to the display orientation of the display 110 of the information processing apparatus 100 acquired by the sensor 113, and there are two types, that is, landscape orientation or portrait orientation.

  In step S402, the CPU 101 of the information processing apparatus 100 determines whether the progress direction of the character written by the user is vertical writing or horizontal writing based on the posture state acquired in step S401. This posture state stores a state before the user places the information processing apparatus 100 horizontally. Specifically, if the posture state acquired in step S401 is horizontal, it is specified as horizontal writing, and if the posture state acquired in step S401 is vertical, it is specified as vertical writing. Whether vertical writing or horizontal writing is determined based on the posture state of the information processing apparatus 100, but it is also possible to determine by specifying the traveling direction of the character written by the user, and the present invention is not limited to this. The traveling direction of the specified character is stored in the RAM 103.

  In step S403, the CPU 101 of the information processing apparatus 100 determines whether or not the X coordinate touched by the touch pen is larger than the X coordinate of the hand contact area. More specifically, it is determined whether the X coordinate 701 touched by the touch pen is larger than the first X coordinate 601 and the second X coordinate 603 in the hand contact area table 600. If it is determined that the X coordinate 701 touched by the touch pen is larger than the first X coordinate 601 and the second X coordinate 603 of the hand contact area table 600, the process proceeds to step S404, and the X coordinate 701 touched by the touch pen is reached. However, if it is determined that it is smaller than the first X coordinate 601 and the second X coordinate 603 of the hand contact area table 600, the process proceeds to step S405.

  If the writing operation is performed with the right hand, the X coordinate 701 touched by the touch pen is always smaller than the first X coordinate 601 and the second X coordinate 603 in the hand contact area table 600. It can be determined whether the writing operation or the writing operation with the left hand.

  In step S404, the CPU 101 of the information processing apparatus 100 identifies that the hand performing the writing operation is with the left hand. The specified information is stored in the RAM 103.

  In step S405, the CPU 101 of the information processing apparatus 100 specifies that the writing operation is performed with the right hand. The specified information is stored in the RAM 103.

  In step S <b> 406, the CPU 101 of the information processing apparatus 100 reads the branch condition table 1700 stored in the flash memory 114. For example, the branch condition table 1700 shown in FIG. The branch condition table 1700 stores a document direction 1701, a hand 1702, a display position 1703, and a display position change flag 1704. The document direction 1701 indicates the direction of the document, and is either vertical writing or horizontal writing. A hand 1702 indicates a hand performing a writing operation by the user, and is either a right hand or a left hand. The display position 1703 is a coordinate value that defines the position where the partial image is displayed, and by adding to the X coordinate 701 and the Y coordinate 702 touched by the touch pen, the position where the partial image is displayed can be specified. . The display position change flag 1704 specifies that the object to which the display position 1703 is added is not the X coordinate 701 or Y coordinate 702 touched by a normal touch pen but the middle point of the two points indicated by the hand contact area table 600. It is a flag to do. Specifically, the midpoint is obtained by adding two X coordinates and Y coordinates and dividing by two. For example, the midpoint between the two points indicated by the hand contact area table 600 in FIG. 6 is (575, 575). The image of the midpoint is a partial image 1100 shown in FIG.

  In step S407, the CPU 101 of the information processing apparatus 100 reads the branch condition table read in step S406 based on the vertical writing or horizontal writing information specified in step S402 and the hand of the writing operation specified in step S404 or step S405. A display position 1703 and a display position change flag 1704 of 1700 are acquired. For example, when the vertical writing is specified in step S402 and the writing operation is specified as a left hand in step S404, the display position 1703 is “(−a, 0)” and the display position change flag 1704 is “1”. Get the value of.

  In step S408, the CPU 101 of the information processing apparatus 100 determines whether the display position change flag 1704 acquired in step S407 is standing. If it is determined that the display position change flag 1704 acquired in step S407 is set, the process proceeds to step S409. If it is determined that the display position change flag 1704 acquired in step S407 is not set, the process proceeds to step 410. Proceed.

  In step S409, since the display position change flag 1704 is set, the CPU 101 of the information processing apparatus 100 starts from the midpoint of the two points indicated by the hand contact area table 600, and the display position acquired in step S407 at the midpoint. By adding 1703, the coordinates of the display position of the partial image are specified. The coordinates of the display position of the specified partial image are stored in the X coordinate 801 and the Y coordinate 802 of the partial image table 800.

  By setting the starting point of the display position of the partial image as the center point of the hand contact area, the problem that occurs when the coordinate touched by the touch pen is set as the starting point, the partial image overlaps with the hand contact area. Solve. Furthermore, since the display position 1703 may be set so as to define the positional relationship from the hand contact area rather than the touch pen contact position, an appropriate position can be obtained even when the hand size is different for each user. There is an effect that it is possible to display a partial image.

  In step S410, the CPU 101 of the information processing apparatus 100 identifies the position where the partial image is displayed by adding the display position 1703 acquired in step S407 to the coordinates indicated by the touch coordinate table 700, and sets the identified display position as the partial display position. Stored in the X coordinate 801 and Y coordinate 802 of the image table 800. The coordinates indicated by the X coordinate 801 and the Y coordinate 802 of the partial image table 800 are specified as the display position of the partial image.

  In step S411, the CPU 101 of the information processing apparatus 100 displays the partial image of the storage location 803 at the coordinates of the partial image table 800, which is the display position specified in step S409 or step S410 (corresponding to display control means). . An image for displaying the partial image 1401 is a partial image display image 1400 shown in FIG. When the partial image 1401 is not displayed, the partial image 1401 is not displayed as shown in the handwritten image 1300 of FIG.

  This is the end of the description of the partial image display process.

  FIG. 5 is a flowchart showing an example of a series of processes in the second embodiment of the present invention. In the first embodiment, the position where the partial image is displayed is specified by using the writing operation with the touch pen from the user as a trigger, and the partial image is displayed. In 2nd Embodiment, the timing which displays a partial image is determined by detecting the eyes | visual_axis from a user. Since the display position determination process is the same as that in the first embodiment, a description thereof will be omitted. Furthermore, the processing of steps S501 to S504 and steps S507 to S515 corresponding to steps S301 to S304 and steps S309 to S317 of the flowchart in the first embodiment is the same as that of the first embodiment, and thus will be described. Is omitted.

  In step S505, the CPU 101 of the information processing apparatus 100 acquires coordinate values of the user's line of sight (corresponding to line-of-sight area specifying means). More specifically, first, the distance of the user's eyes is specified from the two cameras 112. As a distance specifying method, a method of specifying based on a difference between images obtained from two cameras 112 is used. The coordinate value of the user's line of sight can be acquired based on the direction of the two eyes of the user and the distance between the eyes of the user. The acquired coordinate values of the user's line of sight are stored in the line-of-sight coordinate table 1000 shown in FIG.

  In step S506, the CPU 101 of the information processing apparatus 100 determines whether or not the coordinate value of the user's line of sight acquired in step S505 is within the rectangle indicated by the hand contact area table 600 (corresponding to a determination unit). Since the coordinate value of the user's line of sight acquired in step S505 is not accurate, a coordinate value error range is set. For example, the detection error information table 900 shown in FIG. The detection error information table 900 stores an X coordinate error range 901 and a Y coordinate error range 902. The X coordinate error range 901 defines the X coordinate error range, and the Y coordinate error range 902 defines the Y coordinate error range. If the deviation is within this range, even if the coordinates of the line of sight acquired in step S505 are not present in the rectangle indicated by the hand contact area table 600, the hand contact area table 600 is determined to be within the rectangle indicated by the hand contact area table 600. If it is determined that the coordinate value of the user's line of sight acquired in step S505 is within the rectangle indicated by the hand contact area table 600, the process proceeds to step S507, and the coordinate value of the user's line of sight acquired in step S505 is If it is determined that it is not within the rectangle indicated by the contact area table 600, the process proceeds to step S511.

  With the above processing, in the second embodiment, the determination based on the detection of the line of sight is performed as one method for determining that the user's operation (writing operation) has stopped. This makes it possible to display the user's hand contact area at an appropriate timing. For example, it is a display of a partial image 1603 in the line-of-sight image 1600 shown in FIG.

  As described above, according to the present invention, it is possible to appropriately display an area in contact with a display unit that can be touched.

  The present invention can be implemented as a system, apparatus, method, program, storage medium, or the like, and can be applied to a system including a plurality of devices. You may apply to the apparatus which consists of one apparatus.

  Note that the present invention includes a software program that implements the functions of the above-described embodiments directly or remotely from a system or apparatus. The present invention also includes a case where the system or the computer of the apparatus is achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the recording medium for supplying the program include a flexible disk, hard disk, optical disk, magneto-optical disk, MO, CD-ROM, CD-R, and CD-RW. In addition, there are magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R), and the like.

  As another program supply method, a browser on a client computer is used to connect to an Internet home page. The computer program itself of the present invention or a compressed file including an automatic installation function can be downloaded from the homepage by downloading it to a recording medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. That is, a WWW server that allows a plurality of users to download a program file for realizing the functional processing of the present invention on a computer is also included in the present invention.

  In addition, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and key information for decryption is downloaded from a homepage via the Internet to users who have cleared predetermined conditions. Let It is also possible to execute the encrypted program by using the downloaded key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. In addition, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can also be realized by the processing.

  Further, the program read from the recording medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Thereafter, the CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instructions of the program, and the functions of the above-described embodiments are realized by the processing.

  Note that the above-described embodiments are merely examples of implementation in carrying out the present invention, and the technical scope of the present invention should not be construed in a limited manner. That is, the present invention can be implemented in various forms without departing from the technical idea or the main features thereof.

100 Information processing apparatus 101 CPU
102 ROM
103 RAM
104 Display controller 105 Touch panel controller 106 Camera controller 107 Sensor controller 108 Network controller 109 Flash memory controller 110 Display 111 Touch panel 112 Camera 113 Sensor 114 Flash memory

Claims (12)

An information processing apparatus including a display unit capable of receiving input by a user's touch operation,
Area information acquisition means for acquiring information of an area in contact with the display unit;
Display control means for controlling to display information on the area acquired by the area information acquisition means in an area different from the area in contact with the display section when input to the display section is stopped. An information processing apparatus characterized by that. A determination unit for determining whether or not input to the display unit is stopped;
The display control means controls the display of the area information acquired by the area information acquisition means in a different area from the area when the determination means determines that the input is stopped. The information processing apparatus according to claim 1. The determination means further determines whether or not an area in contact with the display unit is larger than a predetermined area,
The information according to claim 2, wherein the display control means displays information on the area when the determination means determines that the area in contact with the display unit is larger than a predetermined area. Processing equipment. The information processing apparatus according to claim 2, wherein the determination unit determines that the input is stopped when an input by a touch operation is not received for a predetermined time. Gaze detection means for detecting gaze from the user;
A line-of-sight area specifying means for specifying which area on the display unit the line of sight detected by the line-of-sight detection means further comprises:
The determining means further determines whether or not the area that is in contact with the display unit includes the area specified by the line-of-sight area specifying means,
When it is determined by the determination unit that the region specified by the line-of-sight region specifying unit is included in the region in contact with the display unit, the display control unit acquires the region information acquisition unit The information processing apparatus according to claim 2, wherein the information on the area is displayed in an area different from the area. The display control means displays information on the area acquired by the area information acquisition means in an area that is not already input by the user. Information processing device. The determination means further determines the direction of input by the user,
The display control means determines a display position based on the direction of the input specified by the determination means, and displays area information acquired by the area information acquisition means. The information processing apparatus according to any one of the above. Further comprising information inclusion determination means for determining whether information is included in an area in contact with the display unit;
When the information inclusion determination unit determines that information is included in the region in contact with the display unit, the display control unit displays the information on the region acquired by the region information acquisition unit. The information processing apparatus according to claim 1, wherein display is performed in a region different from a region in contact with the unit. The determination unit further determines whether or not the information acquired by the region information acquisition unit satisfies a certain ratio of the region in contact with the display unit,
When the determination means determines that the information acquired by the area information acquisition means satisfies a certain percentage of the area in contact with the display unit, the display control means is the area information acquisition means. The information processing apparatus according to any one of claims 2 to 8, wherein the acquired information on the area is controlled to be displayed in an area different from an area in contact with the display unit.   The said display control means displays the information acquired by the said area | region information acquisition means in the area | region different from the said area | region by copying the area | region which is in contact with the said display part. The information processing apparatus according to any one of the above. A control method for an information processing apparatus including a display unit capable of receiving input by a user's touch operation,
A region information acquisition step in which the region information acquisition means of the information processing apparatus acquires information of a region in contact with the display unit;
When the input to the display unit is stopped, the display control unit of the information processing apparatus displays the information on the area acquired in the area information acquisition step in a different area from the area in contact with the display unit. And a display control process for controlling the information processing apparatus. A program capable of causing a computer to execute a control method of an information processing apparatus including a display unit capable of receiving an input by a user's touch operation,
The information processing apparatus;
Area information acquisition means for acquiring information of an area in contact with the display unit;
When the input to the display unit is stopped, the information on the area acquired by the area information acquiring unit is caused to function as a display control unit that controls to display in a region different from the region in contact with the display unit. A program characterized by that.

Images