JP2014016943A - Information processor, display method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display an image inputted by handwriting in a different area even though the image handwritten and inputted by a user is covered with the user's hand or the like.SOLUTION: An information processor includes: display means for receiving a handwriting input of an image within a display area and displaying the image relating to the handwriting input at a position having received the handwriting input; derivation means for deriving handwriting information representing that a hand for performing a handwriting input is a right hand or a left hand; and display control means for displaying a third image at a fourth position after displaying a third image based on a first image at a third position at an end part of a display area corresponding to a first direction from a first position to a second position and the handwriting information or near the end part in a case where the display means receives a handwriting input of a second image at the second position after the display means receives a handwriting input of the first image at the first position, and displaying a fourth image based on the second image at the third position. A direction from the third position to the fourth position is an opposite direction from the first direction.

Description

  The present invention relates to an information processing device, a display method, and a program, and more particularly, to an information processing device, a display method, and a program that display information handwritten by a user.

  In recent years, information processing apparatuses including a display device such as a touch panel on which a user can input by handwriting have been widely distributed. When a user inputs (describes) characters or the like to the display device with a finger or a stylus pen, the display device displays the input characters or the like at the input position.

  For example, Japanese Patent Laying-Open No. 2010-287032 (Patent Document 1) discloses a technique of “determining whether a user is right-handed or left-handed and determining a display position of a screen component based on the determination result”. .

JP 2010-287032 A

  In the above technique, for example, when a left-handed user inputs Japanese or English handwritten on the touch panel, the Japanese or English is generally input in the right direction. Then, since the user's hand holding the stylus pen covers the handwritten character, the user cannot visually recognize the handwritten character.

  The present invention has been made to solve such a problem, and the purpose of the present invention is to provide an image handwritten by the user even if the image handwritten by the user is covered by the user's hand or the like. An information processing apparatus, a display method, and a program for displaying the image in another area.

  An information processing apparatus according to an aspect of the present invention receives a handwritten input of an image within a display area, displays a display unit that displays an image related to the handwritten input at a position where the handwritten input is received, and a hand that performs the handwritten input Deriving means for deriving handwritten information representing right hand or left hand and the display means accepting the handwritten input of the second image at the second position after the displaying means accepts the handwritten input of the first image at the first position After the third image based on the first image is displayed at the third position at or near the end of the display area corresponding to the first direction from the first position to the second position and the handwritten information Display control means for displaying the third image at the fourth position and displaying the fourth image based on the second image at the third position, and the direction from the third position to the fourth position is the first The direction is opposite to the direction.

  Preferably, when the handwritten information represents the left hand and the first direction is the X-axis positive direction when viewed from the user, the display control means The end.

  Preferably, when the handwritten information represents the right hand and the first direction is the X-axis negative direction when viewed from the user, the display control means looks at the end of the display area on the left side when viewed from the user. The end.

  An information processing apparatus according to a different aspect of the present invention receives a handwritten input of an image within a display area, displays a display unit that displays an image related to the handwritten input at a position where the handwritten input is received, and a hand that performs the handwritten input Deriving means for deriving handwritten information representing right hand or left hand, type detecting means for detecting the type of image, and after the display means accepts handwriting input of the first image at the first position, the display means receives the second image. Is received at the second position, the first direction from the first position to the second position and the edge of the display area according to the type of image or the vicinity of the edge based on the first image Display control means for displaying the third image at the third position, then displaying the third image at the fourth position, and displaying the fourth image based on the second image at the third position; The direction from the position to the fourth position is It is a direction opposite direction.

  Preferably, the derivation means includes handwriting detection means for generating handwritten information by detecting whether a hand performing handwriting input is a right hand or a left hand.

  Preferably, the deriving means includes display means for generating handwritten information by accepting a setting of whether the hand performing handwriting input is a right hand or a left hand.

  An information processing apparatus according to a different aspect of the present invention receives a handwritten input of an image in a display area, displays an image related to the handwritten input at a position where the handwritten input is received, and a detection target on the display area After the object detecting means for detecting an object and the display means accept the handwritten input of the first image at the first position, the display means accepts the handwritten input of the second image at the second position and detected by the object detecting means. When the detected detection object faces or substantially opposes the first image and the second image, the end of the display area or the end of the end corresponding to the first direction from the first position to the second position A third image based on the first image is displayed in the vicinity, and then the display position of the third image is moved in the direction opposite to the first direction, and the second image based on the second image is located at or near the end. Display control means for displaying four images.

  Preferably, the object detection means detects the coordinates of the shadow of the detection object formed in the display area, and the display control means determines the coordinates of the first image and the second image and the coordinates of the shadow of the detection object. When the number of the same coordinates is equal to or greater than a predetermined threshold value, it is assumed that the detection target detected by the target detection unit faces or substantially faces the first image and the second image.

  Preferably, the display control means includes the plurality of images so that the positions of the plurality of images that have received handwritten input and the positions of the plurality of images based on the plurality of images are relatively the same. Each of the plurality of images based on each is displayed.

  Preferably, the display control means performs a predetermined process on the image based on the handwritten input image so that the image based on the handwritten input image does not overlap with the image based on the handwritten input image. Let

  Preferably, the predetermined process includes a process of reducing an image based on the handwritten input image in accordance with a size of the handwritten input image.

  Preferably, the predetermined process includes a process of preferentially displaying an image based on an image input by handwriting most recently.

  Preferably, when two or more lines of images are input by handwriting on the display means, the display control means displays an area in which an image based on the first handwritten input image of each line after the second line is displayed. indicate.

  Preferably, the display control means displays an image based on the image at or near the end of the display area corresponding to the position of the image input in handwriting in the Y-axis direction as viewed from the user.

  A display method according to a different aspect of the present invention is a display method that accepts handwritten input of an image in a display area and displays an image related to the handwritten input at a position where the handwritten input is accepted, A step of deriving handwritten information indicating whether the hand is a right hand or a left hand, and when the display means accepts the handwritten input of the second image at the second position after the display means accepts the handwritten input of the first image at the first position After the third image based on the first image is displayed at the third position at or near the end of the display area corresponding to the first direction from the first position to the second position and the handwritten information Displaying the third image at the fourth position and displaying the fourth image based on the second image at the third position, and the direction from the third position to the fourth position is the first direction. The reverse direction.

  A program according to a different aspect of the present invention is a program that accepts handwritten input of an image within a display area, and causes a computer to display an image related to the handwritten input at a position where the handwritten input is accepted. Deriving handwritten information indicating whether the hand performing the handwriting input is the right hand or the left hand, and after the display means accepts the handwriting input of the first image at the first position, the display means performs the handwriting input of the second image. When received at two positions, a third image based on the first image is displayed in the first direction from the first position to the second position and the edge of the display area corresponding to the handwritten information or in the vicinity of the edge. And displaying the third image at the fourth position, and displaying the fourth image based on the second image at the third position, from the third position to the fourth position. Direction in a first direction and the opposite direction.

  In an aspect, even if an image handwritten by the user is covered by a user's hand, the image handwritten by the user can be displayed in another area.

  The above and other objects, features, aspects and advantages of the present invention will become apparent from the following detailed description of the present invention taken in conjunction with the accompanying drawings.

It is the figure which showed the outline of the information processing apparatus of this embodiment. It is the figure which showed the hardware structural example of the information processing apparatus of this embodiment. It is the figure which showed the function structural example of the information processing apparatus of this embodiment. It is the figure which showed typically the set of the coordinates memorize | stored in the coordinate memory | storage part. It is the figure which showed the example of the detection method of a handwriting detection part. It is the figure which showed an example of the screen displayed on a display apparatus. It is the figure which showed an example of the screen displayed on the display apparatus of other embodiment. It is the figure which showed an example of the screen displayed on the display apparatus of other embodiment. FIG. 3 is a diagram illustrating an example of a processing flow according to the first embodiment. It is the figure which showed the function structural example of the information processing apparatus of other embodiment. It is the figure which showed an example of the operation screen. It is the figure which showed the function structural example of the information processing apparatus of other embodiment. It is the figure which showed the shadow etc. of a user's hand. It is the figure which showed an example of the conditions on which a display control part carries out assist display. It is the figure which showed the function structural example of the information processing apparatus of other embodiment. It is the figure which showed an example of the display screen of the information processing apparatus of other embodiment. It is the figure which showed an example of the processing flow of the display control part of other embodiment. It is the figure which showed an example of the display screen of the information processing apparatus of other embodiment. It is the figure which showed an example of the processing flow of the display control part of other embodiment. It is the figure which showed an example of the display screen of the information processing apparatus of other embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals, and their names and functions are also the same. Therefore, repeated description will not be repeated.

[Outline]
With reference to FIG. 1, the outline of the information processing apparatus of this embodiment will be described. FIG. 1 is a diagram schematically illustrating the information processing apparatus according to the present embodiment. In the example of FIG. 1, the user is left-handed, holds the stylus pen 202 with the left hand 204, and inputs an image by hand with the stylus pen 202 to the display unit of the information processing apparatus.

  Here, the display means of the information processing apparatus displays the handwritten input image at a position where the handwritten input is received from the user, and is, for example, a touch panel. The image includes characters, symbols, figures, and the like. In the example of FIG. 1, the image is the characters “U” and “E”. In addition to the stylus pen 202, other means may be used as long as the user can input an image by handwriting into the display area (input area) 312a. The other means is, for example, a user's finger.

  In the present embodiment, a first image 401 input by handwriting by the user is a first image 401, and a second image input by handwriting is a second image 402. In the example of FIG. 1, the first image 401 is a character “U”, and the second image 402 is a character “E”. When the user inputs the third character “O” and subsequent characters by handwriting, the second character “E” is the first image 401 and the third character “O” is the second image 402. The same applies to the fourth and subsequent characters.

  In the example of FIG. 1, the left hand 204 and the stylus pen 202 are made transparent in order to clarify the first image 401 and the second image 402.

  Also, a position where the user has input the first image 401 by handwriting with the stylus pen 202 is defined as a first position 401a. A position where the user has input the second image 402 by handwriting with the stylus pen 202 is defined as a second position 402a. In addition, a direction from the first position 401a toward the second position 402a is referred to as a “first direction α”. That is, the user inputs the first image 401 and the second image 402 by handwriting in the first direction α.

  Each of the first image 401 and the second image 402 is, for example, one independent character or symbol. In the present embodiment, the origin, x-axis, y-axis, right end, left end, right direction, and left direction shown in FIG. 1 are the origin, x-axis viewed from the user who handles the stylus pen 202 (performs handwriting input). , Y-axis, right end, left end, right direction, and left direction.

  As shown in FIG. 1, when the images to be handwritten (the first image 401 and the second image 402) are in Japanese and the user is left-handed, the user is generally viewed from the user. Then, the first image 402 and the second image 402 are input by handwriting in the positive direction α (right direction) of the X axis. Therefore, the user cannot visually recognize the image because the user's left hand 204 covers a character input before handwriting input. In the example of FIG. 1, when the image currently input by handwriting is the character “e”, “the image input by handwriting before the character the user is currently handwriting input” is “U”. Is the character.

  If the user cannot visually recognize the character handwritten recently, the efficiency of the handwriting input process may be reduced. Therefore, the information processing apparatus according to the present embodiment displays the third image 403 at the right end of the display area 312a when handwritten input of the first image 401 and the second image 402 is received. Thereafter, the third image 403 is displayed at the fourth position 404a, and the fourth image 404 is displayed at the third position 403a.

  Here, the third image 403 is based on the first image 401. In the example of FIG. 1, the third image 403 is an image having the same shape and size as the first image 401 “characters of“ U ””. The fourth image 404 is based on the second image 402. The fourth image 404 is an image having the same shape and size as the second image 402 “characters of“ E ””. Further, the direction β from the third position 403a toward the fourth position 404a is opposite to the first direction α. The third image 403 and the fourth image 404 are preferably displayed surrounded by a frame 210. This is because the user can easily distinguish between the handwritten input image (first image 401 and second image 403) and the displayed image (third image 403 and fourth image 404).

  That is, the information processing apparatus scrolls and displays, for example, the third image 403 and the fourth image 404 in the direction β every time handwritten input of the first image 401 and the second image 402 is received. Thereby, even if the first image 401 and the second image 402 are covered by the user's hand or the like, the user views the first image and the second image 402 by viewing the third image and the fourth image 404. Can be recognized. In addition, the information processing apparatus according to the present embodiment is particularly effective when handwritten input in the X-axis positive direction is received.

[Hardware configuration]
With reference to FIG. 2, the hardware configuration of the information processing apparatus 100 of the present embodiment will be described. FIG. 2 is a block diagram illustrating a hardware configuration example of the information processing apparatus 100. In the example of FIG. 2, the information processing apparatus 100 includes a CPU (Central Processing Unit) 302, a RAM (Random Access Memory) 304, a ROM (Read Only Memory) 306, and an EEPROM (Electronically Erasable and Programmable Read Only Memory) 308. A communication unit 310, a display device 312, an operation unit 314, and an external media I / F (Interface) unit 316.

  The CPU 302 performs processing based on programs and various data stored in the ROM 306. The RAM 304 temporarily stores various programs and various data read from the ROM 306. The ROM 306 stores programs and various data that are executed when the information processing apparatus 100 is activated.

  The communication unit 310 communicates with other communication devices. The operation unit 314 receives an operation from the user. The display device 312 is a display having a touch panel function, for example. Therefore, the display device 312 conceptually includes a part of the operation unit 314.

  The external media I / F unit 316 serves as an interface between the information processing apparatus 100 and an external medium 318 (for example, an SD (Secure Digital) memory card).

[Embodiment 1]
<Functional configuration example>
Next, a functional configuration example of the first embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating a functional configuration example of the first embodiment. Hereinafter, the image may be referred to as a character.

  In the example of FIG. 3, the information processing apparatus 100 </ b> A includes a display device 312, a coordinate detection unit 108, a display control unit 110, a coordinate storage unit 112, a direction detection unit 114, an acquisition unit 116, and a handwriting detection unit 106. And including. The display device 312 includes an input receiving unit 102 and a display unit 104.

  For example, the input receiving unit 102 and the display unit 104 each have a thin plate shape. The display device 312 is configured by stacking the input receiving unit 102 and the display unit 104. The display device 312 includes a display area 312a (see FIG. 1). Various information such as a first image handwritten by the user is displayed in the display area 312a. In the example of FIG. 1, the input area of the input receiving unit 102 is the display area 312a.

  The input receiving unit 102 is a panel that receives a handwriting input operation or the like of the first image 402 (see FIG. 1) with the stylus pen 202 or the like. The user performs a handwriting input operation by bringing the stylus pen 202 into contact with the input receiving unit 102. Further, the input receiving unit 102 is transparent, and the user can visually check images and information displayed on the display unit 104 arranged below the input receiving unit 102.

  When the coordinate detection unit 108 receives a handwriting input operation from the user to the input reception unit 102, the coordinate detection unit 108 determines the coordinates of the position (point) where the stylus pen 202 is touched in the display area 312a for a predetermined time (for example, 0.1 second). ) Detected every time. The coordinate detection unit 108 outputs the detected coordinates to the display control unit 110 and the recognition unit 118.

  The recognition unit 118 recognizes a character input by handwriting based on the character dictionary stored in the dictionary storage unit 111 and the plurality of coordinates output from the coordinate detection unit 108. The recognition unit 118 may use various recognition methods as the character recognition methods. For example, the recognition unit 118 recognizes a character input by handwriting by performing a pattern matching process using a plurality of coordinates and a character dictionary. Further, as the dictionary storage unit 111, for example, a ROM 306 may be used.

  The coordinate storage unit 112 stores a set of coordinates for each character recognized by the recognition unit 118. FIG. 4 is a diagram schematically showing a set of coordinates stored in the coordinate storage unit 112. A storage form of the coordinate storage unit 112 will be described with reference to FIG.

  In the example of FIG. 4, the coordinate storage unit 112 has the coordinates (8, 6) (9, 5) of the plurality of points constituting the character “u” for the character “u” as the first image. Is remembered. Further, the coordinate storage unit 112 stores the coordinate coordinates (21, 7), (22, 6),... Of the plurality of points constituting the character “e” for the character “e” that is the first image. ing. As described with reference to FIG. 1, the origin, the x-axis, and the y-axis are the origin, the x-axis, and the y-axis viewed from the user who handles the stylus pen 202.

  The display control unit 110 displays a handwriting input locus of the stylus pen 202 on the display unit 104 based on the coordinates detected by the coordinate detection unit 108. The user can recognize the first image input by handwriting by viewing the handwriting input locus (that is, the first image 402) displayed on the display unit 104. The display control unit 110 displays the handwritten input image at the position of the display unit 104 where the input receiving unit 102 has received the handwritten input.

≪Direction detection≫
Next, direction detection processing by the direction detection unit 114 will be described. The direction detection unit 114 detects the first direction α (see FIG. 1) based on the set of coordinates stored in the coordinate storage unit 112. Here, the first direction α is a direction in which an image is input by handwriting by the user. For example, in the example of FIG. 1, the first direction α is the positive direction of the X axis (right direction as viewed from the user who handles the stylus pen 202). Hereinafter, the right direction, the left direction, the upward direction, and the downward direction are all directions viewed from the user who handles the stylus pen 202.

  Further, the right direction is the positive direction of the X axis, and the left direction is the negative direction of the X axis. Further, the upward direction is the positive direction of the Y axis, and the downward direction is the negative direction of the Y axis.

  Next, a specific example of the direction detection method by the direction detection unit 114 will be described. The direction detection unit 114 acquires the maximum value Xmax1 of the X coordinate and the maximum value Ymax1 of the Y coordinate of the reference character (“U” in the example of FIG. 4). In addition, the direction detection unit 114, after the reference character, the maximum value Xmax2 of the X coordinate and the maximum value of the Y coordinate of the character recognized by the recognition unit 118 ("e" in the example of FIG. 4). Ymax2 is acquired.

  Then, the direction detection unit 114 compares Xmax1 and Xmax2. Here, when the direction detection unit 114 determines that Xmax1 ≦ Xmax2, the direction detection unit 114 determines that the first direction is the right direction. On the other hand, when the direction detection unit 114 determines that Xmax1> Xmax2, the direction detection unit 114 determines that the first direction is the left direction.

  In addition, the direction detection unit 114 compares Ymax1 and Ymax2. If the direction detection unit 114 determines that Ymax1 ≦ Ymax2, the direction detection unit 114 determines that the first direction is the upward direction. On the other hand, when the direction detection unit 114 determines that Ymax1> Ymax2, the direction detection unit 114 determines that the first direction is the downward direction.

  In addition, the direction detection unit 114 acquires the average value Xavg1 of the X coordinate and the average value Yavg1 of the Y coordinate of the reference character. In addition, the direction detection unit 114 acquires the average value Xavg2 of the X coordinate and the average value Yavg2 of the Y coordinate of the character input by handwriting next to the reference character.

  Then, the direction detection unit 114 compares Xavg1 and Xavg2. Here, when the direction detection unit 114 determines that Xavg1 ≦ Xavg2, the direction detection unit 114 determines that the first direction is the right direction. On the other hand, when the direction detection unit 114 determines that Xavg1> Xavg2, the direction detection unit 114 determines that the first direction is the left direction.

  In addition, the direction detection unit 114 compares Yavg1 and Yavg2. When the direction detection unit 114 determines that Yavg1 ≦ Yavg2, the direction detection unit 114 determines that the first direction is the upward direction. On the other hand, when the direction detection unit 114 determines that Yavg1> Yavg2, the direction detection unit 114 determines that the first direction is the downward direction.

  The first direction α (see FIG. 1) can be detected by the direction detection method of the direction detection unit 114. The direction detection unit 114 detects the first direction and generates direction information representing the first direction. The generated direction information is output to the display control unit 110.

≪Handwritten information≫
Next, handwritten information will be described. The handwritten information is information representing the hand holding the stylus pen 202 of the right hand or the left hand. Hereinafter, a method for generating the handwritten information will be described. Further, in this specification, when the handwritten information is information representing the right hand, it is referred to as “the user is right-handed”, and when the handwritten information is information representing the left hand, “the user is left-handed”. May be mentioned.

  In the present embodiment, the handwriting detection unit 106 detects the position of the user's hand on the display area 312a. Here, “on the display area 312a” may mean that the user's hand is in contact with the display area 312a, or the user's hand is far from the display area 312a.

  Further, as a method for detecting the position of the user's hand, for example, when infrared rays or ultrasonic waves are used for the probe, the handwriting detection unit 106 is arranged around the display device 312 and the reflected waves of infrared rays and ultrasonic waves are detected. The fluctuation is detected as an electric signal.

  An example of the detection method of the handwriting detection unit 106 will be described with reference to FIG. FIG. 5 is a diagram illustrating a detection method example of the handwriting detection unit 106. In the example of FIG. 5, the handwriting detection unit 106 includes an infrared sensor arranged around the display area 312a. The sensor area of the infrared sensor is divided into a right half and a left half. The left half area is referred to as area 106a, and the right half area is referred to as area 106b.

  By detecting an infrared reflected wave with the infrared sensor, it is understood that the user's hand is on the infrared sensor. The handwriting detection unit 106 determines whether the detection signal of the reflected wave from the infrared sensor is from the region 106a or the region 106b. When the handwriting detection unit 106 determines that the detection signal is from the region 106a, the handwriting detection unit 106 generates handwritten information indicating that the user's hand holding the stylus pen 202 is the left hand. On the other hand, when the handwriting detection unit 106 determines that the detection signal is from the region 106b, the handwriting detection unit 106 generates handwritten information indicating that the user's hand holding the stylus pen 202 is the right hand. To do.

  As another detection method, the handwriting detection unit 106 includes an imaging device, and performs image processing on an image captured by the imaging device. The handwriting detection unit 106 detects the position of the user's hand based on the image processing result.

  As another detection method, the handwriting detection unit 106 may be an optical sensor liquid crystal. The optical sensor liquid crystal will be briefly described. The display device 312 includes an optical sensor in addition to a driving circuit in each pixel. The handwriting detection unit 106 detects the position of the user's hand on the display area 312a by detecting the shadow of the user's hand.

  As another detection method, an inclination detection unit (for example, an inclination detection sensor or an acceleration sensor) that detects the direction in which the stylus pen 202 is inclined may be included. The handwriting detecting unit 106 receives the tilt direction detected by the tilt detecting unit from the stylus pen 202 during the input operation of the stylus pen 202. Then, the handwriting detection unit 106 generates handwritten information based on the tilt direction. When the handwriting detection unit 106 detects that the stylus pen 202 is tilted to the left, the user generates handwritten information indicating that the stylus pen 202 is held with the left hand. Further, when the handwriting detection unit 106 detects that the stylus pen 202 is tilted to the right, the user generates handwritten information indicating that the stylus pen 202 is held with the right hand.

  The handwriting information generation method by the handwriting detection unit 106 is not limited to these, and other generation methods may be used.

  The acquisition unit 116 acquires the handwritten information generated by the handwriting detection unit 106. When acquiring the handwritten information, the acquiring unit 116 outputs the handwritten information to the display control unit 110.

≪Display mode≫
Next, display modes of the third image 403 and the fourth image 404 by the display control unit 110 will be described with reference to FIG. As described above, the third image 403 and the fourth image 404 are based on the first image 401 and the second image 402, respectively. In the following, displaying the third image 403 and the fourth image 404 as shown in FIG. 1 is referred to as “assist display”. In addition, an image handwritten by the user is set as an input image. That is, the input image includes the first image 401 and the second image 402. In addition, an assist display image is set as an assist display image. That is, the assist display image includes the third image 403 and the fourth image 404.

  As shown in FIG. 6A, it is assumed that the user inputs the first first image “U” by handwriting on the display device 312 with the stylus pen 202. In this case, when the user starts to input the first image 401 “U” by handwriting, the acquiring unit 116 acquires handwritten information. In this case, the acquisition unit 116 acquires handwritten information indicating that the user holds the stylus pen 202 with the left hand.

  Then, the coordinate detection unit 108 detects the coordinates touched by the stylus pen 202 when the user performs handwriting input. Then, the recognition unit 118 recognizes that the character “u” has been input by handwriting by performing character recognition. Then, the recognition unit 118 outputs a first recognition signal indicating that the first image 401 has been recognized to the display control unit 110.

  Next, it is assumed that the user inputs “e”, which is the second image 402 (second image), by handwriting. In this case, the direction detecting unit 114 detects the first direction α of the user while the user is inputting “e” by handwriting. In the example of FIG. 6, the X coordinate of the point at the beginning of handwriting input of “E” is larger than the maximum X coordinate among a plurality of points constituting “U”. Therefore, the direction detection unit 114 generates direction information indicating that the first direction is the right direction, and transmits the direction information to the display control unit 110.

  The display control unit 110 determines the start point 210a for assist display based on the direction information. The display control unit 110 determines the end of the display area 312a according to the direction information and the handwritten information.

  Details of the edge determination method of the display control unit 110 will be described with reference to FIG. As shown in FIG. 6B, the center of gravity of the first position 401a (the position where the handwriting input of the first image 401 is accepted and the display position of the first image 401) is defined as a first center of gravity 401b. The center of gravity of the second position 402a (the position where the handwriting input of the second image 402 is accepted and the display position of the second image 402) is defined as a second center of gravity 402b.

  The display control unit 110 includes an end portion (in the example of FIG. 6B, the end portion 312c that intersects the straight line L from the first centroid 401b to the second centroid 402b among the left and right ends 312b and 312c of the display region 312a. ) Is determined as the assist display position.

  Here, when the direction information is the direction information indicating the right direction and the handwritten information is the handwritten information indicating the left hand, the starting point of the assist display is the right end of the display area 310a. This is because, as shown in FIG. 1, when a left-handed user (that is, a user holding the stylus pen 202 with his left hand) inputs characters or the like in the right direction by handwriting, the user is assisted and displayed from the right end. This is because the assist display can be easily seen while inputting the first image by handwriting.

  When the display control unit 110 determines the start point 210a for assist display, the display control unit 110 displays the end 210b of the frame 210 at the determined start point 210a. Thereby, the user can clearly recognize the place where the assist display is performed.

  Next, as illustrated in FIG. 6C, the display control unit 110 uses the first image 401 that has been input by handwriting most recently while the user is inputting the second image 402 “e” by handwriting. The character “U”, which is the third image 403 based on “U”, is displayed in an assist manner. The assist display direction β is opposite to the first direction α. Note that the first direction α is detected by the direction detection unit 114.

  As shown in FIG. 6C, the “U” character that the user recently input by handwriting is covered by the user's hand, and the user cannot see the “U” character. Therefore, as in the present embodiment, by assisting the display of the character “U”, the user can recognize that the character input by handwriting is “U”.

  Next, as illustrated in FIG. 6D, the user finishes handwriting input “e”, which is the second image 402, and in the middle of handwriting input of the third image “U”, the display control unit 110. Displays an assist display of the fourth image 404 based on “e”, which is the second image 402 most recently input by handwriting, at the third position 403a. In addition, the display control unit 110 assists and displays the third image 403 at the fourth position 404a. As described above, the direction β from the third position 403a toward the fourth position 404a is opposite to the first direction α.

  Here, as the display mode of the third image 403 and the fourth image 404 when the display control unit 110 transitions from the state of FIG. 4C to the state of FIG. 4D, for example, there are two display modes. is there.

  As a first display mode, the display control unit 110 moves the third image 403 from the third position 403a to the fourth position 404a while maintaining the display of the third image 403 (the character “U”). . At the same time, the display control unit 110 displays the fourth image 404 at the third position 403a. That is, the display control unit 110 scrolls the third image 403 and the fourth image 404 in the direction β.

  As a second display mode, the display control unit 110 hides the third image 403 displayed at the third position 403a and displays the third image 403 at the fourth position 404a. At the same time, the display control unit 110 displays the fourth image 404 at the third position 403a.

  Thereby, whenever the user inputs the input image by handwriting, an assist display image based on the input image is displayed. Therefore, even if the input image is covered by the user's hand and the input image cannot be recognized, the user can recognize the input image input by handwriting by viewing the assist display image.

  In addition, when the input reception unit 102 completes the reception of the second image 402 and receives the next image “character“ u ”in the example of FIG. 6D”, the character “e” is the first image. The display control unit 110 performs the above-described processing, assuming that the character “u” is “second image 402”.

  The display modes of the first image 401, the second image 402, the third image 403, and the fourth image 404 will be described using natural numbers N and M. 6C and 6D, the Nth image corresponds to the first image 401, the N + 1th image corresponds to the second image 402, the Nth position corresponds to the first position 401a, and the N + 1th position. Corresponds to the second position 402a. The Mth image corresponds to the third image 403, the M + 1th image corresponds to the fourth image 404, the Mth position corresponds to the third position 403a, and the M + 1th position corresponds to the fourth position 404a. The first direction α is a direction from the Nth position toward the (N + 1) th position.

  While the input receiving unit 102 receives the handwriting input of the Nth image and the handwriting input of the (N + 1) th image, the display control unit 110 displays the Mth image (the third image 403 as an image based on the Nth image). Assist) is displayed at the Mth position (corresponding to the third position). In addition, while the input reception unit 102 has completed the reception of the handwriting input of the (N + 1) th image (corresponding to the fourth image 404) and the handwriting input of the (N + 2) th image is being received, the display control unit 110 displays the (N + 1) th image. The M + 1th image (corresponding to the third image 403), which is an image based on the above, is assisted displayed at the Mth position (corresponding to the third position).

  When the input receiving unit 102 receives handwritten input of the Nth image to N + n (where n is a natural number) image, the display control unit 110 displays the Mth image to the Nth image based on the Nth image to the N + n. Assist display of M + n image. The straight line direction α (first direction) from the Nth position where the handwriting input of the Nth image is accepted to the N + n position where the handwriting input of the N + n image is accepted is the Mth image displayed. The direction β is opposite to the direction β from the M position toward the M + n position where the M + n image is displayed.

≪Assist display after the second line≫
In the following, as shown in FIG. 6E, images input by handwriting by the user (that is, the first image 401 and the second image 402) are collectively referred to as an “input image 4001”, and assistance is performed based on the input image. The displayed images are collectively referred to as “assist display image 4002”.

  Next, as shown in FIG. 6E, a process performed by the display control unit 110 and the like when the user draws the input image 4001 downward will be described. As illustrated in FIG. 6E, when the user inputs “A”, which is the input image 4001, in the downward direction, the direction detection unit 114 detects that the first direction α is the downward direction. Then, the display control unit 110 assists and displays the character “A” as the second image.

  Here, as shown in FIG. 6E, the display control unit 110 is arranged so that the positions of the plurality of input images 4001 and the positions of the plurality of assist display images 4002 are relatively the same. The assist display image 4002 is displayed as an assist. Therefore, the user can recognize the positional relationship between the plurality of input images even when the input image 4001 has a plurality of lines.

≪Cursor display≫
In the following description, an area where the assist display image 4002 is displayed (that is, an area within the frame 210) is referred to as an assist display area 208a. Next, the case where the input image 4001 (see FIG. 6E) on the second and subsequent lines is input by handwriting with the stylus pen 202 will be described. As shown in FIG. 6F, when the input image 4001 “A” on the second and subsequent lines is input by handwriting, the display control unit 110 displays the first input image 4001 on each line on and after the second line. An area (hereinafter referred to as “cursor”) 208b in which an assist display image 4002 based on the above is displayed is displayed. When the user visually inputs the second and subsequent lines by visually recognizing the cursor 208b, the position where the assist display image 4002 corresponding to the first input image 4001 input by handwriting is displayed on each of the second and subsequent lines. Can be recognized.

  The cursor 208b will be further described. The first handwritten input point for the first input image 4001 (in the example of FIGS. 6E and 6F, “A” in FIG. 6E and FIG. 6F) input by handwriting in the second and subsequent lines is set as the start point 206a. The display control unit 110 acquires the coordinates of the start point 206a from the coordinate detection unit 108. Then, the display control unit 110 grasps the position of the start point 206a with respect to characters that have already been input by handwriting (in the example of FIG. 6F, the characters “U, E, U”). The display control unit 110 then recognizes the relative position of the start point 206a that has been grasped in the assist display image 4002 that is already displayed (in the example of FIG. 6F, the characters “U, E, U”). An area including a point 208c at the same position (hereinafter referred to as "same point") is defined as a cursor 208b.

  The acquisition unit 116 acquires handwritten information indicating that the user is holding the stylus pen 202 with the left hand, and the direction detection unit 114 detects the first direction indicating the right direction and the downward direction. Therefore, there is a high possibility that the user performs handwriting input from the start point 206a in the right direction and the downward direction. Accordingly, the cursor 208b having the same point 208c as the upper left corner is displayed. The display control unit 110 may make the display mode of the cursor 208b different from the display mode of other areas. For example, the display control unit 110 blinks the cursor 208b. Thereby, the user can easily recognize the position where the assist display image 4002 is displayed.

  Next, the size (area) of the cursor 208b will be described. The display control unit 110 derives the area of an area (hereinafter referred to as “occupied area”) occupied by each character that has already been input by handwriting. FIG. 6G is a diagram showing an example of the occupied area for the character “U”. The display control unit 110, from the coordinate storage unit 112, for a plurality of points constituting the character “U”, the point 206g where the X coordinate is the maximum value, the point 206i where the X coordinate is the minimum value, and the Y coordinate are the maximum value The X coordinate and the Y coordinate of the point 206f and the point 206h where the Y coordinate is the minimum value are acquired.

  In the straight line passing through the point 206g and the straight line passing through the point 206i, the straight lines parallel to each other are defined as straight lines 206gL and 206iL. In addition, in the straight line passing through the point 206f and the straight line passing through the point 206h, the straight lines parallel to each other are referred to as straight lines 206fL and 206hL. The display control unit 110 derives a rectangular area surrounded by these four straight lines 206gL, 206iL, 206fL, and 206hL as the area of the occupied region.

  The display control unit 110 derives the area of the occupied area of each character that has already been input by handwriting, and obtains an average value thereof. The display control unit 110 sets the obtained average value as the area of the cursor 208b.

≪Y-axis position of assist display≫
Next, as shown in FIG. 7, it is assumed that the user inputs an input image 4001 by handwriting on the upper part of the display area 312a. In this case, in view of the visibility of the user's assist display, the display control unit 110 displays the assist in the lower part.

  For example, the display control unit 110 detects the coordinates of each set of points of the input image 4001 detected by the coordinate detection unit 108. The display control unit 110 calculates the average value of the Y coordinates among the coordinates. Then, the display control unit 110 compares the average value with a predetermined threshold value. When the display control unit 110 determines that the average value is equal to or greater than the threshold value, it means that the input image 4001 has been input by handwriting upward, so the display control unit 110 displays the assist display image 4002 downward. (State shown in FIG. 7). When the display control unit 110 determines that the average value is less than the threshold value, it means that the input image 4001 has been input by handwriting downward, so the display control unit 110 moves the assist display image 4002 upward. Is displayed (state shown in FIG. 1).

  In this way, the display control unit 110 displays the assist display image 4002 at or near the end of the display area 312a corresponding to the position (Y coordinate) of the input image 4001 in the Y-axis direction. Therefore, even if the user inputs the input image 4001 by handwriting on the upper part of the display area 312a, the assist display is performed on the lower part, so that the user can easily recognize the assist display.

≪When the user is right-handed and the first direction is the left direction≫
Next, a case where the user is right-handed and the first direction is the left direction will be described with reference to FIG. FIG. 8 is a diagram illustrating that the user inputs Arabic handwritten as the input image 4001. In general, when a right-handed user inputs, for example, Arabic by handwriting, the first direction α is the left direction.

  In this case, the acquisition unit 116 acquires handwritten information indicating that the user holds the stylus pen 202 with the right hand. In addition, the direction detection unit 114 detects that the first direction α is the left direction. Then, the display control unit 110 determines the left end of the display area as the start point of the assist display as the end corresponding to the description information at the end of the display area 312a. The display control unit 110 assists and displays the Arabic language input by handwriting in the direction β every time the user inputs one Arabic character by handwriting.

  As described above, the display control unit 110 displays the handwritten information as information indicating that the user holds the stylus pen 202 with the right hand, and the first direction α is the left direction or the substantially left direction. Then, an assist display image 4002 is displayed.

≪Process flow≫
Next, the flow of processing of the information processing apparatus according to the first embodiment will be described with reference to FIG. FIG. 9 is a diagram illustrating an example of a processing flow according to the first embodiment. The processing flow of FIG. 9 shows a case where the input image 4001 is in Japanese or English.

  In step S <b> 2, the display control unit 110 determines whether or not the handwritten information acquired by the acquisition unit 116 is information indicating that the user holds the stylus pen 202 with the left hand. If the display control unit 110 determines that the handwritten information is information indicating that the user holds the stylus pen 202 with the right hand (NO in step S2), the process ends without displaying an assist. On the other hand, when the display control unit 110 determines that the handwritten information is information indicating that the user holds the stylus pen 202 with the left hand (YES in step S2), the process proceeds to step S4.

  In step S4, the display control unit 110 sets the setting mode to the left-handed mode. In step S6, the display control unit 110 prepares for assist display (see FIG. 6A).

  In step S <b> 8, the recognition unit 118 recognizes characters in the input image 4001 (that is, the first image 401) that is initially input by handwriting, and then stores the contact coordinates of the stylus pen 202 in the coordinate storage unit 112.

  In step S10, the recognizing unit 118 determines whether or not the character input by handwriting by the user is one character by recognizing the character. If the recognition unit 118 determines that the character handwritten by the user is not one character (NO in step S10), the process returns to step S4. When recognizing unit 118 determines that the character handwritten by the user is one character (YES in step S10), the process proceeds to step S12.

  In step S12, the display control unit 110 copies one character (first image) recognized by the recognition unit 118 in step S10.

  In step S <b> 14, the display control unit 110 acquires the first direction α detected by the direction detection unit 114. The display control unit 110 detects whether the first direction α is rightward or leftward. If the detection result is rightward (YES in step S14), the process proceeds to step S16. If the detection result is leftward (NO in step S14), the process proceeds to step S20.

  In step S16, the CPU 302 increments the X coordinate of the reference character by one character. The reference character is used for the direction detection unit 114 to detect the first direction.

  In step S18, as illustrated in FIG. 1, the display control unit 110 assists and displays an assist display image 4002 based on the input image 4001 copied in step S12 from the right end to the left.

  In step S <b> 20, the coordinate detection unit 108 determines whether the stylus pen 202 is not in contact with the input receiving unit 102. If the coordinate detection unit 108 determines that contact has been lost (YES in step S20), the process proceeds to step S22. On the other hand, when the coordinate detection unit 108 determines that the stylus pen 202 is in contact with the input receiving unit 102 (NO in step S20), the process proceeds to step S26.

  In step S <b> 22, the CPU 302 determines whether or not a predetermined time (for example, 2 seconds) has elapsed since the coordinate detection unit 108 determined that contact has been lost. The CPU 302 repeats the determination until a predetermined time elapses after the coordinate detection unit 108 determines that the contact is not made (NO in step S22). If the CPU 302 determines that a predetermined time has elapsed since the coordinate detection unit 108 determined that contact has not occurred, the process proceeds to step S24.

  In step S <b> 24, the coordinate detection unit 108 determines whether the stylus pen 202 is not in contact with the input receiving unit 102. If it is determined that the coordinate detection unit 108 remains non-contact (YES in step S24), the process proceeds to step S32. On the other hand, when the coordinate detection unit 108 determines that the stylus pen 202 is in contact with the input receiving unit 102 (NO in step S24), the process proceeds to step S26.

  In step S26, the display control unit 110 acquires the first direction α detected by the direction detection unit 114. The display control unit 110 detects whether the first direction α is upward or downward. If the detection result is upward (NO in step S26), the process returns to step S14. If the detection result is downward (YES in step S26), the process proceeds to step S28.

  In step S28, the CPU 302 increments the Y coordinate of the reference character by -1 character.

  In step S30, the display control unit 110 performs assist display of two lines (see FIG. 6E).

  In step S32, the display control unit 110 ends the assist display (deletes the assist display). The determination of YES in step S24 means that the user has finished the handwriting input process. In addition, the determination of NO in step S24 means that the user has input a new character by handwriting.

≪Summary≫
The information processing apparatus according to the present embodiment assists and displays the assist display image 4002 corresponding to the input image 4001 in the opposite direction β to the first direction α from the end corresponding to the first direction α at the end of the display area 312a. The end corresponding to the first direction α is the right end of the display area 312a when the first direction α is the right direction, and the left end of the display area 312a when the first direction α is the left direction. It is. Therefore, the user can recognize the input image 4001 by visually recognizing the assist display image 4002 even if the input image 4001 input by handwriting most recently is covered with a hand and cannot be visually recognized.

[Embodiment 2]
Next, Embodiment 2 will be described. FIG. 10 is a diagram illustrating a functional configuration example of the information processing apparatus 100B according to the second embodiment. FIG. 10 differs from FIG. 3 in that an operation reception unit 120 is added. In the first embodiment, the handwriting detection unit 106 detects whether the hand holding the stylus pen 202 is the right hand or the left hand by detecting the user's hand or the like. In the second embodiment, the operation receiving unit 120 receives an input from the user as to whether the user is right-handed or left-handed.

  The operation reception unit 120 will be described with reference to FIG. FIG. 11 is a diagram illustrating an example of the operation screen 3120 according to the second embodiment. The display device 312 displays the operation screen 3120. Operation screen 3120 includes left-handed key 3120a and right-handed key 3120b. These keys can be touched by the user.

  The user touches a key corresponding to his / her handwriting. The operation reception unit 120 generates handwritten information corresponding to the touched key. The acquisition unit 116 acquires the handwritten information generated by the operation reception unit 120.

  In the example of FIG. 11, the operation screen displayed on the display device 312 has been described. However, the user may select handwriting with a hard key (not shown).

  The derivation unit 122 includes at least one of the operation reception unit 120 and the handwriting detection unit 106. That is, the derivation unit 122 detects handwritten information.

  In the information processing apparatus according to the second embodiment, the acquisition unit 116 can acquire handwritten information by allowing the user to select handwriting without the detection process of the handwriting detection unit 106.

[Embodiment 3]
Next, the information processing apparatus 100C according to the third embodiment will be described with reference to FIG. FIG. 12 is a functional configuration example of the information processing apparatus 100C according to the third embodiment. 12 differs from FIG. 3 in that the acquisition unit 116, the handwriting detection unit 106, and the display control unit 110 are replaced with the acquisition unit 130, the object detection unit 150, and the display control unit 140, respectively.

  In the first embodiment, the display control unit 110 performs assist display based on the first direction detected by the direction detection unit 114 and the handwritten information acquired by the acquisition unit 116. The display control unit 140 according to the third embodiment detects a target detection object existing on the display area 312a without using handwritten information, and performs assist display based on the detection result and the first direction.

  The configuration of the object detection unit 150 is roughly the same as that of the handwriting detection unit 106 (see, for example, FIG. 5). Therefore, the object detection unit 150 can detect the detection object 500. The detection target object 500 is, for example, the stylus pen 202 and the user's hand.

  The object detection unit 150 transmits the detection result to the acquisition unit 130. Here, preferably, the detection result includes coordinates where the detection target object 500 is in contact with the display area 312a and coordinates of a shadow of the detection target object 500 formed in the display area 312a. FIG. 13 is a diagram showing a shadow 204a of the user's hand 204 and the like.

  The object detection unit 150 detects the coordinates (a set of coordinates) of the stylus pen 202 and the user's hand shadow 204a shown in FIG. Then, the object detection unit 150 transmits the coordinates to the acquisition unit 130. The acquisition unit 130 acquires the transmitted set of coordinates C1. The acquisition unit 130 transmits the acquired set of coordinates to the display control unit 140.

  In addition, the display control unit 140 acquires from the coordinate storage unit 112 a set of coordinates C2 constituting the input image 4001 input by handwriting. Then, based on the coordinate set C1 acquired from the acquisition unit 130 and the set of coordinates C2 acquired from the coordinate storage unit 112, the display control unit 140 causes the first image and the detection target 500 to face each other or substantially. It is determined whether or not they are facing each other.

  Specifically, the display control unit 140 compares the coordinate set C1 and the coordinate set C2, and if the number of identical coordinates is equal to or greater than a predetermined threshold, the first image and the detection target object 500 is opposed or substantially opposed. On the other hand, if the number of the same coordinates is less than the threshold value, the display control unit 140 determines that the first image and the detection target object 500 are not opposed to each other.

  When the input image 4001 and the detection target object 500 are opposed or substantially opposed to each other, the user cannot visually check the input image 4001. Therefore, in this case, the display control unit 140 assists and displays the second image corresponding to the input image 4001.

  Further, the method for determining the start position of the assist display is the same as in the first embodiment, and thus the description thereof is omitted.

  According to the information processing apparatus 100C of the third embodiment, when the display control unit 140 determines that the input image 4001 and the detection target object 500 are opposed or substantially opposed to each other, the display control unit 140 displays the display area. Assist display is performed in the direction β opposite to the first direction α from the end corresponding to the first direction α. This method has the same effect as that of the first embodiment without generating handwritten information.

[Embodiment 4]
FIG. 14 is a diagram illustrating a functional configuration example of the information processing apparatus 100D according to the fourth embodiment. 14 is different from FIG. 3 in that the acquisition unit 116 and the display control unit 110 are replaced with the acquisition unit 230 and the display control unit 240, respectively, and a language detection unit 250 is added. Different from 3.

  In the fourth embodiment, when the input image 4001 is a language, the display control unit 240 performs assist display based on the type of language and the first direction α. FIG. 15 is a diagram illustrating an example of conditions for assist display by the display control unit 240.

  As shown in FIG. 15, when the user is left-handed and the language is Japanese or English, the language handwritten by the user's hand is covered as shown in FIG. Therefore, the display control unit performs assist display.

  In addition, when the user is right-handed and the language is Arabic, the language handwritten by the user's hand is covered as shown in FIG. Accordingly, the display control unit 240 performs assist display.

  The language detection unit 250 detects the language type recognized by the recognition unit 118. As the language type detection method of the language detection unit 250, for example, a pattern matching method may be used. The language type detected by the language detection unit 250 is output to the display control unit 240.

  The display control unit 240 performs assist display based on the handwritten information output from the acquisition unit 230 and the language type output from the language detection unit 250.

  According to the information processing apparatus 100D of the fourth embodiment, the same effect as that of the first embodiment is obtained without detecting the first direction.

[Embodiment 5]
With reference to FIG. 16, the information processing apparatus of Embodiment 5 is demonstrated. FIG. 16 is an example of a display screen of the information processing apparatus according to the fifth embodiment. When the user performs large handwriting input on the input image 4001, the input image 4001 and the assist display image 4002 are superimposed, making it difficult for the user to see the assist display image 4002. Therefore, as illustrated in FIG. 16, the information processing apparatus according to the fifth exemplary embodiment reduces and displays the second image according to the size of the area of the first image.

  In the following description, the functional configuration example is illustrated in FIG. 3, but may be functional configuration examples illustrated in other drawings. Hereinafter, the area where the input image 4001 is displayed is referred to as a first image area 510, and the area where the assist display image 4002 is displayed is referred to as a second image area 512.

  With reference to FIG. 17, the content of the process of the display control unit 110 will be described. FIG. 17 is a diagram illustrating an example of a processing flow of the display control unit 110 according to the fifth embodiment.

  In step S102, the display control unit 110 determines whether or not it is estimated that the input image 4001 and the assist display image 4002 are superimposed. Alternatively, the display control unit 110 determines whether or not the input image 4001 and the assist display image 4002 are superimposed. The superimposition of the input image 4001 and the assist display image 4002 is performed based on the coordinates of a plurality of points constituting the input image 4001 and the coordinates of the plurality of points constituting the assist display image 4002.

  In step S102, if display control unit 110 determines that input image 4001 and assist display image 4002 are superimposed (YES in step S102), the process proceeds to step S104. On the other hand, when display control unit 110 determines that input image 4001 and assist display image 4002 do not overlap (NO in step S102), the process proceeds to step S108.

  In step S104, the display control unit 110 calculates the area (for example, the number of dots) of the first image region 510.

  In step S <b> 106, the display control unit 110 reduces the font size of the assist display image 4002 according to the area of the first image region 510. For example, the coefficient r corresponding to the area of the first image region 510 is determined in advance when the information processing apparatus is manufactured. As a method of determining the coefficient r, the coefficient r is determined so as not to be superimposed on the input image 4001 when the second image is assisted displayed with a font size multiplied by the coefficient r. The display control unit 110 multiplies the font size of the assist display image 4002 (that is, the font size of the first image) by the coefficient r. Then, the display control unit 110 assists and displays the assist display image 4002 with the font size multiplied by the coefficient r.

  On the other hand, in step S108, the display control unit 110 assists and displays the assist display image 4002 without changing the font size of the assist display image 4002.

  In step S102, the display control unit 110 may determine whether or not the input image 4001 and the assist display image 4002 have already been superimposed. When the display control unit 110 determines that the input image 4001 and the assist display image 4002 are superimposed, it immediately performs the processes of steps S104 and S106.

  The information processing apparatus according to the fifth embodiment can assist display the assist display image 4002 without superimposing the input image 4001 and the assist display image 4002.

[Embodiment 6]
With reference to FIG. 18, the information processing apparatus of Embodiment 6 is demonstrated. FIG. 18 is an example of a display screen of the information processing apparatus according to the sixth embodiment. When the user performs large handwriting input on the input image 4001, the input image 4001 and the assist display image 4002 are superimposed, making it difficult for the user to see the assist display image 4002.

  Therefore, when the input image 4001 and the assist display image 4002 overlap each other, the display control unit 110 according to the sixth embodiment preferentially displays an image based on the most recently handwritten input image. . In the example of FIG. 18, the display control unit 110 preferentially displays the most recently handwritten input image “Put. The transportation means is a train.” In other words, the display control unit 110 erases and displays all of the “Today's weather is sunny.” And a part of “I will go shopping now.” Yes.

  With reference to FIG. 19, the content of the process of the display control part 110 is demonstrated. FIG. 19 is a diagram illustrating an example of a processing flow of the display control unit 110 according to the sixth embodiment.

  In step S102, the display control unit 110 determines whether or not it is estimated that the input image 4001 and the assist display image 4002 are superimposed when the input image 4001 and the assist display image 4002 are displayed in the same size. To do. Alternatively, the display control unit 110 determines whether or not the input image 4001 and the assist display image 4002 are superimposed.

  In step S102, when the display control unit 110 determines that the input image 4001 and the assist display image 4002 are superimposed (YES in step S102), the process proceeds to step S110. On the other hand, when display control unit 110 determines that input image 4001 and assist display image 4002 do not overlap (NO in step S102), the process proceeds to step S108.

  In step S110, the display control unit 110 preferentially displays the assist display image 4002 based on the input image 4001 input by handwriting most recently. Further, the display control unit 110 may fix the size of the second image area 512 in which the assist display image 4002 is displayed.

  In step S102, the display control unit 110 may determine whether the input image 4001 and the assist display image 4002 are superimposed. In this case, after determining that the input image 4001 and the assist display image 4002 are superimposed, the display control unit 110 preferentially displays the assist display image 4002 based on the input image 4001 input by handwriting most recently.

  The information processing apparatus according to the sixth embodiment can assist display the assist display image 4002 without superimposing the input image 4001 and the assist display image 4002.

  In addition, the display control unit displays the input image 4001 and the assist display image 4002 so that the input image 4001 and the assist display image 4002 are not superimposed by another method, regardless of the method of the fifth and sixth embodiments. You may do it.

[Others]
As described above, it has been described that the information processing apparatus of the present embodiment performs assist display from the end of the display area. In addition, as shown in FIG. 20A, a method of displaying the assist display image 4002 as a pop-up image in an area other than the area where the input image 4001 is input by handwriting is also conceivable. However, as shown in FIG. 20B, the position where the assist display image 4002 is displayed is changed every time the position where the input image 4001 is input by handwriting is changed. Accordingly, the user needs to change the line of sight each time the display position of the assist display image 4002 is changed, and the user becomes difficult to see the assist display image 4002.

  On the other hand, in the information processing apparatus according to the present embodiment, since the starting point of the assist display is fixed, the user can easily see the assist display as compared with FIG.

  The information processing apparatus of the present invention is realized by a CPU and a program executed on the CPU. The program for realizing the present invention can be stored in a computer-readable recording medium such as a semiconductor memory, a hard disk, a CD-ROM, a DVD, or the like, provided by being recorded on these recording media, or a communication interface. It is provided by transmission / reception using a network.

  In addition, the embodiment disclosed this time is illustrative in all points and is not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

  102 input accepting unit, 104 display unit, 106 handwriting detection unit, 108 coordinate detection unit, 110 display control unit, 111 dictionary storage unit, 112 coordinate storage unit, 114 direction detection unit, 116 acquisition unit, 118 recognition unit, 120 operation unit , 122 Deriving unit, 150 Object detecting unit, 202 Stylus pen.

Claims (16)

Display means for receiving handwritten input of an image in a display area, and displaying an image related to the handwritten input at a position where the handwritten input is received;
Deriving means for deriving handwritten information indicating whether the hand performing handwriting input is the right hand or the left hand;
After the display means accepts the handwritten input of the first image at the first position, and when the display means accepts the handwritten input of the second image at the second position, the second position from the first position to the second position. The third image based on the first image is displayed at the third position at or near the end of the display area corresponding to the one direction and the handwritten information, and then the third image is set at the fourth position. Display control means for displaying and displaying a fourth image based on the second image at the third position;
The information processing apparatus, wherein a direction from the third position to the fourth position is opposite to the first direction.   When the handwritten information represents the left hand and the first direction is the positive X-axis direction when viewed from the user, the display control means is on the right side when viewing the end of the display area from the user. The information processing apparatus according to claim 1, wherein the information processing apparatus is an end of the information processing apparatus.   When the handwritten information represents a right hand and the first direction is a negative X-axis direction when viewed from the user, the display control means is a left side when viewing the end of the display area from the user. The information processing apparatus according to claim 1, wherein the information processing apparatus is an end of the information processing apparatus. Display means for receiving handwritten input of an image in a display area, and displaying an image related to the handwritten input at a position where the handwritten input is received;
Deriving means for deriving handwritten information indicating whether the hand performing handwriting input is the right hand or the left hand;
Type detecting means for detecting the type of the image;
After the display means accepts the handwritten input of the first image at the first position, and when the display means accepts the handwritten input of the second image at the second position, the second position from the first position to the second position. After the third image based on the first image is displayed at the third position at or near the end of the display area according to one direction and the type of the image, the third image is displayed at the fourth position. And display control means for displaying a fourth image based on the second image at the third position,
The information processing apparatus, wherein a direction from the third position to the fourth position is opposite to the first direction.   The information processing apparatus according to claim 1, wherein the derivation means includes handwriting detection means for generating the handwritten information by detecting whether a hand performing handwriting input is a right hand or a left hand.   The information processing apparatus according to claim 1, wherein the deriving unit includes a display unit that generates the handwritten information by accepting a setting of whether a hand performing handwriting input is a right hand or a left hand. Display means for receiving handwritten input of an image in a display area, and displaying an image related to the handwritten input at a position where the handwritten input is received;
Object detection means for detecting a detection object on the display area;
After the display means accepts the handwritten input of the first image at the first position, the display means accepts the handwritten input of the second image at the second position, and the detected object detected by the object detecting means is In the case where the first image and the second image are opposed or substantially opposed to each other, the end of the display area corresponding to the first direction from the first position to the second position or the vicinity of the end A third image based on the first image is displayed, and then the display position of the third image is moved in the direction opposite to the first direction, and the second image based on the second image is located near or near the end. An information processing apparatus comprising: display control means for displaying four images. The object detection means detects the coordinates of the shadow of the detection object formed in the display area,
When the number of coordinates that are the same in the coordinates of the first image and the second image and the coordinates of the shadow of the detection target is equal to or greater than a predetermined threshold, the display control means The information processing apparatus according to claim 7, wherein the detection target detected by an object detection unit is opposed to or substantially opposed to the first image and the second image.   The display control means applies each of the plurality of images so that the positions of the plurality of images that have received handwritten input and the positions of the plurality of images based on the plurality of images are relatively the same. The information processing apparatus according to claim 1, wherein each of the plurality of images based thereon is displayed.   The display control means performs a predetermined process on the image based on the handwritten input image so that the image based on the handwritten input image does not overlap with the image based on the handwritten input image. The information processing apparatus according to claim 1.   The information processing apparatus according to claim 10, wherein the predetermined process includes a process of reducing an image based on the handwritten input image according to a size of the image input by handwriting.   The information processing apparatus according to claim 10, wherein the predetermined process includes a process of preferentially displaying an image based on an image input by handwriting most recently.   The display control means displays an area in which an image based on the first handwritten input image of each line after the second line is displayed when two or more lines of the image are input by hand on the display means. The information processing apparatus according to any one of claims 1 to 12.   The display control means displays an image based on the image at or near the end of the display area corresponding to the position of the handwritten input image in the Y-axis direction as viewed from the user. The information processing apparatus according to any one of to 13. A display method that accepts handwritten input of an image in a display area and displays an image related to the handwritten input at a position where the handwritten input is received,
Deriving handwritten information indicating whether the hand performing handwriting input is a right hand or a left hand;
After the display means accepts the handwritten input of the first image at the first position, and when the display means accepts the handwritten input of the second image at the second position, the second position from the first position to the second position. The third image based on the first image is displayed at the third position at or near the end of the display area corresponding to the one direction and the handwritten information, and then the third image is set at the fourth position. And displaying a fourth image based on the second image at the third position,
The display method, wherein a direction from the third position to the fourth position is opposite to the first direction. A program that accepts handwritten input of an image in a display area, and causes the computer to display an image related to the handwritten input at a position where the handwritten input is received,
The program is stored in a computer.
Deriving handwritten information indicating whether the hand performing handwriting input is a right hand or a left hand;
After the display means accepts the handwritten input of the first image at the first position, and when the display means accepts the handwritten input of the second image at the second position, the second position from the first position to the second position. The third image based on the first image is displayed at the third position at or near the end of the display area corresponding to the one direction and the handwritten information, and then the third image is set at the fourth position. Displaying a fourth image based on the second image at the third position, and
A program in which a direction from the third position to the fourth position is opposite to the first direction.

Images