JP2013186720A - Character string selection device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a character string selection device that allows selection of a desired character string through a simple user operation.SOLUTION: A character string selection device includes an operation reception unit for receiving operation for specifying an area of a display surface on the display surface, and a character string detection unit (241) for detecting character string data corresponding to the area specified by the operation received by the operation reception unit from document data displayed on the display surface. When the character string data indicates a character string included in a unit character string composing the document data, the character string detection unit extracts the unit character string from the document data.

Description

  The present invention relates to a character string selection device, and more particularly to a character string selection device that selects a character string in a specified range from a displayed character string.

  In a tablet terminal or a multi-function mobile phone (so-called smart phone), an operation such as selecting a character string displayed on the screen and copying the selected character string can be conveniently realized by a user's finger operation.

  To select and copy a character string, press the display position of the character string you want to select with your finger or pen for a while to select a part of the character string. In addition, the user can designate a character string to be selected by performing an expansion operation or a narrowing operation so as to include the selected portion up to a desired character string portion. Thereafter, a copy operation can be performed on the designated character string.

  In Patent Document 1 (Japanese Patent Laid-Open No. 2004-78509), an operation target character is specified from a positional relationship (upper, middle, and lower part of a character string line) between a displayed character string and a stroke on a touch panel, and character operation is performed. A technique for identifying the type is described.

  Patent Document 2 (Japanese Patent Laid-Open No. 2008-269456) provides a character input device that can accurately input characters without worrying about the direction of dragging a finger. Japanese Patent Laid-Open No. 2002-259043 discloses a data processing device using a tablet device that corrects an error in position coordinates due to the tilt of the pen, detects the tilt angle of the pen, and uses it as application data. Is shown.

  Patent Document 4 (Japanese Patent Laid-Open No. 9-91281) discloses an information processing apparatus that easily and smoothly performs processing on a character string or the like displayed on a display screen. In Patent Documents 2 and 3 described above, selection of a character range using a pen or character input using a pen is not used. However, in Patent Document 4, a range can be selected using a pen. In Patent Document 4, it is determined whether or not the character string or the like has been continuously moved in a predetermined direction while being in contact with the screen from the display position, and the processing on the character string in the vicinity of the continuous movement start position is not limited. Yes.

  Japanese Patent Laid-Open No. 2010-134679 discloses a portable information processing apparatus that performs information retrieval based on a character string selected by a user. This device provides a support function that allows a user to select a desired character string easily and accurately. Specifically, a plurality of character strings that the user really wanted to select are predicted and presented.

  Patent Document 6 (Japanese Patent Application Laid-Open No. 2010-102666) provides a text or image range designation method that can be applied regardless of whether the range designation target is a text character string or an image.

  Patent Document 7 (Japanese Patent Laid-Open No. 2005-92644) describes an image selection method. Specifically, an arbitrary range in the image is selected and the selected image is captured.

JP 2004-78509 A JP 2008-269456 A JP 2002-259043 A JP-A-9-91281 JP 2010-134679 A JP 2010-102666 A JP 2005-92644 A

  In Patent Document 1, it is necessary to input strokes at the upper part, middle part, and lower part of a line of a desired character string, which requires a relatively strict operation from the user. On the other hand, in Patent Document 6, it is only necessary to specify a text or image range utilizing the characteristics of the touch panel in order to select a desired character string from the character string. The designation method is loose.

  However, in Patent Document 6, since the selection range can be specified by displaying a special translucent sheet on the screen, display of the translucent sheet is specially required, and it cannot be said to be a simple operation. .

  In any other patent document, there is no description of a method for selecting a character string specified by a range designation operation by a user.

  Therefore, an object of the present invention is to provide a character string selection device that can select a desired character string by a simple user operation.

  A character string selection device according to an aspect of the present invention includes an operation reception unit that receives an operation for designating an area on a display surface on the display surface, and operation reception from document data displayed on the display surface. A character string detection unit that detects character string data corresponding to an area designated by an operation accepted by the unit, wherein the character string detection unit includes character string data included in a unit character string constituting document data. The unit character string is extracted from the document data.

  Preferably, the character string detection unit includes character string data corresponding to a partial area having a predetermined size in an area designated by an operation received by the operation reception unit from among the document data displayed on the display surface. Is detected.

  Preferably, the character string detection unit includes a comparison unit that compares a ratio of the number of characters of the character string data with respect to the total number of characters of the unit character string and a threshold value, and the character string data is converted into the unit character string based on the comparison result. It is determined whether or not the character string is included.

  Preferably, the operation receiving unit includes an input device configured to receive one or more point input operations on the display surface, and obtains coordinate data including the coordinate value of the point at which the input operation is received by the input device. And a coordinate data acquisition unit configured to perform, and based on a plurality of coordinate data acquired by the coordinate data acquisition unit, a coordinate value of a stroke indicating a start point to an end point of input to the input device is calculated as stroke data And an area is detected from the calculated stroke data.

  Preferably, the unit character string indicates a character string of a paragraph, a character string of a sentence constituting the paragraph, a character string of a clause, or a character string of a word.

  A character string selection method according to another aspect of the present invention includes a step of accepting an operation for designating an area on a display surface on the display surface, and a step of accepting from document data displayed on the display surface. Detecting the character string data corresponding to the area specified by the accepted operation, and in the detecting step, the character string data indicates a character string included in the unit character string constituting the document data. The unit character string is extracted from the document data.

  According to still another aspect of the present invention, there is provided a program for causing a computer to function as a character string selection device. The computer receives an operation for designating an area on the display surface on the display surface, and the display surface. Detecting the character string data corresponding to the area specified by the operation accepted in the accepting step from the document data displayed in the accepting step. In the detecting step, the character string data When a character string included in a unit character string to be configured is indicated, the unit character string is extracted from document data.

  In still another aspect of the present invention, a machine-readable recording medium recording the above program is provided.

  According to the invention, it is possible to select a desired character string by a simple user operation such as an operation for designating an area on the display surface on the display surface.

It is an external view of a portable information processing terminal according to the present embodiment. It is a hardware block diagram of the portable information terminal which concerns on embodiment of this invention. It is a functional block diagram for the character string selection which concerns on embodiment of this invention. It is a figure which shows the example of storing the threshold value referred for the character string selection which concerns on embodiment of this invention. It is a figure which shows an example of the text data concerning embodiment of this invention. It is a figure which shows an example of the text data which concerns on embodiment of this invention. It is a figure which shows an example of the matrix position data which concerns on embodiment of this invention. It is a figure which shows an example of the map data which concern on embodiment of this invention. It is a figure which shows the text data for demonstrating the 1st method which concerns on embodiment of this invention. It is a figure which shows an example of the selection character string by the 1st method which concerns on embodiment of this invention. It is a figure which shows the text data for demonstrating the 2nd method which concerns on embodiment of this invention. It is a figure which shows an example of the selection character string by the 2nd method which concerns on embodiment of this invention. It is a figure which shows the text data for demonstrating the 3rd method which concerns on embodiment of this invention. It is a figure which shows an example of the selection character string by the 3rd method which concerns on embodiment of this invention. It is a figure which shows the other example of the selection character string by the 3rd method which concerns on embodiment of this invention. It is a figure which shows the example in which the character string selection by the 3rd method which concerns on embodiment of this invention is impossible. It is a flowchart of the process for the 3rd method which concerns on embodiment of this invention.

  Embodiments of the present invention will be described below with reference to the drawings. The same reference numerals in the drawings indicate the same or corresponding parts, and description thereof will not be repeated.

  In the present embodiment, the character string is composed of one or more characters. Here, the characters include alphabets, numbers, symbols, blank characters, and the like. The “sentence” is composed of a plurality of unit character strings. The unit character string includes a paragraph, a sentence, a clause, and a word. “Sentence” includes one or more paragraphs, “Paragraph” is a character string from immediately after a new line to immediately before the next new line and includes one or more sentences, and “Sentence” is immediately after a new line / punctuation. Indicates a character string up to a line feed / punctuation mark. The “sentence” includes one or more phrases, and the “sentence” includes one or more words.

<Hardware configuration>
With reference to FIG. 1 and FIG. 2, the configuration of a portable information processing terminal (hereinafter simply referred to as a terminal) 100 according to the present embodiment will be described. FIG. 1 is a diagram illustrating the appearance of the terminal 100. The terminal 100 includes a housing 110, an antenna 120, a speaker 130, a known resistive film type touch panel 140, a button 150, a microphone 160, an LED (Light Emitting Diode) 170, and a pen 101. Here, the touch panel 140 employs a resistive film system, but is not limited to this system, and may be a known electrostatic capacity system, for example.

  A memory card 152 that is a card-like recording medium is detachably attached to the terminal 100 from the outside.

  In one aspect, the terminal 100 is an information processing terminal including a touch panel 140, such as a notebook personal computer, a mobile phone, a PDA (Personal Digital Assistant) or other portable information processing terminal, or an ATM (Automated Teller Machine), It is also realized as an information processing device arranged in a credit card authentication device or other commercial facilities.

  FIG. 2 is a block diagram showing the hardware configuration of terminal 100. In addition to the configuration shown in FIG. 1, the terminal 100 includes a display unit 210, a processor 230, a display driver 214, a flash memory 250, a RAM (Random Access Memory) 252, a graphic memory 254, a ROM (Read Only Memory) 256, a communication A circuit 260, a signal processing circuit 270, a vibrator 280, and a memory driver 151 for accessing the attached memory card 152 under the control of the processor 230 are provided.

  Display unit 210 integrally includes touch panel 140 and display device 212. The display unit 210 is an LCD (Liquid Crystal Display) panel, and a touch panel 140 is placed on the display surface. Therefore, the user can visually recognize the display image on the LCD panel from the outside through the touch panel 140 made of a transparent member.

  When the touch panel 140 is operated on the surface with a finger or the dedicated pen 101, the touch panel 140 detects an operation position by outputting an electric signal corresponding to the operation position. Briefly, the touch panel 140 includes a transparent glass plate and a film, and both are disposed so as to sandwich a transparent electrode grid. The electrode grid represents a two-dimensional array surface in which a plurality of electrodes are arranged in a grid pattern. The electrode grid has a size that matches the size of the display area of the LCD panel.

  When the point of the film is touched (pressed) on the touch panel 140 with a finger or the pen 101, the film bends due to the pressure and comes into contact with the electrode on the glass surface side, and an electrical signal is output through the contacted electrode. The processor 230 measures the voltage division ratio due to the resistance of the transparent electrodes on the glass surface and the film surface based on the output electric signal, thereby setting the touch (pressing) position on the electrode grid as a two-dimensional coordinate value (x0, y0). To detect. Therefore, the touch panel 140 constitutes a part of an operation receiving unit for receiving an input by a user operation. In particular, it corresponds to an input device configured to accept one or more point inputs on the film.

  The LCD panel is configured by two-dimensionally arranging a plurality of electrode elements. Therefore, each electrode element can be specified by the two-dimensional coordinate value (x1, y1). The graphic memory 254 stores image data displayed on the display unit 210 by the processor 230. The image data represents two-dimensional bitmap data having a size that matches the size of the display area of the LCD panel. The display driver 214 generates an electrical signal based on each bit value of the image data, and applies the generated electrical signal to the electrode elements having coordinate values (x1, y1) corresponding to the coordinate values of the bits of the LCD panel. As a result, an image according to the image data in the graphic memory 254 is displayed on the display device 212.

  The processor 230 controls the operation of the terminal 100. The processor 230 has a function of an operation input receiving unit in cooperation with the touch panel 140.

  Specifically, the function of the processor 230 operation input reception unit detects the position of the touched electrode on the electrode grid based on the electrical signal from the touch panel 14, and the detected electrode position corresponds to the corresponding point on the touch panel 140. A coordinate data acquisition unit that converts the coordinate value into the coordinate value and acquires the coordinate data. In addition, the processor 230 calculates stroke data that is a plurality of continuous coordinate values representing a stroke locus from the start point to the end point on the touch panel 140 based on time-series coordinate data based on electric signals input in time series. A stroke extraction unit is included.

  The processor 230 expands the calculated stroke data into bitmap data and stores it in the graphic memory 254. Accordingly, the display device 212 displays a stroke image superimposed on the display image.

  Further, the processor 230 determines the shape of the stroke based on the calculated stroke data. In this determination, the processor 230 collates (pattern matching) the stroke data template indicating the predetermined shape stored in the flash memory 250 with the calculated stroke pattern data, and from the similarity indicated by the collation result, It is determined whether or not the stroke shape is a predetermined shape.

  The flash memory 250 stores the above-described template and holds data given to the terminal 100 or data generated by the processor 230 in a nonvolatile manner.

The RAM 252 temporarily holds data generated by the processor 230.
The graphic memory 254 holds data for displaying an image on the display device 212. In another aspect, the RAM 252 and the graphic memory 254 may be configured as a single unit.

  The ROM 256 holds firmware for operating the terminal 100, the above-described program for accepting operation input and other various programs, and data preliminarily input as setting values for causing the terminal 100 to perform operations specific to the ROM 256. Yes.

  The display driver 214 performs a drawing operation based on data stored in the graphic memory 254 on the display device 212. The display device 212 displays an image according to the operation.

  The communication circuit 260 converts the signal received by the antenna 120 and sends the converted signal to the processor 230. In another aspect, communication circuit 260 converts the signal sent from processor 230 into a signal for transmission, and sends the converted signal to antenna 120.

  The signal processing circuit 270 converts the electrical signal sent from the microphone 160 and sends the converted signal to the processor 230. When terminal 100 outputs audio, signal processing circuit 270 converts the signal sent from processor 230 into a signal for audio output, and sends the converted signal to speaker 130. The speaker 130 outputs sound based on the signal.

  Vibrator 280 oscillates with a predetermined vibration pattern based on a signal sent from processor 230.

  Note that the operation received by receiving the operation input of the processor 230 is not limited to a user operation via the touch panel 140, and includes an operation from the button 150.

<Functional configuration>
A function for selecting a character string based on the operation of the touch panel 140 will be described.

  FIG. 3 is a functional configuration diagram for character string selection according to the embodiment of the present invention. 3 is stored in advance in the ROM 256 as a program, and each function is realized by the processor 230 reading and executing the program from the ROM 256. FIG. 3 shows a peripheral portion for inputting / outputting these functions and information. Here, the touch panel 140 and the graphic memory 254 are shown as peripheral parts, but the peripheral part is not limited thereto. Each function of FIG. 3 is not limited to a program, and may be realized by a combination of a program and a circuit.

  Referring to FIG. 3, processor 230 includes an event detection unit 231 for detecting an event based on a user operation on touch panel 140, a stroke detection unit 232 for calculating stroke data by a user operation after event detection, and stroke data An area detection unit 233, an analysis processing unit 234, and a selection result output unit 235 for detecting an area designated from the above are included.

  The area detection unit 233 detects a coordinate range (area) indicated by the stroke data in the two-dimensional coordinate area of the LCD panel from the calculated stroke data.

  The analysis processing unit 234 selectively parses the partial character string from the character string of the analyzed sentence data and the function of dividing the sentence data being displayed on the display unit 210 into a paragraph, sentence, clause, and word by syntactic analysis. Includes a character string detection unit 241 for extraction.

  The character string detection unit 241 includes a character number counting unit 242 that counts the number of characters in units of paragraphs, sentences, clauses, and words, a character number comparison unit 243 for comparing the ratio of the number of characters of the count result with a predetermined threshold value, and A selection unit 244 is included. The selection unit 244 selectively extracts a partial character string detected from the comparison result of the number of characters from the original sentence and outputs it to the selection result output unit 235.

  The selection result output unit 235 stores information based on the selected partial character string from the selection unit 244 in the graphic memory 254. Therefore, the display unit 210 can display a partial character string selected by a user operation. This display mode is not particularly limited, and may be a partial character string reverse display or the like for easy confirmation by the user.

  FIG. 4 shows an example of storing a threshold value to be referenced for character string selection. Referring to FIG. 4, ROM 256 stores a first threshold value 1TH that is a criterion for selecting a character string of a paragraph, a second threshold value 2TH that is a criterion for selecting a character string of a sentence, and a character string of a phrase. A third threshold 3TH that is a reference for selection, a fourth threshold 4TH that is a reference for selecting a character string of a word, and a range threshold TH are stored. The range threshold TH is a reference that is referred to for determining a range surrounded by stroke data, and will be described in detail later.

<Composition of displayed text>
When the text data is input, the processor 230 generates text data 253 according to the display format from the input text data, and stores the text data 253 in the RAM 252. The text data is data stored in advance in a storage area in the terminal 100, data received by the antenna 120, data input from the outside via the memory driver 151, or the like.

  When displaying the text data 253, the processor 230 generates bitmap data from the text data 253 and stores it in the graphic memory 254.

  The display format described above indicates a character size in units of pixels (dots) for displaying text data on the display unit 210, and sizes such as character spacing, line spacing, and margins.

  FIG. 5 is a diagram showing a part of text data. FIG. 6 is a diagram showing an example of text data 253 generated from the text data of FIG. FIG. 7 is a diagram illustrating an example of the matrix position data 353 acquired from the text data 253. FIG. 8 is a diagram illustrating an example of the map data 453.

  For example, when the character size of the format data indicates a size in which the width and width are equal, the processor 230 converts the text data in FIG. 5 into the text data 253 in FIG. 6 according to the display format, and stores the text data 253 in the RAM 252. Text data 253 is obtained by arranging text data characters in a two-dimensional matrix. The position of the character in this matrix (hereinafter referred to as the matrix position) corresponds to the coordinate position (x1, y1) of the electrode element on the LCD panel of the character, and corresponds to the coordinate position (x0, y0) of the electrode on the touch panel 140. . The processor 230 can perform conversion for associating the matrix position, the coordinate position (x1, y1), and the coordinate position (x0, y0) with each other by following a predetermined conversion procedure.

  The processor 230 generates matrix position data 353 from the text data 253 and stores it in the RAM 252. The analysis processing unit 234 extracts two paragraphs from the text data 253 in FIG. 6 by syntactic analysis, extracts one or more sentences from each paragraph, extracts one or more phrases from each sentence, Extract one or more words from.

  The processor 230 generates the matrix position data 353 in FIG. 7 from the syntax analysis result of the text data 253 in FIG. 6. Specifically, referring to FIG. 7, the paragraph number N1 (= 1) of the first paragraph of FIG. 6 and the matrix position N2 ((1, 1), (2) of the start character and end character of the paragraph. , 32)), a sentence number N3 for each sentence in the paragraph and a matrix position N4 ((1, 1), (2, 32)) of the sentence start and end characters, and each sentence of the sentence A set of a phrase number N5 and a matrix position N6 of the start and end characters of the phrase and a set of a word number N7 and a matrix position N8 of the start and end characters of the word are generated for each phrase. Further, the word WD corresponding to the text data 253 is associated with the set of the word number N7 and the matrix position N8 of each word by a pointer or the like.

  Similarly, referring to FIG. 7, the paragraph number N1 (= 2) of the second paragraph in FIG. 6 and the matrix position N2 ((4,1), (7, 18)), the sentence number N3 for each sentence in the paragraph, and the matrix position N4 of the sentence start and end characters, although not shown, the phrase number and the sentence start and end characters for each sentence of the sentence And for each word in each clause, a word number and a set of matrix positions of the start and end characters of the word are generated.

  In this way, the paragraphs constituting the sentence are extracted from the text data 253, the sentence / sentence / word is extracted from each paragraph, and the identifiers for uniquely identifying them (combinations of values of numbers N1, N3, N5, N7) And the matrix position (N2, N4, N6, N8) and the word WD are associated with each other, thereby generating the matrix position data 353 in a list format.

  The processor 230 performs conversion for associating the character matrix position, the coordinate position (x1, y1), and the coordinate position (x0, y0) with each other by following the above-described conversion procedure. Then, map data 453 is generated from the matrix position data 353 and stored in the RAM 252.

  Specifically, a matrix table having the same size as that in FIG. 6 is prepared, and the position data 500 is stored in the corresponding matrix position for each character. The position data 500 indicates the matrix position of the character acquired by tracing the data of the matrix position data 353 in a list for the corresponding character.

  In the map data 453 of FIG. 8, a part of the position data 500 is shown. The position data 500 represents a paragraph, sentence, clause, or word that generates a character for each square (character or space) of each matrix by a combination of numerical values of 4 digits. For example, “1100” in the first row and the first column represents the first sentence in the first paragraph that has no clauses or words, that is, a blank character. The character “1134” in the first row and the 14th column represents the character in the first paragraph, the first sentence, the third sentence, and the fourth word.

<Area detection>
As described above, the area detection unit 233 according to the present embodiment specifies the coordinate range (area) indicated by the stroke data in the two-dimensional coordinate area of the LCD panel from the stroke data.

  The stroke data indicates a locus on an arc from the start point (touch start) to the end point (touch end) when the user's finger / pen 101 continuously moves so as to surround the desired area. That is, it is desirable that the stroke is a closed curve where the start point and the end point are the same place. However, when the closed curve is not formed, the area detection unit 233 according to the present embodiment uses a circle connecting the start point and the end point from the stroke data. By complementing the arc-shaped trajectory, the stroke data of the closed curve in which the start point and the end point are matched is acquired.

  Note that the display unit 210 may display the actual operation locus, that is, the stroke data before being supplemented with the closed curve, or the locus according to the stroke data after complementation, superimposed on the displayed text. After the selection of the partial character string based on the stroke data, the processor 230 may delete the display of the locus.

<Selection of substring>
For example, one of the following three methods is applied as a method for selectively extracting a partial character string from information on an area detected by the area detection unit 233. It is assumed that the applied method can be variably changed by an operation input from the user.

(First method)
First, a first method will be described in which all (100%) of paragraphs, sentences, clauses, and words that fall within the closed curve indicated by the acquired stroke data are selected. Here, “a paragraph that falls within a closed curve” indicates that the characters that make up the paragraph exist within the closed curve, and “a sentence that falls within the closed curve” means that the characters that make up the sentence are within the closed curve. Is present. “Sentences that fall within a closed curve” and “words that fall within a closed curve” have the same meaning.

  FIG. 9 is a diagram showing a display example of text data, and FIG. 10 is a diagram showing a selected character string. When the user touches the touch panel 140 with the finger / pen 101 and inputs the stroke 501 while the text data in FIG. 9 is displayed, the partial character string 502 in FIG. 10 is selected and displayed. For reference, in FIG. 6, characters displayed in the closed curve of the stroke 501 are shown with hatching.

  In the first method, the character string detection unit 241 follows the above-described predetermined conversion procedure for each coordinate value indicated by the stroke data from the area detection unit 233, so that the matrix position of the character, that is, the matrix position of the map data 453 is obtained. Convert to The map data 453 is searched based on each matrix position obtained by the conversion, and the position data 500 is read.

  A paragraph, sentence, clause, or word corresponding to the closed curve of the stroke is detected from the read 4-digit numerical value of the position data 500, and the character string is extracted from the text data 253.

  For example, it is assumed that the stroke 501 surrounds the first row and the 14th column to the first row and the 17th column. In this case, the numerical values of the position data 500 read from the map data 453 by the character string detection unit 241 indicate “1134” and “1130”. Therefore, the matrix position data 353 is searched with these numerical values. As a result, the word WD of “radiation dose” associated with the set of N1 = 1, N3 = 1, N5 = 3 and N7 = 4, a clause including the word, a sentence including the clause, and the sentence Can be selected as the corresponding paragraph, sentence, clause and word within the closed curve of the stroke.

  Therefore, in order to extract the character string of the word WD “radiation dose” from the text data 253, the character strings (1, 13) to (1, 16) indicated by the associated matrix position N8 are selectively selected from the text data 253. You can extract it.

  Similarly, in order to extract a character string of a clause including the word WD “radiation dose” from the text data 253, the character strings of (1, 11) to (1, 17) indicated by the associated matrix position N6 are converted into text. What is necessary is just to search and extract from the data 253.

  Similarly, in order to extract a character string of a sentence including the word WD “radiation dose” from the text data 253, the character strings of (1, 1) to (2, 32) indicated by the associated matrix position N4 are converted into text. What is necessary is just to search and extract from the data 253.

  Similarly, in order to extract a character string of a paragraph including the word WD “radiation dose” from the text data 253, the character strings of (1, 1) to (2, 32) indicated by the associated matrix position N2 are converted into text. What is necessary is just to search and extract from the data 253.

  Here, since the first method is a method of selecting all (100%) of paragraphs, sentences, clauses, and words that fall within the closed curve indicated by the stroke data, the character string search unit 241 sets, for example, “1134”. If the matrix position data 353 is searched based on this, it can be determined that a set of numerical values (N1, N3, N5, N7) that matches “1134” is included in the first paragraph. Accordingly, all character strings in the first paragraph are selected by the stroke 501.

  In this way, in the (first method), since the corresponding paragraph, sentence, clause, or word (100%) is selected within the closed curve indicated by the stroke data, the character string detection unit 241 detects it. The certainty that the user-desired character string is included in the character string can be improved.

(Second method)
In the first method, all the paragraphs, sentences, phrases, and words (100%) corresponding to the closed curve indicated by the acquired stroke data are selected. In the second method, 60% from the center in the closed curve is selected. Select paragraphs, sentences, clauses, and words that fall within the% range.

Here, to simplify the explanation, it is assumed that the trajectory by the stroke is an ellipse.
FIG. 11 is a diagram showing a display example of text data, and FIG. 12 is a diagram showing a selected character string. When the stroke 503 in FIG. 11 is input to the text data being displayed, the character string 505 (paragraph, sentence, clause, word corresponding to the range of 60% from the center of the area within the closed curve of the stroke 503 ( 12) is selected.

  The character string detection unit 241 calculates the center (intersection of the long axis and short axis) coordinates of the ellipse indicated by the stroke data of the stroke 503, and the region of the 60% ellipse 504 (see FIG. 11) with the center coordinates being concentric circles. calculate. The 60% ellipse is an ellipse whose major axis and minor axis are 60% in length.

  The character string detection unit 241 converts each coordinate value of the region surrounded by the 60% ellipse to the matrix position of the character, that is, the matrix position of the map data 453 by following the above-described predetermined conversion procedure. The map data 453 is searched based on each matrix position obtained by the conversion, and the position data 500 is read. Based on the four-digit numerical value of the read position data 500, it is determined in which unit of a paragraph, sentence, clause, or word, and a character string is extracted based on the determination result. This extraction procedure is the same as the (first method) described above, and the description will not be repeated.

  Here, a 60% ellipse is used, but the present invention is not limited to this, and an ellipse in the range of 60 to 90% may be used.

  In the (second method), in view of inputting a large stroke that surrounds the character string so that the desired character string is surely selected as user psychology, 60 from the center in the closed curve indicated by the stroke data. Select paragraphs, sentences, clauses, and words that fall within the% range. Therefore, it is possible to improve the certainty that the character string detected by the character string detection unit 241 is a character string desired by the user.

  In addition, in order to variably determine the size of the ellipse by the second method, a size (60% to 90%, etc.) may be input from the outside by a user operation and temporarily stored in the RAM 252. Alternatively, the size may be stored in advance in ROM 256 as a range threshold value TH.

(Third method)
In the first and second methods described above, paragraphs, sentences, clauses, and word strings corresponding to the closed curve surrounded by the stroke are selected. In the third method, paragraphs and sentences corresponding to the closed curve are selected. For each of the phrases and words, the one whose number of characters satisfies a predetermined ratio is selected. As this ratio, the first to fourth threshold values 1TH to 4TH stored in advance in the ROM 256 are referred to.

  Here, the first to fourth threshold values 1TH to 4TH are fixed values stored in the ROM 256, but are not limited to fixed values. For example, it may be variably changed by a user operation.

  FIG. 13 is a diagram showing a display example of text data, and FIGS. 14 and 15 are diagrams showing selected character strings. When the stroke 506 in FIG. 13 is input to the text data being displayed, in the third method, the number of characters displayed in the closed curve for each paragraph corresponding to the closed curve in the stroke 506 is the total number of characters in the paragraph. The ratio (ratio) which occupies is calculated, and the paragraph whose ratio is larger than the first threshold 1TH is selected.

  Similarly, with respect to the sentence, for each sentence corresponding to the closed curve of the stroke 506, the ratio (ratio) that the number of characters displayed in the closed curve occupies with respect to the total number of characters of the sentence is calculated, and the ratio is the second threshold value. Select a sentence greater than 2TH. Similarly, for each clause corresponding to the closed curve of the stroke 506, the ratio (ratio) that the number of characters displayed in the closed curve occupies with respect to the total number of characters of the relevant clause is calculated, and a clause whose ratio is larger than the third threshold 3TH is calculated. select. Similarly, for each word that falls within the closed curve of the stroke 506, the ratio (ratio) that the number of characters displayed in the closed curve occupies with respect to the total number of characters of the word is calculated, and a word whose ratio is larger than the fourth threshold 4TH is calculated. select. These first threshold value 1TH to fourth threshold value 4TH may be the same value or may be different.

  When the stroke 506 in FIG. 13 is input, the character string 507 is selected as shown in FIG. 14 when the first to fourth threshold values 1TH to 4TH are 100%, and when it is 60%, as shown in FIG. A character string 508 is selected. The character string selection method when the threshold is 100% is the same as the first method.

  In the third method, when the first to fourth thresholds 1TH to 4TH are about 60%, and a vertically long stroke 600 as shown in FIG. 16 is input, the number of characters included in the closed curve of the stroke 600 itself is calculated. As a result, it becomes impossible to select a partial character string. In this case, an error message may be output (displayed) to prompt the stroke to be input again.

  FIG. 17 is a process flowchart of character string selection by the third method according to the present embodiment. The program according to this flowchart is stored in advance in the ROM 256, and the processing is realized by the processor 230 reading and executing the program. Prior to execution of this program, the text data of FIG. 9 is displayed on the display unit 210, and the processor 230 generates text data 253, matrix position data 353, and map data 453 for the text being displayed, and stores them in the RAM 252. Assuming that

  First, based on the electrical signal from the touch panel 140, the processor 230 detects that the surface of the touch panel 140 has been touched (this is also referred to as a touch panel event) (step S3). For example, the user touches with the finger / pen 101.

  When it is detected that the touch has been made, the stroke detection unit 232 detects a stroke that is a gesture (operation) based on an electrical signal from the touch panel 140, and outputs stroke data (step S5).

  The processor 230 determines whether or not the stroke data is an “enclosing” gesture, that is, whether or not a closed curve is formed (step S7). For example, the coordinate values of the start point and end point of the stroke data are compared, and determination is made based on the comparison result. If it is determined that the gesture is not “enclose” (“not enclose” in step S7), the process returns to step S3.

  If it is determined that the gesture is “enclose” (“enclose” in step S7), the character string detection unit 241 determines whether there is a character in the closed curve (step S11). Specifically, the character string detection unit 241 detects the coordinate value in the closed curve, converts the detected coordinate value to a corresponding matrix position, searches the text data 253 based on the converted matrix position, It is determined whether or not there is a character at the position. If it is determined that there is no character (“no character” in step S11), the process returns to step S3.

  When it is determined that there is a character (“character is present” in step S11), the character string detection unit 241 extracts all the paragraphs, sentences, clauses, and words corresponding to the closed curve from the text data 253. Then, the character count unit 242 counts the number of characters for each extracted paragraph, each sentence, each clause, and each word (step S13). The count value is output to the character number comparison unit 243.

  The number-of-characters comparison unit 243 compares the number of characters in each extracted paragraph with the first threshold value 1TH. Based on the comparison result, it is determined whether or not there is a paragraph that satisfies the condition (number of characters> first threshold value 1TH) among the extracted paragraphs (step S15). If it is determined that there is not (NO in step S15), the process proceeds to step S23.

  If it is determined that there is one (YES in step S15), the character string detection unit 241 determines whether there is only one paragraph that satisfies the above condition (step S17). If it is determined that there is one (YES in step S17), the selection unit 244 extracts only the character string of the paragraph determined to be one from the text data 253 and outputs it to the selection result output unit 235 (step S19). Thereafter, the character string selection process ends.

  When it is determined that the number of paragraphs is not one, that is, two or more (NO in step S17), the selection unit 244 determines the ratio of the number of characters arranged in the closed curve to the total number of characters in the two or more paragraphs. Only the highest paragraph is selected (step S21).

  Specifically, for each paragraph, the character count unit 242 reads a 4-digit value having the value of the number N2 in the most significant digit from the matrix position data 353 and counts the total number of characters of the paragraph from the read 4-digit value. To do. Subsequently, the number of characters in the paragraph is counted from the numerical value of the position data 500 corresponding to each coordinate position in the closed curve. The character string detection unit 241 calculates the above ratio for each paragraph by calculating (number of applicable characters / total number of characters) using the count result.

  The character number comparison unit 243 compares the calculated ratios, selects only the largest paragraph, and outputs a value N2 corresponding to the number N1 of the paragraph to the selection unit 244. Therefore, the selection unit 244 searches the text data 253 based on the matrix position of the value N2 and selects a corresponding character string. Thereafter, the character string selection process ends. For example, when the first paragraph is selected, the character string at the matrix position indicated by the value N2 ((1, 1) to (2, 32)) is selected.

  In step S23, the character number comparison unit 243 counts the number of characters for each sentence that falls within the closed curve, and compares the counted number of characters with the second threshold 2TH. Based on the comparison result, it is determined whether or not there is a sentence that satisfies the condition (number of characters> second threshold 2TH) among the extracted sentences. If it is determined that there is not (NO in step S23), the process proceeds to step S31.

  If it is determined that there is one (YES in step S23), the character string detection unit 241 determines whether there is one sentence that satisfies the above condition (step S25). If it is determined that there is one (YES in step S25), the selection unit 244 outputs only the character string of the sentence determined to be one to the selection result output unit 235 (step S29). Thereafter, the character string selection process ends.

  If it is determined that the number of sentences is not one, that is, two or more (NO in step S25), the selection unit 244 determines the ratio of the number of characters arranged in the closed curve to the total number of sentences among the two or more sentences. Only the highest sentence is selected (step S27).

  Specifically, for each sentence, the character number counting unit 242 reads a 4-digit value having the value of the number N3 in the next digit of the most significant digit from the matrix position data 353 and reads the sentence from the read 4-digit value. Count the total number of characters. Subsequently, the number of characters in the sentence is counted from the numerical value of the position data 500 corresponding to each coordinate position in the closed curve. The character string detection unit 241 calculates a ratio for each sentence by calculating (number of characters / total number of characters) using the count result.

  The number-of-characters comparison unit 243 compares the calculated ratios, selects only the largest sentence, and outputs a value N4 corresponding to the sentence number N3 to the selection unit 244. Therefore, the selection unit 244 searches the text data 253 based on the matrix position of the value N4 and selects a corresponding character string. Thereafter, the character string selection process ends.

  For example, when the first sentence of the first paragraph is selected, the character string at the matrix position indicated by the value N4 ((1, 1) to (2, 32)) is selected, and the second sentence When the first sentence of the paragraph is selected, the character string at the matrix position indicated by the value N4 ((4, 1) to (4, 33)) is selected.

  In step S31, the character number comparison unit 243 counts the number of characters for each clause corresponding to the closed curve, and compares the counted number of characters with the third threshold 3TH. Based on the comparison result, it is determined whether there is a phrase that satisfies the condition (number of characters> third threshold 3TH) among the extracted phrases. If it is determined that there is not (NO in step S31), the process proceeds to step S39.

  If it is determined that there is one (YES in step S31), the character string detection unit 241 determines whether there is one clause that satisfies the above condition (step S33). If it is determined that there is one (YES in step S33), the selection unit 244 outputs only the character string of the phrase determined to be one to the selection result output unit 235 (step S37). Thereafter, the character string selection process ends.

  If it is determined that the number of phrases is not one, that is, two or more (NO in step S33), the selection unit 244 determines the ratio of the number of characters arranged in the closed curve to the total number of characters in the phrase among the two or more phrases. Only the highest phrase is selected (step S35).

  Specifically, the character count unit 242 reads, for each clause, a four-digit value having the value of the number N5 in the third digit from the most significant position from the matrix position data 353, and reads the corresponding clause from the read four-digit value. Count the total number of characters. Subsequently, the number of characters in the clause is counted from the numerical value of the position data 500 corresponding to each coordinate position in the closed curve. The character string detection unit 241 calculates a ratio for each phrase by calculating (number of applicable characters / total number of characters) using the count result.

  The character number comparison unit 243 compares the calculated ratios, selects only the largest phrase, and outputs the value N6 corresponding to the number N5 of the corresponding phrase to the selection unit 244. Therefore, the selection unit 244 searches the text data 253 based on the matrix position of the value N6 and selects a corresponding character string. Thereafter, the character string selection process ends.

  For example, when the first clause of the first sentence of the first paragraph is selected, the character string at the matrix position indicated by the value N6 ((1,2,) to (1,7)) is selected. .

  In step S39, the character number comparison unit 243 counts the number of characters for each word that falls within the closed curve, and compares the counted number of characters with the fourth threshold value 4TH. Based on the comparison result, it is determined whether or not there is a word that satisfies the condition (number of characters> fourth threshold value 4TH) among the extracted words. If it is determined that there is not (NO in step S39), the process returns to step S3.

  If it is determined that there is one (YES in step S39), the character string detection unit 241 determines whether there is one word that satisfies the above condition (step S41). If it is determined that there is one (YES in step S41), the selection unit 244 outputs only the character string of the word determined to be one to the selection result output unit 235 (step S45). Thereafter, the character string selection process ends.

  When it is determined that the number of words is not one, that is, two or more (NO in step S41), the selection unit 244 determines the ratio of the number of characters arranged in the closed curve to the total number of words among the two or more words. Only the highest word is selected (step S43).

  Specifically, for each word, the character number counting unit 242 reads a 4-digit numerical value having the value of the number N7 in the least significant digit from the matrix position data 353 and counts the total number of characters from the read 4-digit numerical value. . Subsequently, the number of characters of the word is counted from the numerical value of the position data 500 corresponding to each coordinate position in the closed curve. The character string detection unit 241 calculates a ratio for each word by calculating (number of applicable characters / total number of characters) using the count result.

  The character number comparison unit 243 compares the calculated ratios, selects only the largest word, and outputs a value N8 corresponding to the number N7 of the word to the selection unit 244. Therefore, the selection unit 244 searches the text data 253 based on the matrix position of the value N8 and selects a corresponding character string. Thereafter, the character string selection process ends.

  For example, when the fourth word of the first clause of the first sentence of the first paragraph is selected, the character at the matrix position indicated by the value N8 ((1,13) to (1,16)) A column is selected.

  As described above, each of the paragraphs, sentences, clauses, and words included in the closed curve occupies the total number of characters for each of the paragraphs, sentences, phrases, and words that include the characters included in the closed curve of the stroke detected by the touch panel 140. When the ratio (ratio) of the number of characters is higher than a predetermined threshold, “character string selection” is performed for the paragraph, sentence, clause, and word.

  Therefore, when selecting a desired character string prior to an operation such as copying a character string, the user includes a portion of the desired character string (paragraph, sentence, clause, word) from the displayed sentences. A desired “character string selection” can be performed by a simple gesture (stroke operation) of roughly enclosing with a finger or a pen 101.

  The character string selection processing program according to the above-described embodiment is stored in advance in the storage area of the terminal 100, and the processing is realized by the processor 230 reading the program from the storage area and executing the instructions of the program. .

  Such a program is a memory medium attached to the terminal 100 and can be recorded on a recording medium readable by the processor 230 and provided to the terminal 100 as a program product. The memory medium is a card-shaped memory 152 that is detachably attached to the terminal 100, a CD (Compact Disc) -ROM, a ROM, a RAM, or the like.

  The processor 230 reads a program from the attached memory 152 via the memory driver 151 and stores it in a RAM or the like. The program stores the program received by the antenna 120 via the network and received by the processor 230 in a predetermined storage area of the RAM. By these methods, a program may be appropriately provided from the outside.

  The provided program product includes the program itself and a recording medium on which the program is recorded.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

100 terminal, 101 pen, 140 touch panel, 210 display unit, 230 processor, 231 event detection unit, 232 stroke detection unit, 233 area detection unit, 234 analysis processing unit, 235 selection result output unit, 241 character string detection unit, 242 character count Count section, 243 character number comparison section, 244 selection section, 253 text data, 353 matrix position data, 453 map data, 500 position data, 501, 503, 506, 600 stroke, 1TH to 4TH first to fourth threshold values.

Claims (11)

An operation accepting unit for accepting an operation for designating an area on the display surface on the display surface;
A character string detection unit that detects character string data corresponding to an area designated by an operation received by the operation reception unit from among the document data displayed on the display surface;
The character string detection unit
A character string selection device that extracts a unit character string from the document data when the character string data indicates a character string included in the unit character string constituting the document data. The character string detection unit
2. The character string data corresponding to a partial area having a predetermined size in an area designated by an operation accepted by the operation accepting unit is detected from document data displayed on the display surface. The character string selection device described in 1. The character string detection unit
A comparison unit that compares a ratio of the number of characters of the character string data with respect to the total number of characters of the unit character string and a threshold;
The character string selection device according to claim 1, wherein the character string data is determined based on a result of the comparison as to whether or not the character string data is a character string included in the unit character string. The operation reception unit
An input device configured to accept one or more point input operations on the display surface;
A coordinate data acquisition unit configured to acquire coordinate data including a coordinate value of a point at which an input operation is accepted by the input device;
A stroke extraction unit configured to calculate, as stroke data, a coordinate value of a stroke indicating a start point to an end point of input to the input device based on the plurality of coordinate data acquired by the coordinate data acquisition unit; Including
The character string selection device according to claim 1, wherein the area is detected from the calculated stroke data.   The character string selection device according to claim 1, wherein the unit character string includes a character string of a paragraph.   The character string selection device according to claim 1, wherein the unit character string includes a character string of a sentence constituting a paragraph.   The character string selection device according to claim 1, wherein the unit character string includes a character string of a phrase.   The character string selection device according to claim 1, wherein the unit character string includes a character string of a word. Receiving an operation for designating an area on the display surface on the display surface;
Detecting from the document data displayed on the display surface, character string data corresponding to an area designated by the operation accepted in the accepting step,
In the detecting step,
A character string selection method, wherein when the character string data indicates a character string included in a unit character string constituting the document data, the unit character string is extracted from the document data. A program for causing a computer to function as a character string selection device, wherein the program causes the computer to
Receiving an operation for designating an area on the display surface on the display surface;
Detecting the character string data corresponding to the area designated by the operation accepted in the accepting step from the document data displayed on the display surface; and
In the detecting step,
A program for causing a unit character string to be extracted from the document data when the character string data indicates a character string included in the unit character string constituting the document data.   A machine-readable recording medium on which the program according to claim 10 is recorded.

Images