JP2014086025A - Information processor, information processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To easily extract desired information from a browsing page on a touch screen.SOLUTION: An information processor 100 comprises: a touch screen which displays a page described in a markup language and inputs information of a position touched on a screen; generation means which generates, when a start point and an end point of movement are determined to coincide with each other on the basis of the position information, a specified area comprised of a closed area having the start point and the end point coincided with each other; conversion means which converts position coordinates of the specified area to position coordinates corresponding to original points on the page; and extraction means which extracts information indicated by a tug corresponding to the specified area on the basis of the position coordinates converted by the conversion means.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program for extracting desired information from a Web page displayed on a touch screen.

  Internet connection terminals such as smartphones and tablets have become widespread, and information can be searched anytime and anywhere. As a method for storing the acquired information, there is a method for bookmarking a page where the information can be browsed. However, in an environment where the Internet connection is not possible, the registered page cannot be browsed, and depending on the browse page, it may be updated, and there is a possibility that information when saved is lost. On the other hand, if you register an Internet page, it will be stored including unnecessary information, and the stored information is not clear.

  There are several ways to save information on Internet-connected terminals with multi-touch screens. The first is a screen shot that stores information displayed on the screen as an image. For example, in the iPad (registered trademark), information displayed on the screen can be saved as an image by simultaneously pressing the HOME button and the Sleep / wake button (see, for example, Non-Patent Document 1). In recent years, there is a screen shot that saves an image of an area designated by a finger instead of the entire screen. For example, it is a “clip” application registered in the small application of XPeria (registered trademark) Tablet S (for example, see Non-Patent Document 2). This is an application that can cut and save only the area specified by a finger as image information in the information displayed on the screen.

"Apple-iPhone 5-Introducing convenient usage of iPhone", [online], [Search September 24, 2012], Internet <URL: http://www.apple.com/jp/ iphone / iphone-5 / tips /〉 "Xperia Tablet's new app" Scrapbook ": C-TEC Back Room 3: So-net Blog" [online], [Searched on September 24, 2012], Internet <URL: http://ctec3.blog. so-net.ne.jp/2012-09-13-5>

  However, in the above-described method, information displayed in the screen is cut out as an image, so that the viewability and readability may be lost. For example, since a screen that can be displayed on a smartphone or a tablet terminal is small, there is a case where not all of the information to be stored can be displayed on the screen. Although a method of reducing the screen is also conceivable, it becomes difficult to read because the characters are small, and the image of the photograph becomes rough, so that readability and readability are lowered.

  The present invention has been made paying attention to the above circumstances, and an object thereof is to provide an information processing apparatus, an information processing method, and a program capable of easily extracting desired information from a browsing page on a touch screen. is there.

  In order to achieve the above object, according to a first aspect of the present invention, there is provided a touch screen that displays a page described in a markup language and inputs position information on a touched screen, and based on the position information. When the start point and end point of movement coincide with each other, a creation means for creating a designated area consisting of a closed area where the start point and the end point coincide with each other, and the position coordinates of the designated area are converted into position coordinates with respect to the origin of the page And converting means for extracting the information indicated by the tag corresponding to the designated area based on the position coordinates converted by the converting means.

  According to the first aspect, when information on a specified area on the screen is saved, elements (such as an image or text indicated by the tag) partially included in the specified area are also missing. It is possible to save in a form that does not exist. Compared to the technique of directly cutting out an image, there are advantages such as no information is lost even if the area is specified roughly, and elements hidden outside the window frame are not lost if part of the area is covered. Therefore, it is possible to extract information corresponding to the designated region as highly significant and readable information with a simple operation.

According to a second aspect of the present invention, in the first aspect, in the extraction unit, the extraction target of the tag is at least one of a tag indicating text, an image, and a graphic.
According to the second aspect, it is possible to cut out the entire context by setting a part of text as a designated area, and regardless of the enlargement / reduction ratio or scroll state on the screen display by setting a part of the image as a designated area. Therefore, it is possible to cut out the image with the original image quality without degrading the image quality. If a link is attached to the graphic, the link is extracted and stored. If the graphic is a simple graphic, the entire graphic is cut out.

According to a third aspect of the present invention, in the first or second aspect, a headline corresponding to the information indicated by the tag extracted by the extraction unit is extracted as complementary information, and the complementary information is added to the information indicated by the tag. It further includes a complementary means for associating.
For example, even if only the information to be saved is cut out and saved, when the information is later reviewed, the reason for saving the information may be difficult to understand. The problem is that the saved information is not included in the saved information. As described above, according to the third aspect, the cut information can be complemented in an easily understandable form.

According to a fourth aspect of the present invention, in the third aspect, the information processing device further includes display means for displaying the information indicated by the tag and the complementary information in association with each other.
According to the 4th aspect, since the information which a tag shows is displayed with complementary information, it becomes possible to further raise the significance of the cut-out information.

  That is, according to the present invention, it is possible to provide an information processing apparatus, an information processing method, and a program that can easily extract desired information from a browsing page on a touch screen.

The block diagram which shows the function structure of the information processing apparatus which concerns on one Embodiment of this invention. The figure which shows an example of the screen display content of the touch screen of the information processing apparatus of FIG. The flowchart which shows the process outline | summary of the information processing apparatus of FIG. The flowchart which shows the operation kind discrimination | determination process. The flowchart which shows a designated area cutting process. The flowchart which shows a designated area | region data input determination process. The flowchart which shows a creation button press determination process. The figure which shows the state which created the designated area. The figure for demonstrating the judgment method of the state in which the start point and the end point corresponded. The figure which shows the state which inputs data after creating a designated area. The figure for demonstrating the extraction method of an HTML tag. The figure which shows an example of the extracted information. The figure which shows the information which added complementary information to the cut information. The figure which shows the re-layout of the cut information.

Embodiments according to the present invention will be described below with reference to the drawings.
FIG. 1 is a block diagram showing a functional configuration of an information processing apparatus according to an embodiment of the present invention. The information processing apparatus 100 includes a control unit 1, a touch screen 2, and a storage unit 3, and includes, for example, a terminal that can be connected to the Internet, such as a smartphone or a tablet. The touch screen 2 includes an operation input unit 21 that inputs operation information by a touch operation, and a display unit 22 that displays characters, images, and the like according to display control by the control unit 1. The control unit 1 includes an operation type determination unit 11, a specified area cut-out processing unit 12, a specified area data input determination processing unit 13, and a creation button press determination processing unit 14, and has a general Web browser function. ing. The storage unit 3 includes a first database 31 that stores the position of a finger when creating a designated area, and a second database 32 that stores supplemented information added to the cut information.

  FIG. 2 shows an example of screen display content of the touch screen 2 of the information processing apparatus 100. In addition to displaying the Internet browsing page by the browser, the terminal screen layout is created to redisplay the data input area that stores information that the user wants to save and multiple information input to the data input area Consists of buttons. For example, it is assumed that the information displayed on the Web browser is a document (Web page) described in a markup language such as HTML.

  The operations performed by the user are general browser operations (enlargement / reduction by pinching in / out, scrolling the screen in the direction of the finger), an operation to cut out the designated area, an operation to input data into the cut out designated area, and data This is an operation of pressing a creation button to redisplay a plurality of pieces of cut information that has been input.

  Hereinafter, the operation of the information processing apparatus 100 configured as described above will be described with reference to the flowcharts of FIGS. 3 to 7. First, FIG. 3 shows an outline of processing of the information processing apparatus 100. In the process 101, when a finger touches from a state where the finger is not touching the touch screen, a Touch Start event occurs (process 102). Thereafter, in process 112, the operation type determination unit 11 performs an operation type determination process for determining the type of operation described above.

[Operation type discrimination process]
FIG. 4 shows details of the operation type discrimination process (process 112). In process 201, the operation type determination unit 11 determines whether the touch screen is a single tap, a double tap, or any other (process 201, process 202). When it is determined that the operation is a double tap, the operation type determination unit 11 determines that the operation is to cut out the designated area, deletes the designated area existing on the screen (process 203), and transitions to the state S1 (process 121).

  On the other hand, when the operation type determination unit 11 determines that it is a thimble tap, the operation type determination unit 11 further determines whether or not the finger exists in the designated area. At this time, if a finger is present in the designated area, it is determined that the cut designated area is an operation for inputting data, and the process transitions to state S2 in process 122. If the finger does not exist in the designated area, but the finger is present on the creation button in process 206 (), it is determined that the operation is to press the creation button in order to redisplay the plurality of pieces of information that have been input. In the process 123, the state transits to the state S3. If there is no finger in the designated area or on the creation button, it is determined that the operation is a general browser operation, and the process proceeds to state S4 in processing 124. In this case, in process 116, the control unit performs a normal browser operation process.

[Specified area cut processing]
FIG. 5 shows details of the designated area cut-out process (process 113). In process 301, the designated area cut-out processing unit 12 determines whether the finger is moving without leaving the touch screen. If the finger is moving without leaving the touch screen, it is determined whether the designated area has already been created (process 302). If the designated area has not yet been created, the designated area cut-out processing unit 12 stores the current position of the finger in the first database 31 in process 303. Then, in the current position of the finger stored in the first database 31 in the process 304, the position information from the current finger position to the current finger position at the time of the latest Touch Start event is connected in a time-series line. Display on the screen. When the designated area cut processing unit 12 determines in process 305 that the start point and the end point are in agreement with each other as shown in FIG. , Hold that state. For example, the process 305 determines whether the start point and the end point match with each other. For example, as shown in FIG. 9, a circular region centered on the start point is created, and when the finger returns to the range, the start point and end point are determined to match. There is a way to do it.

[Specified area data entry judgment processing]
Next, FIG. 6 shows details of the designated area data input determination process (process 114). This process is a process that occurs when a finger touches the designated area created and cut out in process 113. As shown in FIG. 10, the designated area data input determination processing unit 13 determines in process 401 whether the finger has moved without touching the designated area. If it has moved, it is determined whether or not the current position of the finger is within the data input area (process 402). If the current position of the finger is not within the data input area, in step 407, the finger is moved so that the center of the clipped designated area overlaps the current position of the finger. By doing in this way, it is shown to the user that the finger until data input moves the designated area.

  When the user moves the finger to the data entry area while confirming the movement of the designated area, the designated area data entry determination processing unit 13 determines in step 404 that the designated area has been entered, and transitions to process 405. To do. In process 405, an HTML tag of text or an image included in the designated area is extracted from information in the designated area. When a plurality of texts or images are included in one designated area, all HTML tags are extracted.

  Here, an HTML tag extraction method will be described. The designated area is divided into meshes as shown in FIG. 11, and each point becomes a position coordinate from the origin of the screen coordinate system. Therefore, the scroll amount and the enlargement / reduction ratio are converted into a position coordinate with respect to the origin of the viewing page of each point. To do. On the other hand, each tag has the position, width, and height of the origin of the tag with respect to the origin of the viewing page of each HTML tag. Therefore, by checking which HTML tag region each point is in, it is possible to extract which HTML tag portion the portion cut out as the designated region is. As another extraction method, the text / image included in the designated area is recognized as characters / images, and the recognition result of the characters / images is collated with the text / image data described in the tag included in the browsing page. Thus, it is possible to extract which HTML tag part the specified area is.

  Then, if the extracted HTML tag is <img>, the designated area data input determination processing unit 13 stores the image information read by the tag. If the extracted HTML tag is <p> or <textarea>, the text data written in the tag is saved. If the extracted tag is <canvas>, use the getImageData () function to determine the presence or absence of the image. If there is, save the image data. Use the masureText () function to display the presence or absence of text (if the return value is 0, there is no text). ), And if yes, save the text data. Note that the above tags are examples, and the tags to be extracted are not limited to these.

  Next, the designated area data input determination processing unit 13 selects the closest HTML tag <h1>, <h2>, <h3>, <h4>, <h5 among the lines smaller than the line where the extracted tag is written. >, <H6>, or <article> tag is searched, and if found, it is stored as complementary information of the extracted HTML tag information. <h1>, <h2>, <h3>, <h4>, <h5>, <h6>, and <article> are tags that are generally used as headings and titles. For example, as shown in FIG. 12, the storage method registers complementary information such as a title and the extracted tag information (text or image) in the second database 32 in association with each other. Finally, in step 406, the designated area is deleted.

[Create button press judgment process]
Next, details of the creation button press determination process (process 115) are shown in FIG. This process is redisplayed based on the information input in process 114. The creation button press determination processing unit 14 determines whether or not a Touch End event for detecting that the finger has been released has occurred in the process 501, and determines whether or not the position coordinates of the finger before the finger is released are on the creation button. This is determined in process 502. If it is determined that the creation button has been pressed, titles are sequentially rearranged from the second database 32 as shown in FIG. 12 in the order of text and image (process 503), and the reconstructed information is displayed on the screen (step 503). Process 504). For example, as shown in FIG. 13, for example, when a paragraph corresponding to the designated area is extracted, the title closest to this paragraph is added as supplementary information, and the layout is re-laid out in the order of the title and the paragraph.

  As described above, according to the information processing apparatus 100 of the present embodiment, for example, as illustrated in FIG. 14, the entire context can be cut out by setting a part of text as a designated area, and a part of the image is displayed. By setting as the designated area, it is possible to cut and save the image with the image quality of the original image without degrading the image quality regardless of the enlargement / reduction ratio on the screen display or the scroll state. Further, the clipped information is displayed again after adding supplementary information so that it can be easily understood when the information is later reviewed.

  Therefore, according to the above-described embodiment, when information on a specified area on the screen is saved, elements (such as an image or text indicated by the tag) that are partially included in the specified area are also missing. It is possible to save in a form without Compared to the technique of directly cutting out an image, there are advantages such as no information is lost even if the area is specified roughly, and elements hidden outside the window frame are not lost if part of the area is covered. Therefore, it is possible to extract information corresponding to the designated region as highly significant and readable information with a simple operation.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 100 ... Information processing apparatus, 1 ... Control part, 2 ... Touch screen, 3 ... Memory | storage part, 11 ... Operation type discrimination | determination part, 12 ... Designated area cut-out process part, 13 ... Designated area data input determination process part, 14 ... Create button Press determination processing unit, 21 ... operation input unit, 22 ... display unit, 31 ... first database, 32 ... second database.

Claims (9)

A touch screen that displays a page written in a markup language and inputs position information on the touched screen;
Creating means for creating a designated region consisting of a closed region in which the start point and the end point match when the start point and the end point of movement match based on the position information;
Conversion means for converting the position coordinates of the designated area into position coordinates with respect to the origin of the page;
An information processing apparatus comprising: extraction means for extracting information indicated by a tag corresponding to the designated area based on the position coordinates converted by the conversion means.   The information processing apparatus according to claim 1, wherein the extraction unit includes at least one of tags indicating text, images, and graphics.   The supplementary means which extracts the headline corresponding to the information which the tag extracted by the said extraction means shows as supplementary information, and matches the said supplementary information with the information which the said tag shows is further provided. Information processing device.   The information processing apparatus according to claim 3, further comprising display means for displaying the information indicated by the tag and the complementary information in association with each other. A method executed by an information processing apparatus having a touch screen that displays a page described in a markup language and inputs position information on a touched screen,
A creation step of creating a designated region consisting of a closed region in which the start point and the end point match when the start point and the end point of movement match based on the position information;
A conversion step of converting the position coordinates of the designated area into position coordinates with respect to the origin of the page;
Extracting the information indicated by the tag corresponding to the designated area based on the position coordinates converted by the converting step.   6. The information processing method according to claim 5, wherein in the extraction step, a tag extraction target is at least one of a tag indicating text, an image, and a graphic.   The information processing method according to claim 5 or 6, further comprising: a complementing step of extracting a heading immediately before the tag extracted in the extracting step as complementary information, and associating the complementary information with information indicated by the tag. .   The information processing method according to claim 7, further comprising a display step of displaying the information indicated by the tag and the complementary information in association with each other.   The program which makes a computer function as each means which comprises the information processing apparatus of any one of Claims 1 thru | or 4.

Images